-- Logs begin at Sat 2022-04-30 20:01:17 UTC, end at Sat 2022-04-30 22:41:40 UTC. -- Apr 30 21:00:30.272929 ncdv-master-1 systemd[1]: Started Devstack devstack@c-vol.service. Apr 30 21:00:33.590326 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=123682) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 30 21:00:33.590919 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=123682) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 30 21:00:34.019548 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_db.sqlalchemy.engines [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123682) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 21:00:34.325925 ncdv-master-1 cinder-volume[123682]: INFO cinder.rpc [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 30 21:00:34.331144 ncdv-master-1 cinder-volume[123682]: INFO cinder.rpc [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 30 21:00:34.338245 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_db.sqlalchemy.engines [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123682) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 21:00:34.405251 ncdv-master-1 cinder-volume[123682]: INFO cinder.volume.manager [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] Determined volume DB was empty at startup. Apr 30 21:00:34.405905 ncdv-master-1 cinder-volume[123682]: DEBUG cinder.volume.manager [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=123682) __init__ /opt/stack/cinder/cinder/volume/manager.py:286}} Apr 30 21:00:34.414519 ncdv-master-1 cinder-volume[123682]: INFO cinder.volume.manager [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 30 21:00:34.415298 ncdv-master-1 cinder-volume[123682]: WARNING stevedore.named [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 30 21:00:34.415724 ncdv-master-1 cinder-volume[123682]: WARNING castellan.key_manager [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 30 21:00:34.416837 ncdv-master-1 cinder-volume[123682]: WARNING cinder.keymgr.conf_key_mgr [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 30 21:00:34.434814 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_db.sqlalchemy.engines [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123682) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 21:00:34.439852 ncdv-master-1 cinder-volume[123682]: INFO cinder.rpc [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 30 21:00:34.443960 ncdv-master-1 cinder-volume[123682]: INFO cinder.rpc [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] Automatically selected cinder-volume RPC version 3.18 as minimum service version. Apr 30 21:00:34.453249 ncdv-master-1 cinder-volume[123682]: WARNING stevedore.named [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 30 21:00:34.453249 ncdv-master-1 cinder-volume[123682]: WARNING castellan.key_manager [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 30 21:00:34.453249 ncdv-master-1 cinder-volume[123682]: INFO cinder.volume.manager [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] Image-volume cache enabled for host ncdv-master-1@ceph. Apr 30 21:00:34.453789 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_db.sqlalchemy.engines [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123682) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 21:00:34.552426 ncdv-master-1 cinder-volume[123682]: INFO oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] Starting 1 workers Apr 30 21:00:34.557521 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] Started child 123855 {{(pid=123682) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Apr 30 21:00:34.559126 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] Full set of CONF: {{(pid=123682) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Apr 30 21:00:34.559696 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ******************************************************************************** {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 30 21:00:34.560344 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] Configuration options gathered from: {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 30 21:00:34.560911 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 30 21:00:34.561774 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 30 21:00:34.562434 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ================================================================================ {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 30 21:00:34.563881 ncdv-master-1 cinder-volume[123855]: INFO cinder.service [-] Starting cinder-volume node (version 20.1.0) Apr 30 21:00:34.564411 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] allow_availability_zone_fallback = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.565119 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] allow_compression_on_image_upload = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.565807 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] allowed_direct_url_schemes = [] {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.566423 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] api_rate_limit = True {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.567224 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] auth_strategy = keystone {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.567872 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] az_cache_duration = 3600 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.568435 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_availability_zone = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.569152 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_host = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.569699 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_name = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.579027 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_stats_polling_interval = 60 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.579027 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backup_api_class = cinder.backup.api.API {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.579027 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.579027 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backup_name_template = backup-%s {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.579027 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backup_use_same_host = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.579027 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backup_use_temp_snapshot = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.579508 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] chap_password = **** {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.579508 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] chap_username = {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.579508 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.579508 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] cinder_internal_tenant_project_id = 6b52e5e13b9144dfb663578766c2bac0 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.579508 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] cinder_internal_tenant_user_id = f3dc7765f32c4b00a7e41f2754b9595b {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.579508 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] cloned_volume_same_az = True {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.579890 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] cluster = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.579890 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] compression_format = gzip {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.579890 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] compute_api_class = cinder.compute.nova.API {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.579890 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] config_dir = [] {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.579890 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.579890 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] config_source = [] {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.580298 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.580298 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] control_exchange = openstack {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.580298 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] debug = True {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.580941 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] default_availability_zone = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.581656 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] default_group_type = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.582684 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.584517 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] default_volume_type = ceph {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.585122 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] driver_client_cert = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.585691 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] driver_client_cert_key = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.586298 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] driver_data_namespace = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.586856 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] driver_ssl_cert_path = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.587441 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] driver_ssl_cert_verify = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.587999 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] driver_use_ssl = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.588594 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] enable_force_upload = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.589136 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] enable_new_services = True {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.589687 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] enable_unsupported_driver = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.590577 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] enabled_backends = ['ceph'] {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.592314 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] enforce_multipath_for_image_xfer = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.592869 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] filter_function = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.593486 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] glance_api_insecure = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.594969 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] glance_api_servers = ['http://10.222.0.23/image'] {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.595736 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] glance_api_ssl_compression = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.596529 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] glance_ca_certificates_file = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.597184 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] glance_catalog_info = image:glance:publicURL {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.597787 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] glance_certfile = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.598331 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-c2ad1eaf-4e77-4a3c-ad69-5ce2142e35b9 None None] Starting volume driver RBDDriver (1.2.0) Apr 30 21:00:34.598701 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.599276 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] glance_keyfile = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.599839 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] glance_num_retries = 3 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.600236 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c2ad1eaf-4e77-4a3c-ad69-5ce2142e35b9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:00:34.600607 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] glance_request_timeout = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.601178 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] goodness_function = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.601778 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] graceful_shutdown_timeout = 5 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.602568 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] group_api_class = cinder.group.api.API {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.603084 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] host = ncdv-master-1 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.603670 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] iet_conf = /etc/iet/ietd.conf {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.611794 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] image_compress_on_upload = True {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.612409 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] image_conversion_address_space_limit = 1 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.612956 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] image_conversion_cpu_limit = 60 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.613597 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.614074 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] image_upload_use_cinder_backend = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.614489 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] image_upload_use_internal_tenant = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.615120 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] image_volume_cache_enabled = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.615551 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] image_volume_cache_max_count = 0 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.616128 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] image_volume_cache_max_size_gb = 0 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.616594 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] init_host_max_objects_retrieval = 0 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.617039 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] instance_format = [instance: %(uuid)s] {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.617459 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.617932 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] iscsi_iotype = fileio {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.618381 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] iscsi_secondary_ip_addresses = [] {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.618806 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] iscsi_target_flags = {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.619238 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] iscsi_write_cache = on {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.619692 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] iser_helper = tgtadm {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.620362 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] iser_ip_address = 10.222.0.23 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.620830 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] iser_port = 3260 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.621257 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.621713 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] log_config_append = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.622184 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.622730 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] log_dir = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.623159 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] log_file = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.623517 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] log_options = True {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.623942 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] log_rotate_interval = 1 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.624507 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] log_rotate_interval_type = days {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.625106 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] log_rotation_type = none {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.625599 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.626107 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.626679 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.627252 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.627781 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.628374 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] max_age = 0 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.628786 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] max_logfile_count = 30 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.629203 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] max_logfile_size_mb = 200 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.629668 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] max_over_subscription_ratio = 20.0 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.630158 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] message_reap_interval = 86400 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.630572 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] message_ttl = 2592000 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.631015 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] migration_create_volume_timeout_secs = 300 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.631429 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] monkey_patch = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.631861 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] monkey_patch_modules = [] {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.632222 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] my_ip = 10.222.0.23 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.632682 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] no_snapshot_gb_quota = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.633091 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] num_iser_scan_tries = 3 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.633522 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] num_shell_tries = 3 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.634039 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] num_volume_device_scan_tries = 3 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.634454 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] nvmet_ns_id = 10 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.634897 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] nvmet_port_id = 1 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.635360 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] osapi_max_limit = 1000 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.635793 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] osapi_volume_ext_list = [] {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.636269 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.636727 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.637167 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] osapi_volume_listen_port = 8776 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.637578 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] osapi_volume_use_ssl = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.638036 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] osapi_volume_workers = 2 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.638463 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] per_volume_size_limit = -1 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.638874 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] periodic_fuzzy_delay = 60 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.639310 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] periodic_interval = 60 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.639783 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.640202 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] public_endpoint = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.640627 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] publish_errors = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.641032 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] quota_backup_gigabytes = 1000 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.641470 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] quota_backups = 10 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.641911 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] quota_consistencygroups = 10 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.642350 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.642748 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] quota_gigabytes = 1000 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.643315 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] quota_groups = 10 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.643764 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] quota_snapshots = 10 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.644177 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] quota_volumes = 10 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.644604 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] rate_limit_burst = 0 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.645021 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] rate_limit_except_level = CRITICAL {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.645444 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] rate_limit_interval = 0 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.645911 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] reinit_driver_count = 3 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.646340 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] replication_device = **** {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.646775 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] report_discard_supported = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.647189 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] report_interval = 10 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.647875 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] reservation_clean_interval = 86400 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.648234 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] reservation_expire = 86400 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.648650 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] reserved_percentage = 0 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.649111 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.649534 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.650038 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] rpc_response_timeout = 120 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.650454 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] run_external_periodic_tasks = True {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.650861 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.651615 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] scst_target_driver = iscsi {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.652852 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] scst_target_iqn_name = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.653613 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] service_down_time = 60 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.654234 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] snapshot_name_template = snapshot-%s {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.654676 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] snapshot_same_host = True {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.655112 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] split_loggers = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.655474 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] state_path = /opt/stack/data/cinder {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.656551 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] storage_availability_zone = nova {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.657124 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] storage_protocol = iSCSI {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.657574 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] syslog_log_facility = LOG_USER {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.658018 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] target_helper = lioadm {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.658682 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] target_ip_address = 10.222.0.23 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.659225 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] target_port = 3260 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.659951 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.660374 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] target_protocol = iscsi {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.660800 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] trace_flags = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.661228 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.661660 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] transport_url = **** {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.662097 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] until_refresh = 0 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.662507 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] use_chap_auth = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.662925 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] use_default_quota_class = True {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.663356 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] use_eventlog = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.663776 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] use_journal = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.664217 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] use_json = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.664628 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] use_multipath_for_image_xfer = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.665121 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] use_stderr = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.665533 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] use_syslog = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.666008 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] verify_glance_signatures = enabled {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.666554 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] volume_api_class = cinder.volume.api.API {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.667102 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] volume_backend_name = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.667682 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] volume_clear = zero {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.669108 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] volume_clear_ionice = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.669963 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] volume_clear_size = 0 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.670409 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.670836 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] volume_copy_bps_limit = 0 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.671281 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] volume_dd_blocksize = 1M {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.671811 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.672242 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] volume_name_template = volume-%s {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.672657 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] volume_service_inithost_offload = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.673081 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] volume_usage_audit_period = month {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.673613 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.675941 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] watch_log_file = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.677944 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] zoning_mode = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 21:00:34.678764 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.679210 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.679647 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_policy.enforce_new_defaults = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.680046 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_policy.enforce_scope = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.680448 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_policy.policy_default_rule = default {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.680855 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.681266 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_policy.policy_file = policy.yaml {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.681674 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.682165 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.682539 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.682918 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.683446 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.683959 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_concurrency.disable_process_locking = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.684482 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.684928 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] keystone_authtoken.admin_password = **** {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.685347 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.686486 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] keystone_authtoken.admin_token = **** {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.687093 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] keystone_authtoken.admin_user = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.688405 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] keystone_authtoken.auth_admin_prefix = {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.689056 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.689665 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] keystone_authtoken.auth_port = 35357 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.690307 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c2ad1eaf-4e77-4a3c-ad69-5ce2142e35b9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:00:34.690431 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] keystone_authtoken.auth_protocol = https {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.691003 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] keystone_authtoken.auth_section = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.691545 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] keystone_authtoken.auth_type = password {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.692227 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] keystone_authtoken.auth_uri = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.692742 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] keystone_authtoken.auth_version = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.693344 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] keystone_authtoken.cache = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.694014 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.694630 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] keystone_authtoken.certfile = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.695152 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.695695 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.696304 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.696903 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.697416 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] keystone_authtoken.identity_uri = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.698066 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] keystone_authtoken.include_service_catalog = True {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.698594 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] keystone_authtoken.insecure = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.699121 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] keystone_authtoken.interface = public {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.699634 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] keystone_authtoken.keyfile = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.700143 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.700707 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.701227 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.701614 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.702061 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.702705 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.703157 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.703624 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.704189 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.704665 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] keystone_authtoken.region_name = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.705054 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.705416 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] keystone_authtoken.service_token_roles_required = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.705815 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] keystone_authtoken.service_type = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.706192 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.706772 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.707267 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] cache.backend = dogpile.cache.null {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.707658 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] cache.backend_argument = **** {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.708027 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] cache.config_prefix = cache.oslo {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.708577 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] cache.dead_timeout = 60.0 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.708975 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] cache.debug_cache_backend = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.709331 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] cache.enable_retry_client = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.709685 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] cache.enable_socket_keepalive = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.710081 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] cache.enabled = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.710458 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] cache.expiration_time = 600 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.710843 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] cache.hashclient_retry_attempts = 2 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.711521 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] cache.hashclient_retry_delay = 1.0 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.712101 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] cache.memcache_dead_retry = 300 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.712636 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.713267 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.713741 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] cache.memcache_pool_maxsize = 10 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.716807 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.716807 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.716807 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] cache.memcache_socket_timeout = 1.0 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.716807 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] cache.proxies = [] {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.716807 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] cache.retry_attempts = 2 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.716807 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] cache.retry_delay = 0.0 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.716807 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] cache.socket_keepalive_count = 1 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.717265 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] cache.socket_keepalive_idle = 1 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.717526 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] cache.socket_keepalive_interval = 1 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.718465 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] cache.tls_allowed_ciphers = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.719534 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] cache.tls_cafile = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.720411 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] cache.tls_certfile = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.720930 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] cache.tls_enabled = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.721532 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] cache.tls_keyfile = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.722212 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] coordination.backend_url = etcd3+http://10.222.0.23:2379 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.722858 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] database.backend = sqlalchemy {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.723354 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] database.connection = **** {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.724155 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] database.connection_debug = 0 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.724551 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] database.connection_parameters = {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.725045 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] database.connection_recycle_time = 3600 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.725412 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] database.connection_trace = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.725785 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] database.db_inc_retry_interval = True {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.726161 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] database.db_max_retries = 20 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.726518 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] database.db_max_retry_interval = 10 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.727012 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] database.db_retry_interval = 1 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.727386 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] database.max_overflow = 50 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.727759 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] database.max_pool_size = 5 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.728115 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] database.max_retries = 10 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.728568 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] database.mysql_enable_ndb = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.728959 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.729315 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] database.pool_timeout = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.729685 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] database.retry_interval = 10 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.730082 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] database.slave_connection = **** {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.730437 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] database.sqlite_synchronous = True {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.735411 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] database.use_db_reconnect = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.735848 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.736230 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.736630 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.737134 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.737507 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.737971 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] profiler.connection_string = messaging:// {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.738295 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] profiler.enabled = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.738779 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] profiler.es_doc_type = notification {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.739144 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] profiler.es_scroll_size = 10000 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.739511 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] profiler.es_scroll_time = 2m {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.739868 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] profiler.filter_error_trace = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.740243 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] profiler.hmac_keys = SECRET_KEY {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.740625 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] profiler.sentinel_service_name = mymaster {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.740998 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] profiler.socket_timeout = 0.1 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.741350 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] profiler.trace_sqlalchemy = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.741807 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] privsep_osbrick.capabilities = [21] {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.742191 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] privsep_osbrick.group = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.742537 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] privsep_osbrick.helper_command = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.743071 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.743615 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.744260 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] privsep_osbrick.user = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.744855 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.745527 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] cinder_sys_admin.group = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.746148 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] cinder_sys_admin.helper_command = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.746792 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.747374 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.747769 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] cinder_sys_admin.user = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.748500 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] service_user.auth_section = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.749192 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] service_user.auth_type = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.749544 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] service_user.cafile = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.749967 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] service_user.certfile = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.750364 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] service_user.collect_timing = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.750731 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] service_user.insecure = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.751084 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] service_user.keyfile = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.751641 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] service_user.send_service_user_token = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.752004 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] service_user.split_loggers = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.752152 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c2ad1eaf-4e77-4a3c-ad69-5ce2142e35b9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:00:34.752379 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] service_user.timeout = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.752805 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.backend_availability_zone = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.753163 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.753521 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.753930 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.chap_password = **** {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.754304 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.chap_username = {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.754717 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.755082 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.deferred_deletion_delay = 0 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.755454 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.deferred_deletion_purge_interval = 60 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.755805 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.driver_client_cert = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.756175 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.driver_client_cert_key = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.756523 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.driver_data_namespace = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.756874 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.757256 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.757605 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.driver_use_ssl = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.757976 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.enable_deferred_deletion = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.758326 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.758697 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.759058 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.extra_capabilities = {} {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.759404 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.filter_function = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.759750 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.goodness_function = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.760132 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.760481 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.760837 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.761184 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.761560 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.761945 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.762331 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.iscsi_iotype = fileio {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.762709 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.763096 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.iscsi_target_flags = {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.763481 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.iscsi_write_cache = on {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.763846 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.iser_helper = tgtadm {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.764388 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.iser_ip_address = 10.222.0.23 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.764763 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.iser_port = 3260 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.765126 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.765528 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.765908 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.766259 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.num_shell_tries = 3 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.766707 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.767334 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.767979 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.768421 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.rados_connect_timeout = -1 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.768790 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.rados_connection_interval = 5 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.769151 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.rados_connection_retries = 3 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.769526 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.rbd_ceph_conf = {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.769928 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.rbd_cluster_name = ceph {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.770289 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.rbd_exclusive_cinder_pool = True {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.770667 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.rbd_flatten_volume_from_snapshot = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.771051 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.rbd_max_clone_depth = 5 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.771435 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.rbd_pool = rbd {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.771793 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.rbd_secret_uuid = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.772147 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.rbd_store_chunk_size = 4 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.772495 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.rbd_user = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.772877 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.replication_connect_timeout = 5 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.773230 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.replication_device = **** {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.773582 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.report_discard_supported = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.773969 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.report_dynamic_total_capacity = True {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.774321 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.reserved_percentage = 0 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.774707 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.775061 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.775558 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.775961 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.776335 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.target_helper = tgtadm {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.776805 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.target_ip_address = 10.222.0.23 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.777359 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.target_port = 3260 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.778173 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.778553 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.target_protocol = iscsi {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.778902 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.trace_flags = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.779261 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.unique_fqdn_network = True {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.779621 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.use_chap_auth = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.779972 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.780319 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.volume_backend_name = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.780719 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.volume_clear = zero {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.781560 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.volume_clear_ionice = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.782104 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.volume_clear_size = 0 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.782669 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.783202 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.783728 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.784123 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.784603 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.785011 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_reports.file_event_handler = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.785401 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.785812 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_reports.log_dir = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.786190 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.backend_availability_zone = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.786539 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.backend_host = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.786889 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.backend_native_threads_pool_size = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.787240 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.backup_use_temp_snapshot = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.787591 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.chap_password = **** {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.787938 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.chap_username = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.788289 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.chiscsi_conf = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.788637 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.deferred_deletion_delay = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.788985 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.deferred_deletion_purge_interval = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.789331 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.driver_client_cert = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.789676 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.driver_client_cert_key = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.790052 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.driver_data_namespace = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.790399 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.driver_ssl_cert_path = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.790746 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.driver_ssl_cert_verify = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.791092 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.driver_use_ssl = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.791442 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.enable_deferred_deletion = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.791789 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.enable_unsupported_driver = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.792134 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.enforce_multipath_for_image_xfer = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.792484 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.extra_capabilities = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.792855 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.filter_function = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.793203 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.goodness_function = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.793548 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.iet_conf = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.794106 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.image_upload_use_cinder_backend = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.794500 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.image_upload_use_internal_tenant = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.795024 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.image_volume_cache_enabled = True {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.795383 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.image_volume_cache_max_count = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.795739 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.image_volume_cache_max_size_gb = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.796080 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.iscsi_iotype = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.796441 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.iscsi_secondary_ip_addresses = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.797347 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.iscsi_target_flags = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.797705 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.iscsi_write_cache = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.798077 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.driver [None req-c2ad1eaf-4e77-4a3c-ad69-5ce2142e35b9 None None] Driver hasn't implemented _init_vendor_properties() Apr 30 21:00:34.798171 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.iser_helper = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.798425 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.iser_ip_address = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.798526 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.driver [None req-c2ad1eaf-4e77-4a3c-ad69-5ce2142e35b9 None None] Initialized capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:3248ecd5-4483-4276-a2b9-de5137f4f872:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=123855) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:812}} Apr 30 21:00:34.798774 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.iser_port = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.799121 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.iser_target_prefix = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.799468 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.max_over_subscription_ratio = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.799815 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.num_iser_scan_tries = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.800162 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.num_shell_tries = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.800507 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.num_volume_device_scan_tries = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.800854 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.nvmet_ns_id = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.801203 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.nvmet_port_id = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.801572 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.rados_connect_timeout = -1 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.801941 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.rados_connection_interval = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.802293 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.rados_connection_retries = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.802703 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.rbd_ceph_conf = /etc/ceph/ceph.conf {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.803000 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.rbd_cluster_name = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.805805 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.rbd_exclusive_cinder_pool = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.805805 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.rbd_flatten_volume_from_snapshot = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.805805 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.rbd_max_clone_depth = 5 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.805805 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.rbd_pool = volumes {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.805805 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.rbd_secret_uuid = 9e39727c-6075-4d95-b487-e2c486f443b1 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.805805 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.rbd_store_chunk_size = 4 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.806265 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.rbd_user = cinder {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.806651 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.replication_connect_timeout = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.807159 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.replication_device = **** {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.807655 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.report_discard_supported = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.808145 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.report_dynamic_total_capacity = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.815267 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.reserved_percentage = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.815267 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.scst_target_driver = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.815267 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.scst_target_iqn_name = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.815267 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.storage_protocol = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.815267 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.suppress_requests_ssl_warnings = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.815675 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_db.sqlalchemy.engines [None req-c2ad1eaf-4e77-4a3c-ad69-5ce2142e35b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123855) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 21:00:34.815756 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.target_helper = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.815756 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.target_ip_address = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.815756 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.target_port = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.815756 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.target_prefix = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.815756 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.target_protocol = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.815756 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.trace_flags = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.815756 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.unique_fqdn_network = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.816206 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.use_chap_auth = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.816206 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.use_multipath_for_image_xfer = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.816206 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.volume_backend_name = ceph {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.816206 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.volume_clear = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.816206 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.volume_clear_ionice = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.816206 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.volume_clear_size = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.816206 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.volume_copy_blkio_cgroup_name = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.816791 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.volume_copy_bps_limit = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.817309 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.volume_dd_blocksize = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.817866 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.volume_driver = cinder.volume.drivers.rbd.RBDDriver {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.818377 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ceph.volumes_dir = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.818980 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.819506 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.820039 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.820553 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.821090 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.821600 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.822172 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.822690 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.823193 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.823685 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.824214 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.824786 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.825370 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.825996 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.826522 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.827194 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.828039 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.828576 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.829114 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.829682 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.830280 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.830864 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.831445 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_messaging_rabbit.ssl = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.832042 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.832601 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.833154 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.833723 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.834256 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_messaging_notifications.driver = [] {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.834846 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_messaging_notifications.retry = -1 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.835465 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.836003 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.836501 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.837089 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] key_manager.fixed_key = **** {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.837692 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.838249 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] barbican.barbican_api_version = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.838780 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] barbican.barbican_endpoint = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.839345 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] barbican.barbican_endpoint_type = public {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.839882 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] barbican.barbican_region_name = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.840456 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] barbican.cafile = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.840974 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] barbican.certfile = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.841574 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] barbican.collect_timing = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.842117 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] barbican.insecure = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.842667 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] barbican.keyfile = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.843242 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] barbican.number_of_retries = 60 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.845400 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] barbican.retry_delay = 1 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.846035 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] barbican.send_service_user_token = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.846626 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] barbican.split_loggers = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.846903 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.db.sqlalchemy.api [None req-c2ad1eaf-4e77-4a3c-ad69-5ce2142e35b9 None None] Building query based on filter {{(pid=123855) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3459}} Apr 30 21:00:34.847544 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] barbican.timeout = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.848307 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] barbican.verify_ssl = True {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.848890 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] barbican.verify_ssl_path = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.849462 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] barbican_service_user.auth_section = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.850066 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] barbican_service_user.auth_type = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.850635 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] barbican_service_user.cafile = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.851260 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] barbican_service_user.certfile = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.851653 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] barbican_service_user.collect_timing = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.852221 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] barbican_service_user.insecure = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.852781 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] barbican_service_user.keyfile = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.853372 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] barbican_service_user.split_loggers = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.853958 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] barbican_service_user.timeout = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.854560 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] vault.approle_role_id = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.855126 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] vault.approle_secret_id = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.855816 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] vault.cafile = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.856370 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] vault.certfile = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.856943 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] vault.collect_timing = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.857492 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] vault.insecure = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.858087 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] vault.keyfile = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.858611 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] vault.kv_mountpoint = secret {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.859170 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] vault.kv_version = 2 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.860292 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] vault.namespace = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.860788 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] vault.root_token_id = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.861280 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] vault.split_loggers = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.861828 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] vault.ssl_ca_crt_file = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.862321 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] vault.timeout = None {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.862834 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] vault.use_ssl = False {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.863374 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 21:00:34.863817 ncdv-master-1 cinder-volume[123682]: DEBUG oslo_service.service [None req-e5894fa7-aba5-45f5-afe5-e3c4412471d3 None None] ******************************************************************************** {{(pid=123682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 30 21:00:34.868660 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.image_utils [None req-c2ad1eaf-4e77-4a3c-ad69-5ce2142e35b9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=123855) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:955}} Apr 30 21:00:34.881482 ncdv-master-1 cinder-volume[123855]: INFO cinder.keymgr.migration [None req-dfae7a27-597f-4c4c-bbd1-a6d157e6b20b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 30 21:00:34.883422 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c2ad1eaf-4e77-4a3c-ad69-5ce2142e35b9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:00:34.913055 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c2ad1eaf-4e77-4a3c-ad69-5ce2142e35b9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:00:34.978567 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-c2ad1eaf-4e77-4a3c-ad69-5ce2142e35b9 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:00:34.988615 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-c2ad1eaf-4e77-4a3c-ad69-5ce2142e35b9 None None] Driver initialization completed successfully. Apr 30 21:00:34.989273 ncdv-master-1 cinder-volume[123855]: INFO cinder.manager [None req-c2ad1eaf-4e77-4a3c-ad69-5ce2142e35b9 None None] Initiating service 3 cleanup Apr 30 21:00:34.999389 ncdv-master-1 cinder-volume[123855]: INFO cinder.manager [None req-c2ad1eaf-4e77-4a3c-ad69-5ce2142e35b9 None None] Service 3 cleanup completed. Apr 30 21:00:34.999760 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.service [None req-c2ad1eaf-4e77-4a3c-ad69-5ce2142e35b9 None None] Creating RPC server for service cinder-volume {{(pid=123855) start /opt/stack/cinder/cinder/service.py:231}} Apr 30 21:00:35.006953 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.service [None req-c2ad1eaf-4e77-4a3c-ad69-5ce2142e35b9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=123855) start /opt/stack/cinder/cinder/service.py:237}} Apr 30 21:00:35.058605 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-c2ad1eaf-4e77-4a3c-ad69-5ce2142e35b9 None None] Initializing RPC dependent components of volume driver RBDDriver (1.2.0) Apr 30 21:00:35.059518 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c2ad1eaf-4e77-4a3c-ad69-5ce2142e35b9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:00:35.121047 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c2ad1eaf-4e77-4a3c-ad69-5ce2142e35b9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:00:35.245486 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-c2ad1eaf-4e77-4a3c-ad69-5ce2142e35b9 None None] Driver post RPC initialization completed successfully. Apr 30 21:02:27.248009 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:02:27.248818 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:02:27.278120 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:02:27.302863 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:03:27.248842 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:03:27.249607 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:03:27.280416 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:03:27.303980 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:04:27.248935 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:04:27.249596 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:04:27.270861 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:04:27.300113 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:05:27.245607 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:05:27.246333 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:05:27.267506 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:05:27.289093 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:06:27.244351 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:06:27.245076 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:06:27.265898 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:06:27.287032 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:07:27.242043 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:07:27.242768 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:07:27.272005 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:07:27.293925 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:08:27.239770 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:08:27.240490 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:08:27.263735 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:08:27.289472 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:09:27.250163 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:09:27.250163 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:09:27.340971 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:09:27.404549 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:10:27.241517 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:10:27.243062 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:10:27.283051 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:10:27.313907 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:11:27.244040 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:11:27.244713 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:11:27.315804 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:11:27.398926 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:12:27.248939 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:12:27.249707 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:12:27.290273 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:12:27.320457 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:12:40.517000 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-97fc86e8-ff62-4e26-80fa-2e06f5fbb1c1 tempest-LiveMigrationTest-1354815034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:12:40.591524 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-97fc86e8-ff62-4e26-80fa-2e06f5fbb1c1 tempest-LiveMigrationTest-1354815034 None] Flow 'volume_create_manager' (d8e7f1b3-ed3f-4632-9ff5-7aecaf514ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:12:40.601163 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-97fc86e8-ff62-4e26-80fa-2e06f5fbb1c1 tempest-LiveMigrationTest-1354815034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (167e8688-3635-4f7e-a54c-ff8dfe9668fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:12:40.662295 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-97fc86e8-ff62-4e26-80fa-2e06f5fbb1c1 tempest-LiveMigrationTest-1354815034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (167e8688-3635-4f7e-a54c-ff8dfe9668fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveMigrationTest-volume-2063487080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8b53e786-98d2-47b8-a116-d63bdd9029d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a25f2505d5141c5b894bfd6515eb7f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:12:40Z,use_quota=True,user_id='8bd54cdc115e4ae9b202bd06c7658e4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:12:40.667613 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-97fc86e8-ff62-4e26-80fa-2e06f5fbb1c1 tempest-LiveMigrationTest-1354815034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f9514f-73f5-4fac-ba2c-f06dd9449fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:12:40.671997 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-97fc86e8-ff62-4e26-80fa-2e06f5fbb1c1 tempest-LiveMigrationTest-1354815034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f9514f-73f5-4fac-ba2c-f06dd9449fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:12:40.678232 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-97fc86e8-ff62-4e26-80fa-2e06f5fbb1c1 tempest-LiveMigrationTest-1354815034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8bdea33-8397-4566-90fb-30b339bcc273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:12:40.682088 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-97fc86e8-ff62-4e26-80fa-2e06f5fbb1c1 tempest-LiveMigrationTest-1354815034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8bdea33-8397-4566-90fb-30b339bcc273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b53e786-98d2-47b8-a116-d63bdd9029d1', 'volume_name': 'volume-8b53e786-98d2-47b8-a116-d63bdd9029d1', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:12:40.686787 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-97fc86e8-ff62-4e26-80fa-2e06f5fbb1c1 tempest-LiveMigrationTest-1354815034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9589cd9a-6b8a-4750-bef9-ecc11a9dfa44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:12:40.691470 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-97fc86e8-ff62-4e26-80fa-2e06f5fbb1c1 tempest-LiveMigrationTest-1354815034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9589cd9a-6b8a-4750-bef9-ecc11a9dfa44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:12:40.696202 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-97fc86e8-ff62-4e26-80fa-2e06f5fbb1c1 tempest-LiveMigrationTest-1354815034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c263bccf-0d06-4cd3-8ef4-ed71ef3aff26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:12:40.701396 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-97fc86e8-ff62-4e26-80fa-2e06f5fbb1c1 tempest-LiveMigrationTest-1354815034 None] Volume 8b53e786-98d2-47b8-a116-d63bdd9029d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b53e786-98d2-47b8-a116-d63bdd9029d1', 'volume_size': 1} Apr 30 21:12:40.702191 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-97fc86e8-ff62-4e26-80fa-2e06f5fbb1c1 tempest-LiveMigrationTest-1354815034 None] creating volume 'volume-8b53e786-98d2-47b8-a116-d63bdd9029d1' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:12:40.703236 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-97fc86e8-ff62-4e26-80fa-2e06f5fbb1c1 tempest-LiveMigrationTest-1354815034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:12:41.764280 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-97fc86e8-ff62-4e26-80fa-2e06f5fbb1c1 tempest-LiveMigrationTest-1354815034 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:12:41.764928 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-97fc86e8-ff62-4e26-80fa-2e06f5fbb1c1 tempest-LiveMigrationTest-1354815034 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:12:41.769964 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-97fc86e8-ff62-4e26-80fa-2e06f5fbb1c1 tempest-LiveMigrationTest-1354815034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c263bccf-0d06-4cd3-8ef4-ed71ef3aff26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b53e786-98d2-47b8-a116-d63bdd9029d1', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:12:41.777944 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-97fc86e8-ff62-4e26-80fa-2e06f5fbb1c1 tempest-LiveMigrationTest-1354815034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08d661b7-b5cb-42b6-a7a9-40e3a7e949b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:12:41.882252 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-97fc86e8-ff62-4e26-80fa-2e06f5fbb1c1 tempest-LiveMigrationTest-1354815034 None] Volume volume-8b53e786-98d2-47b8-a116-d63bdd9029d1 (8b53e786-98d2-47b8-a116-d63bdd9029d1): created successfully Apr 30 21:12:41.890085 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-97fc86e8-ff62-4e26-80fa-2e06f5fbb1c1 tempest-LiveMigrationTest-1354815034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08d661b7-b5cb-42b6-a7a9-40e3a7e949b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:12:41.899009 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-97fc86e8-ff62-4e26-80fa-2e06f5fbb1c1 tempest-LiveMigrationTest-1354815034 None] Flow 'volume_create_manager' (d8e7f1b3-ed3f-4632-9ff5-7aecaf514ac4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:12:42.019241 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-97fc86e8-ff62-4e26-80fa-2e06f5fbb1c1 tempest-LiveMigrationTest-1354815034 None] Created volume successfully. Apr 30 21:12:44.530112 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-ef4c65de-21bd-474b-a059-a0d2d6022b0c req-d9fc4886-89e5-4ffb-a64b-63acdaa59ada tempest-LiveMigrationTest-1354815034 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:12:45.419146 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-ef4c65de-21bd-474b-a059-a0d2d6022b0c req-d9fc4886-89e5-4ffb-a64b-63acdaa59ada tempest-LiveMigrationTest-1354815034 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.889s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:12:45.420047 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-ef4c65de-21bd-474b-a059-a0d2d6022b0c req-d9fc4886-89e5-4ffb-a64b-63acdaa59ada tempest-LiveMigrationTest-1354815034 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8b53e786-98d2-47b8-a116-d63bdd9029d1', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': '8b53e786-98d2-47b8-a116-d63bdd9029d1', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:12:45.584666 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-ef4c65de-21bd-474b-a059-a0d2d6022b0c req-d9fc4886-89e5-4ffb-a64b-63acdaa59ada tempest-LiveMigrationTest-1354815034 None] Connection info returned from driver {'name': 'volumes/volume-8b53e786-98d2-47b8-a116-d63bdd9029d1', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '8b53e786-98d2-47b8-a116-d63bdd9029d1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd5669fdf-f499-49ee-8de8-afdd9166da19'} {{(pid=123855) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Apr 30 21:12:45.821123 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-ef4c65de-21bd-474b-a059-a0d2d6022b0c req-d9fc4886-89e5-4ffb-a64b-63acdaa59ada tempest-LiveMigrationTest-1354815034 None] attachment_update completed successfully. Apr 30 21:13:03.393013 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-721b08db-c024-4713-8be3-fe1c1e94e63f req-c2e232cb-1d7b-4d3e-8738-6721ac03f094 tempest-LiveMigrationTest-343940872 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:13:04.640801 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-721b08db-c024-4713-8be3-fe1c1e94e63f req-c2e232cb-1d7b-4d3e-8738-6721ac03f094 tempest-LiveMigrationTest-343940872 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.248s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:13:04.643016 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-721b08db-c024-4713-8be3-fe1c1e94e63f req-c2e232cb-1d7b-4d3e-8738-6721ac03f094 tempest-LiveMigrationTest-343940872 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8b53e786-98d2-47b8-a116-d63bdd9029d1', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': '8b53e786-98d2-47b8-a116-d63bdd9029d1', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:13:04.744748 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-721b08db-c024-4713-8be3-fe1c1e94e63f req-c2e232cb-1d7b-4d3e-8738-6721ac03f094 tempest-LiveMigrationTest-343940872 None] Connection info returned from driver {'name': 'volumes/volume-8b53e786-98d2-47b8-a116-d63bdd9029d1', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '8b53e786-98d2-47b8-a116-d63bdd9029d1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '2553227f-6f77-4095-b7c3-6a16b71b81a3'} {{(pid=123855) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Apr 30 21:13:04.881013 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-721b08db-c024-4713-8be3-fe1c1e94e63f req-c2e232cb-1d7b-4d3e-8738-6721ac03f094 tempest-LiveMigrationTest-343940872 None] attachment_update completed successfully. Apr 30 21:13:19.317844 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-70458db5-1e18-4795-b07f-ab2cf60bcd61 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:13:19.356668 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-70458db5-1e18-4795-b07f-ab2cf60bcd61 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Flow 'volume_create_manager' (17d5f53e-c7fc-40df-b498-a0293a56d1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:13:19.367907 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-70458db5-1e18-4795-b07f-ab2cf60bcd61 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd06b166-62c7-4241-9771-854d13e87004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:13:19.396330 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-70458db5-1e18-4795-b07f-ab2cf60bcd61 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd06b166-62c7-4241-9771-854d13e87004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveAutoBlockMigrationV225Test-volume-480262399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=faff6da0-9c40-4fee-bd74-c45260d3e9a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77b426139c194813974502d1910c257f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:13:19Z,use_quota=True,user_id='dadac4f61fe141dba3ee726ca6cbf29a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:13:19.411206 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-70458db5-1e18-4795-b07f-ab2cf60bcd61 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f608f5e-5738-44c1-b55d-ecd39bb0c36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:13:19.421150 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-70458db5-1e18-4795-b07f-ab2cf60bcd61 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f608f5e-5738-44c1-b55d-ecd39bb0c36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:13:19.437307 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-70458db5-1e18-4795-b07f-ab2cf60bcd61 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f260b118-5e67-4975-9226-8123b68dc148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:13:19.445001 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-70458db5-1e18-4795-b07f-ab2cf60bcd61 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f260b118-5e67-4975-9226-8123b68dc148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faff6da0-9c40-4fee-bd74-c45260d3e9a2', 'volume_name': 'volume-faff6da0-9c40-4fee-bd74-c45260d3e9a2', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:13:19.453122 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-70458db5-1e18-4795-b07f-ab2cf60bcd61 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72dad8b4-a860-4ff6-9bec-9a38f0302e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:13:19.459536 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-70458db5-1e18-4795-b07f-ab2cf60bcd61 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72dad8b4-a860-4ff6-9bec-9a38f0302e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:13:19.468788 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-70458db5-1e18-4795-b07f-ab2cf60bcd61 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (067f12cb-1368-44ff-9165-d540bd8ff658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:13:19.470218 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-70458db5-1e18-4795-b07f-ab2cf60bcd61 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Volume faff6da0-9c40-4fee-bd74-c45260d3e9a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faff6da0-9c40-4fee-bd74-c45260d3e9a2', 'volume_size': 1} Apr 30 21:13:19.470984 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-70458db5-1e18-4795-b07f-ab2cf60bcd61 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] creating volume 'volume-faff6da0-9c40-4fee-bd74-c45260d3e9a2' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:13:19.471968 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-70458db5-1e18-4795-b07f-ab2cf60bcd61 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:13:20.302950 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-70458db5-1e18-4795-b07f-ab2cf60bcd61 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:13:20.303338 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-70458db5-1e18-4795-b07f-ab2cf60bcd61 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:13:20.307212 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-70458db5-1e18-4795-b07f-ab2cf60bcd61 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (067f12cb-1368-44ff-9165-d540bd8ff658) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faff6da0-9c40-4fee-bd74-c45260d3e9a2', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:13:20.311838 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-70458db5-1e18-4795-b07f-ab2cf60bcd61 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3e57d4-6449-4e67-89fe-1ed7fc7d9377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:13:20.462046 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-70458db5-1e18-4795-b07f-ab2cf60bcd61 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Volume volume-faff6da0-9c40-4fee-bd74-c45260d3e9a2 (faff6da0-9c40-4fee-bd74-c45260d3e9a2): created successfully Apr 30 21:13:20.474678 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-70458db5-1e18-4795-b07f-ab2cf60bcd61 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3e57d4-6449-4e67-89fe-1ed7fc7d9377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:13:20.492591 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-70458db5-1e18-4795-b07f-ab2cf60bcd61 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Flow 'volume_create_manager' (17d5f53e-c7fc-40df-b498-a0293a56d1ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:13:20.624283 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-70458db5-1e18-4795-b07f-ab2cf60bcd61 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Created volume successfully. Apr 30 21:13:23.329985 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-61d144b2-805f-4d92-8704-5d7143db12c5 req-9575a4df-2f15-4e40-a2ee-4c7047551edf tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:13:23.507203 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-721b08db-c024-4713-8be3-fe1c1e94e63f req-791a4cb1-9b1e-45b7-9821-ad2548d8cd67 tempest-LiveMigrationTest-343940872 None] Terminate volume connection completed successfully. Apr 30 21:13:23.513718 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-721b08db-c024-4713-8be3-fe1c1e94e63f req-791a4cb1-9b1e-45b7-9821-ad2548d8cd67 tempest-LiveMigrationTest-343940872 None] Deleting attachment d5669fdf-f499-49ee-8de8-afdd9166da19. {{(pid=123855) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} Apr 30 21:13:24.859927 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-61d144b2-805f-4d92-8704-5d7143db12c5 req-9575a4df-2f15-4e40-a2ee-4c7047551edf tempest-LiveAutoBlockMigrationV225Test-1505936978 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.531s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:13:24.861297 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-61d144b2-805f-4d92-8704-5d7143db12c5 req-9575a4df-2f15-4e40-a2ee-4c7047551edf tempest-LiveAutoBlockMigrationV225Test-1505936978 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-faff6da0-9c40-4fee-bd74-c45260d3e9a2', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': 'faff6da0-9c40-4fee-bd74-c45260d3e9a2', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:13:24.996284 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-61d144b2-805f-4d92-8704-5d7143db12c5 req-9575a4df-2f15-4e40-a2ee-4c7047551edf tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Connection info returned from driver {'name': 'volumes/volume-faff6da0-9c40-4fee-bd74-c45260d3e9a2', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'faff6da0-9c40-4fee-bd74-c45260d3e9a2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '95c07750-0719-4529-8724-1aff09fd3188'} {{(pid=123855) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Apr 30 21:13:25.194319 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-61d144b2-805f-4d92-8704-5d7143db12c5 req-9575a4df-2f15-4e40-a2ee-4c7047551edf tempest-LiveAutoBlockMigrationV225Test-1505936978 None] attachment_update completed successfully. Apr 30 21:13:27.247968 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:13:27.250186 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:13:27.396364 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:13:27.502800 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:13:36.627124 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-aa0cdf58-aac9-46e4-bd69-d7f7f906ad11 req-c9700a39-bb0b-4997-b728-0cac39774525 tempest-LiveMigrationTest-1354815034 None] Terminate volume connection completed successfully. Apr 30 21:13:36.628188 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-aa0cdf58-aac9-46e4-bd69-d7f7f906ad11 req-c9700a39-bb0b-4997-b728-0cac39774525 tempest-LiveMigrationTest-1354815034 None] Deleting attachment 2553227f-6f77-4095-b7c3-6a16b71b81a3. {{(pid=123855) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} Apr 30 21:13:37.610718 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-5ba891a4-1d59-40d0-ad31-ef8b4b31d975 req-87955779-8049-4d7a-97e8-b5d6101922d3 tempest-LiveAutoBlockMigrationV225Test-718230883 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:13:38.771809 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-5ba891a4-1d59-40d0-ad31-ef8b4b31d975 req-87955779-8049-4d7a-97e8-b5d6101922d3 tempest-LiveAutoBlockMigrationV225Test-718230883 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.161s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:13:38.774567 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-5ba891a4-1d59-40d0-ad31-ef8b4b31d975 req-87955779-8049-4d7a-97e8-b5d6101922d3 tempest-LiveAutoBlockMigrationV225Test-718230883 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-faff6da0-9c40-4fee-bd74-c45260d3e9a2', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': 'faff6da0-9c40-4fee-bd74-c45260d3e9a2', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:13:38.939202 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-5ba891a4-1d59-40d0-ad31-ef8b4b31d975 req-87955779-8049-4d7a-97e8-b5d6101922d3 tempest-LiveAutoBlockMigrationV225Test-718230883 None] Connection info returned from driver {'name': 'volumes/volume-faff6da0-9c40-4fee-bd74-c45260d3e9a2', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'faff6da0-9c40-4fee-bd74-c45260d3e9a2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '76621052-e130-4de0-8564-2662f38bd935'} {{(pid=123855) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Apr 30 21:13:39.122039 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-5ba891a4-1d59-40d0-ad31-ef8b4b31d975 req-87955779-8049-4d7a-97e8-b5d6101922d3 tempest-LiveAutoBlockMigrationV225Test-718230883 None] attachment_update completed successfully. Apr 30 21:13:39.640677 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:13:39.679943 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Flow 'volume_create_manager' (2c69b8c9-c1ce-4527-baa7-2d2c3fa545d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:13:39.687271 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d2d83b0-89b8-4610-b8e2-8c4f8c26c501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:13:39.708549 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d2d83b0-89b8-4610-b8e2-8c4f8c26c501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-675856506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=632a7810-1a6f-420a-a6fd-57675408a8f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a25f2505d5141c5b894bfd6515eb7f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:13:39Z,use_quota=True,user_id='8bd54cdc115e4ae9b202bd06c7658e4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:13:39.716483 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f958f5a6-c83d-4875-ad8c-f43db77aa3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:13:39.721025 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f958f5a6-c83d-4875-ad8c-f43db77aa3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:13:39.734257 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f88030f-0374-4741-9fb5-9a40ea313d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:13:39.852603 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f88030f-0374-4741-9fb5-9a40ea313d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '632a7810-1a6f-420a-a6fd-57675408a8f7', 'volume_name': 'volume-632a7810-1a6f-420a-a6fd-57675408a8f7', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:13:39.860101 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f30a524f-b784-4d0e-9a9d-e74a0d2bdc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:13:39.864238 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f30a524f-b784-4d0e-9a9d-e74a0d2bdc2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:13:39.869111 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eec86d1-146d-4b51-a285-5b7ad3c92f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:13:39.870479 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Volume 632a7810-1a6f-420a-a6fd-57675408a8f7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-632a7810-1a6f-420a-a6fd-57675408a8f7', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 30 21:13:39.871570 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Cloning 632a7810-1a6f-420a-a6fd-57675408a8f7 from image a5b0850f-3b24-4bcb-b0a7-351c3216b27d at location (None, None). {{(pid=123855) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Apr 30 21:13:39.880920 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Lock "b'cinder-a5b0850f-3b24-4bcb-b0a7-351c3216b27d'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:13:39.891245 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Preparing cache entry for image = a5b0850f-3b24-4bcb-b0a7-351c3216b27d on host ncdv-master-1@ceph#ceph. {{(pid=123855) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:879}} Apr 30 21:13:39.892556 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Attempting to retrieve cache entry for image = a5b0850f-3b24-4bcb-b0a7-351c3216b27d on host ncdv-master-1@ceph#ceph. {{(pid=123855) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Apr 30 21:13:51.157153 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-5ba891a4-1d59-40d0-ad31-ef8b4b31d975 req-422b9eb8-5b19-4477-a018-e84c04948bc2 tempest-LiveAutoBlockMigrationV225Test-718230883 None] Terminate volume connection completed successfully. Apr 30 21:13:51.157834 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-5ba891a4-1d59-40d0-ad31-ef8b4b31d975 req-422b9eb8-5b19-4477-a018-e84c04948bc2 tempest-LiveAutoBlockMigrationV225Test-718230883 None] Deleting attachment 95c07750-0719-4529-8724-1aff09fd3188. {{(pid=123855) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} Apr 30 21:13:59.561909 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.image_utils [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a5b0850f-3b24-4bcb-b0a7-351c3216b27d_22cc06wcncdv-master-1@ceph, size 616.00 MB, duration 19.66 sec {{(pid=123855) fetch /opt/stack/cinder/cinder/image/image_utils.py:580}} Apr 30 21:13:59.562834 ncdv-master-1 cinder-volume[123855]: INFO cinder.image.image_utils [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Image download 616.00 MB at 31.33 MB/s Apr 30 21:13:59.827630 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_a5b0850f-3b24-4bcb-b0a7-351c3216b27d_22cc06wcncdv-master-1@ceph {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:14:00.047638 ncdv-master-1 sudo[133787]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_a5b0850f-3b24-4bcb-b0a7-351c3216b27d_22cc06wcncdv-master-1@ceph Apr 30 21:14:00.048752 ncdv-master-1 sudo[133787]: pam_unix(sudo:session): session opened for user root by (uid=0) Apr 30 21:14:01.742368 ncdv-master-1 sudo[133787]: pam_unix(sudo:session): session closed for user root Apr 30 21:14:01.744495 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_a5b0850f-3b24-4bcb-b0a7-351c3216b27d_22cc06wcncdv-master-1@ceph" returned: 0 in 1.917s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:14:01.749362 ncdv-master-1 cinder-volume[123855]: WARNING py.warnings [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Apr 30 21:14:01.749362 ncdv-master-1 cinder-volume[123855]: debtcollector.deprecate( Apr 30 21:14:01.749362 ncdv-master-1 cinder-volume[123855]: Apr 30 21:14:01.750107 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.image_utils [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Temporary image a5b0850f-3b24-4bcb-b0a7-351c3216b27d is fetched for user 8bd54cdc115e4ae9b202bd06c7658e4a. {{(pid=123855) fetch /opt/stack/cinder/cinder/image/image_utils.py:1088}} Apr 30 21:14:02.201449 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_a5b0850f-3b24-4bcb-b0a7-351c3216b27d_22cc06wcncdv-master-1@ceph {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:14:02.297486 ncdv-master-1 sudo[133830]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_a5b0850f-3b24-4bcb-b0a7-351c3216b27d_22cc06wcncdv-master-1@ceph Apr 30 21:14:02.298301 ncdv-master-1 sudo[133830]: pam_unix(sudo:session): session opened for user root by (uid=0) Apr 30 21:14:03.504335 ncdv-master-1 sudo[133830]: pam_unix(sudo:session): session closed for user root Apr 30 21:14:03.506671 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_a5b0850f-3b24-4bcb-b0a7-351c3216b27d_22cc06wcncdv-master-1@ceph" returned: 0 in 1.305s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:14:03.508569 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] creating volume 'volume-632a7810-1a6f-420a-a6fd-57675408a8f7' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:14:03.509876 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:14:04.422099 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:14:04.422099 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:14:04.618149 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.volume_utils [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Attempting download of a5b0850f-3b24-4bcb-b0a7-351c3216b27d ((None, None)) to volume 632a7810-1a6f-420a-a6fd-57675408a8f7. {{(pid=123855) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Apr 30 21:14:04.657650 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_a5b0850f-3b24-4bcb-b0a7-351c3216b27d_fixj9yee {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:14:04.751043 ncdv-master-1 sudo[133852]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_a5b0850f-3b24-4bcb-b0a7-351c3216b27d_fixj9yee Apr 30 21:14:04.751850 ncdv-master-1 sudo[133852]: pam_unix(sudo:session): session opened for user root by (uid=0) Apr 30 21:14:04.846737 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-032a69f5-a9fb-43c1-a1ad-982c5206770a req-c48af72c-4b71-407e-b7c9-eefeef8df5cd tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Terminate volume connection completed successfully. Apr 30 21:14:04.852675 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-032a69f5-a9fb-43c1-a1ad-982c5206770a req-c48af72c-4b71-407e-b7c9-eefeef8df5cd tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Deleting attachment 76621052-e130-4de0-8564-2662f38bd935. {{(pid=123855) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} Apr 30 21:14:06.526676 ncdv-master-1 sudo[133852]: pam_unix(sudo:session): session closed for user root Apr 30 21:14:06.529016 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_a5b0850f-3b24-4bcb-b0a7-351c3216b27d_fixj9yee" returned: 0 in 1.873s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:14:06.530464 ncdv-master-1 cinder-volume[123855]: WARNING py.warnings [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Apr 30 21:14:06.530464 ncdv-master-1 cinder-volume[123855]: debtcollector.deprecate( Apr 30 21:14:06.530464 ncdv-master-1 cinder-volume[123855]: Apr 30 21:14:06.536777 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_a5b0850f-3b24-4bcb-b0a7-351c3216b27d_22cc06wcncdv-master-1@ceph {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:14:06.705884 ncdv-master-1 sudo[133866]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_a5b0850f-3b24-4bcb-b0a7-351c3216b27d_22cc06wcncdv-master-1@ceph Apr 30 21:14:06.707382 ncdv-master-1 sudo[133866]: pam_unix(sudo:session): session opened for user root by (uid=0) Apr 30 21:14:07.097472 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8bde319-ca85-4f43-9bfb-29833a3d9f96 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:14:07.211152 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c8bde319-ca85-4f43-9bfb-29833a3d9f96 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Flow 'volume_create_manager' (65039697-030e-4b69-a1e4-98e663a9a148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:14:07.226174 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c8bde319-ca85-4f43-9bfb-29833a3d9f96 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad729465-b755-4dd0-a05d-4a30788f2038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:14:07.269782 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c8bde319-ca85-4f43-9bfb-29833a3d9f96 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad729465-b755-4dd0-a05d-4a30788f2038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-618095930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=803f05ce-fab0-45aa-af84-09c627560405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77b426139c194813974502d1910c257f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:14:07Z,use_quota=True,user_id='dadac4f61fe141dba3ee726ca6cbf29a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:14:07.281221 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c8bde319-ca85-4f43-9bfb-29833a3d9f96 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b61d9a-2d8d-446f-ba0d-1e9f4c119bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:14:07.286895 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c8bde319-ca85-4f43-9bfb-29833a3d9f96 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b61d9a-2d8d-446f-ba0d-1e9f4c119bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:14:07.293629 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c8bde319-ca85-4f43-9bfb-29833a3d9f96 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f028b96-f8cd-4589-aeb7-8fcb7dcd4ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:14:07.420309 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c8bde319-ca85-4f43-9bfb-29833a3d9f96 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f028b96-f8cd-4589-aeb7-8fcb7dcd4ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '803f05ce-fab0-45aa-af84-09c627560405', 'volume_name': 'volume-803f05ce-fab0-45aa-af84-09c627560405', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:14:07.456795 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c8bde319-ca85-4f43-9bfb-29833a3d9f96 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a25a3636-3be8-4d53-a4ef-2d589e7ccd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:14:07.461345 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c8bde319-ca85-4f43-9bfb-29833a3d9f96 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a25a3636-3be8-4d53-a4ef-2d589e7ccd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:14:07.491041 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c8bde319-ca85-4f43-9bfb-29833a3d9f96 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d807924-b9c9-4025-a087-2dba64b40707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:14:07.500571 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-c8bde319-ca85-4f43-9bfb-29833a3d9f96 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Volume 803f05ce-fab0-45aa-af84-09c627560405: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-803f05ce-fab0-45aa-af84-09c627560405', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 30 21:14:07.506831 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8bde319-ca85-4f43-9bfb-29833a3d9f96 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Cloning 803f05ce-fab0-45aa-af84-09c627560405 from image a5b0850f-3b24-4bcb-b0a7-351c3216b27d at location (None, None). {{(pid=123855) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Apr 30 21:14:08.872780 ncdv-master-1 sudo[133866]: pam_unix(sudo:session): session closed for user root Apr 30 21:14:08.875985 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_a5b0850f-3b24-4bcb-b0a7-351c3216b27d_22cc06wcncdv-master-1@ceph" returned: 0 in 2.339s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:14:08.877462 ncdv-master-1 cinder-volume[123855]: WARNING py.warnings [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Apr 30 21:14:08.877462 ncdv-master-1 cinder-volume[123855]: debtcollector.deprecate( Apr 30 21:14:08.877462 ncdv-master-1 cinder-volume[123855]: Apr 30 21:14:08.878373 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.image_utils [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] a5b0850f-3b24-4bcb-b0a7-351c3216b27d was vhdx, converting to raw {{(pid=123855) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:793}} Apr 30 21:14:08.879943 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_a5b0850f-3b24-4bcb-b0a7-351c3216b27d_22cc06wcncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpt5p7woxr {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:14:08.954942 ncdv-master-1 sudo[133890]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_a5b0850f-3b24-4bcb-b0a7-351c3216b27d_22cc06wcncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpt5p7woxr Apr 30 21:14:08.955870 ncdv-master-1 sudo[133890]: pam_unix(sudo:session): session opened for user root by (uid=0) Apr 30 21:14:12.325908 ncdv-master-1 sudo[133890]: pam_unix(sudo:session): session closed for user root Apr 30 21:14:12.327970 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_a5b0850f-3b24-4bcb-b0a7-351c3216b27d_22cc06wcncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpt5p7woxr" returned: 0 in 3.448s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:14:12.329641 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_a5b0850f-3b24-4bcb-b0a7-351c3216b27d_22cc06wcncdv-master-1@ceph {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:14:12.423854 ncdv-master-1 sudo[133945]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_a5b0850f-3b24-4bcb-b0a7-351c3216b27d_22cc06wcncdv-master-1@ceph Apr 30 21:14:12.424667 ncdv-master-1 sudo[133945]: pam_unix(sudo:session): session opened for user root by (uid=0) Apr 30 21:14:13.839108 ncdv-master-1 sudo[133945]: pam_unix(sudo:session): session closed for user root Apr 30 21:14:13.842135 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_a5b0850f-3b24-4bcb-b0a7-351c3216b27d_22cc06wcncdv-master-1@ceph" returned: 0 in 1.511s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:14:13.842878 ncdv-master-1 cinder-volume[123855]: WARNING py.warnings [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Apr 30 21:14:13.842878 ncdv-master-1 cinder-volume[123855]: debtcollector.deprecate( Apr 30 21:14:13.842878 ncdv-master-1 cinder-volume[123855]: Apr 30 21:14:13.843646 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.image_utils [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a5b0850f-3b24-4bcb-b0a7-351c3216b27d_22cc06wcncdv-master-1@ceph, size 700.00 MB, duration 3.45 sec, destination /opt/stack/data/cinder/conversion/tmpt5p7woxr {{(pid=123855) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:412}} Apr 30 21:14:13.844007 ncdv-master-1 cinder-volume[123855]: INFO cinder.image.image_utils [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Converted 700.00 MB image at 202.91 MB/s Apr 30 21:14:13.845420 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:14:14.065310 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:14:14.070566 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Volume volume-632a7810-1a6f-420a-a6fd-57675408a8f7 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:14:14.173925 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] deleting rbd volume volume-632a7810-1a6f-420a-a6fd-57675408a8f7 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:14:19.977999 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Running cmd (subprocess): rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmpt5p7woxr volume-632a7810-1a6f-420a-a6fd-57675408a8f7 --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:14:27.251283 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:14:27.251283 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:14:27.333083 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:14:27.388300 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:15:12.349803 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] CMD "rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmpt5p7woxr volume-632a7810-1a6f-420a-a6fd-57675408a8f7 --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 52.379s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:15:12.485272 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:15:13.654169 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:15:13.654927 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:15:13.655043 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.volume_utils [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Downloaded image a5b0850f-3b24-4bcb-b0a7-351c3216b27d ((None, None)) to volume 632a7810-1a6f-420a-a6fd-57675408a8f7 successfully. {{(pid=123855) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1218}} Apr 30 21:15:13.717434 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.image_utils [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Temporary image a5b0850f-3b24-4bcb-b0a7-351c3216b27d for user 8bd54cdc115e4ae9b202bd06c7658e4a is deleted. {{(pid=123855) fetch /opt/stack/cinder/cinder/image/image_utils.py:1092}} Apr 30 21:15:14.038152 ncdv-master-1 cinder-volume[123855]: WARNING cinder.quota [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Deprecated: Default quota for resource: volumes_ceph is set by the default quota flag: quota_volumes_ceph, it is now deprecated. Please use the default quota class for default quota. Apr 30 21:15:14.039014 ncdv-master-1 cinder-volume[123855]: WARNING cinder.quota [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Deprecated: Default quota for resource: gigabytes_ceph is set by the default quota flag: quota_gigabytes_ceph, it is now deprecated. Please use the default quota class for default quota. Apr 30 21:15:14.371382 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Created reservations ['2617abce-cae3-4dfa-b8a9-acace5695410', 'b0756d01-3603-46e7-914f-2457acc91e87', '74b3c5ae-4810-4d93-b8af-5229841552b5', 'bc3ff92e-e9b9-4ac6-ab54-7d06d121372c'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:15:14.385960 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Creating image volume entry: {'created_at': datetime.datetime(2022, 4, 30, 21, 13, 39, tzinfo=datetime.timezone.utc), 'volume_metadata': [], 'bootable': False, 'host': 'ncdv-master-1@ceph#ceph', 'encryption_key_id': None, 'scheduled_at': datetime.datetime(2022, 4, 30, 21, 13, 39, tzinfo=datetime.timezone.utc), 'ec2_id': None, 'deleted': False, 'deleted_at': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'service_uuid': None, 'provider_location': None, 'previous_status': None, 'launched_at': None, 'user_id': '8bd54cdc115e4ae9b202bd06c7658e4a', 'availability_zone': 'nova', 'terminated_at': None, 'metadata': {}, 'shared_targets': True, 'multiattach': False, 'provider_id': None, 'provider_geometry': None, 'replication_status': None, 'display_description': None, 'volume_type_id': '460ef46e-2bc4-423f-9bd9-e67dcd7221c3', 'replication_driver_data': None, 'group_id': None, 'updated_at': datetime.datetime(2022, 4, 30, 21, 13, 39, tzinfo=datetime.timezone.utc), 'provider_auth': None, 'consistencygroup_id': None, 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'cluster_name': None, 'size': 1, 'display_name': 'image-a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'volume_admin_metadata': [], 'replication_extended_status': None, 'attach_status': 'detached', 'status': 'creating', 'source_volid': '632a7810-1a6f-420a-a6fd-57675408a8f7'}. {{(pid=123855) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1616}} Apr 30 21:15:14.819309 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Volume reschedule parameters: False retry: None {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:15:14.857310 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Flow 'volume_create_manager' (7a85ab32-b13c-4783-9ec8-b8867a6496f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:15:14.865291 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f4501d4-930a-4dd3-8b7c-ab6e8bf6dc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:15:14.920117 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f4501d4-930a-4dd3-8b7c-ab6e8bf6dc68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='image-a5b0850f-3b24-4bcb-b0a7-351c3216b27d',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5772aef0-721f-450a-93ff-02cc6a41edcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b52e5e13b9144dfb663578766c2bac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=632a7810-1a6f-420a-a6fd-57675408a8f7,status='creating',terminated_at=None,updated_at=2022-04-30T21:13:39Z,use_quota=True,user_id='8bd54cdc115e4ae9b202bd06c7658e4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:15:14.929906 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6010512-14eb-4b5d-8250-aa3b3d06b70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:15:14.935023 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6010512-14eb-4b5d-8250-aa3b3d06b70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:15:14.940734 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e3ce1ba-4caa-456d-bedc-c6c1351cacb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:15:14.959781 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e3ce1ba-4caa-456d-bedc-c6c1351cacb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '5772aef0-721f-450a-93ff-02cc6a41edcc', 'volume_name': 'volume-5772aef0-721f-450a-93ff-02cc6a41edcc', 'volume_size': 1, 'source_volid': '632a7810-1a6f-420a-a6fd-57675408a8f7', 'source_volstatus': 'downloading'}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:15:14.965948 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03386599-6667-4952-88d7-2306f5a4656b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:15:14.970730 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03386599-6667-4952-88d7-2306f5a4656b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:15:14.980355 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e086af0-9245-4941-8807-24caeb138f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:15:14.981516 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Volume 5772aef0-721f-450a-93ff-02cc6a41edcc: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-5772aef0-721f-450a-93ff-02cc6a41edcc', 'volume_size': 1, 'source_volid': '632a7810-1a6f-420a-a6fd-57675408a8f7', 'source_volstatus': 'downloading'} Apr 30 21:15:15.035007 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:15:15.221144 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] creating snapshot='volume-5772aef0-721f-450a-93ff-02cc6a41edcc.clone_snap' {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} Apr 30 21:15:16.523419 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] cloning 'volume-632a7810-1a6f-420a-a6fd-57675408a8f7@volume-5772aef0-721f-450a-93ff-02cc6a41edcc.clone_snap' to 'volume-5772aef0-721f-450a-93ff-02cc6a41edcc' {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} Apr 30 21:15:18.444541 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Volume volume-632a7810-1a6f-420a-a6fd-57675408a8f7 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:15:18.448478 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:15:18.448478 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:15:18.821123 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] clone created successfully {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} Apr 30 21:15:18.825222 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e086af0-9245-4941-8807-24caeb138f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5772aef0-721f-450a-93ff-02cc6a41edcc', 'volume_size': 1, 'source_volid': '632a7810-1a6f-420a-a6fd-57675408a8f7', 'source_volstatus': 'downloading'}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:15:18.838866 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18d8d36d-77a2-45c0-a27d-d532b177f232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:15:18.943265 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Volume volume-5772aef0-721f-450a-93ff-02cc6a41edcc (5772aef0-721f-450a-93ff-02cc6a41edcc): created successfully Apr 30 21:15:18.948837 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18d8d36d-77a2-45c0-a27d-d532b177f232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:15:18.960833 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Flow 'volume_create_manager' (7a85ab32-b13c-4783-9ec8-b8867a6496f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:15:19.045389 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Created volume successfully. Apr 30 21:15:19.246706 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Creating new image-volume cache entry for image a5b0850f-3b24-4bcb-b0a7-351c3216b27d on ncdv-master-1@ceph#ceph {{(pid=123855) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}} Apr 30 21:15:19.366246 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] New image-volume cache entry created: {'id': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'volume_id': '5772aef0-721f-450a-93ff-02cc6a41edcc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7), 'last_used': datetime.datetime(2022, 4, 30, 21, 15, 19, 250848)}. {{(pid=123855) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}} Apr 30 21:15:19.399062 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Lock "b'cinder-a5b0850f-3b24-4bcb-b0a7-351c3216b27d'" released by "_prepare_image_cache_entry" :: held 99.491s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:15:19.399062 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.volume_utils [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Marking volume 632a7810-1a6f-420a-a6fd-57675408a8f7 as bootable. {{(pid=123855) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Apr 30 21:15:19.875116 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-c8bde319-ca85-4f43-9bfb-29833a3d9f96 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Lock "b'cinder-a5b0850f-3b24-4bcb-b0a7-351c3216b27d'" acquired by "_prepare_image_cache_entry" :: waited 72.366s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:15:19.911675 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Copying metadata from image a5b0850f-3b24-4bcb-b0a7-351c3216b27d to 632a7810-1a6f-420a-a6fd-57675408a8f7. {{(pid=123855) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Apr 30 21:15:19.912250 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Creating volume glance metadata for volume 632a7810-1a6f-420a-a6fd-57675408a8f7 backed by image a5b0850f-3b24-4bcb-b0a7-351c3216b27d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123855) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Apr 30 21:15:20.020719 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-c8bde319-ca85-4f43-9bfb-29833a3d9f96 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Found image-volume cache entry: {'id': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'volume_id': '5772aef0-721f-450a-93ff-02cc6a41edcc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7), 'last_used': datetime.datetime(2022, 4, 30, 21, 15, 19, 883371)}. {{(pid=123855) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 30 21:15:20.021696 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-c8bde319-ca85-4f43-9bfb-29833a3d9f96 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Image-volume cache entry image_update_at = 2022-04-30 21:01:07+00:00, requested image updated_at = 2022-04-30 21:01:07+00:00. {{(pid=123855) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 30 21:15:20.022511 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8bde319-ca85-4f43-9bfb-29833a3d9f96 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Found cache entry for image = a5b0850f-3b24-4bcb-b0a7-351c3216b27d on host ncdv-master-1@ceph#ceph. {{(pid=123855) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Apr 30 21:15:20.031261 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-c8bde319-ca85-4f43-9bfb-29833a3d9f96 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Lock "b'cinder-a5b0850f-3b24-4bcb-b0a7-351c3216b27d'" released by "_prepare_image_cache_entry" :: held 0.156s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:15:20.032694 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8bde319-ca85-4f43-9bfb-29833a3d9f96 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Attempting to retrieve cache entry for image = a5b0850f-3b24-4bcb-b0a7-351c3216b27d on host ncdv-master-1@ceph#ceph. {{(pid=123855) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Apr 30 21:15:20.045336 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-c8bde319-ca85-4f43-9bfb-29833a3d9f96 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Found image-volume cache entry: {'id': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'volume_id': '5772aef0-721f-450a-93ff-02cc6a41edcc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7), 'last_used': datetime.datetime(2022, 4, 30, 21, 15, 20, 40933)}. {{(pid=123855) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 30 21:15:20.046636 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-c8bde319-ca85-4f43-9bfb-29833a3d9f96 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Image-volume cache entry image_update_at = 2022-04-30 21:01:07+00:00, requested image updated_at = 2022-04-30 21:01:07+00:00. {{(pid=123855) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 30 21:15:20.048798 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8bde319-ca85-4f43-9bfb-29833a3d9f96 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Creating from source image-volume 5772aef0-721f-450a-93ff-02cc6a41edcc {{(pid=123855) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Apr 30 21:15:20.069667 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c8bde319-ca85-4f43-9bfb-29833a3d9f96 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:15:20.283276 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c8bde319-ca85-4f43-9bfb-29833a3d9f96 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] creating snapshot='volume-803f05ce-fab0-45aa-af84-09c627560405.clone_snap' {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} Apr 30 21:15:22.460455 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c8bde319-ca85-4f43-9bfb-29833a3d9f96 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] cloning 'volume-5772aef0-721f-450a-93ff-02cc6a41edcc@volume-803f05ce-fab0-45aa-af84-09c627560405.clone_snap' to 'volume-803f05ce-fab0-45aa-af84-09c627560405' {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} Apr 30 21:15:22.565349 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eec86d1-146d-4b51-a285-5b7ad3c92f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-632a7810-1a6f-420a-a6fd-57675408a8f7', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:15:22.575029 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13e4ec02-adc1-4f0f-a4a6-c9d52bb3310e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:15:22.701920 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Volume volume-632a7810-1a6f-420a-a6fd-57675408a8f7 (632a7810-1a6f-420a-a6fd-57675408a8f7): created successfully Apr 30 21:15:22.712562 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13e4ec02-adc1-4f0f-a4a6-c9d52bb3310e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:15:22.745929 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Flow 'volume_create_manager' (2c69b8c9-c1ce-4527-baa7-2d2c3fa545d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:15:22.836053 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-8b4251cc-a423-42ac-809c-60cea75756ce tempest-LiveMigrationTest-1354815034 None] Created volume successfully. Apr 30 21:15:24.534953 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c8bde319-ca85-4f43-9bfb-29833a3d9f96 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Volume volume-632a7810-1a6f-420a-a6fd-57675408a8f7 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:15:24.539580 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c8bde319-ca85-4f43-9bfb-29833a3d9f96 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:15:24.539967 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c8bde319-ca85-4f43-9bfb-29833a3d9f96 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:15:25.179590 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c8bde319-ca85-4f43-9bfb-29833a3d9f96 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] clone created successfully {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} Apr 30 21:15:25.194249 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.volume_utils [None req-c8bde319-ca85-4f43-9bfb-29833a3d9f96 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Marking volume 803f05ce-fab0-45aa-af84-09c627560405 as bootable. {{(pid=123855) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Apr 30 21:15:25.389196 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8bde319-ca85-4f43-9bfb-29833a3d9f96 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Copying metadata from image a5b0850f-3b24-4bcb-b0a7-351c3216b27d to 803f05ce-fab0-45aa-af84-09c627560405. {{(pid=123855) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Apr 30 21:15:25.390043 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8bde319-ca85-4f43-9bfb-29833a3d9f96 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Creating volume glance metadata for volume 803f05ce-fab0-45aa-af84-09c627560405 backed by image a5b0850f-3b24-4bcb-b0a7-351c3216b27d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123855) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Apr 30 21:15:25.548635 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c8bde319-ca85-4f43-9bfb-29833a3d9f96 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d807924-b9c9-4025-a087-2dba64b40707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-803f05ce-fab0-45aa-af84-09c627560405', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:15:25.558011 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c8bde319-ca85-4f43-9bfb-29833a3d9f96 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b185cbc-a72c-4b6e-a840-4d60efbfafd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:15:25.654713 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-c8bde319-ca85-4f43-9bfb-29833a3d9f96 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Volume volume-803f05ce-fab0-45aa-af84-09c627560405 (803f05ce-fab0-45aa-af84-09c627560405): created successfully Apr 30 21:15:25.663637 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c8bde319-ca85-4f43-9bfb-29833a3d9f96 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b185cbc-a72c-4b6e-a840-4d60efbfafd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:15:25.674595 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c8bde319-ca85-4f43-9bfb-29833a3d9f96 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Flow 'volume_create_manager' (65039697-030e-4b69-a1e4-98e663a9a148) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:15:25.750964 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-c8bde319-ca85-4f43-9bfb-29833a3d9f96 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Created volume successfully. Apr 30 21:15:27.246261 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:15:27.248269 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:15:27.334517 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:15:27.404056 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:15:29.964156 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-77b6d42a-57ce-4017-9ad9-b42033c8113a req-d1120a13-0c09-4b40-8420-99acc42bc5f3 tempest-LiveMigrationTest-1354815034 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:15:31.226996 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-77b6d42a-57ce-4017-9ad9-b42033c8113a req-d1120a13-0c09-4b40-8420-99acc42bc5f3 tempest-LiveMigrationTest-1354815034 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.261s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:15:31.226996 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-77b6d42a-57ce-4017-9ad9-b42033c8113a req-d1120a13-0c09-4b40-8420-99acc42bc5f3 tempest-LiveMigrationTest-1354815034 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-632a7810-1a6f-420a-a6fd-57675408a8f7', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': '632a7810-1a6f-420a-a6fd-57675408a8f7', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:15:31.368371 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-77b6d42a-57ce-4017-9ad9-b42033c8113a req-d1120a13-0c09-4b40-8420-99acc42bc5f3 tempest-LiveMigrationTest-1354815034 None] Connection info returned from driver {'name': 'volumes/volume-632a7810-1a6f-420a-a6fd-57675408a8f7', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '632a7810-1a6f-420a-a6fd-57675408a8f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c5ad5db5-cf5b-4199-9ba4-290331249f5c'} {{(pid=123855) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Apr 30 21:15:31.469781 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-77b6d42a-57ce-4017-9ad9-b42033c8113a req-d1120a13-0c09-4b40-8420-99acc42bc5f3 tempest-LiveMigrationTest-1354815034 None] attachment_update completed successfully. Apr 30 21:15:32.081359 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-3c64ec55-82a1-4087-9ae5-6eb28f4a7f46 req-f2dafc3b-a812-4529-930d-6f414479d88d tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:15:32.744099 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-3c64ec55-82a1-4087-9ae5-6eb28f4a7f46 req-f2dafc3b-a812-4529-930d-6f414479d88d tempest-LiveAutoBlockMigrationV225Test-1505936978 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.663s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:15:32.744909 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-3c64ec55-82a1-4087-9ae5-6eb28f4a7f46 req-f2dafc3b-a812-4529-930d-6f414479d88d tempest-LiveAutoBlockMigrationV225Test-1505936978 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-803f05ce-fab0-45aa-af84-09c627560405', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': '803f05ce-fab0-45aa-af84-09c627560405', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:15:32.857848 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-3c64ec55-82a1-4087-9ae5-6eb28f4a7f46 req-f2dafc3b-a812-4529-930d-6f414479d88d tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Connection info returned from driver {'name': 'volumes/volume-803f05ce-fab0-45aa-af84-09c627560405', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '803f05ce-fab0-45aa-af84-09c627560405', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '27fbf1cd-206e-43d0-84b7-b62a4163a2b0'} {{(pid=123855) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Apr 30 21:15:33.034285 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-3c64ec55-82a1-4087-9ae5-6eb28f4a7f46 req-f2dafc3b-a812-4529-930d-6f414479d88d tempest-LiveAutoBlockMigrationV225Test-1505936978 None] attachment_update completed successfully. Apr 30 21:16:06.498837 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-d12d583f-5b53-4c75-a0fc-adaec432895d req-b7c2c8ac-476d-47fd-9bd8-ecbb08c94f79 tempest-LiveMigrationTest-343940872 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:16:06.824435 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-526a5a3e-488c-4851-8f34-564048639cae req-d62d2cd0-20d9-4342-ba5d-fab9c3bbc35f tempest-LiveAutoBlockMigrationV225Test-718230883 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:16:07.590946 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-d12d583f-5b53-4c75-a0fc-adaec432895d req-b7c2c8ac-476d-47fd-9bd8-ecbb08c94f79 tempest-LiveMigrationTest-343940872 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.090s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:16:07.590946 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-d12d583f-5b53-4c75-a0fc-adaec432895d req-b7c2c8ac-476d-47fd-9bd8-ecbb08c94f79 tempest-LiveMigrationTest-343940872 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-632a7810-1a6f-420a-a6fd-57675408a8f7', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': '632a7810-1a6f-420a-a6fd-57675408a8f7', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:16:07.736445 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-d12d583f-5b53-4c75-a0fc-adaec432895d req-b7c2c8ac-476d-47fd-9bd8-ecbb08c94f79 tempest-LiveMigrationTest-343940872 None] Connection info returned from driver {'name': 'volumes/volume-632a7810-1a6f-420a-a6fd-57675408a8f7', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '632a7810-1a6f-420a-a6fd-57675408a8f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'eadc63d7-ac11-4887-8616-d8bc82afcd8d'} {{(pid=123855) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Apr 30 21:16:07.909405 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-d12d583f-5b53-4c75-a0fc-adaec432895d req-b7c2c8ac-476d-47fd-9bd8-ecbb08c94f79 tempest-LiveMigrationTest-343940872 None] attachment_update completed successfully. Apr 30 21:16:07.985832 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-526a5a3e-488c-4851-8f34-564048639cae req-d62d2cd0-20d9-4342-ba5d-fab9c3bbc35f tempest-LiveAutoBlockMigrationV225Test-718230883 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.162s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:16:07.986568 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-526a5a3e-488c-4851-8f34-564048639cae req-d62d2cd0-20d9-4342-ba5d-fab9c3bbc35f tempest-LiveAutoBlockMigrationV225Test-718230883 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-803f05ce-fab0-45aa-af84-09c627560405', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': '803f05ce-fab0-45aa-af84-09c627560405', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:16:08.161051 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-526a5a3e-488c-4851-8f34-564048639cae req-d62d2cd0-20d9-4342-ba5d-fab9c3bbc35f tempest-LiveAutoBlockMigrationV225Test-718230883 None] Connection info returned from driver {'name': 'volumes/volume-803f05ce-fab0-45aa-af84-09c627560405', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '803f05ce-fab0-45aa-af84-09c627560405', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '66cddf1c-dbbc-4822-9a1c-11ebd7665bdc'} {{(pid=123855) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Apr 30 21:16:08.352723 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-526a5a3e-488c-4851-8f34-564048639cae req-d62d2cd0-20d9-4342-ba5d-fab9c3bbc35f tempest-LiveAutoBlockMigrationV225Test-718230883 None] attachment_update completed successfully. Apr 30 21:16:20.570421 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-526a5a3e-488c-4851-8f34-564048639cae req-0ed0150d-c1eb-42d7-af5f-b5d19a3ad417 tempest-LiveAutoBlockMigrationV225Test-718230883 None] Terminate volume connection completed successfully. Apr 30 21:16:20.571126 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-526a5a3e-488c-4851-8f34-564048639cae req-0ed0150d-c1eb-42d7-af5f-b5d19a3ad417 tempest-LiveAutoBlockMigrationV225Test-718230883 None] Deleting attachment 27fbf1cd-206e-43d0-84b7-b62a4163a2b0. {{(pid=123855) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} Apr 30 21:16:21.693140 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-d12d583f-5b53-4c75-a0fc-adaec432895d req-1c3e6bc7-6d2a-4ef4-9322-afdfb829bd96 tempest-LiveMigrationTest-343940872 None] Terminate volume connection completed successfully. Apr 30 21:16:21.693860 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-d12d583f-5b53-4c75-a0fc-adaec432895d req-1c3e6bc7-6d2a-4ef4-9322-afdfb829bd96 tempest-LiveMigrationTest-343940872 None] Deleting attachment c5ad5db5-cf5b-4199-9ba4-290331249f5c. {{(pid=123855) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} Apr 30 21:16:27.248972 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:16:27.250307 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:16:27.300404 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:16:27.362930 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:16:29.038446 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-32c95c27-c36d-4e4b-8416-f45ec4bb403e req-ae43c84d-b2ba-4466-a3bb-67e4f34b60f2 tempest-LiveMigrationTest-1354815034 None] Terminate volume connection completed successfully. Apr 30 21:16:29.039116 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-32c95c27-c36d-4e4b-8416-f45ec4bb403e req-ae43c84d-b2ba-4466-a3bb-67e4f34b60f2 tempest-LiveMigrationTest-1354815034 None] Deleting attachment eadc63d7-ac11-4887-8616-d8bc82afcd8d. {{(pid=123855) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} Apr 30 21:16:29.503140 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [req-32c95c27-c36d-4e4b-8416-f45ec4bb403e req-e374ec02-a070-4a06-af56-4ceac0421693 tempest-LiveMigrationTest-1354815034 None] Lock "b'cinder-632a7810-1a6f-420a-a6fd-57675408a8f7-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:16:29.696201 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-32c95c27-c36d-4e4b-8416-f45ec4bb403e req-e374ec02-a070-4a06-af56-4ceac0421693 tempest-LiveMigrationTest-1354815034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:16:30.097607 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-32c95c27-c36d-4e4b-8416-f45ec4bb403e req-e374ec02-a070-4a06-af56-4ceac0421693 tempest-LiveMigrationTest-1354815034 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:16:30.098257 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-32c95c27-c36d-4e4b-8416-f45ec4bb403e req-e374ec02-a070-4a06-af56-4ceac0421693 tempest-LiveMigrationTest-1354815034 None] volume has clone snapshot(s) {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1285}} Apr 30 21:16:30.099466 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-32c95c27-c36d-4e4b-8416-f45ec4bb403e req-e374ec02-a070-4a06-af56-4ceac0421693 tempest-LiveMigrationTest-1354815034 None] Volume volume-632a7810-1a6f-420a-a6fd-57675408a8f7 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:16:31.032878 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-00ed0255-8c48-4d3a-b3ee-cc5825fbc58f tempest-LiveMigrationTest-1354815034 None] Lock "b'cinder-8b53e786-98d2-47b8-a116-d63bdd9029d1-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:16:31.202814 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-00ed0255-8c48-4d3a-b3ee-cc5825fbc58f tempest-LiveMigrationTest-1354815034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:16:31.406991 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-00ed0255-8c48-4d3a-b3ee-cc5825fbc58f tempest-LiveMigrationTest-1354815034 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:16:31.407474 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-00ed0255-8c48-4d3a-b3ee-cc5825fbc58f tempest-LiveMigrationTest-1354815034 None] Volume volume-8b53e786-98d2-47b8-a116-d63bdd9029d1 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:16:31.680941 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-00ed0255-8c48-4d3a-b3ee-cc5825fbc58f tempest-LiveMigrationTest-1354815034 None] deleting rbd volume volume-8b53e786-98d2-47b8-a116-d63bdd9029d1 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:16:32.442605 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [req-32c95c27-c36d-4e4b-8416-f45ec4bb403e req-e374ec02-a070-4a06-af56-4ceac0421693 tempest-LiveMigrationTest-1354815034 None] Created reservations ['78dab1a7-1e14-49f6-b4de-c8861d8bbcd2', '7e3a64a0-3095-471a-a0aa-d0cca9a4e998', 'ecf93245-5855-40ea-ab07-e7705f44114a', 'b3d71802-fda6-4da2-a0e6-9398258075a1'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:16:32.715789 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-32c95c27-c36d-4e4b-8416-f45ec4bb403e req-e374ec02-a070-4a06-af56-4ceac0421693 tempest-LiveMigrationTest-1354815034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:16:32.804944 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-32c95c27-c36d-4e4b-8416-f45ec4bb403e req-e374ec02-a070-4a06-af56-4ceac0421693 tempest-LiveMigrationTest-1354815034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:16:32.920481 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [req-32c95c27-c36d-4e4b-8416-f45ec4bb403e req-e374ec02-a070-4a06-af56-4ceac0421693 tempest-LiveMigrationTest-1354815034 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:16:32.940795 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-32c95c27-c36d-4e4b-8416-f45ec4bb403e req-e374ec02-a070-4a06-af56-4ceac0421693 tempest-LiveMigrationTest-1354815034 None] Deleted volume successfully. Apr 30 21:16:33.038111 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [req-32c95c27-c36d-4e4b-8416-f45ec4bb403e req-e374ec02-a070-4a06-af56-4ceac0421693 tempest-LiveMigrationTest-1354815034 None] Lock "b'cinder-632a7810-1a6f-420a-a6fd-57675408a8f7-delete_volume'" released by "delete_volume" :: held 3.535s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:16:33.314863 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-2e19b65d-008e-4925-825c-22aac4ddbe7b req-b6d62a85-c222-4d47-a0f3-291c21d2a047 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Terminate volume connection completed successfully. Apr 30 21:16:33.316471 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-2e19b65d-008e-4925-825c-22aac4ddbe7b req-b6d62a85-c222-4d47-a0f3-291c21d2a047 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Deleting attachment 66cddf1c-dbbc-4822-9a1c-11ebd7665bdc. {{(pid=123855) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} Apr 30 21:16:33.794358 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [req-2e19b65d-008e-4925-825c-22aac4ddbe7b req-d9cc2f18-0753-4975-a0b5-3f31495a3812 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Lock "b'cinder-803f05ce-fab0-45aa-af84-09c627560405-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:16:33.996627 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-2e19b65d-008e-4925-825c-22aac4ddbe7b req-d9cc2f18-0753-4975-a0b5-3f31495a3812 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:16:34.320628 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-2e19b65d-008e-4925-825c-22aac4ddbe7b req-d9cc2f18-0753-4975-a0b5-3f31495a3812 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:16:34.676274 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-2e19b65d-008e-4925-825c-22aac4ddbe7b req-d9cc2f18-0753-4975-a0b5-3f31495a3812 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] deleting rbd volume volume-803f05ce-fab0-45aa-af84-09c627560405 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:16:35.386715 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-882d6867-e690-449f-8bb6-fcd2a08df6a9 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Lock "b'cinder-faff6da0-9c40-4fee-bd74-c45260d3e9a2-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:16:35.519891 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-882d6867-e690-449f-8bb6-fcd2a08df6a9 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:16:35.744170 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-882d6867-e690-449f-8bb6-fcd2a08df6a9 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:16:35.744702 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-882d6867-e690-449f-8bb6-fcd2a08df6a9 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Volume volume-faff6da0-9c40-4fee-bd74-c45260d3e9a2 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:16:36.116671 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-882d6867-e690-449f-8bb6-fcd2a08df6a9 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] deleting rbd volume volume-faff6da0-9c40-4fee-bd74-c45260d3e9a2 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:16:37.224108 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-00ed0255-8c48-4d3a-b3ee-cc5825fbc58f tempest-LiveMigrationTest-1354815034 None] Created reservations ['2a0d79d3-8af9-4d4f-9838-a8386d080193', 'e9d3f08c-f2dd-46d1-9909-690ab547bcf6', 'c7f9ecf5-8d53-464e-ad60-e9801443290e', 'c282c861-9e98-4da3-ac56-2732cb3035b7'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:16:37.464387 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-00ed0255-8c48-4d3a-b3ee-cc5825fbc58f tempest-LiveMigrationTest-1354815034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:16:37.500912 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-00ed0255-8c48-4d3a-b3ee-cc5825fbc58f tempest-LiveMigrationTest-1354815034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:16:37.564927 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-00ed0255-8c48-4d3a-b3ee-cc5825fbc58f tempest-LiveMigrationTest-1354815034 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:16:37.569679 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-00ed0255-8c48-4d3a-b3ee-cc5825fbc58f tempest-LiveMigrationTest-1354815034 None] Deleted volume successfully. Apr 30 21:16:37.650933 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-00ed0255-8c48-4d3a-b3ee-cc5825fbc58f tempest-LiveMigrationTest-1354815034 None] Lock "b'cinder-8b53e786-98d2-47b8-a116-d63bdd9029d1-delete_volume'" released by "delete_volume" :: held 6.618s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:16:42.913707 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-2e19b65d-008e-4925-825c-22aac4ddbe7b req-d9cc2f18-0753-4975-a0b5-3f31495a3812 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] volume is a clone so cleaning references {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} Apr 30 21:16:43.309647 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-2e19b65d-008e-4925-825c-22aac4ddbe7b req-d9cc2f18-0753-4975-a0b5-3f31495a3812 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] deleting parent snapshot volume-803f05ce-fab0-45aa-af84-09c627560405.clone_snap {{(pid=123855) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} Apr 30 21:16:46.730811 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-8de82937-a4c6-462a-aa58-1968ec1ace1d tempest-ServersTestBootFromVolume-307388374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:16:46.771630 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8de82937-a4c6-462a-aa58-1968ec1ace1d tempest-ServersTestBootFromVolume-307388374 None] Flow 'volume_create_manager' (c9fbdedf-b2bb-4d9c-bbd0-bf2c1cfeb70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:16:46.794860 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8de82937-a4c6-462a-aa58-1968ec1ace1d tempest-ServersTestBootFromVolume-307388374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81701f53-e024-4546-84c4-bf9b896c73a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:16:46.829373 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8de82937-a4c6-462a-aa58-1968ec1ace1d tempest-ServersTestBootFromVolume-307388374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81701f53-e024-4546-84c4-bf9b896c73a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:16:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-462068231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6639f2c6-65d9-49ac-ba19-1bfddc2cceae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c121a94ec3445baa05dcaa3dc22af2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:16:43Z,use_quota=True,user_id='5df6ea2992c04a97af023bfb428ac44e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:16:46.848915 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8de82937-a4c6-462a-aa58-1968ec1ace1d tempest-ServersTestBootFromVolume-307388374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f6d1d4-36e7-41da-b142-5b0a106ad458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:16:46.860350 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8de82937-a4c6-462a-aa58-1968ec1ace1d tempest-ServersTestBootFromVolume-307388374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f6d1d4-36e7-41da-b142-5b0a106ad458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:16:46.873341 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8de82937-a4c6-462a-aa58-1968ec1ace1d tempest-ServersTestBootFromVolume-307388374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4da7865a-a586-4fa1-912e-eddd9e04e4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:16:46.945361 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [req-2e19b65d-008e-4925-825c-22aac4ddbe7b req-d9cc2f18-0753-4975-a0b5-3f31495a3812 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Created reservations ['0d6891a6-d829-4de5-9b00-09447685d9db', '268ec59b-5cf4-4524-b45f-5c6aa6a012ef', '1489df6a-7535-4502-8982-128691bbb85a', '67e0a1f1-8fed-42a2-8023-bcc70eb92b32'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:16:47.063896 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8de82937-a4c6-462a-aa58-1968ec1ace1d tempest-ServersTestBootFromVolume-307388374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4da7865a-a586-4fa1-912e-eddd9e04e4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6639f2c6-65d9-49ac-ba19-1bfddc2cceae', 'volume_name': 'volume-6639f2c6-65d9-49ac-ba19-1bfddc2cceae', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:16:47.081332 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8de82937-a4c6-462a-aa58-1968ec1ace1d tempest-ServersTestBootFromVolume-307388374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffee6466-f232-40f4-9661-2d1e6d3b2311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:16:47.093547 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8de82937-a4c6-462a-aa58-1968ec1ace1d tempest-ServersTestBootFromVolume-307388374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffee6466-f232-40f4-9661-2d1e6d3b2311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:16:47.108459 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8de82937-a4c6-462a-aa58-1968ec1ace1d tempest-ServersTestBootFromVolume-307388374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8ebc423-74cf-47e2-bbc3-3c1ba741b6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:16:47.110133 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-8de82937-a4c6-462a-aa58-1968ec1ace1d tempest-ServersTestBootFromVolume-307388374 None] Volume 6639f2c6-65d9-49ac-ba19-1bfddc2cceae: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6639f2c6-65d9-49ac-ba19-1bfddc2cceae', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 30 21:16:47.112193 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-8de82937-a4c6-462a-aa58-1968ec1ace1d tempest-ServersTestBootFromVolume-307388374 None] Cloning 6639f2c6-65d9-49ac-ba19-1bfddc2cceae from image a5b0850f-3b24-4bcb-b0a7-351c3216b27d at location (None, None). {{(pid=123855) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Apr 30 21:16:47.129173 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-882d6867-e690-449f-8bb6-fcd2a08df6a9 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Created reservations ['7a476952-8bcd-4344-8ac2-f5fcdc046362', '50b7d3d2-a573-4325-9763-23a261b79027', '8f04d2a8-3884-4ca1-a296-f10106e700f6', 'b82bc1b5-85ff-42e7-9a27-7cf62a6766a3'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:16:47.196465 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-8de82937-a4c6-462a-aa58-1968ec1ace1d tempest-ServersTestBootFromVolume-307388374 None] Lock "b'cinder-a5b0850f-3b24-4bcb-b0a7-351c3216b27d'" acquired by "_prepare_image_cache_entry" :: waited 0.083s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:16:47.315181 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-8de82937-a4c6-462a-aa58-1968ec1ace1d tempest-ServersTestBootFromVolume-307388374 None] Found image-volume cache entry: {'id': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'volume_id': '5772aef0-721f-450a-93ff-02cc6a41edcc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7), 'last_used': datetime.datetime(2022, 4, 30, 21, 16, 47, 207102)}. {{(pid=123855) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 30 21:16:47.315787 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-8de82937-a4c6-462a-aa58-1968ec1ace1d tempest-ServersTestBootFromVolume-307388374 None] Image-volume cache entry image_update_at = 2022-04-30 21:01:07+00:00, requested image updated_at = 2022-04-30 21:01:07+00:00. {{(pid=123855) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 30 21:16:47.316284 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-8de82937-a4c6-462a-aa58-1968ec1ace1d tempest-ServersTestBootFromVolume-307388374 None] Found cache entry for image = a5b0850f-3b24-4bcb-b0a7-351c3216b27d on host ncdv-master-1@ceph#ceph. {{(pid=123855) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Apr 30 21:16:47.324874 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-8de82937-a4c6-462a-aa58-1968ec1ace1d tempest-ServersTestBootFromVolume-307388374 None] Lock "b'cinder-a5b0850f-3b24-4bcb-b0a7-351c3216b27d'" released by "_prepare_image_cache_entry" :: held 0.128s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:16:47.325945 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-8de82937-a4c6-462a-aa58-1968ec1ace1d tempest-ServersTestBootFromVolume-307388374 None] Attempting to retrieve cache entry for image = a5b0850f-3b24-4bcb-b0a7-351c3216b27d on host ncdv-master-1@ceph#ceph. {{(pid=123855) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Apr 30 21:16:47.348671 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-8de82937-a4c6-462a-aa58-1968ec1ace1d tempest-ServersTestBootFromVolume-307388374 None] Found image-volume cache entry: {'id': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'volume_id': '5772aef0-721f-450a-93ff-02cc6a41edcc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7), 'last_used': datetime.datetime(2022, 4, 30, 21, 16, 47, 331066)}. {{(pid=123855) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 30 21:16:47.354825 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-8de82937-a4c6-462a-aa58-1968ec1ace1d tempest-ServersTestBootFromVolume-307388374 None] Image-volume cache entry image_update_at = 2022-04-30 21:01:07+00:00, requested image updated_at = 2022-04-30 21:01:07+00:00. {{(pid=123855) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 30 21:16:47.355348 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-8de82937-a4c6-462a-aa58-1968ec1ace1d tempest-ServersTestBootFromVolume-307388374 None] Creating from source image-volume 5772aef0-721f-450a-93ff-02cc6a41edcc {{(pid=123855) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Apr 30 21:16:47.378552 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8de82937-a4c6-462a-aa58-1968ec1ace1d tempest-ServersTestBootFromVolume-307388374 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:16:47.603955 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8de82937-a4c6-462a-aa58-1968ec1ace1d tempest-ServersTestBootFromVolume-307388374 None] creating snapshot='volume-6639f2c6-65d9-49ac-ba19-1bfddc2cceae.clone_snap' {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} Apr 30 21:16:48.845552 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8de82937-a4c6-462a-aa58-1968ec1ace1d tempest-ServersTestBootFromVolume-307388374 None] cloning 'volume-5772aef0-721f-450a-93ff-02cc6a41edcc@volume-6639f2c6-65d9-49ac-ba19-1bfddc2cceae.clone_snap' to 'volume-6639f2c6-65d9-49ac-ba19-1bfddc2cceae' {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} Apr 30 21:16:48.861065 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-2e19b65d-008e-4925-825c-22aac4ddbe7b req-d9cc2f18-0753-4975-a0b5-3f31495a3812 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:16:48.980575 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-2e19b65d-008e-4925-825c-22aac4ddbe7b req-d9cc2f18-0753-4975-a0b5-3f31495a3812 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:16:49.048525 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [req-2e19b65d-008e-4925-825c-22aac4ddbe7b req-d9cc2f18-0753-4975-a0b5-3f31495a3812 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:16:49.065167 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-2e19b65d-008e-4925-825c-22aac4ddbe7b req-d9cc2f18-0753-4975-a0b5-3f31495a3812 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Deleted volume successfully. Apr 30 21:16:49.147873 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [req-2e19b65d-008e-4925-825c-22aac4ddbe7b req-d9cc2f18-0753-4975-a0b5-3f31495a3812 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Lock "b'cinder-803f05ce-fab0-45aa-af84-09c627560405-delete_volume'" released by "delete_volume" :: held 15.354s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:16:49.182875 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-882d6867-e690-449f-8bb6-fcd2a08df6a9 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:16:49.272755 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-882d6867-e690-449f-8bb6-fcd2a08df6a9 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:16:49.359763 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-882d6867-e690-449f-8bb6-fcd2a08df6a9 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:16:49.363694 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-882d6867-e690-449f-8bb6-fcd2a08df6a9 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Deleted volume successfully. Apr 30 21:16:49.474433 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-882d6867-e690-449f-8bb6-fcd2a08df6a9 tempest-LiveAutoBlockMigrationV225Test-1505936978 None] Lock "b'cinder-faff6da0-9c40-4fee-bd74-c45260d3e9a2-delete_volume'" released by "delete_volume" :: held 14.087s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:16:50.171675 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8de82937-a4c6-462a-aa58-1968ec1ace1d tempest-ServersTestBootFromVolume-307388374 None] Volume volume-632a7810-1a6f-420a-a6fd-57675408a8f7.deleted is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:16:50.172961 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8de82937-a4c6-462a-aa58-1968ec1ace1d tempest-ServersTestBootFromVolume-307388374 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:16:50.173334 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8de82937-a4c6-462a-aa58-1968ec1ace1d tempest-ServersTestBootFromVolume-307388374 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:16:50.535051 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8de82937-a4c6-462a-aa58-1968ec1ace1d tempest-ServersTestBootFromVolume-307388374 None] clone created successfully {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} Apr 30 21:16:50.535811 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.volume_utils [None req-8de82937-a4c6-462a-aa58-1968ec1ace1d tempest-ServersTestBootFromVolume-307388374 None] Marking volume 6639f2c6-65d9-49ac-ba19-1bfddc2cceae as bootable. {{(pid=123855) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Apr 30 21:16:50.632766 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-8de82937-a4c6-462a-aa58-1968ec1ace1d tempest-ServersTestBootFromVolume-307388374 None] Copying metadata from image a5b0850f-3b24-4bcb-b0a7-351c3216b27d to 6639f2c6-65d9-49ac-ba19-1bfddc2cceae. {{(pid=123855) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Apr 30 21:16:50.633195 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-8de82937-a4c6-462a-aa58-1968ec1ace1d tempest-ServersTestBootFromVolume-307388374 None] Creating volume glance metadata for volume 6639f2c6-65d9-49ac-ba19-1bfddc2cceae backed by image a5b0850f-3b24-4bcb-b0a7-351c3216b27d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123855) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Apr 30 21:16:50.775628 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8de82937-a4c6-462a-aa58-1968ec1ace1d tempest-ServersTestBootFromVolume-307388374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8ebc423-74cf-47e2-bbc3-3c1ba741b6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6639f2c6-65d9-49ac-ba19-1bfddc2cceae', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:16:50.780688 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8de82937-a4c6-462a-aa58-1968ec1ace1d tempest-ServersTestBootFromVolume-307388374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ed72e33-bd38-41d1-8678-c04cb4098e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:16:50.897547 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-8de82937-a4c6-462a-aa58-1968ec1ace1d tempest-ServersTestBootFromVolume-307388374 None] Volume volume-6639f2c6-65d9-49ac-ba19-1bfddc2cceae (6639f2c6-65d9-49ac-ba19-1bfddc2cceae): created successfully Apr 30 21:16:50.905602 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8de82937-a4c6-462a-aa58-1968ec1ace1d tempest-ServersTestBootFromVolume-307388374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ed72e33-bd38-41d1-8678-c04cb4098e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:16:50.917984 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8de82937-a4c6-462a-aa58-1968ec1ace1d tempest-ServersTestBootFromVolume-307388374 None] Flow 'volume_create_manager' (c9fbdedf-b2bb-4d9c-bbd0-bf2c1cfeb70a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:16:51.047220 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-8de82937-a4c6-462a-aa58-1968ec1ace1d tempest-ServersTestBootFromVolume-307388374 None] Created volume successfully. Apr 30 21:16:52.693068 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-74694d20-b27e-491b-ad27-9a48f861c890 tempest-AttachSCSIVolumeTestJSON-1824069812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:16:52.764395 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-74694d20-b27e-491b-ad27-9a48f861c890 tempest-AttachSCSIVolumeTestJSON-1824069812 None] Flow 'volume_create_manager' (ad2c836e-f3bb-42eb-93a7-98f00d0c7932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:16:52.786724 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-74694d20-b27e-491b-ad27-9a48f861c890 tempest-AttachSCSIVolumeTestJSON-1824069812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a30c025-8b1e-422e-b49e-07446e3daa28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:16:52.815934 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-74694d20-b27e-491b-ad27-9a48f861c890 tempest-AttachSCSIVolumeTestJSON-1824069812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a30c025-8b1e-422e-b49e-07446e3daa28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1707382058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ea6253ad-6d59-440c-8c15-4350734c723a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6309fd24cb2e4a5d8fde4f457d529d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:16:52Z,use_quota=True,user_id='8c1eeba696174da1be8aba8dcce6b112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:16:52.821927 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-74694d20-b27e-491b-ad27-9a48f861c890 tempest-AttachSCSIVolumeTestJSON-1824069812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (674edaea-d5ec-47d6-951b-868f0f9e8664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:16:52.826820 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-74694d20-b27e-491b-ad27-9a48f861c890 tempest-AttachSCSIVolumeTestJSON-1824069812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (674edaea-d5ec-47d6-951b-868f0f9e8664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:16:52.832971 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-74694d20-b27e-491b-ad27-9a48f861c890 tempest-AttachSCSIVolumeTestJSON-1824069812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03e0ae88-3f29-490c-a111-e96afe99e32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:16:52.837529 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-74694d20-b27e-491b-ad27-9a48f861c890 tempest-AttachSCSIVolumeTestJSON-1824069812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03e0ae88-3f29-490c-a111-e96afe99e32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea6253ad-6d59-440c-8c15-4350734c723a', 'volume_name': 'volume-ea6253ad-6d59-440c-8c15-4350734c723a', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:16:52.844358 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-74694d20-b27e-491b-ad27-9a48f861c890 tempest-AttachSCSIVolumeTestJSON-1824069812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (341c95d5-6aea-4fe3-ae91-7866745337e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:16:52.849548 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-74694d20-b27e-491b-ad27-9a48f861c890 tempest-AttachSCSIVolumeTestJSON-1824069812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (341c95d5-6aea-4fe3-ae91-7866745337e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:16:52.855946 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-74694d20-b27e-491b-ad27-9a48f861c890 tempest-AttachSCSIVolumeTestJSON-1824069812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c4d62ab-08a2-41b7-a030-1b0659aa1935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:16:52.863151 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-74694d20-b27e-491b-ad27-9a48f861c890 tempest-AttachSCSIVolumeTestJSON-1824069812 None] Volume ea6253ad-6d59-440c-8c15-4350734c723a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea6253ad-6d59-440c-8c15-4350734c723a', 'volume_size': 1} Apr 30 21:16:52.863869 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-74694d20-b27e-491b-ad27-9a48f861c890 tempest-AttachSCSIVolumeTestJSON-1824069812 None] creating volume 'volume-ea6253ad-6d59-440c-8c15-4350734c723a' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:16:52.864871 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-74694d20-b27e-491b-ad27-9a48f861c890 tempest-AttachSCSIVolumeTestJSON-1824069812 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:16:53.815057 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-74694d20-b27e-491b-ad27-9a48f861c890 tempest-AttachSCSIVolumeTestJSON-1824069812 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:16:53.818645 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-74694d20-b27e-491b-ad27-9a48f861c890 tempest-AttachSCSIVolumeTestJSON-1824069812 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:16:53.823300 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-74694d20-b27e-491b-ad27-9a48f861c890 tempest-AttachSCSIVolumeTestJSON-1824069812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c4d62ab-08a2-41b7-a030-1b0659aa1935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea6253ad-6d59-440c-8c15-4350734c723a', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:16:53.829520 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-74694d20-b27e-491b-ad27-9a48f861c890 tempest-AttachSCSIVolumeTestJSON-1824069812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d84ecf44-85df-43e2-9635-904e0ef5d8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:16:53.915292 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-74694d20-b27e-491b-ad27-9a48f861c890 tempest-AttachSCSIVolumeTestJSON-1824069812 None] Volume volume-ea6253ad-6d59-440c-8c15-4350734c723a (ea6253ad-6d59-440c-8c15-4350734c723a): created successfully Apr 30 21:16:53.922629 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-74694d20-b27e-491b-ad27-9a48f861c890 tempest-AttachSCSIVolumeTestJSON-1824069812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d84ecf44-85df-43e2-9635-904e0ef5d8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:16:53.938096 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-74694d20-b27e-491b-ad27-9a48f861c890 tempest-AttachSCSIVolumeTestJSON-1824069812 None] Flow 'volume_create_manager' (ad2c836e-f3bb-42eb-93a7-98f00d0c7932) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:16:54.085646 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-74694d20-b27e-491b-ad27-9a48f861c890 tempest-AttachSCSIVolumeTestJSON-1824069812 None] Created volume successfully. Apr 30 21:16:56.477004 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-1b0d426e-5a3a-4c43-8e1d-34fdb0684bfc req-e2f8403a-cd1a-4ad0-aa8d-3cca273ce623 tempest-AttachSCSIVolumeTestJSON-1824069812 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:16:57.373797 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-1b0d426e-5a3a-4c43-8e1d-34fdb0684bfc req-e2f8403a-cd1a-4ad0-aa8d-3cca273ce623 tempest-AttachSCSIVolumeTestJSON-1824069812 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.893s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:16:57.374783 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-1b0d426e-5a3a-4c43-8e1d-34fdb0684bfc req-e2f8403a-cd1a-4ad0-aa8d-3cca273ce623 tempest-AttachSCSIVolumeTestJSON-1824069812 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ea6253ad-6d59-440c-8c15-4350734c723a', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': 'ea6253ad-6d59-440c-8c15-4350734c723a', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:16:57.534741 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-1b0d426e-5a3a-4c43-8e1d-34fdb0684bfc req-e2f8403a-cd1a-4ad0-aa8d-3cca273ce623 tempest-AttachSCSIVolumeTestJSON-1824069812 None] Connection info returned from driver {'name': 'volumes/volume-ea6253ad-6d59-440c-8c15-4350734c723a', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ea6253ad-6d59-440c-8c15-4350734c723a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '614d918d-b77a-4a00-b3ec-1089f8fc7621'} {{(pid=123855) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Apr 30 21:16:57.766793 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-1b0d426e-5a3a-4c43-8e1d-34fdb0684bfc req-e2f8403a-cd1a-4ad0-aa8d-3cca273ce623 tempest-AttachSCSIVolumeTestJSON-1824069812 None] attachment_update completed successfully. Apr 30 21:16:58.751959 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-ccfac4c7-1a78-4f60-a50d-25c9ded6384c req-b71a86c7-111b-488e-a1bf-5aeb4a9ef189 tempest-ServersTestBootFromVolume-307388374 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:16:59.839325 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-ccfac4c7-1a78-4f60-a50d-25c9ded6384c req-b71a86c7-111b-488e-a1bf-5aeb4a9ef189 tempest-ServersTestBootFromVolume-307388374 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.087s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:16:59.841037 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-ccfac4c7-1a78-4f60-a50d-25c9ded6384c req-b71a86c7-111b-488e-a1bf-5aeb4a9ef189 tempest-ServersTestBootFromVolume-307388374 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6639f2c6-65d9-49ac-ba19-1bfddc2cceae', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': '6639f2c6-65d9-49ac-ba19-1bfddc2cceae', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:17:00.011982 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-ccfac4c7-1a78-4f60-a50d-25c9ded6384c req-b71a86c7-111b-488e-a1bf-5aeb4a9ef189 tempest-ServersTestBootFromVolume-307388374 None] Connection info returned from driver {'name': 'volumes/volume-6639f2c6-65d9-49ac-ba19-1bfddc2cceae', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '6639f2c6-65d9-49ac-ba19-1bfddc2cceae', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '82c39012-556b-4c7b-a8b0-7ebfb34ab929'} {{(pid=123855) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Apr 30 21:17:00.223963 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-ccfac4c7-1a78-4f60-a50d-25c9ded6384c req-b71a86c7-111b-488e-a1bf-5aeb4a9ef189 tempest-ServersTestBootFromVolume-307388374 None] attachment_update completed successfully. Apr 30 21:17:04.164848 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-90b487de-1000-42a8-a799-a32d94e3d9c8 req-c26e30b8-e4c0-4bb1-9101-f8a6ce97574b tempest-AttachSCSIVolumeTestJSON-1824069812 None] Terminate volume connection completed successfully. Apr 30 21:17:04.165438 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-90b487de-1000-42a8-a799-a32d94e3d9c8 req-c26e30b8-e4c0-4bb1-9101-f8a6ce97574b tempest-AttachSCSIVolumeTestJSON-1824069812 None] Deleting attachment 614d918d-b77a-4a00-b3ec-1089f8fc7621. {{(pid=123855) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} Apr 30 21:17:05.120206 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1b8e048-daa2-422e-9f35-a271205ae72f tempest-TaggedBootDevicesTest-1496276863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:17:05.146546 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a1b8e048-daa2-422e-9f35-a271205ae72f tempest-TaggedBootDevicesTest-1496276863 None] Flow 'volume_create_manager' (de32d81a-83c5-450f-90fa-031c3e2cc809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:17:05.154121 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a1b8e048-daa2-422e-9f35-a271205ae72f tempest-TaggedBootDevicesTest-1496276863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (914e9530-5f94-469f-a909-561f21fd7b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:17:05.175210 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a1b8e048-daa2-422e-9f35-a271205ae72f tempest-TaggedBootDevicesTest-1496276863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (914e9530-5f94-469f-a909-561f21fd7b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-389576971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=acace4b6-8088-43ff-9975-029ca62df01f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b57cf4c7f250443a8afd9460085f6951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:17:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:17:05Z,use_quota=True,user_id='f0c43fdc22254d7f9c5999e044c4f844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:17:05.183884 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a1b8e048-daa2-422e-9f35-a271205ae72f tempest-TaggedBootDevicesTest-1496276863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15caaf8f-3733-4f22-9108-242996117307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:17:05.190045 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a1b8e048-daa2-422e-9f35-a271205ae72f tempest-TaggedBootDevicesTest-1496276863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15caaf8f-3733-4f22-9108-242996117307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:17:05.196189 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a1b8e048-daa2-422e-9f35-a271205ae72f tempest-TaggedBootDevicesTest-1496276863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1bdecb1-f87c-460c-8457-aa2fac8e9476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:17:05.325824 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a1b8e048-daa2-422e-9f35-a271205ae72f tempest-TaggedBootDevicesTest-1496276863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1bdecb1-f87c-460c-8457-aa2fac8e9476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'acace4b6-8088-43ff-9975-029ca62df01f', 'volume_name': 'volume-acace4b6-8088-43ff-9975-029ca62df01f', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:17:05.331187 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a1b8e048-daa2-422e-9f35-a271205ae72f tempest-TaggedBootDevicesTest-1496276863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d87bd467-3be1-4a0d-8925-64f443f1d24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:17:05.336391 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a1b8e048-daa2-422e-9f35-a271205ae72f tempest-TaggedBootDevicesTest-1496276863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d87bd467-3be1-4a0d-8925-64f443f1d24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:17:05.342426 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a1b8e048-daa2-422e-9f35-a271205ae72f tempest-TaggedBootDevicesTest-1496276863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c95942a-f1e4-4a69-9486-257621481588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:17:05.344384 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-a1b8e048-daa2-422e-9f35-a271205ae72f tempest-TaggedBootDevicesTest-1496276863 None] Volume acace4b6-8088-43ff-9975-029ca62df01f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-acace4b6-8088-43ff-9975-029ca62df01f', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 30 21:17:05.345945 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1b8e048-daa2-422e-9f35-a271205ae72f tempest-TaggedBootDevicesTest-1496276863 None] Cloning acace4b6-8088-43ff-9975-029ca62df01f from image a5b0850f-3b24-4bcb-b0a7-351c3216b27d at location (None, None). {{(pid=123855) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Apr 30 21:17:05.359168 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-a1b8e048-daa2-422e-9f35-a271205ae72f tempest-TaggedBootDevicesTest-1496276863 None] Lock "b'cinder-a5b0850f-3b24-4bcb-b0a7-351c3216b27d'" acquired by "_prepare_image_cache_entry" :: waited 0.012s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:17:05.438586 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-a1b8e048-daa2-422e-9f35-a271205ae72f tempest-TaggedBootDevicesTest-1496276863 None] Found image-volume cache entry: {'id': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'volume_id': '5772aef0-721f-450a-93ff-02cc6a41edcc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7), 'last_used': datetime.datetime(2022, 4, 30, 21, 17, 5, 367325)}. {{(pid=123855) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 30 21:17:05.443710 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-a1b8e048-daa2-422e-9f35-a271205ae72f tempest-TaggedBootDevicesTest-1496276863 None] Image-volume cache entry image_update_at = 2022-04-30 21:01:07+00:00, requested image updated_at = 2022-04-30 21:01:07+00:00. {{(pid=123855) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 30 21:17:05.443710 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1b8e048-daa2-422e-9f35-a271205ae72f tempest-TaggedBootDevicesTest-1496276863 None] Found cache entry for image = a5b0850f-3b24-4bcb-b0a7-351c3216b27d on host ncdv-master-1@ceph#ceph. {{(pid=123855) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Apr 30 21:17:05.445268 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-a1b8e048-daa2-422e-9f35-a271205ae72f tempest-TaggedBootDevicesTest-1496276863 None] Lock "b'cinder-a5b0850f-3b24-4bcb-b0a7-351c3216b27d'" released by "_prepare_image_cache_entry" :: held 0.086s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:17:05.446215 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1b8e048-daa2-422e-9f35-a271205ae72f tempest-TaggedBootDevicesTest-1496276863 None] Attempting to retrieve cache entry for image = a5b0850f-3b24-4bcb-b0a7-351c3216b27d on host ncdv-master-1@ceph#ceph. {{(pid=123855) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Apr 30 21:17:05.457849 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-a1b8e048-daa2-422e-9f35-a271205ae72f tempest-TaggedBootDevicesTest-1496276863 None] Found image-volume cache entry: {'id': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'volume_id': '5772aef0-721f-450a-93ff-02cc6a41edcc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7), 'last_used': datetime.datetime(2022, 4, 30, 21, 17, 5, 450723)}. {{(pid=123855) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 30 21:17:05.458476 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-a1b8e048-daa2-422e-9f35-a271205ae72f tempest-TaggedBootDevicesTest-1496276863 None] Image-volume cache entry image_update_at = 2022-04-30 21:01:07+00:00, requested image updated_at = 2022-04-30 21:01:07+00:00. {{(pid=123855) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 30 21:17:05.459065 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1b8e048-daa2-422e-9f35-a271205ae72f tempest-TaggedBootDevicesTest-1496276863 None] Creating from source image-volume 5772aef0-721f-450a-93ff-02cc6a41edcc {{(pid=123855) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Apr 30 21:17:05.485334 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a1b8e048-daa2-422e-9f35-a271205ae72f tempest-TaggedBootDevicesTest-1496276863 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:17:05.708316 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a1b8e048-daa2-422e-9f35-a271205ae72f tempest-TaggedBootDevicesTest-1496276863 None] creating snapshot='volume-acace4b6-8088-43ff-9975-029ca62df01f.clone_snap' {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} Apr 30 21:17:07.772291 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a1b8e048-daa2-422e-9f35-a271205ae72f tempest-TaggedBootDevicesTest-1496276863 None] cloning 'volume-5772aef0-721f-450a-93ff-02cc6a41edcc@volume-acace4b6-8088-43ff-9975-029ca62df01f.clone_snap' to 'volume-acace4b6-8088-43ff-9975-029ca62df01f' {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} Apr 30 21:17:08.897952 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a1b8e048-daa2-422e-9f35-a271205ae72f tempest-TaggedBootDevicesTest-1496276863 None] Volume volume-632a7810-1a6f-420a-a6fd-57675408a8f7.deleted is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:17:08.899336 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a1b8e048-daa2-422e-9f35-a271205ae72f tempest-TaggedBootDevicesTest-1496276863 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:17:08.899910 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a1b8e048-daa2-422e-9f35-a271205ae72f tempest-TaggedBootDevicesTest-1496276863 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:17:09.315226 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a1b8e048-daa2-422e-9f35-a271205ae72f tempest-TaggedBootDevicesTest-1496276863 None] clone created successfully {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} Apr 30 21:17:09.316382 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.volume_utils [None req-a1b8e048-daa2-422e-9f35-a271205ae72f tempest-TaggedBootDevicesTest-1496276863 None] Marking volume acace4b6-8088-43ff-9975-029ca62df01f as bootable. {{(pid=123855) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Apr 30 21:17:09.394041 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1b8e048-daa2-422e-9f35-a271205ae72f tempest-TaggedBootDevicesTest-1496276863 None] Copying metadata from image a5b0850f-3b24-4bcb-b0a7-351c3216b27d to acace4b6-8088-43ff-9975-029ca62df01f. {{(pid=123855) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Apr 30 21:17:09.394471 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1b8e048-daa2-422e-9f35-a271205ae72f tempest-TaggedBootDevicesTest-1496276863 None] Creating volume glance metadata for volume acace4b6-8088-43ff-9975-029ca62df01f backed by image a5b0850f-3b24-4bcb-b0a7-351c3216b27d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123855) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Apr 30 21:17:09.540806 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a1b8e048-daa2-422e-9f35-a271205ae72f tempest-TaggedBootDevicesTest-1496276863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c95942a-f1e4-4a69-9486-257621481588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acace4b6-8088-43ff-9975-029ca62df01f', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:17:09.545865 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a1b8e048-daa2-422e-9f35-a271205ae72f tempest-TaggedBootDevicesTest-1496276863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0db51ef-1073-42c3-851f-c2e34cac82b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:17:09.651517 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-a1b8e048-daa2-422e-9f35-a271205ae72f tempest-TaggedBootDevicesTest-1496276863 None] Volume volume-acace4b6-8088-43ff-9975-029ca62df01f (acace4b6-8088-43ff-9975-029ca62df01f): created successfully Apr 30 21:17:09.655266 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a1b8e048-daa2-422e-9f35-a271205ae72f tempest-TaggedBootDevicesTest-1496276863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0db51ef-1073-42c3-851f-c2e34cac82b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:17:09.661748 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a1b8e048-daa2-422e-9f35-a271205ae72f tempest-TaggedBootDevicesTest-1496276863 None] Flow 'volume_create_manager' (de32d81a-83c5-450f-90fa-031c3e2cc809) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:17:09.755336 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-a1b8e048-daa2-422e-9f35-a271205ae72f tempest-TaggedBootDevicesTest-1496276863 None] Created volume successfully. Apr 30 21:17:11.567076 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-1940d0d5-1a07-4961-92f6-f292c1769b6c tempest-TaggedBootDevicesTest-1496276863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:17:11.611348 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-1940d0d5-1a07-4961-92f6-f292c1769b6c tempest-TaggedBootDevicesTest-1496276863 None] Flow 'volume_create_manager' (45791679-53ad-4f0c-b8ef-6037b813fd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:17:11.633025 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-1940d0d5-1a07-4961-92f6-f292c1769b6c tempest-TaggedBootDevicesTest-1496276863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaf4b28f-e6d2-48f8-a407-e3b366efe6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:17:11.678970 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-1940d0d5-1a07-4961-92f6-f292c1769b6c tempest-TaggedBootDevicesTest-1496276863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaf4b28f-e6d2-48f8-a407-e3b366efe6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-880546840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2c40c928-cd22-4b64-8d73-211240864fa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b57cf4c7f250443a8afd9460085f6951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:17:11Z,use_quota=True,user_id='f0c43fdc22254d7f9c5999e044c4f844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:17:11.694393 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-1940d0d5-1a07-4961-92f6-f292c1769b6c tempest-TaggedBootDevicesTest-1496276863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ba59daf-895a-40ff-863a-05b7d9b82efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:17:11.702165 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-1940d0d5-1a07-4961-92f6-f292c1769b6c tempest-TaggedBootDevicesTest-1496276863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ba59daf-895a-40ff-863a-05b7d9b82efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:17:11.708878 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-1940d0d5-1a07-4961-92f6-f292c1769b6c tempest-TaggedBootDevicesTest-1496276863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15525558-9425-4d43-8b2c-bdec16bc0fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:17:11.714207 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-1940d0d5-1a07-4961-92f6-f292c1769b6c tempest-TaggedBootDevicesTest-1496276863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15525558-9425-4d43-8b2c-bdec16bc0fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c40c928-cd22-4b64-8d73-211240864fa6', 'volume_name': 'volume-2c40c928-cd22-4b64-8d73-211240864fa6', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:17:11.721723 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-1940d0d5-1a07-4961-92f6-f292c1769b6c tempest-TaggedBootDevicesTest-1496276863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da7b9b94-dbd9-49b7-8876-449c74751e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:17:11.727051 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-1940d0d5-1a07-4961-92f6-f292c1769b6c tempest-TaggedBootDevicesTest-1496276863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da7b9b94-dbd9-49b7-8876-449c74751e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:17:11.732360 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-1940d0d5-1a07-4961-92f6-f292c1769b6c tempest-TaggedBootDevicesTest-1496276863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (020454c3-f2a2-4f87-ac83-df433fe128a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:17:11.733839 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-1940d0d5-1a07-4961-92f6-f292c1769b6c tempest-TaggedBootDevicesTest-1496276863 None] Volume 2c40c928-cd22-4b64-8d73-211240864fa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c40c928-cd22-4b64-8d73-211240864fa6', 'volume_size': 1} Apr 30 21:17:11.734446 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-1940d0d5-1a07-4961-92f6-f292c1769b6c tempest-TaggedBootDevicesTest-1496276863 None] creating volume 'volume-2c40c928-cd22-4b64-8d73-211240864fa6' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:17:11.736730 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-1940d0d5-1a07-4961-92f6-f292c1769b6c tempest-TaggedBootDevicesTest-1496276863 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:17:12.612661 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-1940d0d5-1a07-4961-92f6-f292c1769b6c tempest-TaggedBootDevicesTest-1496276863 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:17:12.613298 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-1940d0d5-1a07-4961-92f6-f292c1769b6c tempest-TaggedBootDevicesTest-1496276863 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:17:12.617287 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-1940d0d5-1a07-4961-92f6-f292c1769b6c tempest-TaggedBootDevicesTest-1496276863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (020454c3-f2a2-4f87-ac83-df433fe128a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c40c928-cd22-4b64-8d73-211240864fa6', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:17:12.627918 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-1940d0d5-1a07-4961-92f6-f292c1769b6c tempest-TaggedBootDevicesTest-1496276863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e969f844-6d70-4ecd-b8a7-7011db2af5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:17:12.752002 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-1940d0d5-1a07-4961-92f6-f292c1769b6c tempest-TaggedBootDevicesTest-1496276863 None] Volume volume-2c40c928-cd22-4b64-8d73-211240864fa6 (2c40c928-cd22-4b64-8d73-211240864fa6): created successfully Apr 30 21:17:12.755652 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-1940d0d5-1a07-4961-92f6-f292c1769b6c tempest-TaggedBootDevicesTest-1496276863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e969f844-6d70-4ecd-b8a7-7011db2af5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:17:12.765852 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-1940d0d5-1a07-4961-92f6-f292c1769b6c tempest-TaggedBootDevicesTest-1496276863 None] Flow 'volume_create_manager' (45791679-53ad-4f0c-b8ef-6037b813fd3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:17:12.837883 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-1940d0d5-1a07-4961-92f6-f292c1769b6c tempest-TaggedBootDevicesTest-1496276863 None] Created volume successfully. Apr 30 21:17:14.353135 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb07ce50-73e3-4166-adad-15672b7bd363 tempest-TaggedBootDevicesTest-1496276863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:17:14.396842 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bb07ce50-73e3-4166-adad-15672b7bd363 tempest-TaggedBootDevicesTest-1496276863 None] Flow 'volume_create_manager' (c6201e02-885a-45f0-94da-2c5b90924eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:17:14.404318 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bb07ce50-73e3-4166-adad-15672b7bd363 tempest-TaggedBootDevicesTest-1496276863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47641bd3-1929-491c-b3e9-54a53db034a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:17:14.425861 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bb07ce50-73e3-4166-adad-15672b7bd363 tempest-TaggedBootDevicesTest-1496276863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47641bd3-1929-491c-b3e9-54a53db034a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-2101680604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=80f5c8d3-2b42-46ef-9de8-ca18b38a1f28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b57cf4c7f250443a8afd9460085f6951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:17:14Z,use_quota=True,user_id='f0c43fdc22254d7f9c5999e044c4f844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:17:14.436623 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bb07ce50-73e3-4166-adad-15672b7bd363 tempest-TaggedBootDevicesTest-1496276863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47f43ae1-20e2-4218-858f-fe85f06928e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:17:14.440935 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bb07ce50-73e3-4166-adad-15672b7bd363 tempest-TaggedBootDevicesTest-1496276863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47f43ae1-20e2-4218-858f-fe85f06928e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:17:14.446533 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bb07ce50-73e3-4166-adad-15672b7bd363 tempest-TaggedBootDevicesTest-1496276863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db2aa7d3-514b-45dc-937c-4566d27c111a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:17:14.450670 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bb07ce50-73e3-4166-adad-15672b7bd363 tempest-TaggedBootDevicesTest-1496276863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db2aa7d3-514b-45dc-937c-4566d27c111a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80f5c8d3-2b42-46ef-9de8-ca18b38a1f28', 'volume_name': 'volume-80f5c8d3-2b42-46ef-9de8-ca18b38a1f28', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:17:14.456158 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bb07ce50-73e3-4166-adad-15672b7bd363 tempest-TaggedBootDevicesTest-1496276863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4319953-009e-428f-83ec-1e4337cdfb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:17:14.460148 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bb07ce50-73e3-4166-adad-15672b7bd363 tempest-TaggedBootDevicesTest-1496276863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4319953-009e-428f-83ec-1e4337cdfb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:17:14.464879 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bb07ce50-73e3-4166-adad-15672b7bd363 tempest-TaggedBootDevicesTest-1496276863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59e78173-1df0-42d7-826f-2fdd65cec68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:17:14.466000 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-bb07ce50-73e3-4166-adad-15672b7bd363 tempest-TaggedBootDevicesTest-1496276863 None] Volume 80f5c8d3-2b42-46ef-9de8-ca18b38a1f28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80f5c8d3-2b42-46ef-9de8-ca18b38a1f28', 'volume_size': 1} Apr 30 21:17:14.466394 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bb07ce50-73e3-4166-adad-15672b7bd363 tempest-TaggedBootDevicesTest-1496276863 None] creating volume 'volume-80f5c8d3-2b42-46ef-9de8-ca18b38a1f28' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:17:14.467084 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bb07ce50-73e3-4166-adad-15672b7bd363 tempest-TaggedBootDevicesTest-1496276863 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:17:14.970833 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bb07ce50-73e3-4166-adad-15672b7bd363 tempest-TaggedBootDevicesTest-1496276863 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:17:14.972579 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bb07ce50-73e3-4166-adad-15672b7bd363 tempest-TaggedBootDevicesTest-1496276863 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:17:14.981694 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bb07ce50-73e3-4166-adad-15672b7bd363 tempest-TaggedBootDevicesTest-1496276863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59e78173-1df0-42d7-826f-2fdd65cec68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80f5c8d3-2b42-46ef-9de8-ca18b38a1f28', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:17:14.988293 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bb07ce50-73e3-4166-adad-15672b7bd363 tempest-TaggedBootDevicesTest-1496276863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c56c2958-bf97-42ec-ae99-6549a610092a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:17:15.065229 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-bb07ce50-73e3-4166-adad-15672b7bd363 tempest-TaggedBootDevicesTest-1496276863 None] Volume volume-80f5c8d3-2b42-46ef-9de8-ca18b38a1f28 (80f5c8d3-2b42-46ef-9de8-ca18b38a1f28): created successfully Apr 30 21:17:15.083957 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bb07ce50-73e3-4166-adad-15672b7bd363 tempest-TaggedBootDevicesTest-1496276863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c56c2958-bf97-42ec-ae99-6549a610092a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:17:15.106944 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bb07ce50-73e3-4166-adad-15672b7bd363 tempest-TaggedBootDevicesTest-1496276863 None] Flow 'volume_create_manager' (c6201e02-885a-45f0-94da-2c5b90924eba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:17:15.222981 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-bb07ce50-73e3-4166-adad-15672b7bd363 tempest-TaggedBootDevicesTest-1496276863 None] Created volume successfully. Apr 30 21:17:17.590552 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-c5e85e7f-b9fd-49cc-a7ab-715ea6484000 tempest-AttachSCSIVolumeTestJSON-1824069812 None] Lock "b'cinder-ea6253ad-6d59-440c-8c15-4350734c723a-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:17:17.873118 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c5e85e7f-b9fd-49cc-a7ab-715ea6484000 tempest-AttachSCSIVolumeTestJSON-1824069812 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:17:18.152242 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c5e85e7f-b9fd-49cc-a7ab-715ea6484000 tempest-AttachSCSIVolumeTestJSON-1824069812 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:17:18.155324 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c5e85e7f-b9fd-49cc-a7ab-715ea6484000 tempest-AttachSCSIVolumeTestJSON-1824069812 None] Volume volume-ea6253ad-6d59-440c-8c15-4350734c723a is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:17:18.302927 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c5e85e7f-b9fd-49cc-a7ab-715ea6484000 tempest-AttachSCSIVolumeTestJSON-1824069812 None] deleting rbd volume volume-ea6253ad-6d59-440c-8c15-4350734c723a {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:17:22.787337 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-c5e85e7f-b9fd-49cc-a7ab-715ea6484000 tempest-AttachSCSIVolumeTestJSON-1824069812 None] Created reservations ['7e9fb643-7f00-4994-8010-26ca0228b03f', 'e44857eb-f9fc-4a2a-af9f-aff2fa9aec56', '788d16ee-0149-40ac-8f07-db9945734840', '87b9c4c3-2cef-441e-a0a5-1cc23bb90eae'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:17:23.107387 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c5e85e7f-b9fd-49cc-a7ab-715ea6484000 tempest-AttachSCSIVolumeTestJSON-1824069812 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:17:23.231982 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c5e85e7f-b9fd-49cc-a7ab-715ea6484000 tempest-AttachSCSIVolumeTestJSON-1824069812 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:17:23.429118 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-c5e85e7f-b9fd-49cc-a7ab-715ea6484000 tempest-AttachSCSIVolumeTestJSON-1824069812 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:17:23.434740 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-c5e85e7f-b9fd-49cc-a7ab-715ea6484000 tempest-AttachSCSIVolumeTestJSON-1824069812 None] Deleted volume successfully. Apr 30 21:17:23.591590 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-c5e85e7f-b9fd-49cc-a7ab-715ea6484000 tempest-AttachSCSIVolumeTestJSON-1824069812 None] Lock "b'cinder-ea6253ad-6d59-440c-8c15-4350734c723a-delete_volume'" released by "delete_volume" :: held 6.001s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:17:27.250228 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:17:27.254181 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:17:27.325499 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:17:27.385695 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:17:49.711501 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-bd59acc6-600e-495b-9503-abb09ff60d50 req-5464aa14-329d-49f3-9252-5ad1438c71c5 tempest-TaggedBootDevicesTest-1496276863 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:17:50.554038 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-bd59acc6-600e-495b-9503-abb09ff60d50 req-5464aa14-329d-49f3-9252-5ad1438c71c5 tempest-TaggedBootDevicesTest-1496276863 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.844s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:17:50.554823 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-bd59acc6-600e-495b-9503-abb09ff60d50 req-5464aa14-329d-49f3-9252-5ad1438c71c5 tempest-TaggedBootDevicesTest-1496276863 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-acace4b6-8088-43ff-9975-029ca62df01f', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': 'acace4b6-8088-43ff-9975-029ca62df01f', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:17:50.684541 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-bd59acc6-600e-495b-9503-abb09ff60d50 req-5464aa14-329d-49f3-9252-5ad1438c71c5 tempest-TaggedBootDevicesTest-1496276863 None] Connection info returned from driver {'name': 'volumes/volume-acace4b6-8088-43ff-9975-029ca62df01f', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'acace4b6-8088-43ff-9975-029ca62df01f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0b86a235-7c92-4fc6-ba37-2a770ef74c9e'} {{(pid=123855) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Apr 30 21:17:50.933394 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-bd59acc6-600e-495b-9503-abb09ff60d50 req-5464aa14-329d-49f3-9252-5ad1438c71c5 tempest-TaggedBootDevicesTest-1496276863 None] attachment_update completed successfully. Apr 30 21:17:52.012523 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-bd59acc6-600e-495b-9503-abb09ff60d50 req-adad5c24-6a79-4217-9214-14dc171b4cc1 tempest-TaggedBootDevicesTest-1496276863 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:17:53.017342 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-bd59acc6-600e-495b-9503-abb09ff60d50 req-adad5c24-6a79-4217-9214-14dc171b4cc1 tempest-TaggedBootDevicesTest-1496276863 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.004s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:17:53.018202 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-bd59acc6-600e-495b-9503-abb09ff60d50 req-adad5c24-6a79-4217-9214-14dc171b4cc1 tempest-TaggedBootDevicesTest-1496276863 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2c40c928-cd22-4b64-8d73-211240864fa6', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': '2c40c928-cd22-4b64-8d73-211240864fa6', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:17:53.150429 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-bd59acc6-600e-495b-9503-abb09ff60d50 req-adad5c24-6a79-4217-9214-14dc171b4cc1 tempest-TaggedBootDevicesTest-1496276863 None] Connection info returned from driver {'name': 'volumes/volume-2c40c928-cd22-4b64-8d73-211240864fa6', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2c40c928-cd22-4b64-8d73-211240864fa6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '48d1435b-da65-49f9-a64e-be815fb17fd5'} {{(pid=123855) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Apr 30 21:17:53.361599 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-bd59acc6-600e-495b-9503-abb09ff60d50 req-adad5c24-6a79-4217-9214-14dc171b4cc1 tempest-TaggedBootDevicesTest-1496276863 None] attachment_update completed successfully. Apr 30 21:17:54.430530 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-bd59acc6-600e-495b-9503-abb09ff60d50 req-412828ce-47d3-4cb4-b8fb-36f5546a66d3 tempest-TaggedBootDevicesTest-1496276863 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:17:55.420228 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-bd59acc6-600e-495b-9503-abb09ff60d50 req-412828ce-47d3-4cb4-b8fb-36f5546a66d3 tempest-TaggedBootDevicesTest-1496276863 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.990s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:17:55.421570 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-bd59acc6-600e-495b-9503-abb09ff60d50 req-412828ce-47d3-4cb4-b8fb-36f5546a66d3 tempest-TaggedBootDevicesTest-1496276863 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-80f5c8d3-2b42-46ef-9de8-ca18b38a1f28', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': '80f5c8d3-2b42-46ef-9de8-ca18b38a1f28', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:17:55.519110 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-bd59acc6-600e-495b-9503-abb09ff60d50 req-412828ce-47d3-4cb4-b8fb-36f5546a66d3 tempest-TaggedBootDevicesTest-1496276863 None] Connection info returned from driver {'name': 'volumes/volume-80f5c8d3-2b42-46ef-9de8-ca18b38a1f28', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '80f5c8d3-2b42-46ef-9de8-ca18b38a1f28', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3889338b-777e-4f52-9874-e8b6d7b1b709'} {{(pid=123855) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Apr 30 21:17:55.682024 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-bd59acc6-600e-495b-9503-abb09ff60d50 req-412828ce-47d3-4cb4-b8fb-36f5546a66d3 tempest-TaggedBootDevicesTest-1496276863 None] attachment_update completed successfully. Apr 30 21:18:27.255705 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:18:27.259570 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:18:27.320480 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:18:27.382802 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:18:30.479776 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-3536da37-348b-405e-b675-759aeb852701 tempest-VolumesAdminNegativeTest-2051823524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:18:30.507930 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3536da37-348b-405e-b675-759aeb852701 tempest-VolumesAdminNegativeTest-2051823524 None] Flow 'volume_create_manager' (d0a0cda2-e03c-4d5f-a1b6-43066ba506dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:18:30.522757 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3536da37-348b-405e-b675-759aeb852701 tempest-VolumesAdminNegativeTest-2051823524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f505f93-0661-4b8e-8578-acad47c1cb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:18:30.549174 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3536da37-348b-405e-b675-759aeb852701 tempest-VolumesAdminNegativeTest-2051823524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f505f93-0661-4b8e-8578-acad47c1cb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:18:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-970354945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5087ffaf-42b2-4c3a-8cbf-0a636593c2ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c823086e6504aa0ac38c2b9b86970b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:18:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:18:30Z,use_quota=True,user_id='993cfa563e564a5f924d7e75d118f1d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:18:30.561892 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3536da37-348b-405e-b675-759aeb852701 tempest-VolumesAdminNegativeTest-2051823524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8db52b0-fd04-4fbd-ade1-6eadfaf6d1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:18:30.574929 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3536da37-348b-405e-b675-759aeb852701 tempest-VolumesAdminNegativeTest-2051823524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8db52b0-fd04-4fbd-ade1-6eadfaf6d1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:18:30.590805 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3536da37-348b-405e-b675-759aeb852701 tempest-VolumesAdminNegativeTest-2051823524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98c2615c-a4ca-44cd-8fd1-a8f947497dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:18:30.597588 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3536da37-348b-405e-b675-759aeb852701 tempest-VolumesAdminNegativeTest-2051823524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98c2615c-a4ca-44cd-8fd1-a8f947497dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5087ffaf-42b2-4c3a-8cbf-0a636593c2ea', 'volume_name': 'volume-5087ffaf-42b2-4c3a-8cbf-0a636593c2ea', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:18:30.616542 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3536da37-348b-405e-b675-759aeb852701 tempest-VolumesAdminNegativeTest-2051823524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0ded269-b92a-4769-ad7a-674f4a22c241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:18:30.624556 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3536da37-348b-405e-b675-759aeb852701 tempest-VolumesAdminNegativeTest-2051823524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0ded269-b92a-4769-ad7a-674f4a22c241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:18:30.641594 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3536da37-348b-405e-b675-759aeb852701 tempest-VolumesAdminNegativeTest-2051823524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9719efda-57b8-4c48-b751-24f217264f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:18:30.641594 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-3536da37-348b-405e-b675-759aeb852701 tempest-VolumesAdminNegativeTest-2051823524 None] Volume 5087ffaf-42b2-4c3a-8cbf-0a636593c2ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5087ffaf-42b2-4c3a-8cbf-0a636593c2ea', 'volume_size': 1} Apr 30 21:18:30.641594 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-3536da37-348b-405e-b675-759aeb852701 tempest-VolumesAdminNegativeTest-2051823524 None] creating volume 'volume-5087ffaf-42b2-4c3a-8cbf-0a636593c2ea' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:18:30.642039 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-3536da37-348b-405e-b675-759aeb852701 tempest-VolumesAdminNegativeTest-2051823524 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:18:31.705029 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-3536da37-348b-405e-b675-759aeb852701 tempest-VolumesAdminNegativeTest-2051823524 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:18:31.709726 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-3536da37-348b-405e-b675-759aeb852701 tempest-VolumesAdminNegativeTest-2051823524 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:18:31.709726 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3536da37-348b-405e-b675-759aeb852701 tempest-VolumesAdminNegativeTest-2051823524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9719efda-57b8-4c48-b751-24f217264f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5087ffaf-42b2-4c3a-8cbf-0a636593c2ea', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:18:31.714749 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3536da37-348b-405e-b675-759aeb852701 tempest-VolumesAdminNegativeTest-2051823524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (125dc07e-72dc-4e61-adc6-b91f7c87b6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:18:31.815317 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-3536da37-348b-405e-b675-759aeb852701 tempest-VolumesAdminNegativeTest-2051823524 None] Volume volume-5087ffaf-42b2-4c3a-8cbf-0a636593c2ea (5087ffaf-42b2-4c3a-8cbf-0a636593c2ea): created successfully Apr 30 21:18:31.819280 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3536da37-348b-405e-b675-759aeb852701 tempest-VolumesAdminNegativeTest-2051823524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (125dc07e-72dc-4e61-adc6-b91f7c87b6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:18:31.831032 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3536da37-348b-405e-b675-759aeb852701 tempest-VolumesAdminNegativeTest-2051823524 None] Flow 'volume_create_manager' (d0a0cda2-e03c-4d5f-a1b6-43066ba506dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:18:31.910925 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-3536da37-348b-405e-b675-759aeb852701 tempest-VolumesAdminNegativeTest-2051823524 None] Created volume successfully. Apr 30 21:18:34.062119 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-c627b955-de62-42cb-aa2c-f2fbb15a79d7 req-dd3f0940-9a82-4b35-b03b-671a2dfa7095 tempest-VolumesAdminNegativeTest-2051823524 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:18:34.931872 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-c627b955-de62-42cb-aa2c-f2fbb15a79d7 req-dd3f0940-9a82-4b35-b03b-671a2dfa7095 tempest-VolumesAdminNegativeTest-2051823524 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.869s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:18:34.932866 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-c627b955-de62-42cb-aa2c-f2fbb15a79d7 req-dd3f0940-9a82-4b35-b03b-671a2dfa7095 tempest-VolumesAdminNegativeTest-2051823524 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5087ffaf-42b2-4c3a-8cbf-0a636593c2ea', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': '5087ffaf-42b2-4c3a-8cbf-0a636593c2ea', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:18:35.055078 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-c627b955-de62-42cb-aa2c-f2fbb15a79d7 req-dd3f0940-9a82-4b35-b03b-671a2dfa7095 tempest-VolumesAdminNegativeTest-2051823524 None] Connection info returned from driver {'name': 'volumes/volume-5087ffaf-42b2-4c3a-8cbf-0a636593c2ea', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5087ffaf-42b2-4c3a-8cbf-0a636593c2ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '97a9b565-8895-410d-b828-f69369818d62'} {{(pid=123855) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Apr 30 21:18:35.213428 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-c627b955-de62-42cb-aa2c-f2fbb15a79d7 req-dd3f0940-9a82-4b35-b03b-671a2dfa7095 tempest-VolumesAdminNegativeTest-2051823524 None] attachment_update completed successfully. Apr 30 21:18:41.598986 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-c24372f6-d78b-4fc2-8520-a76c48e5b918 req-945a3bd0-016c-4a41-9dfb-25cfa25e7157 tempest-VolumesAdminNegativeTest-2051823524 None] Terminate volume connection completed successfully. Apr 30 21:18:41.599633 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-c24372f6-d78b-4fc2-8520-a76c48e5b918 req-945a3bd0-016c-4a41-9dfb-25cfa25e7157 tempest-VolumesAdminNegativeTest-2051823524 None] Deleting attachment 97a9b565-8895-410d-b828-f69369818d62. {{(pid=123855) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} Apr 30 21:18:43.811228 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-890ca383-9af5-4590-9411-7bca320f712e tempest-VolumesAdminNegativeTest-2051823524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:18:43.833667 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-890ca383-9af5-4590-9411-7bca320f712e tempest-VolumesAdminNegativeTest-2051823524 None] Flow 'volume_create_manager' (5df0404d-9b99-4ac7-bf8d-2cd085d27a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:18:43.840283 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-890ca383-9af5-4590-9411-7bca320f712e tempest-VolumesAdminNegativeTest-2051823524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (254956ec-adaf-4cbe-bffc-4dc7f482afb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:18:43.858581 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-890ca383-9af5-4590-9411-7bca320f712e tempest-VolumesAdminNegativeTest-2051823524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (254956ec-adaf-4cbe-bffc-4dc7f482afb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1500573665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6b508150-9895-4466-a4fe-58faf003f7b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c823086e6504aa0ac38c2b9b86970b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:18:44Z,use_quota=True,user_id='993cfa563e564a5f924d7e75d118f1d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:18:43.864769 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-890ca383-9af5-4590-9411-7bca320f712e tempest-VolumesAdminNegativeTest-2051823524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88d59e0e-2e0a-41d9-a8b6-70f5caabc3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:18:43.869007 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-890ca383-9af5-4590-9411-7bca320f712e tempest-VolumesAdminNegativeTest-2051823524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88d59e0e-2e0a-41d9-a8b6-70f5caabc3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:18:43.874533 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-890ca383-9af5-4590-9411-7bca320f712e tempest-VolumesAdminNegativeTest-2051823524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e5b4195-2724-440f-88a2-e27611332697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:18:43.878867 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-890ca383-9af5-4590-9411-7bca320f712e tempest-VolumesAdminNegativeTest-2051823524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e5b4195-2724-440f-88a2-e27611332697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b508150-9895-4466-a4fe-58faf003f7b2', 'volume_name': 'volume-6b508150-9895-4466-a4fe-58faf003f7b2', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:18:43.884032 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-890ca383-9af5-4590-9411-7bca320f712e tempest-VolumesAdminNegativeTest-2051823524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03202aa3-0b4d-4b2c-bf56-f43d25ad4602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:18:43.888314 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-890ca383-9af5-4590-9411-7bca320f712e tempest-VolumesAdminNegativeTest-2051823524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03202aa3-0b4d-4b2c-bf56-f43d25ad4602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:18:43.893330 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-890ca383-9af5-4590-9411-7bca320f712e tempest-VolumesAdminNegativeTest-2051823524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ead57d59-dcbc-45df-85a9-86d03dbe9dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:18:43.901723 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-890ca383-9af5-4590-9411-7bca320f712e tempest-VolumesAdminNegativeTest-2051823524 None] Volume 6b508150-9895-4466-a4fe-58faf003f7b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b508150-9895-4466-a4fe-58faf003f7b2', 'volume_size': 1} Apr 30 21:18:43.901723 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-890ca383-9af5-4590-9411-7bca320f712e tempest-VolumesAdminNegativeTest-2051823524 None] creating volume 'volume-6b508150-9895-4466-a4fe-58faf003f7b2' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:18:43.901723 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-890ca383-9af5-4590-9411-7bca320f712e tempest-VolumesAdminNegativeTest-2051823524 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:18:45.134244 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-890ca383-9af5-4590-9411-7bca320f712e tempest-VolumesAdminNegativeTest-2051823524 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:18:45.136933 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-890ca383-9af5-4590-9411-7bca320f712e tempest-VolumesAdminNegativeTest-2051823524 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:18:45.141017 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-890ca383-9af5-4590-9411-7bca320f712e tempest-VolumesAdminNegativeTest-2051823524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ead57d59-dcbc-45df-85a9-86d03dbe9dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b508150-9895-4466-a4fe-58faf003f7b2', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:18:45.152875 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-890ca383-9af5-4590-9411-7bca320f712e tempest-VolumesAdminNegativeTest-2051823524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d3174a-1d64-40cd-9747-52245b75d38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:18:45.278022 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-890ca383-9af5-4590-9411-7bca320f712e tempest-VolumesAdminNegativeTest-2051823524 None] Volume volume-6b508150-9895-4466-a4fe-58faf003f7b2 (6b508150-9895-4466-a4fe-58faf003f7b2): created successfully Apr 30 21:18:45.283360 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-890ca383-9af5-4590-9411-7bca320f712e tempest-VolumesAdminNegativeTest-2051823524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d3174a-1d64-40cd-9747-52245b75d38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:18:45.290396 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-890ca383-9af5-4590-9411-7bca320f712e tempest-VolumesAdminNegativeTest-2051823524 None] Flow 'volume_create_manager' (5df0404d-9b99-4ac7-bf8d-2cd085d27a3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:18:45.397999 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-890ca383-9af5-4590-9411-7bca320f712e tempest-VolumesAdminNegativeTest-2051823524 None] Created volume successfully. Apr 30 21:18:46.243982 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-c3e20880-95b0-4651-9e36-0cfb93327358 tempest-VolumesAdminNegativeTest-2051823524 None] Lock "b'cinder-6b508150-9895-4466-a4fe-58faf003f7b2-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:18:46.386264 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c3e20880-95b0-4651-9e36-0cfb93327358 tempest-VolumesAdminNegativeTest-2051823524 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:18:46.655232 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c3e20880-95b0-4651-9e36-0cfb93327358 tempest-VolumesAdminNegativeTest-2051823524 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:18:46.655688 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c3e20880-95b0-4651-9e36-0cfb93327358 tempest-VolumesAdminNegativeTest-2051823524 None] Volume volume-6b508150-9895-4466-a4fe-58faf003f7b2 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:18:46.902386 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c3e20880-95b0-4651-9e36-0cfb93327358 tempest-VolumesAdminNegativeTest-2051823524 None] deleting rbd volume volume-6b508150-9895-4466-a4fe-58faf003f7b2 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:18:54.575541 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-c3e20880-95b0-4651-9e36-0cfb93327358 tempest-VolumesAdminNegativeTest-2051823524 None] Created reservations ['99d8cbbf-3a2a-41c7-b0eb-db453e28ae1e', '8ffa0b84-fa74-47c1-834c-fa2937cbc965', '27ff94b5-17f2-4a81-b8d3-cf6c2ba24635', 'a499cb16-aa19-45ca-81ca-52c7aaa8e081'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:18:54.825483 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c3e20880-95b0-4651-9e36-0cfb93327358 tempest-VolumesAdminNegativeTest-2051823524 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:18:54.991245 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c3e20880-95b0-4651-9e36-0cfb93327358 tempest-VolumesAdminNegativeTest-2051823524 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:18:55.080660 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-c3e20880-95b0-4651-9e36-0cfb93327358 tempest-VolumesAdminNegativeTest-2051823524 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:18:55.085588 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-c3e20880-95b0-4651-9e36-0cfb93327358 tempest-VolumesAdminNegativeTest-2051823524 None] Deleted volume successfully. Apr 30 21:18:55.250630 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-c3e20880-95b0-4651-9e36-0cfb93327358 tempest-VolumesAdminNegativeTest-2051823524 None] Lock "b'cinder-6b508150-9895-4466-a4fe-58faf003f7b2-delete_volume'" released by "delete_volume" :: held 9.004s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:18:55.400017 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-7b825718-6cbb-4da6-8c5d-b2fe4ff9b0ed tempest-VolumesAdminNegativeTest-2051823524 None] Lock "b'cinder-5087ffaf-42b2-4c3a-8cbf-0a636593c2ea-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:18:55.611666 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-7b825718-6cbb-4da6-8c5d-b2fe4ff9b0ed tempest-VolumesAdminNegativeTest-2051823524 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:18:56.157021 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-7b825718-6cbb-4da6-8c5d-b2fe4ff9b0ed tempest-VolumesAdminNegativeTest-2051823524 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:18:56.161108 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-7b825718-6cbb-4da6-8c5d-b2fe4ff9b0ed tempest-VolumesAdminNegativeTest-2051823524 None] Volume volume-5087ffaf-42b2-4c3a-8cbf-0a636593c2ea is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:18:56.448912 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-7b825718-6cbb-4da6-8c5d-b2fe4ff9b0ed tempest-VolumesAdminNegativeTest-2051823524 None] deleting rbd volume volume-5087ffaf-42b2-4c3a-8cbf-0a636593c2ea {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:19:04.151712 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-7b825718-6cbb-4da6-8c5d-b2fe4ff9b0ed tempest-VolumesAdminNegativeTest-2051823524 None] Created reservations ['5097ab60-c7b9-4d48-9269-7221b3d75386', '5aa266fc-30e0-40f3-8410-11fb26a38fe5', '77d5b980-0668-4017-8e89-9db263eeb296', '18b64bee-bbed-481e-b92f-885a1bcd49f2'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:19:04.385175 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-7b825718-6cbb-4da6-8c5d-b2fe4ff9b0ed tempest-VolumesAdminNegativeTest-2051823524 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:19:04.422078 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-7b825718-6cbb-4da6-8c5d-b2fe4ff9b0ed tempest-VolumesAdminNegativeTest-2051823524 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:19:04.473777 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-7b825718-6cbb-4da6-8c5d-b2fe4ff9b0ed tempest-VolumesAdminNegativeTest-2051823524 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:19:04.479201 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-7b825718-6cbb-4da6-8c5d-b2fe4ff9b0ed tempest-VolumesAdminNegativeTest-2051823524 None] Deleted volume successfully. Apr 30 21:19:04.570347 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-7b825718-6cbb-4da6-8c5d-b2fe4ff9b0ed tempest-VolumesAdminNegativeTest-2051823524 None] Lock "b'cinder-5087ffaf-42b2-4c3a-8cbf-0a636593c2ea-delete_volume'" released by "delete_volume" :: held 9.170s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:19:27.260057 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:19:27.262507 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:19:27.357418 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:19:27.441034 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:20:00.191837 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-76481a06-2731-4a1f-b237-c3799415a5b1 tempest-TaggedBootDevicesTest_v242-1954731281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:20:00.230347 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-76481a06-2731-4a1f-b237-c3799415a5b1 tempest-TaggedBootDevicesTest_v242-1954731281 None] Flow 'volume_create_manager' (0f1e43d7-b869-449a-9c19-a0245d74ce44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:20:00.246338 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-76481a06-2731-4a1f-b237-c3799415a5b1 tempest-TaggedBootDevicesTest_v242-1954731281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64c5d5da-ccf5-40d5-ab76-fbadd0157273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:20:00.262030 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-76481a06-2731-4a1f-b237-c3799415a5b1 tempest-TaggedBootDevicesTest_v242-1954731281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64c5d5da-ccf5-40d5-ab76-fbadd0157273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1699715250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=36930a8a-00bb-4076-b396-25ba68392b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b81eb3fcf4664f479119191dbc28bf07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:20:00Z,use_quota=True,user_id='af1585cd61ba445eba82fb0b5c74a460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:20:00.292834 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-76481a06-2731-4a1f-b237-c3799415a5b1 tempest-TaggedBootDevicesTest_v242-1954731281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (605f9fa7-24e4-4c43-a86d-871eb63a298e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:20:00.299143 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-76481a06-2731-4a1f-b237-c3799415a5b1 tempest-TaggedBootDevicesTest_v242-1954731281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (605f9fa7-24e4-4c43-a86d-871eb63a298e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:20:00.306073 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-76481a06-2731-4a1f-b237-c3799415a5b1 tempest-TaggedBootDevicesTest_v242-1954731281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b221f91-7030-4093-8b47-12eb8eea1cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:20:00.442305 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-76481a06-2731-4a1f-b237-c3799415a5b1 tempest-TaggedBootDevicesTest_v242-1954731281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b221f91-7030-4093-8b47-12eb8eea1cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '36930a8a-00bb-4076-b396-25ba68392b9d', 'volume_name': 'volume-36930a8a-00bb-4076-b396-25ba68392b9d', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:20:00.449742 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-76481a06-2731-4a1f-b237-c3799415a5b1 tempest-TaggedBootDevicesTest_v242-1954731281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fbad24b-7cae-42ab-a25e-420b453afe9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:20:00.470822 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-76481a06-2731-4a1f-b237-c3799415a5b1 tempest-TaggedBootDevicesTest_v242-1954731281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fbad24b-7cae-42ab-a25e-420b453afe9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:20:00.485958 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-76481a06-2731-4a1f-b237-c3799415a5b1 tempest-TaggedBootDevicesTest_v242-1954731281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebed5dad-8525-4e10-bdd4-49af1c2d8952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:20:00.491334 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-76481a06-2731-4a1f-b237-c3799415a5b1 tempest-TaggedBootDevicesTest_v242-1954731281 None] Volume 36930a8a-00bb-4076-b396-25ba68392b9d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-36930a8a-00bb-4076-b396-25ba68392b9d', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 30 21:20:00.491334 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-76481a06-2731-4a1f-b237-c3799415a5b1 tempest-TaggedBootDevicesTest_v242-1954731281 None] Cloning 36930a8a-00bb-4076-b396-25ba68392b9d from image a5b0850f-3b24-4bcb-b0a7-351c3216b27d at location (None, None). {{(pid=123855) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Apr 30 21:20:00.508840 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-76481a06-2731-4a1f-b237-c3799415a5b1 tempest-TaggedBootDevicesTest_v242-1954731281 None] Lock "b'cinder-a5b0850f-3b24-4bcb-b0a7-351c3216b27d'" acquired by "_prepare_image_cache_entry" :: waited 0.020s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:20:00.596293 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-76481a06-2731-4a1f-b237-c3799415a5b1 tempest-TaggedBootDevicesTest_v242-1954731281 None] Found image-volume cache entry: {'id': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'volume_id': '5772aef0-721f-450a-93ff-02cc6a41edcc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7), 'last_used': datetime.datetime(2022, 4, 30, 21, 20, 0, 515261)}. {{(pid=123855) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 30 21:20:00.597746 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-76481a06-2731-4a1f-b237-c3799415a5b1 tempest-TaggedBootDevicesTest_v242-1954731281 None] Image-volume cache entry image_update_at = 2022-04-30 21:01:07+00:00, requested image updated_at = 2022-04-30 21:01:07+00:00. {{(pid=123855) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 30 21:20:00.606014 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-76481a06-2731-4a1f-b237-c3799415a5b1 tempest-TaggedBootDevicesTest_v242-1954731281 None] Found cache entry for image = a5b0850f-3b24-4bcb-b0a7-351c3216b27d on host ncdv-master-1@ceph#ceph. {{(pid=123855) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Apr 30 21:20:00.621585 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-76481a06-2731-4a1f-b237-c3799415a5b1 tempest-TaggedBootDevicesTest_v242-1954731281 None] Lock "b'cinder-a5b0850f-3b24-4bcb-b0a7-351c3216b27d'" released by "_prepare_image_cache_entry" :: held 0.107s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:20:00.627951 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-76481a06-2731-4a1f-b237-c3799415a5b1 tempest-TaggedBootDevicesTest_v242-1954731281 None] Attempting to retrieve cache entry for image = a5b0850f-3b24-4bcb-b0a7-351c3216b27d on host ncdv-master-1@ceph#ceph. {{(pid=123855) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Apr 30 21:20:00.644429 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-76481a06-2731-4a1f-b237-c3799415a5b1 tempest-TaggedBootDevicesTest_v242-1954731281 None] Found image-volume cache entry: {'id': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'volume_id': '5772aef0-721f-450a-93ff-02cc6a41edcc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7), 'last_used': datetime.datetime(2022, 4, 30, 21, 20, 0, 639112)}. {{(pid=123855) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 30 21:20:00.644820 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-76481a06-2731-4a1f-b237-c3799415a5b1 tempest-TaggedBootDevicesTest_v242-1954731281 None] Image-volume cache entry image_update_at = 2022-04-30 21:01:07+00:00, requested image updated_at = 2022-04-30 21:01:07+00:00. {{(pid=123855) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 30 21:20:00.645236 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-76481a06-2731-4a1f-b237-c3799415a5b1 tempest-TaggedBootDevicesTest_v242-1954731281 None] Creating from source image-volume 5772aef0-721f-450a-93ff-02cc6a41edcc {{(pid=123855) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Apr 30 21:20:00.686163 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-76481a06-2731-4a1f-b237-c3799415a5b1 tempest-TaggedBootDevicesTest_v242-1954731281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:20:01.075750 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-76481a06-2731-4a1f-b237-c3799415a5b1 tempest-TaggedBootDevicesTest_v242-1954731281 None] creating snapshot='volume-36930a8a-00bb-4076-b396-25ba68392b9d.clone_snap' {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} Apr 30 21:20:03.504836 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-76481a06-2731-4a1f-b237-c3799415a5b1 tempest-TaggedBootDevicesTest_v242-1954731281 None] cloning 'volume-5772aef0-721f-450a-93ff-02cc6a41edcc@volume-36930a8a-00bb-4076-b396-25ba68392b9d.clone_snap' to 'volume-36930a8a-00bb-4076-b396-25ba68392b9d' {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} Apr 30 21:20:06.206246 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-76481a06-2731-4a1f-b237-c3799415a5b1 tempest-TaggedBootDevicesTest_v242-1954731281 None] Volume volume-632a7810-1a6f-420a-a6fd-57675408a8f7.deleted is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:20:06.207342 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-76481a06-2731-4a1f-b237-c3799415a5b1 tempest-TaggedBootDevicesTest_v242-1954731281 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:20:06.209907 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-76481a06-2731-4a1f-b237-c3799415a5b1 tempest-TaggedBootDevicesTest_v242-1954731281 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:20:06.999037 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-76481a06-2731-4a1f-b237-c3799415a5b1 tempest-TaggedBootDevicesTest_v242-1954731281 None] clone created successfully {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} Apr 30 21:20:06.999743 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.volume_utils [None req-76481a06-2731-4a1f-b237-c3799415a5b1 tempest-TaggedBootDevicesTest_v242-1954731281 None] Marking volume 36930a8a-00bb-4076-b396-25ba68392b9d as bootable. {{(pid=123855) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Apr 30 21:20:07.075428 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-76481a06-2731-4a1f-b237-c3799415a5b1 tempest-TaggedBootDevicesTest_v242-1954731281 None] Copying metadata from image a5b0850f-3b24-4bcb-b0a7-351c3216b27d to 36930a8a-00bb-4076-b396-25ba68392b9d. {{(pid=123855) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Apr 30 21:20:07.075946 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-76481a06-2731-4a1f-b237-c3799415a5b1 tempest-TaggedBootDevicesTest_v242-1954731281 None] Creating volume glance metadata for volume 36930a8a-00bb-4076-b396-25ba68392b9d backed by image a5b0850f-3b24-4bcb-b0a7-351c3216b27d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123855) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Apr 30 21:20:07.176762 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-76481a06-2731-4a1f-b237-c3799415a5b1 tempest-TaggedBootDevicesTest_v242-1954731281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebed5dad-8525-4e10-bdd4-49af1c2d8952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36930a8a-00bb-4076-b396-25ba68392b9d', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:20:07.182503 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-76481a06-2731-4a1f-b237-c3799415a5b1 tempest-TaggedBootDevicesTest_v242-1954731281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77be6d2b-9502-4b27-a590-b6c6b87ae5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:20:07.269038 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-76481a06-2731-4a1f-b237-c3799415a5b1 tempest-TaggedBootDevicesTest_v242-1954731281 None] Volume volume-36930a8a-00bb-4076-b396-25ba68392b9d (36930a8a-00bb-4076-b396-25ba68392b9d): created successfully Apr 30 21:20:07.274330 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-76481a06-2731-4a1f-b237-c3799415a5b1 tempest-TaggedBootDevicesTest_v242-1954731281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77be6d2b-9502-4b27-a590-b6c6b87ae5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:20:07.281024 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-76481a06-2731-4a1f-b237-c3799415a5b1 tempest-TaggedBootDevicesTest_v242-1954731281 None] Flow 'volume_create_manager' (0f1e43d7-b869-449a-9c19-a0245d74ce44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:20:07.367598 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-76481a06-2731-4a1f-b237-c3799415a5b1 tempest-TaggedBootDevicesTest_v242-1954731281 None] Created volume successfully. Apr 30 21:20:08.478843 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-89739d96-47f0-4fb4-866d-986d652d5e34 tempest-TaggedBootDevicesTest_v242-1954731281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:20:08.503602 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-89739d96-47f0-4fb4-866d-986d652d5e34 tempest-TaggedBootDevicesTest_v242-1954731281 None] Flow 'volume_create_manager' (ede08c82-98bc-46ed-9b65-28e5714587ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:20:08.513985 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-89739d96-47f0-4fb4-866d-986d652d5e34 tempest-TaggedBootDevicesTest_v242-1954731281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dacf2e4-779e-4429-a93c-8e6651df08fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:20:08.536841 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-89739d96-47f0-4fb4-866d-986d652d5e34 tempest-TaggedBootDevicesTest_v242-1954731281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dacf2e4-779e-4429-a93c-8e6651df08fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1137684164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=27b24866-27ef-457f-bbcc-0152de7c242b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b81eb3fcf4664f479119191dbc28bf07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:20:08Z,use_quota=True,user_id='af1585cd61ba445eba82fb0b5c74a460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:20:08.552460 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-89739d96-47f0-4fb4-866d-986d652d5e34 tempest-TaggedBootDevicesTest_v242-1954731281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60fd3b69-fcbf-4c34-af74-71595097051f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:20:08.559092 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-89739d96-47f0-4fb4-866d-986d652d5e34 tempest-TaggedBootDevicesTest_v242-1954731281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60fd3b69-fcbf-4c34-af74-71595097051f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:20:08.565247 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-89739d96-47f0-4fb4-866d-986d652d5e34 tempest-TaggedBootDevicesTest_v242-1954731281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (936d46fc-d24f-4dac-99d7-cb6cb08b6c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:20:08.570061 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-89739d96-47f0-4fb4-866d-986d652d5e34 tempest-TaggedBootDevicesTest_v242-1954731281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (936d46fc-d24f-4dac-99d7-cb6cb08b6c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27b24866-27ef-457f-bbcc-0152de7c242b', 'volume_name': 'volume-27b24866-27ef-457f-bbcc-0152de7c242b', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:20:08.575186 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-89739d96-47f0-4fb4-866d-986d652d5e34 tempest-TaggedBootDevicesTest_v242-1954731281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25bd2e82-a0ba-48e0-b5aa-5791161ce05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:20:08.579393 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-89739d96-47f0-4fb4-866d-986d652d5e34 tempest-TaggedBootDevicesTest_v242-1954731281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25bd2e82-a0ba-48e0-b5aa-5791161ce05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:20:08.584117 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-89739d96-47f0-4fb4-866d-986d652d5e34 tempest-TaggedBootDevicesTest_v242-1954731281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ba7cf8-b077-4bd4-92ee-092602d38ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:20:08.585215 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-89739d96-47f0-4fb4-866d-986d652d5e34 tempest-TaggedBootDevicesTest_v242-1954731281 None] Volume 27b24866-27ef-457f-bbcc-0152de7c242b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27b24866-27ef-457f-bbcc-0152de7c242b', 'volume_size': 1} Apr 30 21:20:08.585882 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-89739d96-47f0-4fb4-866d-986d652d5e34 tempest-TaggedBootDevicesTest_v242-1954731281 None] creating volume 'volume-27b24866-27ef-457f-bbcc-0152de7c242b' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:20:08.586688 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-89739d96-47f0-4fb4-866d-986d652d5e34 tempest-TaggedBootDevicesTest_v242-1954731281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:20:09.550548 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-89739d96-47f0-4fb4-866d-986d652d5e34 tempest-TaggedBootDevicesTest_v242-1954731281 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:20:09.551254 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-89739d96-47f0-4fb4-866d-986d652d5e34 tempest-TaggedBootDevicesTest_v242-1954731281 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:20:09.555271 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-89739d96-47f0-4fb4-866d-986d652d5e34 tempest-TaggedBootDevicesTest_v242-1954731281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ba7cf8-b077-4bd4-92ee-092602d38ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27b24866-27ef-457f-bbcc-0152de7c242b', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:20:09.563642 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-89739d96-47f0-4fb4-866d-986d652d5e34 tempest-TaggedBootDevicesTest_v242-1954731281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89f985af-d055-44ee-923f-bbdedc916d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:20:09.652106 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-89739d96-47f0-4fb4-866d-986d652d5e34 tempest-TaggedBootDevicesTest_v242-1954731281 None] Volume volume-27b24866-27ef-457f-bbcc-0152de7c242b (27b24866-27ef-457f-bbcc-0152de7c242b): created successfully Apr 30 21:20:09.656922 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-89739d96-47f0-4fb4-866d-986d652d5e34 tempest-TaggedBootDevicesTest_v242-1954731281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89f985af-d055-44ee-923f-bbdedc916d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:20:09.662873 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-89739d96-47f0-4fb4-866d-986d652d5e34 tempest-TaggedBootDevicesTest_v242-1954731281 None] Flow 'volume_create_manager' (ede08c82-98bc-46ed-9b65-28e5714587ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:20:09.728852 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-89739d96-47f0-4fb4-866d-986d652d5e34 tempest-TaggedBootDevicesTest_v242-1954731281 None] Created volume successfully. Apr 30 21:20:11.151341 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-4abd6c36-1c4c-4319-8725-a08cf5e404dd tempest-TaggedBootDevicesTest_v242-1954731281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:20:11.172139 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4abd6c36-1c4c-4319-8725-a08cf5e404dd tempest-TaggedBootDevicesTest_v242-1954731281 None] Flow 'volume_create_manager' (10131d71-4667-4d84-bb32-872b11848f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:20:11.180019 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4abd6c36-1c4c-4319-8725-a08cf5e404dd tempest-TaggedBootDevicesTest_v242-1954731281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c215e5-e42b-425f-aad4-e168a024f1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:20:11.201233 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4abd6c36-1c4c-4319-8725-a08cf5e404dd tempest-TaggedBootDevicesTest_v242-1954731281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c215e5-e42b-425f-aad4-e168a024f1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1084862396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=04049fb4-d6f1-4d01-83c2-db5981be2487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b81eb3fcf4664f479119191dbc28bf07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:20:11Z,use_quota=True,user_id='af1585cd61ba445eba82fb0b5c74a460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:20:11.207429 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4abd6c36-1c4c-4319-8725-a08cf5e404dd tempest-TaggedBootDevicesTest_v242-1954731281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3924325-9e77-478c-94f3-3e2d8130a454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:20:11.212161 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4abd6c36-1c4c-4319-8725-a08cf5e404dd tempest-TaggedBootDevicesTest_v242-1954731281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3924325-9e77-478c-94f3-3e2d8130a454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:20:11.217331 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4abd6c36-1c4c-4319-8725-a08cf5e404dd tempest-TaggedBootDevicesTest_v242-1954731281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e81bde6-410d-4f51-96df-e73090901562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:20:11.231029 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4abd6c36-1c4c-4319-8725-a08cf5e404dd tempest-TaggedBootDevicesTest_v242-1954731281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e81bde6-410d-4f51-96df-e73090901562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04049fb4-d6f1-4d01-83c2-db5981be2487', 'volume_name': 'volume-04049fb4-d6f1-4d01-83c2-db5981be2487', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:20:11.236311 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4abd6c36-1c4c-4319-8725-a08cf5e404dd tempest-TaggedBootDevicesTest_v242-1954731281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7952be71-825f-41e9-9bf7-5b5cb9106866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:20:11.240425 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4abd6c36-1c4c-4319-8725-a08cf5e404dd tempest-TaggedBootDevicesTest_v242-1954731281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7952be71-825f-41e9-9bf7-5b5cb9106866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:20:11.246240 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4abd6c36-1c4c-4319-8725-a08cf5e404dd tempest-TaggedBootDevicesTest_v242-1954731281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a55651-0ba2-4647-b031-261bde0abd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:20:11.247272 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-4abd6c36-1c4c-4319-8725-a08cf5e404dd tempest-TaggedBootDevicesTest_v242-1954731281 None] Volume 04049fb4-d6f1-4d01-83c2-db5981be2487: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04049fb4-d6f1-4d01-83c2-db5981be2487', 'volume_size': 1} Apr 30 21:20:11.247771 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-4abd6c36-1c4c-4319-8725-a08cf5e404dd tempest-TaggedBootDevicesTest_v242-1954731281 None] creating volume 'volume-04049fb4-d6f1-4d01-83c2-db5981be2487' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:20:11.248455 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-4abd6c36-1c4c-4319-8725-a08cf5e404dd tempest-TaggedBootDevicesTest_v242-1954731281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:20:12.336486 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-4abd6c36-1c4c-4319-8725-a08cf5e404dd tempest-TaggedBootDevicesTest_v242-1954731281 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:20:12.337105 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-4abd6c36-1c4c-4319-8725-a08cf5e404dd tempest-TaggedBootDevicesTest_v242-1954731281 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:20:12.341234 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4abd6c36-1c4c-4319-8725-a08cf5e404dd tempest-TaggedBootDevicesTest_v242-1954731281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a55651-0ba2-4647-b031-261bde0abd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04049fb4-d6f1-4d01-83c2-db5981be2487', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:20:12.346703 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4abd6c36-1c4c-4319-8725-a08cf5e404dd tempest-TaggedBootDevicesTest_v242-1954731281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28afc291-88ee-4819-ae28-2ae02a6a2660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:20:12.412636 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-4abd6c36-1c4c-4319-8725-a08cf5e404dd tempest-TaggedBootDevicesTest_v242-1954731281 None] Volume volume-04049fb4-d6f1-4d01-83c2-db5981be2487 (04049fb4-d6f1-4d01-83c2-db5981be2487): created successfully Apr 30 21:20:12.416337 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4abd6c36-1c4c-4319-8725-a08cf5e404dd tempest-TaggedBootDevicesTest_v242-1954731281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28afc291-88ee-4819-ae28-2ae02a6a2660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:20:12.422565 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4abd6c36-1c4c-4319-8725-a08cf5e404dd tempest-TaggedBootDevicesTest_v242-1954731281 None] Flow 'volume_create_manager' (10131d71-4667-4d84-bb32-872b11848f25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:20:12.515404 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-4abd6c36-1c4c-4319-8725-a08cf5e404dd tempest-TaggedBootDevicesTest_v242-1954731281 None] Created volume successfully. Apr 30 21:20:19.683088 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b7fc625-5626-4f5d-8b89-ada0d7a5741a tempest-DeleteServersTestJSON-557044403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:20:19.706982 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-7b7fc625-5626-4f5d-8b89-ada0d7a5741a tempest-DeleteServersTestJSON-557044403 None] Flow 'volume_create_manager' (fc2900c5-e131-4da9-a837-06da1a683bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:20:19.715635 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-7b7fc625-5626-4f5d-8b89-ada0d7a5741a tempest-DeleteServersTestJSON-557044403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5bd1414-a1a4-45a6-ae42-ce84f571c2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:20:19.733799 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-7b7fc625-5626-4f5d-8b89-ada0d7a5741a tempest-DeleteServersTestJSON-557044403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5bd1414-a1a4-45a6-ae42-ce84f571c2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-787181324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ea469c91-90fa-49e9-98c2-38c22ad83db0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='713c8f2f4e2141f18904b10656eaf37f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:20:20Z,use_quota=True,user_id='2f5eafa970bd4247bdaef1cda747c3fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:20:19.738008 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-7b7fc625-5626-4f5d-8b89-ada0d7a5741a tempest-DeleteServersTestJSON-557044403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08fa3336-653e-49ca-acf7-7f9eaa71a461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:20:19.742911 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-7b7fc625-5626-4f5d-8b89-ada0d7a5741a tempest-DeleteServersTestJSON-557044403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08fa3336-653e-49ca-acf7-7f9eaa71a461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:20:19.749640 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-7b7fc625-5626-4f5d-8b89-ada0d7a5741a tempest-DeleteServersTestJSON-557044403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c381b9-9c7f-4c1c-b164-4a390a43d4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:20:19.754410 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-7b7fc625-5626-4f5d-8b89-ada0d7a5741a tempest-DeleteServersTestJSON-557044403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c381b9-9c7f-4c1c-b164-4a390a43d4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea469c91-90fa-49e9-98c2-38c22ad83db0', 'volume_name': 'volume-ea469c91-90fa-49e9-98c2-38c22ad83db0', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:20:19.761474 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-7b7fc625-5626-4f5d-8b89-ada0d7a5741a tempest-DeleteServersTestJSON-557044403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5030d961-c10e-4f1c-9e5c-bd7277a3077d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:20:19.787042 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-7b7fc625-5626-4f5d-8b89-ada0d7a5741a tempest-DeleteServersTestJSON-557044403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5030d961-c10e-4f1c-9e5c-bd7277a3077d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:20:19.811024 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-7b7fc625-5626-4f5d-8b89-ada0d7a5741a tempest-DeleteServersTestJSON-557044403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df576a87-a493-47d9-8309-e05a7a0bcd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:20:19.815512 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-7b7fc625-5626-4f5d-8b89-ada0d7a5741a tempest-DeleteServersTestJSON-557044403 None] Volume ea469c91-90fa-49e9-98c2-38c22ad83db0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea469c91-90fa-49e9-98c2-38c22ad83db0', 'volume_size': 1} Apr 30 21:20:19.818335 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-7b7fc625-5626-4f5d-8b89-ada0d7a5741a tempest-DeleteServersTestJSON-557044403 None] creating volume 'volume-ea469c91-90fa-49e9-98c2-38c22ad83db0' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:20:19.819308 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-7b7fc625-5626-4f5d-8b89-ada0d7a5741a tempest-DeleteServersTestJSON-557044403 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:20:20.941445 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-7b7fc625-5626-4f5d-8b89-ada0d7a5741a tempest-DeleteServersTestJSON-557044403 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:20:20.942011 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-7b7fc625-5626-4f5d-8b89-ada0d7a5741a tempest-DeleteServersTestJSON-557044403 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:20:20.952216 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-7b7fc625-5626-4f5d-8b89-ada0d7a5741a tempest-DeleteServersTestJSON-557044403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df576a87-a493-47d9-8309-e05a7a0bcd10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea469c91-90fa-49e9-98c2-38c22ad83db0', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:20:20.957043 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-7b7fc625-5626-4f5d-8b89-ada0d7a5741a tempest-DeleteServersTestJSON-557044403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f11216d-ff14-4321-b48e-469824f3543c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:20:21.126894 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-7b7fc625-5626-4f5d-8b89-ada0d7a5741a tempest-DeleteServersTestJSON-557044403 None] Volume volume-ea469c91-90fa-49e9-98c2-38c22ad83db0 (ea469c91-90fa-49e9-98c2-38c22ad83db0): created successfully Apr 30 21:20:21.133206 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-7b7fc625-5626-4f5d-8b89-ada0d7a5741a tempest-DeleteServersTestJSON-557044403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f11216d-ff14-4321-b48e-469824f3543c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:20:21.147646 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-7b7fc625-5626-4f5d-8b89-ada0d7a5741a tempest-DeleteServersTestJSON-557044403 None] Flow 'volume_create_manager' (fc2900c5-e131-4da9-a837-06da1a683bef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:20:21.300669 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-7b7fc625-5626-4f5d-8b89-ada0d7a5741a tempest-DeleteServersTestJSON-557044403 None] Created volume successfully. Apr 30 21:20:23.062489 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-55606186-0ef2-4dbd-836a-c0fefeb400d2 req-14ed77f6-9a8c-4327-a715-bbe7885799e9 tempest-DeleteServersTestJSON-557044403 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:20:23.775821 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-55606186-0ef2-4dbd-836a-c0fefeb400d2 req-14ed77f6-9a8c-4327-a715-bbe7885799e9 tempest-DeleteServersTestJSON-557044403 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.713s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:20:23.776743 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-55606186-0ef2-4dbd-836a-c0fefeb400d2 req-14ed77f6-9a8c-4327-a715-bbe7885799e9 tempest-DeleteServersTestJSON-557044403 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ea469c91-90fa-49e9-98c2-38c22ad83db0', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': 'ea469c91-90fa-49e9-98c2-38c22ad83db0', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:20:23.863950 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-55606186-0ef2-4dbd-836a-c0fefeb400d2 req-14ed77f6-9a8c-4327-a715-bbe7885799e9 tempest-DeleteServersTestJSON-557044403 None] Connection info returned from driver {'name': 'volumes/volume-ea469c91-90fa-49e9-98c2-38c22ad83db0', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ea469c91-90fa-49e9-98c2-38c22ad83db0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3c525538-d6da-4038-abf7-37ea91a05b9c'} {{(pid=123855) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Apr 30 21:20:23.981182 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-55606186-0ef2-4dbd-836a-c0fefeb400d2 req-14ed77f6-9a8c-4327-a715-bbe7885799e9 tempest-DeleteServersTestJSON-557044403 None] attachment_update completed successfully. Apr 30 21:20:27.263378 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:20:27.264523 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:20:27.312873 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:20:27.360658 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:20:35.095513 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-ab6f5d60-a774-45ad-a472-f8690fd0bca8 req-5d6a4e6b-ed1d-40c6-a618-af2aba979512 tempest-TaggedBootDevicesTest_v242-1954731281 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:20:35.846720 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-ab6f5d60-a774-45ad-a472-f8690fd0bca8 req-5d6a4e6b-ed1d-40c6-a618-af2aba979512 tempest-TaggedBootDevicesTest_v242-1954731281 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.751s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:20:35.847569 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-ab6f5d60-a774-45ad-a472-f8690fd0bca8 req-5d6a4e6b-ed1d-40c6-a618-af2aba979512 tempest-TaggedBootDevicesTest_v242-1954731281 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-36930a8a-00bb-4076-b396-25ba68392b9d', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': '36930a8a-00bb-4076-b396-25ba68392b9d', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:20:35.966354 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-ab6f5d60-a774-45ad-a472-f8690fd0bca8 req-5d6a4e6b-ed1d-40c6-a618-af2aba979512 tempest-TaggedBootDevicesTest_v242-1954731281 None] Connection info returned from driver {'name': 'volumes/volume-36930a8a-00bb-4076-b396-25ba68392b9d', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '36930a8a-00bb-4076-b396-25ba68392b9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '458db7a5-cc0a-4591-b8ab-3e0d71c577c7'} {{(pid=123855) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Apr 30 21:20:36.160708 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-ab6f5d60-a774-45ad-a472-f8690fd0bca8 req-5d6a4e6b-ed1d-40c6-a618-af2aba979512 tempest-TaggedBootDevicesTest_v242-1954731281 None] attachment_update completed successfully. Apr 30 21:20:36.859480 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-ab6f5d60-a774-45ad-a472-f8690fd0bca8 req-2577dd36-0905-4eb2-89fe-7474878ef367 tempest-TaggedBootDevicesTest_v242-1954731281 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:20:37.715610 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-ab6f5d60-a774-45ad-a472-f8690fd0bca8 req-2577dd36-0905-4eb2-89fe-7474878ef367 tempest-TaggedBootDevicesTest_v242-1954731281 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.856s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:20:37.720957 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-ab6f5d60-a774-45ad-a472-f8690fd0bca8 req-2577dd36-0905-4eb2-89fe-7474878ef367 tempest-TaggedBootDevicesTest_v242-1954731281 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-27b24866-27ef-457f-bbcc-0152de7c242b', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': '27b24866-27ef-457f-bbcc-0152de7c242b', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:20:37.870706 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-ab6f5d60-a774-45ad-a472-f8690fd0bca8 req-2577dd36-0905-4eb2-89fe-7474878ef367 tempest-TaggedBootDevicesTest_v242-1954731281 None] Connection info returned from driver {'name': 'volumes/volume-27b24866-27ef-457f-bbcc-0152de7c242b', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '27b24866-27ef-457f-bbcc-0152de7c242b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'eca33b27-8323-4b8c-9b6d-28fa47313110'} {{(pid=123855) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Apr 30 21:20:38.069339 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-ab6f5d60-a774-45ad-a472-f8690fd0bca8 req-2577dd36-0905-4eb2-89fe-7474878ef367 tempest-TaggedBootDevicesTest_v242-1954731281 None] attachment_update completed successfully. Apr 30 21:20:38.911770 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-ab6f5d60-a774-45ad-a472-f8690fd0bca8 req-38cdf08c-a93c-4d20-9ddb-26207a5eeb19 tempest-TaggedBootDevicesTest_v242-1954731281 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:20:39.463292 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-c902e5d3-070d-4044-9313-394ff9e0b91c req-0d8c878f-6527-41c0-bc9a-2f8cec109b61 tempest-DeleteServersTestJSON-557044403 None] Terminate volume connection completed successfully. Apr 30 21:20:39.463905 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-c902e5d3-070d-4044-9313-394ff9e0b91c req-0d8c878f-6527-41c0-bc9a-2f8cec109b61 tempest-DeleteServersTestJSON-557044403 None] Deleting attachment 3c525538-d6da-4038-abf7-37ea91a05b9c. {{(pid=123855) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} Apr 30 21:20:39.884604 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-ab6f5d60-a774-45ad-a472-f8690fd0bca8 req-38cdf08c-a93c-4d20-9ddb-26207a5eeb19 tempest-TaggedBootDevicesTest_v242-1954731281 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.973s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:20:39.885478 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-ab6f5d60-a774-45ad-a472-f8690fd0bca8 req-38cdf08c-a93c-4d20-9ddb-26207a5eeb19 tempest-TaggedBootDevicesTest_v242-1954731281 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-04049fb4-d6f1-4d01-83c2-db5981be2487', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': '04049fb4-d6f1-4d01-83c2-db5981be2487', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:20:40.080496 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-ab6f5d60-a774-45ad-a472-f8690fd0bca8 req-38cdf08c-a93c-4d20-9ddb-26207a5eeb19 tempest-TaggedBootDevicesTest_v242-1954731281 None] Connection info returned from driver {'name': 'volumes/volume-04049fb4-d6f1-4d01-83c2-db5981be2487', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '04049fb4-d6f1-4d01-83c2-db5981be2487', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '53f86d87-91e7-4dd8-aa7c-169aa2ce1ae7'} {{(pid=123855) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Apr 30 21:20:40.333202 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-ab6f5d60-a774-45ad-a472-f8690fd0bca8 req-38cdf08c-a93c-4d20-9ddb-26207a5eeb19 tempest-TaggedBootDevicesTest_v242-1954731281 None] attachment_update completed successfully. Apr 30 21:21:27.266348 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:21:27.268038 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:21:27.333614 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:21:27.393536 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:22:19.347846 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-60b57e95-9869-4736-8693-db9c14d67ad3 tempest-AttachVolumeShelveTestJSON-2129222160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:22:19.369193 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-60b57e95-9869-4736-8693-db9c14d67ad3 tempest-AttachVolumeShelveTestJSON-2129222160 None] Flow 'volume_create_manager' (6f24ad7c-db45-46cd-8a5c-22d5d9dfb66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:22:19.380156 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-60b57e95-9869-4736-8693-db9c14d67ad3 tempest-AttachVolumeShelveTestJSON-2129222160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdb86232-3e49-48b5-bda9-eb5b881a0c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:22:19.399174 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-60b57e95-9869-4736-8693-db9c14d67ad3 tempest-AttachVolumeShelveTestJSON-2129222160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdb86232-3e49-48b5-bda9-eb5b881a0c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1482632044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ecaa8fc8-122d-4201-b4ec-f389b692b0fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc5d20f2f9f4ecf981cdfe980cfc21d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:22:19Z,use_quota=True,user_id='65bedbcb4d094160a9a9fc3b6ba6f603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:22:19.406009 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-60b57e95-9869-4736-8693-db9c14d67ad3 tempest-AttachVolumeShelveTestJSON-2129222160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (468ddcba-32f2-428b-90e8-d5362c45c2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:22:19.413938 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-60b57e95-9869-4736-8693-db9c14d67ad3 tempest-AttachVolumeShelveTestJSON-2129222160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (468ddcba-32f2-428b-90e8-d5362c45c2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:22:19.418115 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-60b57e95-9869-4736-8693-db9c14d67ad3 tempest-AttachVolumeShelveTestJSON-2129222160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ca2c516-72a1-4323-8f25-801eac4a285d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:22:19.422525 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-60b57e95-9869-4736-8693-db9c14d67ad3 tempest-AttachVolumeShelveTestJSON-2129222160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ca2c516-72a1-4323-8f25-801eac4a285d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecaa8fc8-122d-4201-b4ec-f389b692b0fa', 'volume_name': 'volume-ecaa8fc8-122d-4201-b4ec-f389b692b0fa', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:22:19.431961 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-60b57e95-9869-4736-8693-db9c14d67ad3 tempest-AttachVolumeShelveTestJSON-2129222160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e9098aa-fbec-49c7-8c78-b766b33add3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:22:19.438722 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-60b57e95-9869-4736-8693-db9c14d67ad3 tempest-AttachVolumeShelveTestJSON-2129222160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e9098aa-fbec-49c7-8c78-b766b33add3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:22:19.444625 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-60b57e95-9869-4736-8693-db9c14d67ad3 tempest-AttachVolumeShelveTestJSON-2129222160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (078ece27-d9bd-4a47-9145-797c80f69fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:22:19.445772 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-60b57e95-9869-4736-8693-db9c14d67ad3 tempest-AttachVolumeShelveTestJSON-2129222160 None] Volume ecaa8fc8-122d-4201-b4ec-f389b692b0fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecaa8fc8-122d-4201-b4ec-f389b692b0fa', 'volume_size': 1} Apr 30 21:22:19.446341 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-60b57e95-9869-4736-8693-db9c14d67ad3 tempest-AttachVolumeShelveTestJSON-2129222160 None] creating volume 'volume-ecaa8fc8-122d-4201-b4ec-f389b692b0fa' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:22:19.447268 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-60b57e95-9869-4736-8693-db9c14d67ad3 tempest-AttachVolumeShelveTestJSON-2129222160 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:22:20.481360 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-60b57e95-9869-4736-8693-db9c14d67ad3 tempest-AttachVolumeShelveTestJSON-2129222160 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:22:20.482041 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-60b57e95-9869-4736-8693-db9c14d67ad3 tempest-AttachVolumeShelveTestJSON-2129222160 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:22:20.487144 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-60b57e95-9869-4736-8693-db9c14d67ad3 tempest-AttachVolumeShelveTestJSON-2129222160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (078ece27-d9bd-4a47-9145-797c80f69fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecaa8fc8-122d-4201-b4ec-f389b692b0fa', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:22:20.507016 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-60b57e95-9869-4736-8693-db9c14d67ad3 tempest-AttachVolumeShelveTestJSON-2129222160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6be6cec-6b00-4827-b16f-df1e479ac5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:22:20.597423 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-60b57e95-9869-4736-8693-db9c14d67ad3 tempest-AttachVolumeShelveTestJSON-2129222160 None] Volume volume-ecaa8fc8-122d-4201-b4ec-f389b692b0fa (ecaa8fc8-122d-4201-b4ec-f389b692b0fa): created successfully Apr 30 21:22:20.603231 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-60b57e95-9869-4736-8693-db9c14d67ad3 tempest-AttachVolumeShelveTestJSON-2129222160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6be6cec-6b00-4827-b16f-df1e479ac5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:22:20.609793 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-60b57e95-9869-4736-8693-db9c14d67ad3 tempest-AttachVolumeShelveTestJSON-2129222160 None] Flow 'volume_create_manager' (6f24ad7c-db45-46cd-8a5c-22d5d9dfb66c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:22:20.734999 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-60b57e95-9869-4736-8693-db9c14d67ad3 tempest-AttachVolumeShelveTestJSON-2129222160 None] Created volume successfully. Apr 30 21:22:27.262774 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:22:27.263537 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:22:27.288302 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:22:27.332201 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:23:03.022738 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-32e95766-1555-494a-8f22-726993839724 req-fe16357b-d68e-4eca-aba1-aa835ce008d9 tempest-AttachVolumeShelveTestJSON-2129222160 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:23:03.700825 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-32e95766-1555-494a-8f22-726993839724 req-fe16357b-d68e-4eca-aba1-aa835ce008d9 tempest-AttachVolumeShelveTestJSON-2129222160 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.678s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:23:03.702029 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-32e95766-1555-494a-8f22-726993839724 req-fe16357b-d68e-4eca-aba1-aa835ce008d9 tempest-AttachVolumeShelveTestJSON-2129222160 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ecaa8fc8-122d-4201-b4ec-f389b692b0fa', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': 'ecaa8fc8-122d-4201-b4ec-f389b692b0fa', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:23:03.814006 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-32e95766-1555-494a-8f22-726993839724 req-fe16357b-d68e-4eca-aba1-aa835ce008d9 tempest-AttachVolumeShelveTestJSON-2129222160 None] Connection info returned from driver {'name': 'volumes/volume-ecaa8fc8-122d-4201-b4ec-f389b692b0fa', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ecaa8fc8-122d-4201-b4ec-f389b692b0fa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a78e59ae-3577-40d4-aa55-9e90b76b3e21'} {{(pid=123855) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Apr 30 21:23:03.918699 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-32e95766-1555-494a-8f22-726993839724 req-fe16357b-d68e-4eca-aba1-aa835ce008d9 tempest-AttachVolumeShelveTestJSON-2129222160 None] attachment_update completed successfully. Apr 30 21:23:27.259742 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:23:27.261358 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:23:27.311581 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:23:27.369101 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:23:45.734279 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-e929dd99-bb6f-4744-ae9b-f53aa8190f7c tempest-VolumesTestJSON-905126376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:23:45.754822 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e929dd99-bb6f-4744-ae9b-f53aa8190f7c tempest-VolumesTestJSON-905126376 None] Flow 'volume_create_manager' (458ecef1-dc9c-486f-a8c5-3f7784566f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:23:45.761345 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e929dd99-bb6f-4744-ae9b-f53aa8190f7c tempest-VolumesTestJSON-905126376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f30a7d2-49bb-403e-87d5-daff8afef817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:23:45.776952 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e929dd99-bb6f-4744-ae9b-f53aa8190f7c tempest-VolumesTestJSON-905126376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f30a7d2-49bb-403e-87d5-daff8afef817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1460556174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4db3c1e6-b18f-4af0-b9e4-ecbb653b3a76,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d60fbfd64cc04f3eb8f2db6746afaf04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:23:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:23:46Z,use_quota=True,user_id='a44db0249a214dcc9b2985ff18a3a690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:23:45.782304 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e929dd99-bb6f-4744-ae9b-f53aa8190f7c tempest-VolumesTestJSON-905126376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bae1beea-10f0-4f51-b2c4-16343a97c631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:23:45.786975 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e929dd99-bb6f-4744-ae9b-f53aa8190f7c tempest-VolumesTestJSON-905126376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bae1beea-10f0-4f51-b2c4-16343a97c631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:23:45.792059 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e929dd99-bb6f-4744-ae9b-f53aa8190f7c tempest-VolumesTestJSON-905126376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8355195-9490-483b-a76e-9a017508733e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:23:45.796106 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e929dd99-bb6f-4744-ae9b-f53aa8190f7c tempest-VolumesTestJSON-905126376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8355195-9490-483b-a76e-9a017508733e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4db3c1e6-b18f-4af0-b9e4-ecbb653b3a76', 'volume_name': 'volume-4db3c1e6-b18f-4af0-b9e4-ecbb653b3a76', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:23:45.801272 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e929dd99-bb6f-4744-ae9b-f53aa8190f7c tempest-VolumesTestJSON-905126376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc3d3355-8f27-49d7-aae9-a391e1190261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:23:45.805217 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e929dd99-bb6f-4744-ae9b-f53aa8190f7c tempest-VolumesTestJSON-905126376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc3d3355-8f27-49d7-aae9-a391e1190261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:23:45.809913 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e929dd99-bb6f-4744-ae9b-f53aa8190f7c tempest-VolumesTestJSON-905126376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (257ad4fd-4d36-4cac-80ee-c2b1b8cb3f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:23:45.810983 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-e929dd99-bb6f-4744-ae9b-f53aa8190f7c tempest-VolumesTestJSON-905126376 None] Volume 4db3c1e6-b18f-4af0-b9e4-ecbb653b3a76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4db3c1e6-b18f-4af0-b9e4-ecbb653b3a76', 'volume_size': 1} Apr 30 21:23:45.811420 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e929dd99-bb6f-4744-ae9b-f53aa8190f7c tempest-VolumesTestJSON-905126376 None] creating volume 'volume-4db3c1e6-b18f-4af0-b9e4-ecbb653b3a76' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:23:45.812341 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e929dd99-bb6f-4744-ae9b-f53aa8190f7c tempest-VolumesTestJSON-905126376 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:23:46.813105 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-8f0e6638-7bf0-4e15-99ad-3ea0033c551d tempest-DeleteServersTestJSON-557044403 None] Lock "b'cinder-ea469c91-90fa-49e9-98c2-38c22ad83db0-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:23:46.845992 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e929dd99-bb6f-4744-ae9b-f53aa8190f7c tempest-VolumesTestJSON-905126376 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:23:46.846544 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e929dd99-bb6f-4744-ae9b-f53aa8190f7c tempest-VolumesTestJSON-905126376 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:23:46.850692 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e929dd99-bb6f-4744-ae9b-f53aa8190f7c tempest-VolumesTestJSON-905126376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (257ad4fd-4d36-4cac-80ee-c2b1b8cb3f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4db3c1e6-b18f-4af0-b9e4-ecbb653b3a76', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:23:46.855501 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e929dd99-bb6f-4744-ae9b-f53aa8190f7c tempest-VolumesTestJSON-905126376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2b35049-ef37-48c9-8f49-cd7a589ceb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:23:46.916208 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8f0e6638-7bf0-4e15-99ad-3ea0033c551d tempest-DeleteServersTestJSON-557044403 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:23:47.205992 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8f0e6638-7bf0-4e15-99ad-3ea0033c551d tempest-DeleteServersTestJSON-557044403 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:23:47.206446 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8f0e6638-7bf0-4e15-99ad-3ea0033c551d tempest-DeleteServersTestJSON-557044403 None] Volume volume-ea469c91-90fa-49e9-98c2-38c22ad83db0 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:23:47.447834 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8f0e6638-7bf0-4e15-99ad-3ea0033c551d tempest-DeleteServersTestJSON-557044403 None] deleting rbd volume volume-ea469c91-90fa-49e9-98c2-38c22ad83db0 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:23:47.450803 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-e929dd99-bb6f-4744-ae9b-f53aa8190f7c tempest-VolumesTestJSON-905126376 None] Volume volume-4db3c1e6-b18f-4af0-b9e4-ecbb653b3a76 (4db3c1e6-b18f-4af0-b9e4-ecbb653b3a76): created successfully Apr 30 21:23:47.454436 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e929dd99-bb6f-4744-ae9b-f53aa8190f7c tempest-VolumesTestJSON-905126376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2b35049-ef37-48c9-8f49-cd7a589ceb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:23:47.460602 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e929dd99-bb6f-4744-ae9b-f53aa8190f7c tempest-VolumesTestJSON-905126376 None] Flow 'volume_create_manager' (458ecef1-dc9c-486f-a8c5-3f7784566f2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:23:47.560810 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-e929dd99-bb6f-4744-ae9b-f53aa8190f7c tempest-VolumesTestJSON-905126376 None] Created volume successfully. Apr 30 21:23:48.745815 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-b694ca53-7e13-42e9-8a6e-a18f381f7e55 tempest-VolumesTestJSON-905126376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:23:48.765021 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b694ca53-7e13-42e9-8a6e-a18f381f7e55 tempest-VolumesTestJSON-905126376 None] Flow 'volume_create_manager' (78782358-4720-40d2-8fef-3db73e9d436c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:23:48.772069 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b694ca53-7e13-42e9-8a6e-a18f381f7e55 tempest-VolumesTestJSON-905126376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec868aa6-383e-408b-a6b8-b22e1f91cb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:23:48.787791 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b694ca53-7e13-42e9-8a6e-a18f381f7e55 tempest-VolumesTestJSON-905126376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec868aa6-383e-408b-a6b8-b22e1f91cb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1911707717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6f62fb1b-5a1a-4586-a3a3-04a650ff1ea2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d60fbfd64cc04f3eb8f2db6746afaf04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:23:49Z,use_quota=True,user_id='a44db0249a214dcc9b2985ff18a3a690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:23:48.796085 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b694ca53-7e13-42e9-8a6e-a18f381f7e55 tempest-VolumesTestJSON-905126376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d4a6dec-370a-4c3a-863a-85eb87348073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:23:48.800689 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b694ca53-7e13-42e9-8a6e-a18f381f7e55 tempest-VolumesTestJSON-905126376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d4a6dec-370a-4c3a-863a-85eb87348073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:23:48.805938 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b694ca53-7e13-42e9-8a6e-a18f381f7e55 tempest-VolumesTestJSON-905126376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08b7f72f-66f9-496c-8b27-e828eacc0e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:23:48.810085 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b694ca53-7e13-42e9-8a6e-a18f381f7e55 tempest-VolumesTestJSON-905126376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08b7f72f-66f9-496c-8b27-e828eacc0e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f62fb1b-5a1a-4586-a3a3-04a650ff1ea2', 'volume_name': 'volume-6f62fb1b-5a1a-4586-a3a3-04a650ff1ea2', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:23:48.814954 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b694ca53-7e13-42e9-8a6e-a18f381f7e55 tempest-VolumesTestJSON-905126376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efefe1a2-841a-48fc-91cb-c839b96eef55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:23:48.818956 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b694ca53-7e13-42e9-8a6e-a18f381f7e55 tempest-VolumesTestJSON-905126376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efefe1a2-841a-48fc-91cb-c839b96eef55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:23:48.823617 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b694ca53-7e13-42e9-8a6e-a18f381f7e55 tempest-VolumesTestJSON-905126376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7499dcee-4102-4d6b-845e-ebba3f41c8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:23:48.824690 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-b694ca53-7e13-42e9-8a6e-a18f381f7e55 tempest-VolumesTestJSON-905126376 None] Volume 6f62fb1b-5a1a-4586-a3a3-04a650ff1ea2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f62fb1b-5a1a-4586-a3a3-04a650ff1ea2', 'volume_size': 1} Apr 30 21:23:48.825155 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b694ca53-7e13-42e9-8a6e-a18f381f7e55 tempest-VolumesTestJSON-905126376 None] creating volume 'volume-6f62fb1b-5a1a-4586-a3a3-04a650ff1ea2' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:23:48.825846 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b694ca53-7e13-42e9-8a6e-a18f381f7e55 tempest-VolumesTestJSON-905126376 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:23:49.976381 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b694ca53-7e13-42e9-8a6e-a18f381f7e55 tempest-VolumesTestJSON-905126376 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:23:49.977568 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b694ca53-7e13-42e9-8a6e-a18f381f7e55 tempest-VolumesTestJSON-905126376 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:23:49.980660 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b694ca53-7e13-42e9-8a6e-a18f381f7e55 tempest-VolumesTestJSON-905126376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7499dcee-4102-4d6b-845e-ebba3f41c8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f62fb1b-5a1a-4586-a3a3-04a650ff1ea2', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:23:49.985230 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b694ca53-7e13-42e9-8a6e-a18f381f7e55 tempest-VolumesTestJSON-905126376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af2873d8-8f56-4b67-b290-2a83b7132f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:23:50.041454 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-b694ca53-7e13-42e9-8a6e-a18f381f7e55 tempest-VolumesTestJSON-905126376 None] Volume volume-6f62fb1b-5a1a-4586-a3a3-04a650ff1ea2 (6f62fb1b-5a1a-4586-a3a3-04a650ff1ea2): created successfully Apr 30 21:23:50.048240 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b694ca53-7e13-42e9-8a6e-a18f381f7e55 tempest-VolumesTestJSON-905126376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af2873d8-8f56-4b67-b290-2a83b7132f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:23:50.056920 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b694ca53-7e13-42e9-8a6e-a18f381f7e55 tempest-VolumesTestJSON-905126376 None] Flow 'volume_create_manager' (78782358-4720-40d2-8fef-3db73e9d436c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:23:50.177976 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-b694ca53-7e13-42e9-8a6e-a18f381f7e55 tempest-VolumesTestJSON-905126376 None] Created volume successfully. Apr 30 21:23:51.661414 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-41cce054-cfab-4948-b2b0-059bc793a85d tempest-VolumesTestJSON-905126376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:23:51.680276 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-41cce054-cfab-4948-b2b0-059bc793a85d tempest-VolumesTestJSON-905126376 None] Flow 'volume_create_manager' (78a29759-87a8-46f5-b10d-6e03c11d427f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:23:51.689936 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-41cce054-cfab-4948-b2b0-059bc793a85d tempest-VolumesTestJSON-905126376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc9bb4c3-89d4-49a9-bcf0-1b0e81937d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:23:51.702403 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-41cce054-cfab-4948-b2b0-059bc793a85d tempest-VolumesTestJSON-905126376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc9bb4c3-89d4-49a9-bcf0-1b0e81937d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1013501644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c3b6d437-2ca0-4de7-a114-53af39c8ccd3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d60fbfd64cc04f3eb8f2db6746afaf04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:23:51Z,use_quota=True,user_id='a44db0249a214dcc9b2985ff18a3a690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:23:51.708947 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-41cce054-cfab-4948-b2b0-059bc793a85d tempest-VolumesTestJSON-905126376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9acb055-d823-4f40-9711-5cea07fad19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:23:51.713220 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-41cce054-cfab-4948-b2b0-059bc793a85d tempest-VolumesTestJSON-905126376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9acb055-d823-4f40-9711-5cea07fad19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:23:51.718361 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-41cce054-cfab-4948-b2b0-059bc793a85d tempest-VolumesTestJSON-905126376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc2aec93-73e4-417d-a482-a9332e523687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:23:51.723090 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-41cce054-cfab-4948-b2b0-059bc793a85d tempest-VolumesTestJSON-905126376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc2aec93-73e4-417d-a482-a9332e523687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3b6d437-2ca0-4de7-a114-53af39c8ccd3', 'volume_name': 'volume-c3b6d437-2ca0-4de7-a114-53af39c8ccd3', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:23:51.728093 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-41cce054-cfab-4948-b2b0-059bc793a85d tempest-VolumesTestJSON-905126376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b387992-ec87-4eca-b119-0c3edeaec16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:23:51.732474 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-41cce054-cfab-4948-b2b0-059bc793a85d tempest-VolumesTestJSON-905126376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b387992-ec87-4eca-b119-0c3edeaec16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:23:51.737498 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-41cce054-cfab-4948-b2b0-059bc793a85d tempest-VolumesTestJSON-905126376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fab47b14-a2a1-4622-8a7f-aca1d71aa195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:23:51.738653 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-41cce054-cfab-4948-b2b0-059bc793a85d tempest-VolumesTestJSON-905126376 None] Volume c3b6d437-2ca0-4de7-a114-53af39c8ccd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3b6d437-2ca0-4de7-a114-53af39c8ccd3', 'volume_size': 1} Apr 30 21:23:51.739050 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-41cce054-cfab-4948-b2b0-059bc793a85d tempest-VolumesTestJSON-905126376 None] creating volume 'volume-c3b6d437-2ca0-4de7-a114-53af39c8ccd3' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:23:51.739729 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-41cce054-cfab-4948-b2b0-059bc793a85d tempest-VolumesTestJSON-905126376 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:23:52.925639 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-41cce054-cfab-4948-b2b0-059bc793a85d tempest-VolumesTestJSON-905126376 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:23:52.926277 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-41cce054-cfab-4948-b2b0-059bc793a85d tempest-VolumesTestJSON-905126376 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:23:52.929988 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-41cce054-cfab-4948-b2b0-059bc793a85d tempest-VolumesTestJSON-905126376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fab47b14-a2a1-4622-8a7f-aca1d71aa195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3b6d437-2ca0-4de7-a114-53af39c8ccd3', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:23:52.937828 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-41cce054-cfab-4948-b2b0-059bc793a85d tempest-VolumesTestJSON-905126376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f937446-3f3c-4dc1-9ea9-9e13e2e64756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:23:52.983671 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-41cce054-cfab-4948-b2b0-059bc793a85d tempest-VolumesTestJSON-905126376 None] Volume volume-c3b6d437-2ca0-4de7-a114-53af39c8ccd3 (c3b6d437-2ca0-4de7-a114-53af39c8ccd3): created successfully Apr 30 21:23:52.999147 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-41cce054-cfab-4948-b2b0-059bc793a85d tempest-VolumesTestJSON-905126376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f937446-3f3c-4dc1-9ea9-9e13e2e64756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:23:53.005215 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-41cce054-cfab-4948-b2b0-059bc793a85d tempest-VolumesTestJSON-905126376 None] Flow 'volume_create_manager' (78a29759-87a8-46f5-b10d-6e03c11d427f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:23:53.121355 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-41cce054-cfab-4948-b2b0-059bc793a85d tempest-VolumesTestJSON-905126376 None] Created volume successfully. Apr 30 21:23:54.570560 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-f0f7d744-0e4f-444f-9055-c54518f2027c tempest-VolumesTestJSON-905126376 None] Lock "b'cinder-c3b6d437-2ca0-4de7-a114-53af39c8ccd3-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:23:54.675944 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f0f7d744-0e4f-444f-9055-c54518f2027c tempest-VolumesTestJSON-905126376 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:23:54.908478 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f0f7d744-0e4f-444f-9055-c54518f2027c tempest-VolumesTestJSON-905126376 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:23:54.908825 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f0f7d744-0e4f-444f-9055-c54518f2027c tempest-VolumesTestJSON-905126376 None] Volume volume-c3b6d437-2ca0-4de7-a114-53af39c8ccd3 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:23:55.248135 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f0f7d744-0e4f-444f-9055-c54518f2027c tempest-VolumesTestJSON-905126376 None] deleting rbd volume volume-c3b6d437-2ca0-4de7-a114-53af39c8ccd3 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:23:55.652570 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-8f0e6638-7bf0-4e15-99ad-3ea0033c551d tempest-DeleteServersTestJSON-557044403 None] Created reservations ['e2b8b61e-e2ca-4fa5-8c6a-908aabb38da4', '9cf55995-9ee8-4a1a-af1b-65ebf7bdfd44', '222435f6-2cdc-4fa8-adbf-76f595f49da5', 'b54c57a1-438d-476e-ab9c-669baea20563'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:23:55.877505 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8f0e6638-7bf0-4e15-99ad-3ea0033c551d tempest-DeleteServersTestJSON-557044403 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:23:55.931655 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8f0e6638-7bf0-4e15-99ad-3ea0033c551d tempest-DeleteServersTestJSON-557044403 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:23:56.063496 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-8f0e6638-7bf0-4e15-99ad-3ea0033c551d tempest-DeleteServersTestJSON-557044403 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:23:56.067905 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-8f0e6638-7bf0-4e15-99ad-3ea0033c551d tempest-DeleteServersTestJSON-557044403 None] Deleted volume successfully. Apr 30 21:23:56.154115 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-8f0e6638-7bf0-4e15-99ad-3ea0033c551d tempest-DeleteServersTestJSON-557044403 None] Lock "b'cinder-ea469c91-90fa-49e9-98c2-38c22ad83db0-delete_volume'" released by "delete_volume" :: held 9.340s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:24:02.475387 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-f0f7d744-0e4f-444f-9055-c54518f2027c tempest-VolumesTestJSON-905126376 None] Created reservations ['afac9b5f-1898-4d2c-9c1c-a127aa5a7e78', '5301d0b0-3d8a-477f-93db-f5cf4c174be8', 'eed7d80d-f84e-4c51-b190-f7492654197d', 'd5ef3d70-a504-4189-9817-baa2a65f7d5f'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:24:02.767358 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f0f7d744-0e4f-444f-9055-c54518f2027c tempest-VolumesTestJSON-905126376 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:24:02.821528 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f0f7d744-0e4f-444f-9055-c54518f2027c tempest-VolumesTestJSON-905126376 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:24:02.861725 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-f0f7d744-0e4f-444f-9055-c54518f2027c tempest-VolumesTestJSON-905126376 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:24:02.872517 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-f0f7d744-0e4f-444f-9055-c54518f2027c tempest-VolumesTestJSON-905126376 None] Deleted volume successfully. Apr 30 21:24:02.970913 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-f0f7d744-0e4f-444f-9055-c54518f2027c tempest-VolumesTestJSON-905126376 None] Lock "b'cinder-c3b6d437-2ca0-4de7-a114-53af39c8ccd3-delete_volume'" released by "delete_volume" :: held 8.401s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:24:03.335691 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-6c168c12-65a9-4f76-aa0a-1cd25bfcb6d6 tempest-VolumesTestJSON-905126376 None] Lock "b'cinder-6f62fb1b-5a1a-4586-a3a3-04a650ff1ea2-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:24:03.465591 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-6c168c12-65a9-4f76-aa0a-1cd25bfcb6d6 tempest-VolumesTestJSON-905126376 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:24:03.812314 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-6c168c12-65a9-4f76-aa0a-1cd25bfcb6d6 tempest-VolumesTestJSON-905126376 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:24:03.814163 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-6c168c12-65a9-4f76-aa0a-1cd25bfcb6d6 tempest-VolumesTestJSON-905126376 None] Volume volume-6f62fb1b-5a1a-4586-a3a3-04a650ff1ea2 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:24:04.173118 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-6c168c12-65a9-4f76-aa0a-1cd25bfcb6d6 tempest-VolumesTestJSON-905126376 None] deleting rbd volume volume-6f62fb1b-5a1a-4586-a3a3-04a650ff1ea2 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:24:07.616462 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-5c8bb11b-eb18-491d-a965-eb713cd488c3 req-ebf7494b-7572-4352-9870-cbc0316b2c17 tempest-AttachVolumeShelveTestJSON-2129222160 None] Terminate volume connection completed successfully. Apr 30 21:24:07.617566 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-5c8bb11b-eb18-491d-a965-eb713cd488c3 req-ebf7494b-7572-4352-9870-cbc0316b2c17 tempest-AttachVolumeShelveTestJSON-2129222160 None] Deleting attachment a78e59ae-3577-40d4-aa55-9e90b76b3e21. {{(pid=123855) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} Apr 30 21:24:11.751374 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-6c168c12-65a9-4f76-aa0a-1cd25bfcb6d6 tempest-VolumesTestJSON-905126376 None] Created reservations ['a875f4e1-ea1a-46b3-a96d-0bc197dab981', '1121376f-dec0-4643-b20c-158e03985caa', '4b00b2db-04dd-4c31-a1bb-f932061de9ce', '80d8fd26-3021-445f-8b69-f3dc1dc63aa4'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:24:12.057804 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-6c168c12-65a9-4f76-aa0a-1cd25bfcb6d6 tempest-VolumesTestJSON-905126376 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:24:12.240571 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-6c168c12-65a9-4f76-aa0a-1cd25bfcb6d6 tempest-VolumesTestJSON-905126376 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:24:12.326476 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-6c168c12-65a9-4f76-aa0a-1cd25bfcb6d6 tempest-VolumesTestJSON-905126376 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:24:12.331833 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-6c168c12-65a9-4f76-aa0a-1cd25bfcb6d6 tempest-VolumesTestJSON-905126376 None] Deleted volume successfully. Apr 30 21:24:12.399615 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-0bc7c067-c901-465f-a52c-c4664b63fb13 tempest-VolumesTestJSON-905126376 None] Lock "b'cinder-4db3c1e6-b18f-4af0-b9e4-ecbb653b3a76-delete_volume'" acquired by "delete_volume" :: waited 0.035s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:24:12.440230 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-6c168c12-65a9-4f76-aa0a-1cd25bfcb6d6 tempest-VolumesTestJSON-905126376 None] Lock "b'cinder-6f62fb1b-5a1a-4586-a3a3-04a650ff1ea2-delete_volume'" released by "delete_volume" :: held 9.093s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:24:12.548477 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-0bc7c067-c901-465f-a52c-c4664b63fb13 tempest-VolumesTestJSON-905126376 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:24:12.778972 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-0bc7c067-c901-465f-a52c-c4664b63fb13 tempest-VolumesTestJSON-905126376 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:24:12.779530 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-0bc7c067-c901-465f-a52c-c4664b63fb13 tempest-VolumesTestJSON-905126376 None] Volume volume-4db3c1e6-b18f-4af0-b9e4-ecbb653b3a76 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:24:13.041688 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-0bc7c067-c901-465f-a52c-c4664b63fb13 tempest-VolumesTestJSON-905126376 None] deleting rbd volume volume-4db3c1e6-b18f-4af0-b9e4-ecbb653b3a76 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:24:13.995734 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-e2683536-8903-4a33-a28e-acda5d7dc730 req-2fbde7ec-3b5e-454c-9145-fc0445025c0b tempest-ServersTestBootFromVolume-307388374 None] Terminate volume connection completed successfully. Apr 30 21:24:13.996324 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-e2683536-8903-4a33-a28e-acda5d7dc730 req-2fbde7ec-3b5e-454c-9145-fc0445025c0b tempest-ServersTestBootFromVolume-307388374 None] Deleting attachment 82c39012-556b-4c7b-a8b0-7ebfb34ab929. {{(pid=123855) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} Apr 30 21:24:14.531842 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [req-e2683536-8903-4a33-a28e-acda5d7dc730 req-8e186e11-7ade-476a-8385-567e8b7ae432 tempest-ServersTestBootFromVolume-307388374 None] Lock "b'cinder-6639f2c6-65d9-49ac-ba19-1bfddc2cceae-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:24:14.707960 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-e2683536-8903-4a33-a28e-acda5d7dc730 req-8e186e11-7ade-476a-8385-567e8b7ae432 tempest-ServersTestBootFromVolume-307388374 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:24:15.118989 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-e2683536-8903-4a33-a28e-acda5d7dc730 req-8e186e11-7ade-476a-8385-567e8b7ae432 tempest-ServersTestBootFromVolume-307388374 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:24:15.439211 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-e2683536-8903-4a33-a28e-acda5d7dc730 req-8e186e11-7ade-476a-8385-567e8b7ae432 tempest-ServersTestBootFromVolume-307388374 None] deleting rbd volume volume-6639f2c6-65d9-49ac-ba19-1bfddc2cceae {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:24:21.830191 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-0bc7c067-c901-465f-a52c-c4664b63fb13 tempest-VolumesTestJSON-905126376 None] Created reservations ['3fc4a9d8-873a-4af1-8c01-72ceca5609fa', 'fb51706f-0baf-4038-be9d-7fd125325c2f', 'c5ce63fb-9ef1-4cad-9b5d-f5466a7a61bf', '98067ed8-e8a7-47a1-b82f-1593ef0491fe'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:24:22.151012 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-0bc7c067-c901-465f-a52c-c4664b63fb13 tempest-VolumesTestJSON-905126376 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:24:22.185312 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-0bc7c067-c901-465f-a52c-c4664b63fb13 tempest-VolumesTestJSON-905126376 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:24:22.217906 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-0bc7c067-c901-465f-a52c-c4664b63fb13 tempest-VolumesTestJSON-905126376 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:24:22.222637 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-0bc7c067-c901-465f-a52c-c4664b63fb13 tempest-VolumesTestJSON-905126376 None] Deleted volume successfully. Apr 30 21:24:22.314200 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-0bc7c067-c901-465f-a52c-c4664b63fb13 tempest-VolumesTestJSON-905126376 None] Lock "b'cinder-4db3c1e6-b18f-4af0-b9e4-ecbb653b3a76-delete_volume'" released by "delete_volume" :: held 9.914s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:24:25.052889 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-e2683536-8903-4a33-a28e-acda5d7dc730 req-8e186e11-7ade-476a-8385-567e8b7ae432 tempest-ServersTestBootFromVolume-307388374 None] volume is a clone so cleaning references {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} Apr 30 21:24:25.284899 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-e2683536-8903-4a33-a28e-acda5d7dc730 req-8e186e11-7ade-476a-8385-567e8b7ae432 tempest-ServersTestBootFromVolume-307388374 None] deleting parent snapshot volume-6639f2c6-65d9-49ac-ba19-1bfddc2cceae.clone_snap {{(pid=123855) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} Apr 30 21:24:28.941351 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:24:28.942892 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:24:29.007419 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:24:29.098804 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:24:29.263637 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [req-e2683536-8903-4a33-a28e-acda5d7dc730 req-8e186e11-7ade-476a-8385-567e8b7ae432 tempest-ServersTestBootFromVolume-307388374 None] Created reservations ['6f19433b-06e3-4719-bed2-b6cd6d801ad0', 'bce1d019-00e2-4663-9ceb-1478c36cd91c', '2135df83-6998-431b-9c77-d796cc7ad9ed', 'c6e56ce2-4f82-4a84-a64d-d91f0d30be5b'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:24:29.465120 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-e2683536-8903-4a33-a28e-acda5d7dc730 req-8e186e11-7ade-476a-8385-567e8b7ae432 tempest-ServersTestBootFromVolume-307388374 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:24:29.545571 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-e2683536-8903-4a33-a28e-acda5d7dc730 req-8e186e11-7ade-476a-8385-567e8b7ae432 tempest-ServersTestBootFromVolume-307388374 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:24:29.619202 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [req-e2683536-8903-4a33-a28e-acda5d7dc730 req-8e186e11-7ade-476a-8385-567e8b7ae432 tempest-ServersTestBootFromVolume-307388374 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:24:29.625351 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-e2683536-8903-4a33-a28e-acda5d7dc730 req-8e186e11-7ade-476a-8385-567e8b7ae432 tempest-ServersTestBootFromVolume-307388374 None] Deleted volume successfully. Apr 30 21:24:29.709167 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [req-e2683536-8903-4a33-a28e-acda5d7dc730 req-8e186e11-7ade-476a-8385-567e8b7ae432 tempest-ServersTestBootFromVolume-307388374 None] Lock "b'cinder-6639f2c6-65d9-49ac-ba19-1bfddc2cceae-delete_volume'" released by "delete_volume" :: held 15.173s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:25:19.894389 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-494748b4-bec3-4b9e-9762-86ce8c977055 tempest-AttachVolumeShelveTestJSON-2129222160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:25:19.920219 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-494748b4-bec3-4b9e-9762-86ce8c977055 tempest-AttachVolumeShelveTestJSON-2129222160 None] Flow 'volume_create_manager' (36e7ae49-d504-4c9f-94d1-f40fb82bb955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:25:19.927701 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-494748b4-bec3-4b9e-9762-86ce8c977055 tempest-AttachVolumeShelveTestJSON-2129222160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d55ec932-4f2e-44fc-bc83-c044f0077bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:25:19.945283 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-494748b4-bec3-4b9e-9762-86ce8c977055 tempest-AttachVolumeShelveTestJSON-2129222160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d55ec932-4f2e-44fc-bc83-c044f0077bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-733130768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=70c7df6b-296f-4bb3-a474-a0df44259086,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc5d20f2f9f4ecf981cdfe980cfc21d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:25:20Z,use_quota=True,user_id='65bedbcb4d094160a9a9fc3b6ba6f603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:25:19.954839 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-494748b4-bec3-4b9e-9762-86ce8c977055 tempest-AttachVolumeShelveTestJSON-2129222160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a1959d-2a08-4b8b-941b-c9fd640ff1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:25:19.969819 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-494748b4-bec3-4b9e-9762-86ce8c977055 tempest-AttachVolumeShelveTestJSON-2129222160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a1959d-2a08-4b8b-941b-c9fd640ff1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:25:19.976929 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-494748b4-bec3-4b9e-9762-86ce8c977055 tempest-AttachVolumeShelveTestJSON-2129222160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (882792bd-486e-47b3-9109-41d5abce53af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:25:19.987130 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-494748b4-bec3-4b9e-9762-86ce8c977055 tempest-AttachVolumeShelveTestJSON-2129222160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (882792bd-486e-47b3-9109-41d5abce53af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70c7df6b-296f-4bb3-a474-a0df44259086', 'volume_name': 'volume-70c7df6b-296f-4bb3-a474-a0df44259086', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:25:19.999344 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-494748b4-bec3-4b9e-9762-86ce8c977055 tempest-AttachVolumeShelveTestJSON-2129222160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0553b5ee-0c75-48df-9b66-18412faa8134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:25:20.004245 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-494748b4-bec3-4b9e-9762-86ce8c977055 tempest-AttachVolumeShelveTestJSON-2129222160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0553b5ee-0c75-48df-9b66-18412faa8134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:25:20.011615 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-494748b4-bec3-4b9e-9762-86ce8c977055 tempest-AttachVolumeShelveTestJSON-2129222160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35243c2b-e3f8-4801-9db4-773c0f469404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:25:20.013190 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-494748b4-bec3-4b9e-9762-86ce8c977055 tempest-AttachVolumeShelveTestJSON-2129222160 None] Volume 70c7df6b-296f-4bb3-a474-a0df44259086: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70c7df6b-296f-4bb3-a474-a0df44259086', 'volume_size': 1} Apr 30 21:25:20.014010 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-494748b4-bec3-4b9e-9762-86ce8c977055 tempest-AttachVolumeShelveTestJSON-2129222160 None] creating volume 'volume-70c7df6b-296f-4bb3-a474-a0df44259086' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:25:20.015677 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-494748b4-bec3-4b9e-9762-86ce8c977055 tempest-AttachVolumeShelveTestJSON-2129222160 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:25:21.482357 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-494748b4-bec3-4b9e-9762-86ce8c977055 tempest-AttachVolumeShelveTestJSON-2129222160 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:25:21.486008 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-494748b4-bec3-4b9e-9762-86ce8c977055 tempest-AttachVolumeShelveTestJSON-2129222160 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:25:21.495791 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-494748b4-bec3-4b9e-9762-86ce8c977055 tempest-AttachVolumeShelveTestJSON-2129222160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35243c2b-e3f8-4801-9db4-773c0f469404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70c7df6b-296f-4bb3-a474-a0df44259086', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:25:21.514996 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-494748b4-bec3-4b9e-9762-86ce8c977055 tempest-AttachVolumeShelveTestJSON-2129222160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c75dcadc-b189-46a6-b808-3d8adc36462d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:25:21.616369 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-494748b4-bec3-4b9e-9762-86ce8c977055 tempest-AttachVolumeShelveTestJSON-2129222160 None] Volume volume-70c7df6b-296f-4bb3-a474-a0df44259086 (70c7df6b-296f-4bb3-a474-a0df44259086): created successfully Apr 30 21:25:21.620883 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-494748b4-bec3-4b9e-9762-86ce8c977055 tempest-AttachVolumeShelveTestJSON-2129222160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c75dcadc-b189-46a6-b808-3d8adc36462d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:25:21.627777 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-494748b4-bec3-4b9e-9762-86ce8c977055 tempest-AttachVolumeShelveTestJSON-2129222160 None] Flow 'volume_create_manager' (36e7ae49-d504-4c9f-94d1-f40fb82bb955) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:25:21.753136 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-494748b4-bec3-4b9e-9762-86ce8c977055 tempest-AttachVolumeShelveTestJSON-2129222160 None] Created volume successfully. Apr 30 21:25:28.946414 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:25:28.946414 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:25:29.012375 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:25:29.093667 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:25:31.611884 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb16e8ce-018f-4790-8911-4b638730d014 tempest-AttachVolumeNegativeTest-612541851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:25:31.656963 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-fb16e8ce-018f-4790-8911-4b638730d014 tempest-AttachVolumeNegativeTest-612541851 None] Flow 'volume_create_manager' (39a11f33-565a-4cf3-aa79-94e7e7f45dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:25:31.663969 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-fb16e8ce-018f-4790-8911-4b638730d014 tempest-AttachVolumeNegativeTest-612541851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c0e525b-3258-47bd-bbe8-2788bfc2bce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:25:31.684912 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-fb16e8ce-018f-4790-8911-4b638730d014 tempest-AttachVolumeNegativeTest-612541851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c0e525b-3258-47bd-bbe8-2788bfc2bce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-57607424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=28cf7446-872a-4b61-8092-677879a5220a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ceedad6e134d94ac8758f8385a47e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:25:31Z,use_quota=True,user_id='9cc9b55d852942538c3ad8f317dcd73e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:25:31.690910 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-fb16e8ce-018f-4790-8911-4b638730d014 tempest-AttachVolumeNegativeTest-612541851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (832e6b3a-e86f-4d98-9ac5-f758a0148f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:25:31.695342 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-fb16e8ce-018f-4790-8911-4b638730d014 tempest-AttachVolumeNegativeTest-612541851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (832e6b3a-e86f-4d98-9ac5-f758a0148f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:25:31.700829 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-fb16e8ce-018f-4790-8911-4b638730d014 tempest-AttachVolumeNegativeTest-612541851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce5c62f4-048a-4de4-9997-b912f993d810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:25:31.705957 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-fb16e8ce-018f-4790-8911-4b638730d014 tempest-AttachVolumeNegativeTest-612541851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce5c62f4-048a-4de4-9997-b912f993d810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28cf7446-872a-4b61-8092-677879a5220a', 'volume_name': 'volume-28cf7446-872a-4b61-8092-677879a5220a', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:25:31.711322 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-fb16e8ce-018f-4790-8911-4b638730d014 tempest-AttachVolumeNegativeTest-612541851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (797db9f3-e22f-4d0e-bfbf-f3b99afd47a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:25:31.720541 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-fb16e8ce-018f-4790-8911-4b638730d014 tempest-AttachVolumeNegativeTest-612541851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (797db9f3-e22f-4d0e-bfbf-f3b99afd47a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:25:31.726928 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-fb16e8ce-018f-4790-8911-4b638730d014 tempest-AttachVolumeNegativeTest-612541851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eee8b139-a8f3-4960-bd8a-fc50d7cbf90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:25:31.731070 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-fb16e8ce-018f-4790-8911-4b638730d014 tempest-AttachVolumeNegativeTest-612541851 None] Volume 28cf7446-872a-4b61-8092-677879a5220a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28cf7446-872a-4b61-8092-677879a5220a', 'volume_size': 1} Apr 30 21:25:31.731565 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-fb16e8ce-018f-4790-8911-4b638730d014 tempest-AttachVolumeNegativeTest-612541851 None] creating volume 'volume-28cf7446-872a-4b61-8092-677879a5220a' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:25:31.732298 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-fb16e8ce-018f-4790-8911-4b638730d014 tempest-AttachVolumeNegativeTest-612541851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:25:33.430329 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-fb16e8ce-018f-4790-8911-4b638730d014 tempest-AttachVolumeNegativeTest-612541851 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:25:33.431564 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-fb16e8ce-018f-4790-8911-4b638730d014 tempest-AttachVolumeNegativeTest-612541851 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:25:33.439575 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-fb16e8ce-018f-4790-8911-4b638730d014 tempest-AttachVolumeNegativeTest-612541851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eee8b139-a8f3-4960-bd8a-fc50d7cbf90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28cf7446-872a-4b61-8092-677879a5220a', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:25:33.451585 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-fb16e8ce-018f-4790-8911-4b638730d014 tempest-AttachVolumeNegativeTest-612541851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f47c6cf8-5dab-42d2-98e2-e650f500995b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:25:33.638028 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-fb16e8ce-018f-4790-8911-4b638730d014 tempest-AttachVolumeNegativeTest-612541851 None] Volume volume-28cf7446-872a-4b61-8092-677879a5220a (28cf7446-872a-4b61-8092-677879a5220a): created successfully Apr 30 21:25:33.645353 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-fb16e8ce-018f-4790-8911-4b638730d014 tempest-AttachVolumeNegativeTest-612541851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f47c6cf8-5dab-42d2-98e2-e650f500995b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:25:33.649644 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-fb16e8ce-018f-4790-8911-4b638730d014 tempest-AttachVolumeNegativeTest-612541851 None] Flow 'volume_create_manager' (39a11f33-565a-4cf3-aa79-94e7e7f45dbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:25:33.747158 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-fb16e8ce-018f-4790-8911-4b638730d014 tempest-AttachVolumeNegativeTest-612541851 None] Created volume successfully. Apr 30 21:25:35.894535 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-35c43610-673d-4088-a2c2-456cf8b3c025 req-a835f091-88dd-4018-b76a-9866da4a0409 tempest-AttachVolumeNegativeTest-612541851 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:25:36.932320 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-35c43610-673d-4088-a2c2-456cf8b3c025 req-a835f091-88dd-4018-b76a-9866da4a0409 tempest-AttachVolumeNegativeTest-612541851 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.039s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:25:36.935077 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-35c43610-673d-4088-a2c2-456cf8b3c025 req-a835f091-88dd-4018-b76a-9866da4a0409 tempest-AttachVolumeNegativeTest-612541851 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-28cf7446-872a-4b61-8092-677879a5220a', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': '28cf7446-872a-4b61-8092-677879a5220a', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:25:37.136841 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-35c43610-673d-4088-a2c2-456cf8b3c025 req-a835f091-88dd-4018-b76a-9866da4a0409 tempest-AttachVolumeNegativeTest-612541851 None] Connection info returned from driver {'name': 'volumes/volume-28cf7446-872a-4b61-8092-677879a5220a', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '28cf7446-872a-4b61-8092-677879a5220a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '57644098-e0e4-410d-94f6-7ac8c610460a'} {{(pid=123855) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Apr 30 21:25:37.374725 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-35c43610-673d-4088-a2c2-456cf8b3c025 req-a835f091-88dd-4018-b76a-9866da4a0409 tempest-AttachVolumeNegativeTest-612541851 None] attachment_update completed successfully. Apr 30 21:26:06.418518 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-74f772b8-6042-406c-8ba5-f53541b5ac24 req-f49663de-f84f-47c9-ad9d-a126b89380db tempest-AttachVolumeShelveTestJSON-2129222160 None] No connector for attachment 261a56ef-7b39-40d2-863a-a2286c88ab40; skipping storage backend terminate_connection call. {{(pid=123855) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4910}} Apr 30 21:26:06.432594 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-74f772b8-6042-406c-8ba5-f53541b5ac24 req-f49663de-f84f-47c9-ad9d-a126b89380db tempest-AttachVolumeShelveTestJSON-2129222160 None] Deleting attachment 261a56ef-7b39-40d2-863a-a2286c88ab40. {{(pid=123855) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} Apr 30 21:26:14.701690 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-d5af17c8-2c07-47d2-98c1-01aeca794804 req-2edb6738-88ad-4bf3-af5b-2115f633f623 tempest-TaggedBootDevicesTest-1496276863 None] Terminate volume connection completed successfully. Apr 30 21:26:14.702524 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-d5af17c8-2c07-47d2-98c1-01aeca794804 req-2edb6738-88ad-4bf3-af5b-2115f633f623 tempest-TaggedBootDevicesTest-1496276863 None] Deleting attachment 0b86a235-7c92-4fc6-ba37-2a770ef74c9e. {{(pid=123855) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} Apr 30 21:26:15.139338 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-d5af17c8-2c07-47d2-98c1-01aeca794804 req-f8707ab9-6430-46ba-b117-e2723a5a8ced tempest-TaggedBootDevicesTest-1496276863 None] Terminate volume connection completed successfully. Apr 30 21:26:15.139765 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-d5af17c8-2c07-47d2-98c1-01aeca794804 req-f8707ab9-6430-46ba-b117-e2723a5a8ced tempest-TaggedBootDevicesTest-1496276863 None] Deleting attachment 48d1435b-da65-49f9-a64e-be815fb17fd5. {{(pid=123855) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} Apr 30 21:26:15.377101 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-d5af17c8-2c07-47d2-98c1-01aeca794804 req-025bdb70-952a-4816-86a7-037d8e8fe8b8 tempest-TaggedBootDevicesTest-1496276863 None] Terminate volume connection completed successfully. Apr 30 21:26:15.377521 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-d5af17c8-2c07-47d2-98c1-01aeca794804 req-025bdb70-952a-4816-86a7-037d8e8fe8b8 tempest-TaggedBootDevicesTest-1496276863 None] Deleting attachment 3889338b-777e-4f52-9874-e8b6d7b1b709. {{(pid=123855) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} Apr 30 21:26:25.856013 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-d36fdf2f-1441-457f-84ca-625da21ced26 tempest-TaggedBootDevicesTest-1496276863 None] Lock "b'cinder-80f5c8d3-2b42-46ef-9de8-ca18b38a1f28-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:26:26.041325 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-d36fdf2f-1441-457f-84ca-625da21ced26 tempest-TaggedBootDevicesTest-1496276863 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:26:26.353449 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-d36fdf2f-1441-457f-84ca-625da21ced26 tempest-TaggedBootDevicesTest-1496276863 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:26:26.355357 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-d36fdf2f-1441-457f-84ca-625da21ced26 tempest-TaggedBootDevicesTest-1496276863 None] Volume volume-80f5c8d3-2b42-46ef-9de8-ca18b38a1f28 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:26:26.518523 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-d36fdf2f-1441-457f-84ca-625da21ced26 tempest-TaggedBootDevicesTest-1496276863 None] deleting rbd volume volume-80f5c8d3-2b42-46ef-9de8-ca18b38a1f28 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:26:28.951269 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:26:28.953528 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:26:29.026787 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:26:29.092734 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:26:35.104627 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-d36fdf2f-1441-457f-84ca-625da21ced26 tempest-TaggedBootDevicesTest-1496276863 None] Created reservations ['1f342d8d-ec47-4f6d-88ef-b4f5bd90efe8', 'a4859fa9-b447-4a76-a56c-f79b9d327326', '7d074871-b854-4b13-b411-14e0c64fcfb6', '4173e9e6-df95-47ae-a6e8-638a0b5c42aa'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:26:35.357118 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-d36fdf2f-1441-457f-84ca-625da21ced26 tempest-TaggedBootDevicesTest-1496276863 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:26:35.416185 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-d36fdf2f-1441-457f-84ca-625da21ced26 tempest-TaggedBootDevicesTest-1496276863 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:26:35.474462 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-d36fdf2f-1441-457f-84ca-625da21ced26 tempest-TaggedBootDevicesTest-1496276863 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:26:35.479254 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-d36fdf2f-1441-457f-84ca-625da21ced26 tempest-TaggedBootDevicesTest-1496276863 None] Deleted volume successfully. Apr 30 21:26:35.574727 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-d36fdf2f-1441-457f-84ca-625da21ced26 tempest-TaggedBootDevicesTest-1496276863 None] Lock "b'cinder-80f5c8d3-2b42-46ef-9de8-ca18b38a1f28-delete_volume'" released by "delete_volume" :: held 9.718s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:26:36.058070 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-df6eba01-a77d-4a63-bef3-6106e3d569d3 tempest-TaggedBootDevicesTest-1496276863 None] Lock "b'cinder-2c40c928-cd22-4b64-8d73-211240864fa6-delete_volume'" acquired by "delete_volume" :: waited 0.030s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:26:36.228535 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-df6eba01-a77d-4a63-bef3-6106e3d569d3 tempest-TaggedBootDevicesTest-1496276863 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:26:36.459280 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-df6eba01-a77d-4a63-bef3-6106e3d569d3 tempest-TaggedBootDevicesTest-1496276863 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:26:36.459700 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-df6eba01-a77d-4a63-bef3-6106e3d569d3 tempest-TaggedBootDevicesTest-1496276863 None] Volume volume-2c40c928-cd22-4b64-8d73-211240864fa6 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:26:36.677836 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-df6eba01-a77d-4a63-bef3-6106e3d569d3 tempest-TaggedBootDevicesTest-1496276863 None] deleting rbd volume volume-2c40c928-cd22-4b64-8d73-211240864fa6 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:26:44.409026 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-df6eba01-a77d-4a63-bef3-6106e3d569d3 tempest-TaggedBootDevicesTest-1496276863 None] Created reservations ['e1493379-03db-4d77-8901-adde807ae3a1', 'e146e130-93ec-460d-b04a-d465ed32f609', 'c008b9ed-5c1f-4c2e-b929-1dd867cafc1b', 'ce824e1e-f6fe-4d50-9340-0389082b49de'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:26:44.612583 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-df6eba01-a77d-4a63-bef3-6106e3d569d3 tempest-TaggedBootDevicesTest-1496276863 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:26:44.705702 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-df6eba01-a77d-4a63-bef3-6106e3d569d3 tempest-TaggedBootDevicesTest-1496276863 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:26:44.766644 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-df6eba01-a77d-4a63-bef3-6106e3d569d3 tempest-TaggedBootDevicesTest-1496276863 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:26:44.771074 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-df6eba01-a77d-4a63-bef3-6106e3d569d3 tempest-TaggedBootDevicesTest-1496276863 None] Deleted volume successfully. Apr 30 21:26:44.913053 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-df6eba01-a77d-4a63-bef3-6106e3d569d3 tempest-TaggedBootDevicesTest-1496276863 None] Lock "b'cinder-2c40c928-cd22-4b64-8d73-211240864fa6-delete_volume'" released by "delete_volume" :: held 8.853s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:26:45.045975 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-f050dc64-89f4-4cef-98a7-a85e53bbc058 tempest-TaggedBootDevicesTest-1496276863 None] Lock "b'cinder-acace4b6-8088-43ff-9975-029ca62df01f-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:26:45.212560 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f050dc64-89f4-4cef-98a7-a85e53bbc058 tempest-TaggedBootDevicesTest-1496276863 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:26:45.574415 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f050dc64-89f4-4cef-98a7-a85e53bbc058 tempest-TaggedBootDevicesTest-1496276863 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:26:45.837572 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f050dc64-89f4-4cef-98a7-a85e53bbc058 tempest-TaggedBootDevicesTest-1496276863 None] deleting rbd volume volume-acace4b6-8088-43ff-9975-029ca62df01f {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:26:55.196767 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-0de7c25a-85fb-4432-b3d4-677ce39c92c3 req-29358c34-d8c3-4902-a2f5-c24129e4c17e tempest-AttachVolumeNegativeTest-612541851 None] Terminate volume connection completed successfully. Apr 30 21:26:55.197412 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-0de7c25a-85fb-4432-b3d4-677ce39c92c3 req-29358c34-d8c3-4902-a2f5-c24129e4c17e tempest-AttachVolumeNegativeTest-612541851 None] Deleting attachment 57644098-e0e4-410d-94f6-7ac8c610460a. {{(pid=123855) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} Apr 30 21:26:55.718974 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f050dc64-89f4-4cef-98a7-a85e53bbc058 tempest-TaggedBootDevicesTest-1496276863 None] volume is a clone so cleaning references {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} Apr 30 21:26:56.033159 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f050dc64-89f4-4cef-98a7-a85e53bbc058 tempest-TaggedBootDevicesTest-1496276863 None] deleting parent snapshot volume-acace4b6-8088-43ff-9975-029ca62df01f.clone_snap {{(pid=123855) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} Apr 30 21:27:00.585042 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-f050dc64-89f4-4cef-98a7-a85e53bbc058 tempest-TaggedBootDevicesTest-1496276863 None] Created reservations ['518f290a-a74f-4da3-a849-5f509b91cc08', '55bc346b-7fa9-4234-954c-18e546d28126', '821a520d-8f95-4077-b181-2847bbba835d', 'dccbb0ba-e0da-47fe-98fd-ed8f61d1ad47'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:27:00.820374 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f050dc64-89f4-4cef-98a7-a85e53bbc058 tempest-TaggedBootDevicesTest-1496276863 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:27:00.861459 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f050dc64-89f4-4cef-98a7-a85e53bbc058 tempest-TaggedBootDevicesTest-1496276863 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:27:00.913536 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-f050dc64-89f4-4cef-98a7-a85e53bbc058 tempest-TaggedBootDevicesTest-1496276863 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:27:00.919076 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-f050dc64-89f4-4cef-98a7-a85e53bbc058 tempest-TaggedBootDevicesTest-1496276863 None] Deleted volume successfully. Apr 30 21:27:01.003745 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-f050dc64-89f4-4cef-98a7-a85e53bbc058 tempest-TaggedBootDevicesTest-1496276863 None] Lock "b'cinder-acace4b6-8088-43ff-9975-029ca62df01f-delete_volume'" released by "delete_volume" :: held 15.958s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:27:26.174576 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-bde19814-fdae-4cb5-8832-ae5371484151 tempest-AttachVolumeShelveTestJSON-2129222160 None] Lock "b'cinder-70c7df6b-296f-4bb3-a474-a0df44259086-delete_volume'" acquired by "delete_volume" :: waited 0.033s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:27:26.317518 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bde19814-fdae-4cb5-8832-ae5371484151 tempest-AttachVolumeShelveTestJSON-2129222160 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:27:26.676625 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bde19814-fdae-4cb5-8832-ae5371484151 tempest-AttachVolumeShelveTestJSON-2129222160 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:27:26.677133 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bde19814-fdae-4cb5-8832-ae5371484151 tempest-AttachVolumeShelveTestJSON-2129222160 None] Volume volume-70c7df6b-296f-4bb3-a474-a0df44259086 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:27:26.768393 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bde19814-fdae-4cb5-8832-ae5371484151 tempest-AttachVolumeShelveTestJSON-2129222160 None] deleting rbd volume volume-70c7df6b-296f-4bb3-a474-a0df44259086 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:27:28.949683 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:27:28.950378 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:27:28.984748 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:27:29.032668 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:27:34.887993 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-bde19814-fdae-4cb5-8832-ae5371484151 tempest-AttachVolumeShelveTestJSON-2129222160 None] Created reservations ['6aa07279-42a1-48d3-a6ac-5e523086f596', 'b8d9ee3d-9768-490a-88df-91d92f355cf8', '57475457-72a1-4cf4-a2b1-f3a33c63ddc0', '07607c6c-7d06-4f74-8074-f2d0519e00f7'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:27:35.196523 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bde19814-fdae-4cb5-8832-ae5371484151 tempest-AttachVolumeShelveTestJSON-2129222160 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:27:35.248428 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bde19814-fdae-4cb5-8832-ae5371484151 tempest-AttachVolumeShelveTestJSON-2129222160 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:27:35.297371 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-bde19814-fdae-4cb5-8832-ae5371484151 tempest-AttachVolumeShelveTestJSON-2129222160 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:27:35.303850 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-bde19814-fdae-4cb5-8832-ae5371484151 tempest-AttachVolumeShelveTestJSON-2129222160 None] Deleted volume successfully. Apr 30 21:27:35.405297 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-bde19814-fdae-4cb5-8832-ae5371484151 tempest-AttachVolumeShelveTestJSON-2129222160 None] Lock "b'cinder-70c7df6b-296f-4bb3-a474-a0df44259086-delete_volume'" released by "delete_volume" :: held 9.234s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:27:37.045653 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-398c9013-6521-41e9-9f09-d43ac50f00bd tempest-AttachVolumeShelveTestJSON-2129222160 None] Lock "b'cinder-ecaa8fc8-122d-4201-b4ec-f389b692b0fa-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:27:37.184471 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-398c9013-6521-41e9-9f09-d43ac50f00bd tempest-AttachVolumeShelveTestJSON-2129222160 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:27:37.411898 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-398c9013-6521-41e9-9f09-d43ac50f00bd tempest-AttachVolumeShelveTestJSON-2129222160 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:27:37.412706 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-398c9013-6521-41e9-9f09-d43ac50f00bd tempest-AttachVolumeShelveTestJSON-2129222160 None] Volume volume-ecaa8fc8-122d-4201-b4ec-f389b692b0fa is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:27:37.615775 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-398c9013-6521-41e9-9f09-d43ac50f00bd tempest-AttachVolumeShelveTestJSON-2129222160 None] deleting rbd volume volume-ecaa8fc8-122d-4201-b4ec-f389b692b0fa {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:27:46.561960 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-398c9013-6521-41e9-9f09-d43ac50f00bd tempest-AttachVolumeShelveTestJSON-2129222160 None] Created reservations ['5994b832-4d2e-462c-8c8c-44bd6ef5af63', '33e2cad4-f5d1-4f30-bd23-eebfd28a55b2', '973b116d-722f-4d32-900f-603be5d69b42', '91d9d0d5-5598-4325-81e8-83b675059248'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:27:46.865889 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-398c9013-6521-41e9-9f09-d43ac50f00bd tempest-AttachVolumeShelveTestJSON-2129222160 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:27:46.934478 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-398c9013-6521-41e9-9f09-d43ac50f00bd tempest-AttachVolumeShelveTestJSON-2129222160 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:27:47.015566 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-398c9013-6521-41e9-9f09-d43ac50f00bd tempest-AttachVolumeShelveTestJSON-2129222160 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:27:47.015566 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-398c9013-6521-41e9-9f09-d43ac50f00bd tempest-AttachVolumeShelveTestJSON-2129222160 None] Deleted volume successfully. Apr 30 21:27:47.099255 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-398c9013-6521-41e9-9f09-d43ac50f00bd tempest-AttachVolumeShelveTestJSON-2129222160 None] Lock "b'cinder-ecaa8fc8-122d-4201-b4ec-f389b692b0fa-delete_volume'" released by "delete_volume" :: held 10.052s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:28:01.888978 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [req-e2912f6b-2115-40ca-8a0b-b1118efa8ff9 req-68a30d90-16c0-4a36-aca9-04dc1412398c tempest-VolumesGetTestJSON-362554649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:28:01.923256 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-e2912f6b-2115-40ca-8a0b-b1118efa8ff9 req-68a30d90-16c0-4a36-aca9-04dc1412398c tempest-VolumesGetTestJSON-362554649 None] Flow 'volume_create_manager' (8a17f085-3306-4dc9-9aaa-3300ad143988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:28:01.932725 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-e2912f6b-2115-40ca-8a0b-b1118efa8ff9 req-68a30d90-16c0-4a36-aca9-04dc1412398c tempest-VolumesGetTestJSON-362554649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (155b26a4-9246-4e6b-ad39-6ce15c3f95c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:01.956108 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-e2912f6b-2115-40ca-8a0b-b1118efa8ff9 req-68a30d90-16c0-4a36-aca9-04dc1412398c tempest-VolumesGetTestJSON-362554649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (155b26a4-9246-4e6b-ad39-6ce15c3f95c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1689545878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=eaadabac-c80f-4a79-8d6c-4e6fd42b613a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cf406de8e3de44c1ad8c376bd32503ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:28:02Z,use_quota=True,user_id='a5e7a9057ca044b780a30da3333aecbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:01.961570 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-e2912f6b-2115-40ca-8a0b-b1118efa8ff9 req-68a30d90-16c0-4a36-aca9-04dc1412398c tempest-VolumesGetTestJSON-362554649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75193c87-75ac-4618-af0d-b41f5dc42043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:01.966461 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-e2912f6b-2115-40ca-8a0b-b1118efa8ff9 req-68a30d90-16c0-4a36-aca9-04dc1412398c tempest-VolumesGetTestJSON-362554649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75193c87-75ac-4618-af0d-b41f5dc42043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:01.973187 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-e2912f6b-2115-40ca-8a0b-b1118efa8ff9 req-68a30d90-16c0-4a36-aca9-04dc1412398c tempest-VolumesGetTestJSON-362554649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c372d20f-a54c-4736-b5db-9cd3ec4cc44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:01.998469 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-e2912f6b-2115-40ca-8a0b-b1118efa8ff9 req-68a30d90-16c0-4a36-aca9-04dc1412398c tempest-VolumesGetTestJSON-362554649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c372d20f-a54c-4736-b5db-9cd3ec4cc44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaadabac-c80f-4a79-8d6c-4e6fd42b613a', 'volume_name': 'volume-eaadabac-c80f-4a79-8d6c-4e6fd42b613a', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:02.008225 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-e2912f6b-2115-40ca-8a0b-b1118efa8ff9 req-68a30d90-16c0-4a36-aca9-04dc1412398c tempest-VolumesGetTestJSON-362554649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c4275a-746e-4683-810e-a22420f27e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:02.013400 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-e2912f6b-2115-40ca-8a0b-b1118efa8ff9 req-68a30d90-16c0-4a36-aca9-04dc1412398c tempest-VolumesGetTestJSON-362554649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c4275a-746e-4683-810e-a22420f27e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:02.021425 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-e2912f6b-2115-40ca-8a0b-b1118efa8ff9 req-68a30d90-16c0-4a36-aca9-04dc1412398c tempest-VolumesGetTestJSON-362554649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deea7792-bf90-4483-bea8-c497e497c33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:02.022849 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [req-e2912f6b-2115-40ca-8a0b-b1118efa8ff9 req-68a30d90-16c0-4a36-aca9-04dc1412398c tempest-VolumesGetTestJSON-362554649 None] Volume eaadabac-c80f-4a79-8d6c-4e6fd42b613a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaadabac-c80f-4a79-8d6c-4e6fd42b613a', 'volume_size': 1} Apr 30 21:28:02.023246 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-e2912f6b-2115-40ca-8a0b-b1118efa8ff9 req-68a30d90-16c0-4a36-aca9-04dc1412398c tempest-VolumesGetTestJSON-362554649 None] creating volume 'volume-eaadabac-c80f-4a79-8d6c-4e6fd42b613a' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:28:02.025250 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-e2912f6b-2115-40ca-8a0b-b1118efa8ff9 req-68a30d90-16c0-4a36-aca9-04dc1412398c tempest-VolumesGetTestJSON-362554649 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:28:03.207623 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-e2912f6b-2115-40ca-8a0b-b1118efa8ff9 req-68a30d90-16c0-4a36-aca9-04dc1412398c tempest-VolumesGetTestJSON-362554649 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:28:03.207623 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-e2912f6b-2115-40ca-8a0b-b1118efa8ff9 req-68a30d90-16c0-4a36-aca9-04dc1412398c tempest-VolumesGetTestJSON-362554649 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:28:03.208542 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-e2912f6b-2115-40ca-8a0b-b1118efa8ff9 req-68a30d90-16c0-4a36-aca9-04dc1412398c tempest-VolumesGetTestJSON-362554649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deea7792-bf90-4483-bea8-c497e497c33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaadabac-c80f-4a79-8d6c-4e6fd42b613a', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:03.216245 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-e2912f6b-2115-40ca-8a0b-b1118efa8ff9 req-68a30d90-16c0-4a36-aca9-04dc1412398c tempest-VolumesGetTestJSON-362554649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c61b697-9219-4e44-a868-ca0fe6319374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:03.308876 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [req-e2912f6b-2115-40ca-8a0b-b1118efa8ff9 req-68a30d90-16c0-4a36-aca9-04dc1412398c tempest-VolumesGetTestJSON-362554649 None] Volume volume-eaadabac-c80f-4a79-8d6c-4e6fd42b613a (eaadabac-c80f-4a79-8d6c-4e6fd42b613a): created successfully Apr 30 21:28:03.314848 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-e2912f6b-2115-40ca-8a0b-b1118efa8ff9 req-68a30d90-16c0-4a36-aca9-04dc1412398c tempest-VolumesGetTestJSON-362554649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c61b697-9219-4e44-a868-ca0fe6319374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:03.328776 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-e2912f6b-2115-40ca-8a0b-b1118efa8ff9 req-68a30d90-16c0-4a36-aca9-04dc1412398c tempest-VolumesGetTestJSON-362554649 None] Flow 'volume_create_manager' (8a17f085-3306-4dc9-9aaa-3300ad143988) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:28:03.439068 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-e2912f6b-2115-40ca-8a0b-b1118efa8ff9 req-68a30d90-16c0-4a36-aca9-04dc1412398c tempest-VolumesGetTestJSON-362554649 None] Created volume successfully. Apr 30 21:28:04.206452 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [req-cbc47a39-1b63-41b3-86ec-a57f90987d65 req-1508d5ff-ca97-4d3d-a8e9-95d7594c5111 tempest-VolumesGetTestJSON-362554649 None] Lock "b'cinder-eaadabac-c80f-4a79-8d6c-4e6fd42b613a-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:28:04.380347 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-cbc47a39-1b63-41b3-86ec-a57f90987d65 req-1508d5ff-ca97-4d3d-a8e9-95d7594c5111 tempest-VolumesGetTestJSON-362554649 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:28:04.692554 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-cbc47a39-1b63-41b3-86ec-a57f90987d65 req-1508d5ff-ca97-4d3d-a8e9-95d7594c5111 tempest-VolumesGetTestJSON-362554649 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:28:04.692989 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-cbc47a39-1b63-41b3-86ec-a57f90987d65 req-1508d5ff-ca97-4d3d-a8e9-95d7594c5111 tempest-VolumesGetTestJSON-362554649 None] Volume volume-eaadabac-c80f-4a79-8d6c-4e6fd42b613a is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:28:04.819846 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-cbc47a39-1b63-41b3-86ec-a57f90987d65 req-1508d5ff-ca97-4d3d-a8e9-95d7594c5111 tempest-VolumesGetTestJSON-362554649 None] deleting rbd volume volume-eaadabac-c80f-4a79-8d6c-4e6fd42b613a {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:28:06.969856 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c04a205-f676-41ec-b8f8-663d16f84c77 tempest-AttachVolumeNegativeTest-612541851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:28:06.989566 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0c04a205-f676-41ec-b8f8-663d16f84c77 tempest-AttachVolumeNegativeTest-612541851 None] Flow 'volume_create_manager' (6a2ebdf0-c825-420b-ad08-7295efa6b3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:28:06.999549 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0c04a205-f676-41ec-b8f8-663d16f84c77 tempest-AttachVolumeNegativeTest-612541851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cd3b3c8-8e30-4a47-a833-8d549c8c2837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:07.017402 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0c04a205-f676-41ec-b8f8-663d16f84c77 tempest-AttachVolumeNegativeTest-612541851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cd3b3c8-8e30-4a47-a833-8d549c8c2837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1199062924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5f41c7c8-f686-4ee6-9456-ce2b755ded8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ceedad6e134d94ac8758f8385a47e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:28:07Z,use_quota=True,user_id='9cc9b55d852942538c3ad8f317dcd73e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:07.022927 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0c04a205-f676-41ec-b8f8-663d16f84c77 tempest-AttachVolumeNegativeTest-612541851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60227548-cab7-46c8-9200-850a261018de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:07.027681 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0c04a205-f676-41ec-b8f8-663d16f84c77 tempest-AttachVolumeNegativeTest-612541851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60227548-cab7-46c8-9200-850a261018de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:07.032761 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0c04a205-f676-41ec-b8f8-663d16f84c77 tempest-AttachVolumeNegativeTest-612541851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dabeb34-728c-4900-9b85-65cd1414deb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:07.037612 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0c04a205-f676-41ec-b8f8-663d16f84c77 tempest-AttachVolumeNegativeTest-612541851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dabeb34-728c-4900-9b85-65cd1414deb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f41c7c8-f686-4ee6-9456-ce2b755ded8d', 'volume_name': 'volume-5f41c7c8-f686-4ee6-9456-ce2b755ded8d', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:07.043682 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0c04a205-f676-41ec-b8f8-663d16f84c77 tempest-AttachVolumeNegativeTest-612541851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a74bd165-9338-4287-b10d-a3e6f77a7c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:07.047580 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0c04a205-f676-41ec-b8f8-663d16f84c77 tempest-AttachVolumeNegativeTest-612541851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a74bd165-9338-4287-b10d-a3e6f77a7c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:07.052207 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0c04a205-f676-41ec-b8f8-663d16f84c77 tempest-AttachVolumeNegativeTest-612541851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6bd0ff4-b26f-4f7e-ad44-1bb951324590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:07.053281 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-0c04a205-f676-41ec-b8f8-663d16f84c77 tempest-AttachVolumeNegativeTest-612541851 None] Volume 5f41c7c8-f686-4ee6-9456-ce2b755ded8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f41c7c8-f686-4ee6-9456-ce2b755ded8d', 'volume_size': 1} Apr 30 21:28:07.053666 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-0c04a205-f676-41ec-b8f8-663d16f84c77 tempest-AttachVolumeNegativeTest-612541851 None] creating volume 'volume-5f41c7c8-f686-4ee6-9456-ce2b755ded8d' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:28:07.054361 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-0c04a205-f676-41ec-b8f8-663d16f84c77 tempest-AttachVolumeNegativeTest-612541851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:28:07.903700 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-0c04a205-f676-41ec-b8f8-663d16f84c77 tempest-AttachVolumeNegativeTest-612541851 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:28:07.904463 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-0c04a205-f676-41ec-b8f8-663d16f84c77 tempest-AttachVolumeNegativeTest-612541851 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:28:07.911976 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0c04a205-f676-41ec-b8f8-663d16f84c77 tempest-AttachVolumeNegativeTest-612541851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6bd0ff4-b26f-4f7e-ad44-1bb951324590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f41c7c8-f686-4ee6-9456-ce2b755ded8d', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:07.919270 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0c04a205-f676-41ec-b8f8-663d16f84c77 tempest-AttachVolumeNegativeTest-612541851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba004e23-f921-428f-8361-387fbceefb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:08.034398 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-0c04a205-f676-41ec-b8f8-663d16f84c77 tempest-AttachVolumeNegativeTest-612541851 None] Volume volume-5f41c7c8-f686-4ee6-9456-ce2b755ded8d (5f41c7c8-f686-4ee6-9456-ce2b755ded8d): created successfully Apr 30 21:28:08.059383 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0c04a205-f676-41ec-b8f8-663d16f84c77 tempest-AttachVolumeNegativeTest-612541851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba004e23-f921-428f-8361-387fbceefb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:08.068224 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0c04a205-f676-41ec-b8f8-663d16f84c77 tempest-AttachVolumeNegativeTest-612541851 None] Flow 'volume_create_manager' (6a2ebdf0-c825-420b-ad08-7295efa6b3ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:28:08.269325 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-0c04a205-f676-41ec-b8f8-663d16f84c77 tempest-AttachVolumeNegativeTest-612541851 None] Created volume successfully. Apr 30 21:28:10.724010 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-c9b12ab5-47c0-4643-97de-b4fee60f0dfd req-adbc241e-1414-4f65-b178-19940030b0fe tempest-AttachVolumeNegativeTest-612541851 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:28:11.457281 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-c9b12ab5-47c0-4643-97de-b4fee60f0dfd req-adbc241e-1414-4f65-b178-19940030b0fe tempest-AttachVolumeNegativeTest-612541851 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.733s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:28:11.458535 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-c9b12ab5-47c0-4643-97de-b4fee60f0dfd req-adbc241e-1414-4f65-b178-19940030b0fe tempest-AttachVolumeNegativeTest-612541851 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5f41c7c8-f686-4ee6-9456-ce2b755ded8d', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': '5f41c7c8-f686-4ee6-9456-ce2b755ded8d', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:28:11.558815 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-c9b12ab5-47c0-4643-97de-b4fee60f0dfd req-adbc241e-1414-4f65-b178-19940030b0fe tempest-AttachVolumeNegativeTest-612541851 None] Connection info returned from driver {'name': 'volumes/volume-5f41c7c8-f686-4ee6-9456-ce2b755ded8d', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5f41c7c8-f686-4ee6-9456-ce2b755ded8d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'fc0da5bd-192f-47b0-b1ee-3e3dfad7afe1'} {{(pid=123855) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Apr 30 21:28:11.714498 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-c9b12ab5-47c0-4643-97de-b4fee60f0dfd req-adbc241e-1414-4f65-b178-19940030b0fe tempest-AttachVolumeNegativeTest-612541851 None] attachment_update completed successfully. Apr 30 21:28:12.692587 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [req-cbc47a39-1b63-41b3-86ec-a57f90987d65 req-1508d5ff-ca97-4d3d-a8e9-95d7594c5111 tempest-VolumesGetTestJSON-362554649 None] Created reservations ['e30b3b1d-5372-4501-a9e2-434e6d9ee043', '9a1a00d9-55f9-46dd-9be7-a7bc2e01d5fe', 'd8e316f1-650a-4418-87ce-b9f60f1dc4ef', 'dde22b39-2da2-42cc-a94a-e788de95c176'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:28:12.919330 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-cbc47a39-1b63-41b3-86ec-a57f90987d65 req-1508d5ff-ca97-4d3d-a8e9-95d7594c5111 tempest-VolumesGetTestJSON-362554649 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:28:12.984295 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-cbc47a39-1b63-41b3-86ec-a57f90987d65 req-1508d5ff-ca97-4d3d-a8e9-95d7594c5111 tempest-VolumesGetTestJSON-362554649 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:28:13.065080 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [req-cbc47a39-1b63-41b3-86ec-a57f90987d65 req-1508d5ff-ca97-4d3d-a8e9-95d7594c5111 tempest-VolumesGetTestJSON-362554649 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:28:13.070453 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-cbc47a39-1b63-41b3-86ec-a57f90987d65 req-1508d5ff-ca97-4d3d-a8e9-95d7594c5111 tempest-VolumesGetTestJSON-362554649 None] Deleted volume successfully. Apr 30 21:28:13.224486 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [req-cbc47a39-1b63-41b3-86ec-a57f90987d65 req-1508d5ff-ca97-4d3d-a8e9-95d7594c5111 tempest-VolumesGetTestJSON-362554649 None] Lock "b'cinder-eaadabac-c80f-4a79-8d6c-4e6fd42b613a-delete_volume'" released by "delete_volume" :: held 9.022s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:28:13.999782 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-c588c360-8758-4b33-82c3-7b6fdaf9a7c5 tempest-VolumesActionsTest-1155069277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:28:14.081160 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c588c360-8758-4b33-82c3-7b6fdaf9a7c5 tempest-VolumesActionsTest-1155069277 None] Flow 'volume_create_manager' (18d53be8-ef44-4c86-896f-52111c0acd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:28:14.107922 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c588c360-8758-4b33-82c3-7b6fdaf9a7c5 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5abb1564-f0f0-40dd-9dff-fba36a19f645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:14.157807 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c588c360-8758-4b33-82c3-7b6fdaf9a7c5 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5abb1564-f0f0-40dd-9dff-fba36a19f645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-605763823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5ea0bb8a-5a1f-4bfe-96b4-b381a5310142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='426405d77bbc4e24adcbe789ba3f42f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:28:14Z,use_quota=True,user_id='3383f0c2b1874b15b38dea61e4b8e498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:14.170353 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c588c360-8758-4b33-82c3-7b6fdaf9a7c5 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc2a7fb2-66c6-45b6-b5e2-f748daddf252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:14.210061 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c588c360-8758-4b33-82c3-7b6fdaf9a7c5 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc2a7fb2-66c6-45b6-b5e2-f748daddf252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:14.228769 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c588c360-8758-4b33-82c3-7b6fdaf9a7c5 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22d76272-8f33-4d43-9e53-761e42ff94b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:14.244799 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c588c360-8758-4b33-82c3-7b6fdaf9a7c5 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22d76272-8f33-4d43-9e53-761e42ff94b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ea0bb8a-5a1f-4bfe-96b4-b381a5310142', 'volume_name': 'volume-5ea0bb8a-5a1f-4bfe-96b4-b381a5310142', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:14.285251 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c588c360-8758-4b33-82c3-7b6fdaf9a7c5 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e503363d-fa3c-48a7-a0d1-6d65578fd081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:14.289975 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c588c360-8758-4b33-82c3-7b6fdaf9a7c5 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e503363d-fa3c-48a7-a0d1-6d65578fd081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:14.295531 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c588c360-8758-4b33-82c3-7b6fdaf9a7c5 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47f85346-397b-4d50-b62e-a600982e3a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:14.297511 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-c588c360-8758-4b33-82c3-7b6fdaf9a7c5 tempest-VolumesActionsTest-1155069277 None] Volume 5ea0bb8a-5a1f-4bfe-96b4-b381a5310142: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ea0bb8a-5a1f-4bfe-96b4-b381a5310142', 'volume_size': 1} Apr 30 21:28:14.306395 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c588c360-8758-4b33-82c3-7b6fdaf9a7c5 tempest-VolumesActionsTest-1155069277 None] creating volume 'volume-5ea0bb8a-5a1f-4bfe-96b4-b381a5310142' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:28:14.307277 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c588c360-8758-4b33-82c3-7b6fdaf9a7c5 tempest-VolumesActionsTest-1155069277 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:28:15.333574 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c588c360-8758-4b33-82c3-7b6fdaf9a7c5 tempest-VolumesActionsTest-1155069277 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:28:15.336016 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c588c360-8758-4b33-82c3-7b6fdaf9a7c5 tempest-VolumesActionsTest-1155069277 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:28:15.342495 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c588c360-8758-4b33-82c3-7b6fdaf9a7c5 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47f85346-397b-4d50-b62e-a600982e3a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ea0bb8a-5a1f-4bfe-96b4-b381a5310142', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:15.347737 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c588c360-8758-4b33-82c3-7b6fdaf9a7c5 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6505ccc-2525-45cb-94b4-a2673e8fae7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:15.469805 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-c588c360-8758-4b33-82c3-7b6fdaf9a7c5 tempest-VolumesActionsTest-1155069277 None] Volume volume-5ea0bb8a-5a1f-4bfe-96b4-b381a5310142 (5ea0bb8a-5a1f-4bfe-96b4-b381a5310142): created successfully Apr 30 21:28:15.474117 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c588c360-8758-4b33-82c3-7b6fdaf9a7c5 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6505ccc-2525-45cb-94b4-a2673e8fae7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:15.480853 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c588c360-8758-4b33-82c3-7b6fdaf9a7c5 tempest-VolumesActionsTest-1155069277 None] Flow 'volume_create_manager' (18d53be8-ef44-4c86-896f-52111c0acd60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:28:15.566589 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-c588c360-8758-4b33-82c3-7b6fdaf9a7c5 tempest-VolumesActionsTest-1155069277 None] Created volume successfully. Apr 30 21:28:16.093474 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-56330018-6a31-4c9b-a80f-54ee94194879 tempest-VolumesActionsTest-1155069277 None] Lock "b'cinder-5ea0bb8a-5a1f-4bfe-96b4-b381a5310142'" acquired by "attach_volume" :: waited 0.010s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:28:16.369943 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-56330018-6a31-4c9b-a80f-54ee94194879 tempest-VolumesActionsTest-1155069277 None] Attaching volume 5ea0bb8a-5a1f-4bfe-96b4-b381a5310142 to instance 9f211fea-c08c-4f08-92bd-948dc20d7503 at mountpoint /dev/sdb on host None. Apr 30 21:28:16.481286 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-56330018-6a31-4c9b-a80f-54ee94194879 tempest-VolumesActionsTest-1155069277 None] Attach volume completed successfully. Apr 30 21:28:16.487389 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-56330018-6a31-4c9b-a80f-54ee94194879 tempest-VolumesActionsTest-1155069277 None] Lock "b'cinder-5ea0bb8a-5a1f-4bfe-96b4-b381a5310142'" released by "attach_volume" :: held 0.393s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:28:16.871392 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-4983aba1-36d9-4db5-a7d0-6d0d48f6e2a5 req-f173db08-0fb9-4338-9c01-923b5bcebea6 tempest-AttachVolumeNegativeTest-612541851 None] Terminate volume connection completed successfully. Apr 30 21:28:16.878305 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-4983aba1-36d9-4db5-a7d0-6d0d48f6e2a5 req-f173db08-0fb9-4338-9c01-923b5bcebea6 tempest-AttachVolumeNegativeTest-612541851 None] Deleting attachment fc0da5bd-192f-47b0-b1ee-3e3dfad7afe1. {{(pid=123855) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} Apr 30 21:28:17.814146 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-65de9e0a-486a-405b-815a-56d603e81d6f tempest-VolumesActionsTest-2024194076 None] Terminate volume connection completed successfully. Apr 30 21:28:17.863094 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-65de9e0a-486a-405b-815a-56d603e81d6f tempest-VolumesActionsTest-2024194076 None] Lock "b'cinder-5ea0bb8a-5a1f-4bfe-96b4-b381a5310142-detach_volume'" acquired by "detach_volume" :: waited 0.010s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:28:17.875458 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-65de9e0a-486a-405b-815a-56d603e81d6f tempest-VolumesActionsTest-2024194076 None] Detaching volume 5ea0bb8a-5a1f-4bfe-96b4-b381a5310142 from instance 9f211fea-c08c-4f08-92bd-948dc20d7503. Apr 30 21:28:18.109331 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-65de9e0a-486a-405b-815a-56d603e81d6f tempest-VolumesActionsTest-2024194076 None] Detach volume completed successfully. Apr 30 21:28:18.119014 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-65de9e0a-486a-405b-815a-56d603e81d6f tempest-VolumesActionsTest-2024194076 None] Lock "b'cinder-5ea0bb8a-5a1f-4bfe-96b4-b381a5310142-detach_volume'" released by "detach_volume" :: held 0.254s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:28:18.515295 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-c7600553-d593-48d6-9204-c301f3d5fe78 tempest-VolumesActionsTest-1155069277 None] Lock "b'cinder-5ea0bb8a-5a1f-4bfe-96b4-b381a5310142-detach_volume'" acquired by "detach_volume" :: waited 0.022s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:28:18.516997 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-c7600553-d593-48d6-9204-c301f3d5fe78 tempest-VolumesActionsTest-1155069277 None] Volume detach called, but volume not attached. Apr 30 21:28:18.643060 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-c7600553-d593-48d6-9204-c301f3d5fe78 tempest-VolumesActionsTest-1155069277 None] Lock "b'cinder-5ea0bb8a-5a1f-4bfe-96b4-b381a5310142-detach_volume'" released by "detach_volume" :: held 0.126s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:28:25.491620 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ad852e9-a6a6-43ba-8573-1010a98a7ec0 tempest-VolumesActionsTest-1155069277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:28:25.532094 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-7ad852e9-a6a6-43ba-8573-1010a98a7ec0 tempest-VolumesActionsTest-1155069277 None] Flow 'volume_create_manager' (40920745-2668-44bb-9dff-c03d8e80f17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:28:25.539974 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-7ad852e9-a6a6-43ba-8573-1010a98a7ec0 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64139f16-9811-42df-ad68-d2ae4066a75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:25.556333 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-7ad852e9-a6a6-43ba-8573-1010a98a7ec0 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64139f16-9811-42df-ad68-d2ae4066a75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-14734429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f5d000ee-ad36-4616-a456-115f6f3b8046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='426405d77bbc4e24adcbe789ba3f42f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:28:25Z,use_quota=True,user_id='3383f0c2b1874b15b38dea61e4b8e498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:25.561961 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-7ad852e9-a6a6-43ba-8573-1010a98a7ec0 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f767f9dd-099c-4bf9-88aa-7a4a75a82925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:25.566235 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-7ad852e9-a6a6-43ba-8573-1010a98a7ec0 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f767f9dd-099c-4bf9-88aa-7a4a75a82925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:25.571472 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-7ad852e9-a6a6-43ba-8573-1010a98a7ec0 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (966a33a6-308b-4e2c-a8cc-25b5cba1e1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:25.575576 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-7ad852e9-a6a6-43ba-8573-1010a98a7ec0 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (966a33a6-308b-4e2c-a8cc-25b5cba1e1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5d000ee-ad36-4616-a456-115f6f3b8046', 'volume_name': 'volume-f5d000ee-ad36-4616-a456-115f6f3b8046', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:25.580843 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-7ad852e9-a6a6-43ba-8573-1010a98a7ec0 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db8b0925-94cb-48dc-aaff-6f16eb382bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:25.585086 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-7ad852e9-a6a6-43ba-8573-1010a98a7ec0 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db8b0925-94cb-48dc-aaff-6f16eb382bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:25.591055 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-7ad852e9-a6a6-43ba-8573-1010a98a7ec0 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f738db47-d94a-4659-9605-61eaa2d12457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:25.593170 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-7ad852e9-a6a6-43ba-8573-1010a98a7ec0 tempest-VolumesActionsTest-1155069277 None] Volume f5d000ee-ad36-4616-a456-115f6f3b8046: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5d000ee-ad36-4616-a456-115f6f3b8046', 'volume_size': 1} Apr 30 21:28:25.593791 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-7ad852e9-a6a6-43ba-8573-1010a98a7ec0 tempest-VolumesActionsTest-1155069277 None] creating volume 'volume-f5d000ee-ad36-4616-a456-115f6f3b8046' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:28:25.596215 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-7ad852e9-a6a6-43ba-8573-1010a98a7ec0 tempest-VolumesActionsTest-1155069277 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:28:26.673523 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-7ad852e9-a6a6-43ba-8573-1010a98a7ec0 tempest-VolumesActionsTest-1155069277 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:28:26.673523 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-7ad852e9-a6a6-43ba-8573-1010a98a7ec0 tempest-VolumesActionsTest-1155069277 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:28:26.675630 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-7ad852e9-a6a6-43ba-8573-1010a98a7ec0 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f738db47-d94a-4659-9605-61eaa2d12457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5d000ee-ad36-4616-a456-115f6f3b8046', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:26.682569 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-7ad852e9-a6a6-43ba-8573-1010a98a7ec0 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f84ca3-a5df-45f2-9f71-479ffc9a6129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:26.800828 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-7ad852e9-a6a6-43ba-8573-1010a98a7ec0 tempest-VolumesActionsTest-1155069277 None] Volume volume-f5d000ee-ad36-4616-a456-115f6f3b8046 (f5d000ee-ad36-4616-a456-115f6f3b8046): created successfully Apr 30 21:28:26.805398 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-7ad852e9-a6a6-43ba-8573-1010a98a7ec0 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f84ca3-a5df-45f2-9f71-479ffc9a6129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:26.814466 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-7ad852e9-a6a6-43ba-8573-1010a98a7ec0 tempest-VolumesActionsTest-1155069277 None] Flow 'volume_create_manager' (40920745-2668-44bb-9dff-c03d8e80f17b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:28:26.899363 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-7ad852e9-a6a6-43ba-8573-1010a98a7ec0 tempest-VolumesActionsTest-1155069277 None] Created volume successfully. Apr 30 21:28:27.717998 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-044c5d34-51e2-4406-8825-16b2511aadc8 tempest-VolumesActionsTest-2024194076 None] Lock "b'cinder-f5d000ee-ad36-4616-a456-115f6f3b8046-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:28:27.816865 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-044c5d34-51e2-4406-8825-16b2511aadc8 tempest-VolumesActionsTest-2024194076 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:28:28.189120 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-044c5d34-51e2-4406-8825-16b2511aadc8 tempest-VolumesActionsTest-2024194076 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:28:28.189974 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-044c5d34-51e2-4406-8825-16b2511aadc8 tempest-VolumesActionsTest-2024194076 None] Volume volume-f5d000ee-ad36-4616-a456-115f6f3b8046 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:28:28.358956 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-044c5d34-51e2-4406-8825-16b2511aadc8 tempest-VolumesActionsTest-2024194076 None] deleting rbd volume volume-f5d000ee-ad36-4616-a456-115f6f3b8046 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:28:28.950327 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:28:28.951007 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:28:29.038802 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:28:29.098746 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:28:32.932194 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-044c5d34-51e2-4406-8825-16b2511aadc8 tempest-VolumesActionsTest-2024194076 None] Created reservations ['2c932890-c83b-4f07-9730-c6dab521aca2', '2f35f034-ad18-4ea7-bdee-60141c3f88cf', '7ca865f5-f625-41a8-989d-cfe03596c9ad', '38a57ae2-63f8-4608-be2b-7855048dd13a'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:28:33.151847 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-044c5d34-51e2-4406-8825-16b2511aadc8 tempest-VolumesActionsTest-2024194076 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:28:33.200118 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-044c5d34-51e2-4406-8825-16b2511aadc8 tempest-VolumesActionsTest-2024194076 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:28:33.279275 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-044c5d34-51e2-4406-8825-16b2511aadc8 tempest-VolumesActionsTest-2024194076 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:28:33.287399 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-044c5d34-51e2-4406-8825-16b2511aadc8 tempest-VolumesActionsTest-2024194076 None] Deleted volume successfully. Apr 30 21:28:33.374865 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-044c5d34-51e2-4406-8825-16b2511aadc8 tempest-VolumesActionsTest-2024194076 None] Lock "b'cinder-f5d000ee-ad36-4616-a456-115f6f3b8046-delete_volume'" released by "delete_volume" :: held 5.657s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:28:34.225863 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-35b286b2-876e-4432-8050-41397181e641 tempest-VolumesActionsTest-1155069277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:28:34.249307 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-35b286b2-876e-4432-8050-41397181e641 tempest-VolumesActionsTest-1155069277 None] Flow 'volume_create_manager' (66a951cd-631c-4ec3-a793-44baec207d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:28:34.257022 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-35b286b2-876e-4432-8050-41397181e641 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e18022d-8538-4cbc-98dd-e349c20971a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:34.278294 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-35b286b2-876e-4432-8050-41397181e641 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e18022d-8538-4cbc-98dd-e349c20971a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1324308814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=acf807d4-c969-421a-8846-fbc328b7e900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='426405d77bbc4e24adcbe789ba3f42f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:28:34Z,use_quota=True,user_id='3383f0c2b1874b15b38dea61e4b8e498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:34.288154 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-35b286b2-876e-4432-8050-41397181e641 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c770aa0-3bfe-4fa5-a06a-66deb3cc1431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:34.293619 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-35b286b2-876e-4432-8050-41397181e641 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c770aa0-3bfe-4fa5-a06a-66deb3cc1431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:34.300006 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-35b286b2-876e-4432-8050-41397181e641 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc29020-022d-4065-8a95-7c72d621e31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:34.304720 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-35b286b2-876e-4432-8050-41397181e641 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc29020-022d-4065-8a95-7c72d621e31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acf807d4-c969-421a-8846-fbc328b7e900', 'volume_name': 'volume-acf807d4-c969-421a-8846-fbc328b7e900', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:34.310731 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-35b286b2-876e-4432-8050-41397181e641 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d13c7aee-9b71-4dfc-ae2a-043187fca308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:34.315633 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-35b286b2-876e-4432-8050-41397181e641 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d13c7aee-9b71-4dfc-ae2a-043187fca308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:34.320847 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-35b286b2-876e-4432-8050-41397181e641 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5d5d4e5-b1d3-4a36-bd4c-2631d6102b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:34.323676 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-35b286b2-876e-4432-8050-41397181e641 tempest-VolumesActionsTest-1155069277 None] Volume acf807d4-c969-421a-8846-fbc328b7e900: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acf807d4-c969-421a-8846-fbc328b7e900', 'volume_size': 1} Apr 30 21:28:34.323676 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-35b286b2-876e-4432-8050-41397181e641 tempest-VolumesActionsTest-1155069277 None] creating volume 'volume-acf807d4-c969-421a-8846-fbc328b7e900' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:28:34.323676 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-35b286b2-876e-4432-8050-41397181e641 tempest-VolumesActionsTest-1155069277 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:28:35.106536 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-35b286b2-876e-4432-8050-41397181e641 tempest-VolumesActionsTest-1155069277 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:28:35.107263 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-35b286b2-876e-4432-8050-41397181e641 tempest-VolumesActionsTest-1155069277 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:28:35.111869 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-35b286b2-876e-4432-8050-41397181e641 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5d5d4e5-b1d3-4a36-bd4c-2631d6102b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acf807d4-c969-421a-8846-fbc328b7e900', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:35.121130 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-35b286b2-876e-4432-8050-41397181e641 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13f34a72-846f-47d1-a01d-33368212882e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:35.325929 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-35b286b2-876e-4432-8050-41397181e641 tempest-VolumesActionsTest-1155069277 None] Volume volume-acf807d4-c969-421a-8846-fbc328b7e900 (acf807d4-c969-421a-8846-fbc328b7e900): created successfully Apr 30 21:28:35.329707 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-35b286b2-876e-4432-8050-41397181e641 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13f34a72-846f-47d1-a01d-33368212882e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:35.337237 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-35b286b2-876e-4432-8050-41397181e641 tempest-VolumesActionsTest-1155069277 None] Flow 'volume_create_manager' (66a951cd-631c-4ec3-a793-44baec207d46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:28:35.432061 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-35b286b2-876e-4432-8050-41397181e641 tempest-VolumesActionsTest-1155069277 None] Created volume successfully. Apr 30 21:28:36.826551 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-e0fcc17e-975f-4ef6-84b7-bdde7c210599 tempest-VolumesActionsTest-2024194076 None] Lock "b'cinder-acf807d4-c969-421a-8846-fbc328b7e900-delete_volume'" acquired by "delete_volume" :: waited 0.035s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:28:36.995779 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e0fcc17e-975f-4ef6-84b7-bdde7c210599 tempest-VolumesActionsTest-2024194076 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:28:37.209309 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e0fcc17e-975f-4ef6-84b7-bdde7c210599 tempest-VolumesActionsTest-2024194076 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:28:37.210079 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e0fcc17e-975f-4ef6-84b7-bdde7c210599 tempest-VolumesActionsTest-2024194076 None] Volume volume-acf807d4-c969-421a-8846-fbc328b7e900 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:28:37.375955 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e0fcc17e-975f-4ef6-84b7-bdde7c210599 tempest-VolumesActionsTest-2024194076 None] deleting rbd volume volume-acf807d4-c969-421a-8846-fbc328b7e900 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:28:41.309322 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-e0fcc17e-975f-4ef6-84b7-bdde7c210599 tempest-VolumesActionsTest-2024194076 None] Created reservations ['4b468253-21eb-4ef9-8c8e-ff96169474ce', 'a908b54a-55ef-43ac-a16d-2aba3b1c3022', 'da743b1a-2cce-4269-8a90-46b9b55633c1', '88847e5a-3e13-4d2e-b4da-76716659aba9'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:28:41.537220 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e0fcc17e-975f-4ef6-84b7-bdde7c210599 tempest-VolumesActionsTest-2024194076 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:28:41.589001 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e0fcc17e-975f-4ef6-84b7-bdde7c210599 tempest-VolumesActionsTest-2024194076 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:28:41.626268 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-e0fcc17e-975f-4ef6-84b7-bdde7c210599 tempest-VolumesActionsTest-2024194076 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:28:41.631394 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-e0fcc17e-975f-4ef6-84b7-bdde7c210599 tempest-VolumesActionsTest-2024194076 None] Deleted volume successfully. Apr 30 21:28:41.806198 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-e0fcc17e-975f-4ef6-84b7-bdde7c210599 tempest-VolumesActionsTest-2024194076 None] Lock "b'cinder-acf807d4-c969-421a-8846-fbc328b7e900-delete_volume'" released by "delete_volume" :: held 4.943s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:28:43.515702 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef758e28-5916-4a54-86b2-a1556657c1de tempest-VolumesActionsTest-1155069277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:28:43.537414 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-ef758e28-5916-4a54-86b2-a1556657c1de tempest-VolumesActionsTest-1155069277 None] Flow 'volume_create_manager' (fa6adef8-cbbe-4a93-be4a-07f14ad93c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:28:43.546591 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-ef758e28-5916-4a54-86b2-a1556657c1de tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f661486-9f8c-4a23-bbce-03cef35d39b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:43.563962 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-ef758e28-5916-4a54-86b2-a1556657c1de tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f661486-9f8c-4a23-bbce-03cef35d39b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1085893658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7a81d0c7-64ee-4fba-9992-d2bf5c117777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='426405d77bbc4e24adcbe789ba3f42f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:28:43Z,use_quota=True,user_id='3383f0c2b1874b15b38dea61e4b8e498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:43.569979 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-ef758e28-5916-4a54-86b2-a1556657c1de tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0870a18a-a5b3-4f15-a0e8-6c3b31fc12de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:43.574074 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-ef758e28-5916-4a54-86b2-a1556657c1de tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0870a18a-a5b3-4f15-a0e8-6c3b31fc12de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:43.579160 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-ef758e28-5916-4a54-86b2-a1556657c1de tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d9c1f2b-a074-4df2-9dd1-71b8d54443b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:43.583255 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-ef758e28-5916-4a54-86b2-a1556657c1de tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d9c1f2b-a074-4df2-9dd1-71b8d54443b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a81d0c7-64ee-4fba-9992-d2bf5c117777', 'volume_name': 'volume-7a81d0c7-64ee-4fba-9992-d2bf5c117777', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:43.590952 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-ef758e28-5916-4a54-86b2-a1556657c1de tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91a834b4-3b2c-4b26-a475-a7ec4c8181d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:43.594996 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-ef758e28-5916-4a54-86b2-a1556657c1de tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91a834b4-3b2c-4b26-a475-a7ec4c8181d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:43.599925 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-ef758e28-5916-4a54-86b2-a1556657c1de tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (556aa39f-53a0-4d1b-8b87-97317a043ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:43.601039 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-ef758e28-5916-4a54-86b2-a1556657c1de tempest-VolumesActionsTest-1155069277 None] Volume 7a81d0c7-64ee-4fba-9992-d2bf5c117777: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a81d0c7-64ee-4fba-9992-d2bf5c117777', 'volume_size': 1} Apr 30 21:28:43.601426 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ef758e28-5916-4a54-86b2-a1556657c1de tempest-VolumesActionsTest-1155069277 None] creating volume 'volume-7a81d0c7-64ee-4fba-9992-d2bf5c117777' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:28:43.602418 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ef758e28-5916-4a54-86b2-a1556657c1de tempest-VolumesActionsTest-1155069277 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:28:44.405597 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ef758e28-5916-4a54-86b2-a1556657c1de tempest-VolumesActionsTest-1155069277 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:28:44.406057 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ef758e28-5916-4a54-86b2-a1556657c1de tempest-VolumesActionsTest-1155069277 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:28:44.418645 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-ef758e28-5916-4a54-86b2-a1556657c1de tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (556aa39f-53a0-4d1b-8b87-97317a043ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a81d0c7-64ee-4fba-9992-d2bf5c117777', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:44.441514 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-ef758e28-5916-4a54-86b2-a1556657c1de tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a45216b-279d-4cf8-84c8-9840350fdb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:44.510435 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-ef758e28-5916-4a54-86b2-a1556657c1de tempest-VolumesActionsTest-1155069277 None] Volume volume-7a81d0c7-64ee-4fba-9992-d2bf5c117777 (7a81d0c7-64ee-4fba-9992-d2bf5c117777): created successfully Apr 30 21:28:44.514446 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-ef758e28-5916-4a54-86b2-a1556657c1de tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a45216b-279d-4cf8-84c8-9840350fdb59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:44.525320 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-ef758e28-5916-4a54-86b2-a1556657c1de tempest-VolumesActionsTest-1155069277 None] Flow 'volume_create_manager' (fa6adef8-cbbe-4a93-be4a-07f14ad93c73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:28:44.666393 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-ef758e28-5916-4a54-86b2-a1556657c1de tempest-VolumesActionsTest-1155069277 None] Created volume successfully. Apr 30 21:28:44.785101 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-36185bd8-3197-4809-911e-b624511c8594 req-c9467dbc-6e94-4ddb-b78d-250969903b38 tempest-TaggedBootDevicesTest_v242-1954731281 None] Terminate volume connection completed successfully. Apr 30 21:28:44.785530 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-36185bd8-3197-4809-911e-b624511c8594 req-c9467dbc-6e94-4ddb-b78d-250969903b38 tempest-TaggedBootDevicesTest_v242-1954731281 None] Deleting attachment 458db7a5-cc0a-4591-b8ab-3e0d71c577c7. {{(pid=123855) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} Apr 30 21:28:45.052053 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-36185bd8-3197-4809-911e-b624511c8594 req-aac72d8f-74a6-45d4-920a-1939de9655d5 tempest-TaggedBootDevicesTest_v242-1954731281 None] Terminate volume connection completed successfully. Apr 30 21:28:45.052581 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-36185bd8-3197-4809-911e-b624511c8594 req-aac72d8f-74a6-45d4-920a-1939de9655d5 tempest-TaggedBootDevicesTest_v242-1954731281 None] Deleting attachment eca33b27-8323-4b8c-9b6d-28fa47313110. {{(pid=123855) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} Apr 30 21:28:45.312083 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-36185bd8-3197-4809-911e-b624511c8594 req-1e127e3c-6c61-4838-a270-a1266215399c tempest-TaggedBootDevicesTest_v242-1954731281 None] Terminate volume connection completed successfully. Apr 30 21:28:45.313275 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-36185bd8-3197-4809-911e-b624511c8594 req-1e127e3c-6c61-4838-a270-a1266215399c tempest-TaggedBootDevicesTest_v242-1954731281 None] Deleting attachment 53f86d87-91e7-4dd8-aa7c-169aa2ce1ae7. {{(pid=123855) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} Apr 30 21:28:45.787756 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-9d1cbf7a-e852-4217-91be-d055a2d2edf7 tempest-VolumesActionsTest-2024194076 None] Lock "b'cinder-7a81d0c7-64ee-4fba-9992-d2bf5c117777-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:28:45.926551 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9d1cbf7a-e852-4217-91be-d055a2d2edf7 tempest-VolumesActionsTest-2024194076 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:28:46.272119 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9d1cbf7a-e852-4217-91be-d055a2d2edf7 tempest-VolumesActionsTest-2024194076 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:28:46.273488 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9d1cbf7a-e852-4217-91be-d055a2d2edf7 tempest-VolumesActionsTest-2024194076 None] Volume volume-7a81d0c7-64ee-4fba-9992-d2bf5c117777 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:28:46.428196 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9d1cbf7a-e852-4217-91be-d055a2d2edf7 tempest-VolumesActionsTest-2024194076 None] deleting rbd volume volume-7a81d0c7-64ee-4fba-9992-d2bf5c117777 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:28:50.231801 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-9d1cbf7a-e852-4217-91be-d055a2d2edf7 tempest-VolumesActionsTest-2024194076 None] Created reservations ['c925e431-2355-4988-babd-76e3c99304cf', '90c952a9-2e41-4d8a-b430-ea4f7ced2ca0', 'd164be68-d50b-400a-828d-73fc8369bf7d', 'b6236d75-5659-49e8-98a0-1c40089bf0c6'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:28:50.504295 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9d1cbf7a-e852-4217-91be-d055a2d2edf7 tempest-VolumesActionsTest-2024194076 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:28:50.559185 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9d1cbf7a-e852-4217-91be-d055a2d2edf7 tempest-VolumesActionsTest-2024194076 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:28:50.616140 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-9d1cbf7a-e852-4217-91be-d055a2d2edf7 tempest-VolumesActionsTest-2024194076 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:28:50.617460 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-9d1cbf7a-e852-4217-91be-d055a2d2edf7 tempest-VolumesActionsTest-2024194076 None] Deleted volume successfully. Apr 30 21:28:50.704397 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-9d1cbf7a-e852-4217-91be-d055a2d2edf7 tempest-VolumesActionsTest-2024194076 None] Lock "b'cinder-7a81d0c7-64ee-4fba-9992-d2bf5c117777-delete_volume'" released by "delete_volume" :: held 4.917s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:28:52.493902 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a035d7e-5786-4cb1-8428-84f409903d1e tempest-VolumesActionsTest-1155069277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:28:52.524742 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9a035d7e-5786-4cb1-8428-84f409903d1e tempest-VolumesActionsTest-1155069277 None] Flow 'volume_create_manager' (5190009a-1820-4527-af35-075259afaaee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:28:52.532734 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9a035d7e-5786-4cb1-8428-84f409903d1e tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d86e972f-6f2d-448e-990e-f2d1b91dd505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:52.552474 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9a035d7e-5786-4cb1-8428-84f409903d1e tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d86e972f-6f2d-448e-990e-f2d1b91dd505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-153014335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=39b75278-d0b0-4335-90d0-4813662229c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='426405d77bbc4e24adcbe789ba3f42f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:28:52Z,use_quota=True,user_id='3383f0c2b1874b15b38dea61e4b8e498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:52.558530 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9a035d7e-5786-4cb1-8428-84f409903d1e tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (087728f5-5901-48e2-9570-eed95e0e5182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:52.564101 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9a035d7e-5786-4cb1-8428-84f409903d1e tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (087728f5-5901-48e2-9570-eed95e0e5182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:52.569841 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9a035d7e-5786-4cb1-8428-84f409903d1e tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (038fbf9e-fdee-4316-90cc-ea3340345f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:52.575282 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9a035d7e-5786-4cb1-8428-84f409903d1e tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (038fbf9e-fdee-4316-90cc-ea3340345f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39b75278-d0b0-4335-90d0-4813662229c2', 'volume_name': 'volume-39b75278-d0b0-4335-90d0-4813662229c2', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:52.581729 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9a035d7e-5786-4cb1-8428-84f409903d1e tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e2d838c-85a4-4f09-831a-5e4a504b40c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:52.588064 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9a035d7e-5786-4cb1-8428-84f409903d1e tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e2d838c-85a4-4f09-831a-5e4a504b40c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:52.593415 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9a035d7e-5786-4cb1-8428-84f409903d1e tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffb517ee-ce4e-490c-986e-15ed2e7c95a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:52.594816 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-9a035d7e-5786-4cb1-8428-84f409903d1e tempest-VolumesActionsTest-1155069277 None] Volume 39b75278-d0b0-4335-90d0-4813662229c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39b75278-d0b0-4335-90d0-4813662229c2', 'volume_size': 1} Apr 30 21:28:52.595573 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9a035d7e-5786-4cb1-8428-84f409903d1e tempest-VolumesActionsTest-1155069277 None] creating volume 'volume-39b75278-d0b0-4335-90d0-4813662229c2' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:28:52.596567 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9a035d7e-5786-4cb1-8428-84f409903d1e tempest-VolumesActionsTest-1155069277 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:28:53.188107 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9a035d7e-5786-4cb1-8428-84f409903d1e tempest-VolumesActionsTest-1155069277 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:28:53.188904 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9a035d7e-5786-4cb1-8428-84f409903d1e tempest-VolumesActionsTest-1155069277 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:28:53.192998 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9a035d7e-5786-4cb1-8428-84f409903d1e tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffb517ee-ce4e-490c-986e-15ed2e7c95a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39b75278-d0b0-4335-90d0-4813662229c2', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:53.205016 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9a035d7e-5786-4cb1-8428-84f409903d1e tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b33d1d03-1490-47e6-8a1b-ea6b3d09d139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:53.294781 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-9a035d7e-5786-4cb1-8428-84f409903d1e tempest-VolumesActionsTest-1155069277 None] Volume volume-39b75278-d0b0-4335-90d0-4813662229c2 (39b75278-d0b0-4335-90d0-4813662229c2): created successfully Apr 30 21:28:53.299499 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9a035d7e-5786-4cb1-8428-84f409903d1e tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b33d1d03-1490-47e6-8a1b-ea6b3d09d139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:53.309941 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9a035d7e-5786-4cb1-8428-84f409903d1e tempest-VolumesActionsTest-1155069277 None] Flow 'volume_create_manager' (5190009a-1820-4527-af35-075259afaaee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:28:53.417097 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-9a035d7e-5786-4cb1-8428-84f409903d1e tempest-VolumesActionsTest-1155069277 None] Created volume successfully. Apr 30 21:28:53.709337 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-c1807909-754a-499a-b40b-c25f0c717b20 tempest-TaggedBootDevicesTest_v242-1954731281 None] Lock "b'cinder-04049fb4-d6f1-4d01-83c2-db5981be2487-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:28:53.815539 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c1807909-754a-499a-b40b-c25f0c717b20 tempest-TaggedBootDevicesTest_v242-1954731281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:28:54.219890 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c1807909-754a-499a-b40b-c25f0c717b20 tempest-TaggedBootDevicesTest_v242-1954731281 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:28:54.220305 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c1807909-754a-499a-b40b-c25f0c717b20 tempest-TaggedBootDevicesTest_v242-1954731281 None] Volume volume-04049fb4-d6f1-4d01-83c2-db5981be2487 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:28:54.394693 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c1807909-754a-499a-b40b-c25f0c717b20 tempest-TaggedBootDevicesTest_v242-1954731281 None] deleting rbd volume volume-04049fb4-d6f1-4d01-83c2-db5981be2487 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:28:54.809817 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-a7bce90b-1c38-4ec4-9d95-1c2b26794830 tempest-VolumesActionsTest-2024194076 None] Lock "b'cinder-39b75278-d0b0-4335-90d0-4813662229c2-delete_volume'" acquired by "delete_volume" :: waited 0.041s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:28:54.992521 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a7bce90b-1c38-4ec4-9d95-1c2b26794830 tempest-VolumesActionsTest-2024194076 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:28:55.370900 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a7bce90b-1c38-4ec4-9d95-1c2b26794830 tempest-VolumesActionsTest-2024194076 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:28:55.371540 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a7bce90b-1c38-4ec4-9d95-1c2b26794830 tempest-VolumesActionsTest-2024194076 None] Volume volume-39b75278-d0b0-4335-90d0-4813662229c2 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:28:55.606204 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a7bce90b-1c38-4ec4-9d95-1c2b26794830 tempest-VolumesActionsTest-2024194076 None] deleting rbd volume volume-39b75278-d0b0-4335-90d0-4813662229c2 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:28:56.481440 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-55b1b125-73d2-493d-a55e-b5319dceba9c tempest-VolumeQuotasAdminTestJSON-395236735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:28:56.501711 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-55b1b125-73d2-493d-a55e-b5319dceba9c tempest-VolumeQuotasAdminTestJSON-395236735 None] Flow 'volume_create_manager' (0f4fee3b-161f-4b45-9b10-3bdec095b4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:28:56.508236 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-55b1b125-73d2-493d-a55e-b5319dceba9c tempest-VolumeQuotasAdminTestJSON-395236735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa1dc940-f008-4e3a-87b2-6af1a99539fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:56.526533 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-55b1b125-73d2-493d-a55e-b5319dceba9c tempest-VolumeQuotasAdminTestJSON-395236735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa1dc940-f008-4e3a-87b2-6af1a99539fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1949532103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0198bfd4-3ffa-4b9d-a169-19fa193b5b87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8db42a5e42884bc687a546cb4904ef5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:28:56Z,use_quota=True,user_id='e6c81689d8214c0f85463ad23fbb592f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:56.531790 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-55b1b125-73d2-493d-a55e-b5319dceba9c tempest-VolumeQuotasAdminTestJSON-395236735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3eb2e29-ce77-456f-ad6c-3ffefeaa7888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:56.535902 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-55b1b125-73d2-493d-a55e-b5319dceba9c tempest-VolumeQuotasAdminTestJSON-395236735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3eb2e29-ce77-456f-ad6c-3ffefeaa7888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:56.541697 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-55b1b125-73d2-493d-a55e-b5319dceba9c tempest-VolumeQuotasAdminTestJSON-395236735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0868a3a2-4f5d-48b7-b6bc-59d8f525bed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:56.545802 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-55b1b125-73d2-493d-a55e-b5319dceba9c tempest-VolumeQuotasAdminTestJSON-395236735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0868a3a2-4f5d-48b7-b6bc-59d8f525bed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0198bfd4-3ffa-4b9d-a169-19fa193b5b87', 'volume_name': 'volume-0198bfd4-3ffa-4b9d-a169-19fa193b5b87', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:56.553882 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-55b1b125-73d2-493d-a55e-b5319dceba9c tempest-VolumeQuotasAdminTestJSON-395236735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e0011f-95c1-46dd-ba2e-f4675281b40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:56.558519 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-55b1b125-73d2-493d-a55e-b5319dceba9c tempest-VolumeQuotasAdminTestJSON-395236735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e0011f-95c1-46dd-ba2e-f4675281b40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:56.576798 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-55b1b125-73d2-493d-a55e-b5319dceba9c tempest-VolumeQuotasAdminTestJSON-395236735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2191f92-8f60-4060-85c1-e6feb94b2bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:56.580202 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-55b1b125-73d2-493d-a55e-b5319dceba9c tempest-VolumeQuotasAdminTestJSON-395236735 None] Volume 0198bfd4-3ffa-4b9d-a169-19fa193b5b87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0198bfd4-3ffa-4b9d-a169-19fa193b5b87', 'volume_size': 1} Apr 30 21:28:56.581564 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-55b1b125-73d2-493d-a55e-b5319dceba9c tempest-VolumeQuotasAdminTestJSON-395236735 None] creating volume 'volume-0198bfd4-3ffa-4b9d-a169-19fa193b5b87' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:28:56.582332 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-55b1b125-73d2-493d-a55e-b5319dceba9c tempest-VolumeQuotasAdminTestJSON-395236735 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:28:57.602621 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-55b1b125-73d2-493d-a55e-b5319dceba9c tempest-VolumeQuotasAdminTestJSON-395236735 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:28:57.603323 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-55b1b125-73d2-493d-a55e-b5319dceba9c tempest-VolumeQuotasAdminTestJSON-395236735 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:28:57.606702 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-55b1b125-73d2-493d-a55e-b5319dceba9c tempest-VolumeQuotasAdminTestJSON-395236735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2191f92-8f60-4060-85c1-e6feb94b2bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0198bfd4-3ffa-4b9d-a169-19fa193b5b87', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:57.611342 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-55b1b125-73d2-493d-a55e-b5319dceba9c tempest-VolumeQuotasAdminTestJSON-395236735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddc13f15-7158-4213-8dcc-3d71bed2f5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:28:57.727981 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-55b1b125-73d2-493d-a55e-b5319dceba9c tempest-VolumeQuotasAdminTestJSON-395236735 None] Volume volume-0198bfd4-3ffa-4b9d-a169-19fa193b5b87 (0198bfd4-3ffa-4b9d-a169-19fa193b5b87): created successfully Apr 30 21:28:57.736688 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-55b1b125-73d2-493d-a55e-b5319dceba9c tempest-VolumeQuotasAdminTestJSON-395236735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddc13f15-7158-4213-8dcc-3d71bed2f5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:28:57.751290 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-55b1b125-73d2-493d-a55e-b5319dceba9c tempest-VolumeQuotasAdminTestJSON-395236735 None] Flow 'volume_create_manager' (0f4fee3b-161f-4b45-9b10-3bdec095b4b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:28:57.832057 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-55b1b125-73d2-493d-a55e-b5319dceba9c tempest-VolumeQuotasAdminTestJSON-395236735 None] Created volume successfully. Apr 30 21:28:58.563454 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-8163b04c-ddac-4a52-987c-afdf709023f0 tempest-VolumeQuotasAdminTestJSON-395236735 None] Lock "b'cinder-0198bfd4-3ffa-4b9d-a169-19fa193b5b87-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:28:58.747665 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8163b04c-ddac-4a52-987c-afdf709023f0 tempest-VolumeQuotasAdminTestJSON-395236735 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:28:58.982278 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8163b04c-ddac-4a52-987c-afdf709023f0 tempest-VolumeQuotasAdminTestJSON-395236735 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:28:58.987012 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8163b04c-ddac-4a52-987c-afdf709023f0 tempest-VolumeQuotasAdminTestJSON-395236735 None] Volume volume-0198bfd4-3ffa-4b9d-a169-19fa193b5b87 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:28:59.211975 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8163b04c-ddac-4a52-987c-afdf709023f0 tempest-VolumeQuotasAdminTestJSON-395236735 None] deleting rbd volume volume-0198bfd4-3ffa-4b9d-a169-19fa193b5b87 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:29:00.837338 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-c1807909-754a-499a-b40b-c25f0c717b20 tempest-TaggedBootDevicesTest_v242-1954731281 None] Created reservations ['61a54da1-162e-47a8-89fc-c1b5b7d6f661', '27ac9c61-3d50-49d0-8298-6d024b60aa7f', 'd8b14b3a-ae51-4d65-8880-ef7ef44fb108', 'dd2479d8-5d4e-4456-8b31-29d217c492c7'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:29:01.020730 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c1807909-754a-499a-b40b-c25f0c717b20 tempest-TaggedBootDevicesTest_v242-1954731281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:01.046384 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c1807909-754a-499a-b40b-c25f0c717b20 tempest-TaggedBootDevicesTest_v242-1954731281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:01.071758 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-c1807909-754a-499a-b40b-c25f0c717b20 tempest-TaggedBootDevicesTest_v242-1954731281 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:29:01.075648 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-c1807909-754a-499a-b40b-c25f0c717b20 tempest-TaggedBootDevicesTest_v242-1954731281 None] Deleted volume successfully. Apr 30 21:29:01.230584 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-c1807909-754a-499a-b40b-c25f0c717b20 tempest-TaggedBootDevicesTest_v242-1954731281 None] Lock "b'cinder-04049fb4-d6f1-4d01-83c2-db5981be2487-delete_volume'" released by "delete_volume" :: held 7.522s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:29:01.581424 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-421f5d87-0ce0-4eb0-852b-c3892837a179 tempest-TaggedBootDevicesTest_v242-1954731281 None] Lock "b'cinder-27b24866-27ef-457f-bbcc-0152de7c242b-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:29:01.686197 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-421f5d87-0ce0-4eb0-852b-c3892837a179 tempest-TaggedBootDevicesTest_v242-1954731281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:01.931858 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-421f5d87-0ce0-4eb0-852b-c3892837a179 tempest-TaggedBootDevicesTest_v242-1954731281 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:29:01.932475 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-421f5d87-0ce0-4eb0-852b-c3892837a179 tempest-TaggedBootDevicesTest_v242-1954731281 None] Volume volume-27b24866-27ef-457f-bbcc-0152de7c242b is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:29:02.226957 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-421f5d87-0ce0-4eb0-852b-c3892837a179 tempest-TaggedBootDevicesTest_v242-1954731281 None] deleting rbd volume volume-27b24866-27ef-457f-bbcc-0152de7c242b {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:29:02.800027 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-a7bce90b-1c38-4ec4-9d95-1c2b26794830 tempest-VolumesActionsTest-2024194076 None] Created reservations ['a5119bc1-ca4a-4361-becb-3b5c9650a34c', '518d3b3a-46d6-4e82-a65b-343ec6d66e5b', '90d91aed-35e2-4bca-940c-4bd1c6278a25', '4c5b6cb4-3cd2-43b9-a00a-b68f02281fa5'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:29:03.025554 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a7bce90b-1c38-4ec4-9d95-1c2b26794830 tempest-VolumesActionsTest-2024194076 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:03.058913 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a7bce90b-1c38-4ec4-9d95-1c2b26794830 tempest-VolumesActionsTest-2024194076 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:03.087923 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-a7bce90b-1c38-4ec4-9d95-1c2b26794830 tempest-VolumesActionsTest-2024194076 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:29:03.092944 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-a7bce90b-1c38-4ec4-9d95-1c2b26794830 tempest-VolumesActionsTest-2024194076 None] Deleted volume successfully. Apr 30 21:29:03.192244 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-a7bce90b-1c38-4ec4-9d95-1c2b26794830 tempest-VolumesActionsTest-2024194076 None] Lock "b'cinder-39b75278-d0b0-4335-90d0-4813662229c2-delete_volume'" released by "delete_volume" :: held 8.394s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:29:04.310268 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-993363d4-fe8f-40d3-9019-31d54fb89d29 tempest-VolumesActionsTest-1155069277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:29:04.330153 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-993363d4-fe8f-40d3-9019-31d54fb89d29 tempest-VolumesActionsTest-1155069277 None] Flow 'volume_create_manager' (cc7f9cd3-d95d-47c7-a337-96461554d989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:29:04.337154 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-993363d4-fe8f-40d3-9019-31d54fb89d29 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c62c4a6-b44c-4562-9170-0e27aaff4507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:04.353553 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-993363d4-fe8f-40d3-9019-31d54fb89d29 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c62c4a6-b44c-4562-9170-0e27aaff4507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:29:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-211415744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7f71ec09-ba58-4046-a73c-5801cd44f818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='426405d77bbc4e24adcbe789ba3f42f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:29:04Z,use_quota=True,user_id='3383f0c2b1874b15b38dea61e4b8e498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:04.359301 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-993363d4-fe8f-40d3-9019-31d54fb89d29 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba7341b3-aa29-41c4-a2e1-90eba7c702f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:04.363683 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-993363d4-fe8f-40d3-9019-31d54fb89d29 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba7341b3-aa29-41c4-a2e1-90eba7c702f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:04.368810 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-993363d4-fe8f-40d3-9019-31d54fb89d29 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (713ea7ac-626a-4fc8-98ac-8645125d9d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:04.372912 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-993363d4-fe8f-40d3-9019-31d54fb89d29 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (713ea7ac-626a-4fc8-98ac-8645125d9d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f71ec09-ba58-4046-a73c-5801cd44f818', 'volume_name': 'volume-7f71ec09-ba58-4046-a73c-5801cd44f818', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:04.377843 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-993363d4-fe8f-40d3-9019-31d54fb89d29 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f92cf7a1-edc7-41b9-90f7-782a641ab0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:04.381783 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-993363d4-fe8f-40d3-9019-31d54fb89d29 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f92cf7a1-edc7-41b9-90f7-782a641ab0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:04.386407 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-993363d4-fe8f-40d3-9019-31d54fb89d29 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6028c71b-bff0-4e68-bc8c-1a3b20b27bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:04.387669 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-993363d4-fe8f-40d3-9019-31d54fb89d29 tempest-VolumesActionsTest-1155069277 None] Volume 7f71ec09-ba58-4046-a73c-5801cd44f818: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f71ec09-ba58-4046-a73c-5801cd44f818', 'volume_size': 1} Apr 30 21:29:04.388137 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-993363d4-fe8f-40d3-9019-31d54fb89d29 tempest-VolumesActionsTest-1155069277 None] creating volume 'volume-7f71ec09-ba58-4046-a73c-5801cd44f818' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:29:04.388911 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-993363d4-fe8f-40d3-9019-31d54fb89d29 tempest-VolumesActionsTest-1155069277 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:05.405038 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-993363d4-fe8f-40d3-9019-31d54fb89d29 tempest-VolumesActionsTest-1155069277 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:29:05.406104 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-993363d4-fe8f-40d3-9019-31d54fb89d29 tempest-VolumesActionsTest-1155069277 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:29:05.411637 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-993363d4-fe8f-40d3-9019-31d54fb89d29 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6028c71b-bff0-4e68-bc8c-1a3b20b27bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f71ec09-ba58-4046-a73c-5801cd44f818', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:05.416838 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-993363d4-fe8f-40d3-9019-31d54fb89d29 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84de86dd-1624-42c1-b869-6c97fa9c76b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:05.494238 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-993363d4-fe8f-40d3-9019-31d54fb89d29 tempest-VolumesActionsTest-1155069277 None] Volume volume-7f71ec09-ba58-4046-a73c-5801cd44f818 (7f71ec09-ba58-4046-a73c-5801cd44f818): created successfully Apr 30 21:29:05.497865 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-993363d4-fe8f-40d3-9019-31d54fb89d29 tempest-VolumesActionsTest-1155069277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84de86dd-1624-42c1-b869-6c97fa9c76b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:05.503309 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-993363d4-fe8f-40d3-9019-31d54fb89d29 tempest-VolumesActionsTest-1155069277 None] Flow 'volume_create_manager' (cc7f9cd3-d95d-47c7-a337-96461554d989) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:29:05.579832 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-993363d4-fe8f-40d3-9019-31d54fb89d29 tempest-VolumesActionsTest-1155069277 None] Created volume successfully. Apr 30 21:29:06.980418 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-8163b04c-ddac-4a52-987c-afdf709023f0 tempest-VolumeQuotasAdminTestJSON-395236735 None] Created reservations ['030b160e-581d-4d16-9c1d-94b568ecf24e', 'bc0582ed-bcd7-4695-9886-3404b45e9ff0', 'ac838238-6254-4192-932c-83a6d339a1e9', '4a633dbb-3aa1-45ec-ae40-dcee8faeb5df'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:29:07.240052 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8163b04c-ddac-4a52-987c-afdf709023f0 tempest-VolumeQuotasAdminTestJSON-395236735 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:07.312733 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8163b04c-ddac-4a52-987c-afdf709023f0 tempest-VolumeQuotasAdminTestJSON-395236735 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:07.350685 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-8163b04c-ddac-4a52-987c-afdf709023f0 tempest-VolumeQuotasAdminTestJSON-395236735 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:29:07.360015 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-8163b04c-ddac-4a52-987c-afdf709023f0 tempest-VolumeQuotasAdminTestJSON-395236735 None] Deleted volume successfully. Apr 30 21:29:07.854225 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-8163b04c-ddac-4a52-987c-afdf709023f0 tempest-VolumeQuotasAdminTestJSON-395236735 None] Lock "b'cinder-0198bfd4-3ffa-4b9d-a169-19fa193b5b87-delete_volume'" released by "delete_volume" :: held 9.291s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:29:07.952685 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-f725d264-f668-4cfa-a4ec-6c6aaa4a18b6 tempest-VolumesActionsTest-1155069277 None] Lock "b'cinder-7f71ec09-ba58-4046-a73c-5801cd44f818-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:29:08.068866 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f725d264-f668-4cfa-a4ec-6c6aaa4a18b6 tempest-VolumesActionsTest-1155069277 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:08.370609 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f725d264-f668-4cfa-a4ec-6c6aaa4a18b6 tempest-VolumesActionsTest-1155069277 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:29:08.375395 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f725d264-f668-4cfa-a4ec-6c6aaa4a18b6 tempest-VolumesActionsTest-1155069277 None] Volume volume-7f71ec09-ba58-4046-a73c-5801cd44f818 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:29:08.626699 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f725d264-f668-4cfa-a4ec-6c6aaa4a18b6 tempest-VolumesActionsTest-1155069277 None] deleting rbd volume volume-7f71ec09-ba58-4046-a73c-5801cd44f818 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:29:09.132543 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4374ec7-917e-4218-a7af-a915f9d43893 tempest-VolumeQuotasAdminTestJSON-395236735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:29:09.152865 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e4374ec7-917e-4218-a7af-a915f9d43893 tempest-VolumeQuotasAdminTestJSON-395236735 None] Flow 'volume_create_manager' (66976474-d283-4b34-857b-8eb94824c5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:29:09.160403 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e4374ec7-917e-4218-a7af-a915f9d43893 tempest-VolumeQuotasAdminTestJSON-395236735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (147ad56c-6117-41ab-b7a3-93e2a5a1fb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:09.175181 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e4374ec7-917e-4218-a7af-a915f9d43893 tempest-VolumeQuotasAdminTestJSON-395236735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (147ad56c-6117-41ab-b7a3-93e2a5a1fb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-163683937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=44d849f8-4162-4593-a36a-39859a8c3a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8db42a5e42884bc687a546cb4904ef5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:29:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:29:09Z,use_quota=True,user_id='e6c81689d8214c0f85463ad23fbb592f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:09.181188 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e4374ec7-917e-4218-a7af-a915f9d43893 tempest-VolumeQuotasAdminTestJSON-395236735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afbacf73-e5a1-4599-a547-8fd69e2f915b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:09.185296 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e4374ec7-917e-4218-a7af-a915f9d43893 tempest-VolumeQuotasAdminTestJSON-395236735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afbacf73-e5a1-4599-a547-8fd69e2f915b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:09.190399 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e4374ec7-917e-4218-a7af-a915f9d43893 tempest-VolumeQuotasAdminTestJSON-395236735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f865d82f-3d51-4679-bc68-46a0b9f460fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:09.194434 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e4374ec7-917e-4218-a7af-a915f9d43893 tempest-VolumeQuotasAdminTestJSON-395236735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f865d82f-3d51-4679-bc68-46a0b9f460fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44d849f8-4162-4593-a36a-39859a8c3a63', 'volume_name': 'volume-44d849f8-4162-4593-a36a-39859a8c3a63', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:09.199407 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e4374ec7-917e-4218-a7af-a915f9d43893 tempest-VolumeQuotasAdminTestJSON-395236735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e906824-1605-458b-b1cd-e5ce00935677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:09.203376 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e4374ec7-917e-4218-a7af-a915f9d43893 tempest-VolumeQuotasAdminTestJSON-395236735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e906824-1605-458b-b1cd-e5ce00935677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:09.211179 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e4374ec7-917e-4218-a7af-a915f9d43893 tempest-VolumeQuotasAdminTestJSON-395236735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d514a07a-abde-4eb7-bede-07632832ada9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:09.212620 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-e4374ec7-917e-4218-a7af-a915f9d43893 tempest-VolumeQuotasAdminTestJSON-395236735 None] Volume 44d849f8-4162-4593-a36a-39859a8c3a63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44d849f8-4162-4593-a36a-39859a8c3a63', 'volume_size': 1} Apr 30 21:29:09.213018 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e4374ec7-917e-4218-a7af-a915f9d43893 tempest-VolumeQuotasAdminTestJSON-395236735 None] creating volume 'volume-44d849f8-4162-4593-a36a-39859a8c3a63' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:29:09.213903 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e4374ec7-917e-4218-a7af-a915f9d43893 tempest-VolumeQuotasAdminTestJSON-395236735 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:10.011485 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-421f5d87-0ce0-4eb0-852b-c3892837a179 tempest-TaggedBootDevicesTest_v242-1954731281 None] Created reservations ['f894f413-c4d5-4910-b6e7-35203f638b1f', 'badf76bc-d337-4486-ba7a-8e74b4495aab', '42c8f5cc-147e-4d83-b575-18f2e344c03b', 'cb907052-26ac-4724-8596-91ae25fd4711'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:29:10.171629 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e4374ec7-917e-4218-a7af-a915f9d43893 tempest-VolumeQuotasAdminTestJSON-395236735 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:29:10.172931 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e4374ec7-917e-4218-a7af-a915f9d43893 tempest-VolumeQuotasAdminTestJSON-395236735 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:29:10.176064 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e4374ec7-917e-4218-a7af-a915f9d43893 tempest-VolumeQuotasAdminTestJSON-395236735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d514a07a-abde-4eb7-bede-07632832ada9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44d849f8-4162-4593-a36a-39859a8c3a63', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:10.181879 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e4374ec7-917e-4218-a7af-a915f9d43893 tempest-VolumeQuotasAdminTestJSON-395236735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df749aff-985f-4555-acd8-606ace643787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:10.244224 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-421f5d87-0ce0-4eb0-852b-c3892837a179 tempest-TaggedBootDevicesTest_v242-1954731281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:10.286586 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-421f5d87-0ce0-4eb0-852b-c3892837a179 tempest-TaggedBootDevicesTest_v242-1954731281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:10.384349 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-421f5d87-0ce0-4eb0-852b-c3892837a179 tempest-TaggedBootDevicesTest_v242-1954731281 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:29:10.389602 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-421f5d87-0ce0-4eb0-852b-c3892837a179 tempest-TaggedBootDevicesTest_v242-1954731281 None] Deleted volume successfully. Apr 30 21:29:10.393418 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-e4374ec7-917e-4218-a7af-a915f9d43893 tempest-VolumeQuotasAdminTestJSON-395236735 None] Volume volume-44d849f8-4162-4593-a36a-39859a8c3a63 (44d849f8-4162-4593-a36a-39859a8c3a63): created successfully Apr 30 21:29:10.397194 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e4374ec7-917e-4218-a7af-a915f9d43893 tempest-VolumeQuotasAdminTestJSON-395236735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df749aff-985f-4555-acd8-606ace643787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:10.403002 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e4374ec7-917e-4218-a7af-a915f9d43893 tempest-VolumeQuotasAdminTestJSON-395236735 None] Flow 'volume_create_manager' (66976474-d283-4b34-857b-8eb94824c5d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:29:10.501166 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-421f5d87-0ce0-4eb0-852b-c3892837a179 tempest-TaggedBootDevicesTest_v242-1954731281 None] Lock "b'cinder-27b24866-27ef-457f-bbcc-0152de7c242b-delete_volume'" released by "delete_volume" :: held 8.920s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:29:10.522049 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-e4374ec7-917e-4218-a7af-a915f9d43893 tempest-VolumeQuotasAdminTestJSON-395236735 None] Created volume successfully. Apr 30 21:29:11.451689 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-7a5eeab8-df17-4090-aa32-8be4e4451f16 tempest-TaggedBootDevicesTest_v242-1954731281 None] Lock "b'cinder-36930a8a-00bb-4076-b396-25ba68392b9d-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:29:11.590785 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-7a5eeab8-df17-4090-aa32-8be4e4451f16 tempest-TaggedBootDevicesTest_v242-1954731281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:11.979418 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-7a5eeab8-df17-4090-aa32-8be4e4451f16 tempest-TaggedBootDevicesTest_v242-1954731281 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:29:12.212423 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-7a5eeab8-df17-4090-aa32-8be4e4451f16 tempest-TaggedBootDevicesTest_v242-1954731281 None] deleting rbd volume volume-36930a8a-00bb-4076-b396-25ba68392b9d {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:29:12.913995 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-302ae967-0122-458e-8344-342cabf5f64e tempest-VolumeQuotasAdminTestJSON-1745180684 None] Transfer volume completed successfully. Apr 30 21:29:14.192042 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-3c018dbc-f039-4baa-871f-746aaf33dbb7 tempest-VolumeQuotasAdminTestJSON-1360482116 None] Lock "b'cinder-44d849f8-4162-4593-a36a-39859a8c3a63-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:29:14.304818 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-3c018dbc-f039-4baa-871f-746aaf33dbb7 tempest-VolumeQuotasAdminTestJSON-1360482116 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:14.528146 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-3c018dbc-f039-4baa-871f-746aaf33dbb7 tempest-VolumeQuotasAdminTestJSON-1360482116 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:29:14.528563 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-3c018dbc-f039-4baa-871f-746aaf33dbb7 tempest-VolumeQuotasAdminTestJSON-1360482116 None] Volume volume-44d849f8-4162-4593-a36a-39859a8c3a63 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:29:14.697095 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-3c018dbc-f039-4baa-871f-746aaf33dbb7 tempest-VolumeQuotasAdminTestJSON-1360482116 None] deleting rbd volume volume-44d849f8-4162-4593-a36a-39859a8c3a63 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:29:14.823159 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-f725d264-f668-4cfa-a4ec-6c6aaa4a18b6 tempest-VolumesActionsTest-1155069277 None] Created reservations ['67d73b33-ede3-4d38-b139-dd6ea92d9586', 'ec4f2e95-260b-4575-89c4-5cb80359a167', '89ba0541-7236-4caf-86a0-d1b3e3187283', '2a5943b1-5fd4-43dd-8c51-089fc5429c8b'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:29:15.026240 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f725d264-f668-4cfa-a4ec-6c6aaa4a18b6 tempest-VolumesActionsTest-1155069277 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:15.189721 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f725d264-f668-4cfa-a4ec-6c6aaa4a18b6 tempest-VolumesActionsTest-1155069277 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:15.263976 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-f725d264-f668-4cfa-a4ec-6c6aaa4a18b6 tempest-VolumesActionsTest-1155069277 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:29:15.267395 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-f725d264-f668-4cfa-a4ec-6c6aaa4a18b6 tempest-VolumesActionsTest-1155069277 None] Deleted volume successfully. Apr 30 21:29:15.356242 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-f725d264-f668-4cfa-a4ec-6c6aaa4a18b6 tempest-VolumesActionsTest-1155069277 None] Lock "b'cinder-7f71ec09-ba58-4046-a73c-5801cd44f818-delete_volume'" released by "delete_volume" :: held 7.406s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:29:16.327115 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-a8e2d7f3-1a3a-4846-a154-d8ab28c7158b tempest-VolumesActionsTest-1155069277 None] Lock "b'cinder-5ea0bb8a-5a1f-4bfe-96b4-b381a5310142-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:29:16.463568 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a8e2d7f3-1a3a-4846-a154-d8ab28c7158b tempest-VolumesActionsTest-1155069277 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:16.825584 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a8e2d7f3-1a3a-4846-a154-d8ab28c7158b tempest-VolumesActionsTest-1155069277 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:29:16.826038 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a8e2d7f3-1a3a-4846-a154-d8ab28c7158b tempest-VolumesActionsTest-1155069277 None] Volume volume-5ea0bb8a-5a1f-4bfe-96b4-b381a5310142 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:29:17.080351 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a8e2d7f3-1a3a-4846-a154-d8ab28c7158b tempest-VolumesActionsTest-1155069277 None] deleting rbd volume volume-5ea0bb8a-5a1f-4bfe-96b4-b381a5310142 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:29:20.783129 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-7a5eeab8-df17-4090-aa32-8be4e4451f16 tempest-TaggedBootDevicesTest_v242-1954731281 None] volume is a clone so cleaning references {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} Apr 30 21:29:20.998398 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-7a5eeab8-df17-4090-aa32-8be4e4451f16 tempest-TaggedBootDevicesTest_v242-1954731281 None] deleting parent snapshot volume-36930a8a-00bb-4076-b396-25ba68392b9d.clone_snap {{(pid=123855) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} Apr 30 21:29:24.711544 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-3c018dbc-f039-4baa-871f-746aaf33dbb7 tempest-VolumeQuotasAdminTestJSON-1360482116 None] Created reservations ['9411d134-1977-4da3-bea8-2fc2cb29b3b1', 'f0829a0e-4ce1-4a6a-bebe-d0921d2b3ef3', 'ae2c1242-ff1c-4196-8e9f-7af9c271a7c2', '2e65966a-2086-4fcb-ab71-cccfb91e431e'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:29:24.725357 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-7a5eeab8-df17-4090-aa32-8be4e4451f16 tempest-TaggedBootDevicesTest_v242-1954731281 None] Created reservations ['7e6c8c99-f41c-4598-96b5-ea50a39dde34', 'cc6d1da5-7a0a-4c33-86f6-f4b50628ce29', '0274defe-7558-4db5-92aa-b8d4cc131743', '1b4ea6e0-4892-4420-ada2-51b94e2571be'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:29:24.728114 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-a8e2d7f3-1a3a-4846-a154-d8ab28c7158b tempest-VolumesActionsTest-1155069277 None] Created reservations ['76b6c82d-64e5-401d-922c-9ada0057ccce', '0c8d378a-381b-4a29-a0dd-e5c8373b7a2a', '703a1960-7412-43ee-9a39-35a7f5159d20', '6b13cce9-221e-4597-b5e8-61a3a2ecaf6e'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:29:24.961131 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-3c018dbc-f039-4baa-871f-746aaf33dbb7 tempest-VolumeQuotasAdminTestJSON-1360482116 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:25.031831 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-3c018dbc-f039-4baa-871f-746aaf33dbb7 tempest-VolumeQuotasAdminTestJSON-1360482116 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:25.084424 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-3c018dbc-f039-4baa-871f-746aaf33dbb7 tempest-VolumeQuotasAdminTestJSON-1360482116 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:29:25.092084 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-3c018dbc-f039-4baa-871f-746aaf33dbb7 tempest-VolumeQuotasAdminTestJSON-1360482116 None] Deleted volume successfully. Apr 30 21:29:25.098691 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-7a5eeab8-df17-4090-aa32-8be4e4451f16 tempest-TaggedBootDevicesTest_v242-1954731281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:25.155368 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-7a5eeab8-df17-4090-aa32-8be4e4451f16 tempest-TaggedBootDevicesTest_v242-1954731281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:25.295799 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-7a5eeab8-df17-4090-aa32-8be4e4451f16 tempest-TaggedBootDevicesTest_v242-1954731281 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:29:25.298530 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a8e2d7f3-1a3a-4846-a154-d8ab28c7158b tempest-VolumesActionsTest-1155069277 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:25.367595 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a8e2d7f3-1a3a-4846-a154-d8ab28c7158b tempest-VolumesActionsTest-1155069277 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:25.434281 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-a8e2d7f3-1a3a-4846-a154-d8ab28c7158b tempest-VolumesActionsTest-1155069277 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:29:25.443477 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-7a5eeab8-df17-4090-aa32-8be4e4451f16 tempest-TaggedBootDevicesTest_v242-1954731281 None] Deleted volume successfully. Apr 30 21:29:25.452399 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-3c018dbc-f039-4baa-871f-746aaf33dbb7 tempest-VolumeQuotasAdminTestJSON-1360482116 None] Lock "b'cinder-44d849f8-4162-4593-a36a-39859a8c3a63-delete_volume'" released by "delete_volume" :: held 11.260s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:29:25.482524 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-a8e2d7f3-1a3a-4846-a154-d8ab28c7158b tempest-VolumesActionsTest-1155069277 None] Deleted volume successfully. Apr 30 21:29:25.527603 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-7a5eeab8-df17-4090-aa32-8be4e4451f16 tempest-TaggedBootDevicesTest_v242-1954731281 None] Lock "b'cinder-36930a8a-00bb-4076-b396-25ba68392b9d-delete_volume'" released by "delete_volume" :: held 14.073s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:29:25.579858 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-a8e2d7f3-1a3a-4846-a154-d8ab28c7158b tempest-VolumesActionsTest-1155069277 None] Lock "b'cinder-5ea0bb8a-5a1f-4bfe-96b4-b381a5310142-delete_volume'" released by "delete_volume" :: held 9.254s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:29:28.954473 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:29:28.955925 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:29.010201 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:29.065268 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:29:31.261195 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-10cc450a-e602-4976-bd23-3c63499f1de6 tempest-AttachVolumeNegativeTest-612541851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:29:31.283525 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-10cc450a-e602-4976-bd23-3c63499f1de6 tempest-AttachVolumeNegativeTest-612541851 None] Flow 'volume_create_manager' (f770f674-9226-4f31-abea-6af28a4bb2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:29:31.291861 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-10cc450a-e602-4976-bd23-3c63499f1de6 tempest-AttachVolumeNegativeTest-612541851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67fd3ba1-69f0-4108-ad4e-16b9a9aee00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:31.313931 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-10cc450a-e602-4976-bd23-3c63499f1de6 tempest-AttachVolumeNegativeTest-612541851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67fd3ba1-69f0-4108-ad4e-16b9a9aee00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-993798881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b08ce48b-427b-4e2c-8fb6-29fce76e8e58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ceedad6e134d94ac8758f8385a47e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:29:31Z,use_quota=True,user_id='9cc9b55d852942538c3ad8f317dcd73e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:31.338489 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-10cc450a-e602-4976-bd23-3c63499f1de6 tempest-AttachVolumeNegativeTest-612541851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab19398b-9bed-4169-b288-cab8e37e8418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:31.343487 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-10cc450a-e602-4976-bd23-3c63499f1de6 tempest-AttachVolumeNegativeTest-612541851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab19398b-9bed-4169-b288-cab8e37e8418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:31.355102 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-10cc450a-e602-4976-bd23-3c63499f1de6 tempest-AttachVolumeNegativeTest-612541851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b922887a-0f12-4bcc-9eb4-30b253237775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:31.371019 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-10cc450a-e602-4976-bd23-3c63499f1de6 tempest-AttachVolumeNegativeTest-612541851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b922887a-0f12-4bcc-9eb4-30b253237775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b08ce48b-427b-4e2c-8fb6-29fce76e8e58', 'volume_name': 'volume-b08ce48b-427b-4e2c-8fb6-29fce76e8e58', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:31.386052 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-10cc450a-e602-4976-bd23-3c63499f1de6 tempest-AttachVolumeNegativeTest-612541851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0041e1b1-72a9-4ef8-a0e3-2f5580042ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:31.391097 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-10cc450a-e602-4976-bd23-3c63499f1de6 tempest-AttachVolumeNegativeTest-612541851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0041e1b1-72a9-4ef8-a0e3-2f5580042ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:31.397980 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-10cc450a-e602-4976-bd23-3c63499f1de6 tempest-AttachVolumeNegativeTest-612541851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a680aedd-a5de-4db8-becc-250e5d68474d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:31.399355 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-10cc450a-e602-4976-bd23-3c63499f1de6 tempest-AttachVolumeNegativeTest-612541851 None] Volume b08ce48b-427b-4e2c-8fb6-29fce76e8e58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b08ce48b-427b-4e2c-8fb6-29fce76e8e58', 'volume_size': 1} Apr 30 21:29:31.399970 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-10cc450a-e602-4976-bd23-3c63499f1de6 tempest-AttachVolumeNegativeTest-612541851 None] creating volume 'volume-b08ce48b-427b-4e2c-8fb6-29fce76e8e58' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:29:31.401075 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-10cc450a-e602-4976-bd23-3c63499f1de6 tempest-AttachVolumeNegativeTest-612541851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:31.988340 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-10cc450a-e602-4976-bd23-3c63499f1de6 tempest-AttachVolumeNegativeTest-612541851 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:29:31.998942 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-10cc450a-e602-4976-bd23-3c63499f1de6 tempest-AttachVolumeNegativeTest-612541851 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:29:31.998942 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-10cc450a-e602-4976-bd23-3c63499f1de6 tempest-AttachVolumeNegativeTest-612541851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a680aedd-a5de-4db8-becc-250e5d68474d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b08ce48b-427b-4e2c-8fb6-29fce76e8e58', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:32.000882 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-10cc450a-e602-4976-bd23-3c63499f1de6 tempest-AttachVolumeNegativeTest-612541851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc922cc1-cbc6-40fa-ab14-c7a40f2c4c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:32.105552 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-10cc450a-e602-4976-bd23-3c63499f1de6 tempest-AttachVolumeNegativeTest-612541851 None] Volume volume-b08ce48b-427b-4e2c-8fb6-29fce76e8e58 (b08ce48b-427b-4e2c-8fb6-29fce76e8e58): created successfully Apr 30 21:29:32.109724 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-10cc450a-e602-4976-bd23-3c63499f1de6 tempest-AttachVolumeNegativeTest-612541851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc922cc1-cbc6-40fa-ab14-c7a40f2c4c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:32.121300 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-10cc450a-e602-4976-bd23-3c63499f1de6 tempest-AttachVolumeNegativeTest-612541851 None] Flow 'volume_create_manager' (f770f674-9226-4f31-abea-6af28a4bb2a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:29:32.214000 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-10cc450a-e602-4976-bd23-3c63499f1de6 tempest-AttachVolumeNegativeTest-612541851 None] Created volume successfully. Apr 30 21:29:34.726939 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-9cee8d85-c212-4a48-8e2d-230c818dd9e0 req-c71ea1e9-7f62-497d-8fa4-0ed0368f5734 tempest-AttachVolumeNegativeTest-612541851 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:29:35.606340 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-9cee8d85-c212-4a48-8e2d-230c818dd9e0 req-c71ea1e9-7f62-497d-8fa4-0ed0368f5734 tempest-AttachVolumeNegativeTest-612541851 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.879s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:29:35.607164 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-9cee8d85-c212-4a48-8e2d-230c818dd9e0 req-c71ea1e9-7f62-497d-8fa4-0ed0368f5734 tempest-AttachVolumeNegativeTest-612541851 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b08ce48b-427b-4e2c-8fb6-29fce76e8e58', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': 'b08ce48b-427b-4e2c-8fb6-29fce76e8e58', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:29:35.742824 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-9cee8d85-c212-4a48-8e2d-230c818dd9e0 req-c71ea1e9-7f62-497d-8fa4-0ed0368f5734 tempest-AttachVolumeNegativeTest-612541851 None] Connection info returned from driver {'name': 'volumes/volume-b08ce48b-427b-4e2c-8fb6-29fce76e8e58', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b08ce48b-427b-4e2c-8fb6-29fce76e8e58', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '646edc0b-fa35-44d5-ac5d-e5f29d1b72c3'} {{(pid=123855) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Apr 30 21:29:35.926411 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-9cee8d85-c212-4a48-8e2d-230c818dd9e0 req-c71ea1e9-7f62-497d-8fa4-0ed0368f5734 tempest-AttachVolumeNegativeTest-612541851 None] attachment_update completed successfully. Apr 30 21:29:37.775757 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-39109644-4acd-43b0-a156-8eaa2f8a4e8a tempest-VolumeQuotasNegativeTestJSON-1343541694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:29:37.798261 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-39109644-4acd-43b0-a156-8eaa2f8a4e8a tempest-VolumeQuotasNegativeTestJSON-1343541694 None] Flow 'volume_create_manager' (bf6922f3-f495-4d5f-99bd-9c629dce3270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:29:37.805803 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-39109644-4acd-43b0-a156-8eaa2f8a4e8a tempest-VolumeQuotasNegativeTestJSON-1343541694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9d509a3-855c-45a8-95d2-da2f6693e78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:37.850374 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-39109644-4acd-43b0-a156-8eaa2f8a4e8a tempest-VolumeQuotasNegativeTestJSON-1343541694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9d509a3-855c-45a8-95d2-da2f6693e78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-450289150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6927c29e-ccec-4643-ba4d-750d273b2e12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5260d9c3a5f4165873b033b64eba1da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:29:38Z,use_quota=True,user_id='d5ad157e93c646c896df7d256eedc4b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:37.866597 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-39109644-4acd-43b0-a156-8eaa2f8a4e8a tempest-VolumeQuotasNegativeTestJSON-1343541694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5231ba07-4a81-469f-a6e9-db44d43cb94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:37.875115 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-39109644-4acd-43b0-a156-8eaa2f8a4e8a tempest-VolumeQuotasNegativeTestJSON-1343541694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5231ba07-4a81-469f-a6e9-db44d43cb94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:37.888008 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-39109644-4acd-43b0-a156-8eaa2f8a4e8a tempest-VolumeQuotasNegativeTestJSON-1343541694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61e5a6b2-4467-48f6-b0d2-644d2e556aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:37.893949 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-39109644-4acd-43b0-a156-8eaa2f8a4e8a tempest-VolumeQuotasNegativeTestJSON-1343541694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61e5a6b2-4467-48f6-b0d2-644d2e556aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6927c29e-ccec-4643-ba4d-750d273b2e12', 'volume_name': 'volume-6927c29e-ccec-4643-ba4d-750d273b2e12', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:37.902500 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-39109644-4acd-43b0-a156-8eaa2f8a4e8a tempest-VolumeQuotasNegativeTestJSON-1343541694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd7e4790-21db-4115-926b-715b7acd638d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:37.906821 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-39109644-4acd-43b0-a156-8eaa2f8a4e8a tempest-VolumeQuotasNegativeTestJSON-1343541694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd7e4790-21db-4115-926b-715b7acd638d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:37.922948 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-39109644-4acd-43b0-a156-8eaa2f8a4e8a tempest-VolumeQuotasNegativeTestJSON-1343541694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4042d7dd-6d03-4161-bfe0-d8d2ae2a875e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:37.926406 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-39109644-4acd-43b0-a156-8eaa2f8a4e8a tempest-VolumeQuotasNegativeTestJSON-1343541694 None] Volume 6927c29e-ccec-4643-ba4d-750d273b2e12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6927c29e-ccec-4643-ba4d-750d273b2e12', 'volume_size': 1} Apr 30 21:29:37.926406 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-39109644-4acd-43b0-a156-8eaa2f8a4e8a tempest-VolumeQuotasNegativeTestJSON-1343541694 None] creating volume 'volume-6927c29e-ccec-4643-ba4d-750d273b2e12' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:29:37.926406 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-39109644-4acd-43b0-a156-8eaa2f8a4e8a tempest-VolumeQuotasNegativeTestJSON-1343541694 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:38.511179 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-f026849a-3f00-4894-be4b-4bf6f298fd7f tempest-VolumesListAdminTestJSON-1293302386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:29:38.587849 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f026849a-3f00-4894-be4b-4bf6f298fd7f tempest-VolumesListAdminTestJSON-1293302386 None] Flow 'volume_create_manager' (2a9dac14-e07f-4e29-9daa-b3f2bed6f407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:29:38.629155 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f026849a-3f00-4894-be4b-4bf6f298fd7f tempest-VolumesListAdminTestJSON-1293302386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ceb6404-df67-4dd7-8f5a-c7deb4a6fbeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:38.674931 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f026849a-3f00-4894-be4b-4bf6f298fd7f tempest-VolumesListAdminTestJSON-1293302386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ceb6404-df67-4dd7-8f5a-c7deb4a6fbeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1744795922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=836d8edf-24bd-4958-8d3e-b153af99ed49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe19df8503d40afbdd17781c0cf915c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:29:38Z,use_quota=True,user_id='666ed7c4c48b4a9886026bcb6151f3bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:38.704437 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f026849a-3f00-4894-be4b-4bf6f298fd7f tempest-VolumesListAdminTestJSON-1293302386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7084d7d-d04d-4224-a81a-81ccac33456f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:38.707978 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f026849a-3f00-4894-be4b-4bf6f298fd7f tempest-VolumesListAdminTestJSON-1293302386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7084d7d-d04d-4224-a81a-81ccac33456f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:38.727664 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f026849a-3f00-4894-be4b-4bf6f298fd7f tempest-VolumesListAdminTestJSON-1293302386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b917165c-6af8-4ce0-a8eb-23287bf7d260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:38.745026 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f026849a-3f00-4894-be4b-4bf6f298fd7f tempest-VolumesListAdminTestJSON-1293302386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b917165c-6af8-4ce0-a8eb-23287bf7d260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '836d8edf-24bd-4958-8d3e-b153af99ed49', 'volume_name': 'volume-836d8edf-24bd-4958-8d3e-b153af99ed49', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:38.760096 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f026849a-3f00-4894-be4b-4bf6f298fd7f tempest-VolumesListAdminTestJSON-1293302386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9079f30c-496f-4fb6-b938-59c262122861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:38.769058 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f026849a-3f00-4894-be4b-4bf6f298fd7f tempest-VolumesListAdminTestJSON-1293302386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9079f30c-496f-4fb6-b938-59c262122861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:38.781262 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f026849a-3f00-4894-be4b-4bf6f298fd7f tempest-VolumesListAdminTestJSON-1293302386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21bbb908-0423-4a4a-9abe-f8d9469ea4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:38.784273 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-f026849a-3f00-4894-be4b-4bf6f298fd7f tempest-VolumesListAdminTestJSON-1293302386 None] Volume 836d8edf-24bd-4958-8d3e-b153af99ed49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-836d8edf-24bd-4958-8d3e-b153af99ed49', 'volume_size': 1} Apr 30 21:29:38.786873 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f026849a-3f00-4894-be4b-4bf6f298fd7f tempest-VolumesListAdminTestJSON-1293302386 None] creating volume 'volume-836d8edf-24bd-4958-8d3e-b153af99ed49' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:29:38.788121 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f026849a-3f00-4894-be4b-4bf6f298fd7f tempest-VolumesListAdminTestJSON-1293302386 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:39.133409 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-39109644-4acd-43b0-a156-8eaa2f8a4e8a tempest-VolumeQuotasNegativeTestJSON-1343541694 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:29:39.135783 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-39109644-4acd-43b0-a156-8eaa2f8a4e8a tempest-VolumeQuotasNegativeTestJSON-1343541694 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:29:39.140795 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-39109644-4acd-43b0-a156-8eaa2f8a4e8a tempest-VolumeQuotasNegativeTestJSON-1343541694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4042d7dd-6d03-4161-bfe0-d8d2ae2a875e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6927c29e-ccec-4643-ba4d-750d273b2e12', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:39.150386 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-39109644-4acd-43b0-a156-8eaa2f8a4e8a tempest-VolumeQuotasNegativeTestJSON-1343541694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e01bced-8717-4559-95de-959a6e6040b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:39.284609 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-39109644-4acd-43b0-a156-8eaa2f8a4e8a tempest-VolumeQuotasNegativeTestJSON-1343541694 None] Volume volume-6927c29e-ccec-4643-ba4d-750d273b2e12 (6927c29e-ccec-4643-ba4d-750d273b2e12): created successfully Apr 30 21:29:39.289179 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-39109644-4acd-43b0-a156-8eaa2f8a4e8a tempest-VolumeQuotasNegativeTestJSON-1343541694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e01bced-8717-4559-95de-959a6e6040b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:39.294928 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-39109644-4acd-43b0-a156-8eaa2f8a4e8a tempest-VolumeQuotasNegativeTestJSON-1343541694 None] Flow 'volume_create_manager' (bf6922f3-f495-4d5f-99bd-9c629dce3270) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:29:39.423710 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-39109644-4acd-43b0-a156-8eaa2f8a4e8a tempest-VolumeQuotasNegativeTestJSON-1343541694 None] Created volume successfully. Apr 30 21:29:39.755640 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f026849a-3f00-4894-be4b-4bf6f298fd7f tempest-VolumesListAdminTestJSON-1293302386 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:29:39.760567 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f026849a-3f00-4894-be4b-4bf6f298fd7f tempest-VolumesListAdminTestJSON-1293302386 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:29:39.767773 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f026849a-3f00-4894-be4b-4bf6f298fd7f tempest-VolumesListAdminTestJSON-1293302386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21bbb908-0423-4a4a-9abe-f8d9469ea4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-836d8edf-24bd-4958-8d3e-b153af99ed49', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:39.774081 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f026849a-3f00-4894-be4b-4bf6f298fd7f tempest-VolumesListAdminTestJSON-1293302386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fffa06c9-ce66-4924-9edf-e2f8f9694b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:39.873319 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-f026849a-3f00-4894-be4b-4bf6f298fd7f tempest-VolumesListAdminTestJSON-1293302386 None] Volume volume-836d8edf-24bd-4958-8d3e-b153af99ed49 (836d8edf-24bd-4958-8d3e-b153af99ed49): created successfully Apr 30 21:29:39.883558 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f026849a-3f00-4894-be4b-4bf6f298fd7f tempest-VolumesListAdminTestJSON-1293302386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fffa06c9-ce66-4924-9edf-e2f8f9694b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:39.918776 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f026849a-3f00-4894-be4b-4bf6f298fd7f tempest-VolumesListAdminTestJSON-1293302386 None] Flow 'volume_create_manager' (2a9dac14-e07f-4e29-9daa-b3f2bed6f407) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:29:39.981532 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-f026849a-3f00-4894-be4b-4bf6f298fd7f tempest-VolumesListAdminTestJSON-1293302386 None] Created volume successfully. Apr 30 21:29:41.173960 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-f3d54811-1df6-421a-a6f4-88f2567728ca req-22db2be2-8f54-41e5-8b6f-4b4cbddecc3c tempest-AttachVolumeNegativeTest-612541851 None] Terminate volume connection completed successfully. Apr 30 21:29:41.173960 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-f3d54811-1df6-421a-a6f4-88f2567728ca req-22db2be2-8f54-41e5-8b6f-4b4cbddecc3c tempest-AttachVolumeNegativeTest-612541851 None] Deleting attachment 646edc0b-fa35-44d5-ac5d-e5f29d1b72c3. {{(pid=123855) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} Apr 30 21:29:41.440165 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-d843f925-5641-4349-9d13-5d76c2c779fd tempest-VolumesListAdminTestJSON-1293302386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:29:41.462536 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d843f925-5641-4349-9d13-5d76c2c779fd tempest-VolumesListAdminTestJSON-1293302386 None] Flow 'volume_create_manager' (3f1e3f64-64be-4de2-b54a-b09b2896d7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:29:41.470024 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d843f925-5641-4349-9d13-5d76c2c779fd tempest-VolumesListAdminTestJSON-1293302386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5d321c1-7db3-4217-b20a-bba0c1ce1bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:41.488488 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d843f925-5641-4349-9d13-5d76c2c779fd tempest-VolumesListAdminTestJSON-1293302386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5d321c1-7db3-4217-b20a-bba0c1ce1bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1854161818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c8345122-ad95-4d6f-82e6-90fa09abf578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe19df8503d40afbdd17781c0cf915c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:29:41Z,use_quota=True,user_id='666ed7c4c48b4a9886026bcb6151f3bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:41.495773 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d843f925-5641-4349-9d13-5d76c2c779fd tempest-VolumesListAdminTestJSON-1293302386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f6fcf7c-8794-4214-954d-8d92cf5205ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:41.500632 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d843f925-5641-4349-9d13-5d76c2c779fd tempest-VolumesListAdminTestJSON-1293302386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f6fcf7c-8794-4214-954d-8d92cf5205ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:41.507316 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d843f925-5641-4349-9d13-5d76c2c779fd tempest-VolumesListAdminTestJSON-1293302386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f4f5fc0-d873-43ea-bf22-c0910a3fade4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:41.512097 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d843f925-5641-4349-9d13-5d76c2c779fd tempest-VolumesListAdminTestJSON-1293302386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f4f5fc0-d873-43ea-bf22-c0910a3fade4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8345122-ad95-4d6f-82e6-90fa09abf578', 'volume_name': 'volume-c8345122-ad95-4d6f-82e6-90fa09abf578', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:41.517412 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d843f925-5641-4349-9d13-5d76c2c779fd tempest-VolumesListAdminTestJSON-1293302386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07316ccc-1966-4ca8-aa81-43e844b15338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:41.521363 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d843f925-5641-4349-9d13-5d76c2c779fd tempest-VolumesListAdminTestJSON-1293302386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07316ccc-1966-4ca8-aa81-43e844b15338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:41.526825 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d843f925-5641-4349-9d13-5d76c2c779fd tempest-VolumesListAdminTestJSON-1293302386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cfce94f-a28b-4cd7-aa66-328007b6dcf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:41.527912 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-d843f925-5641-4349-9d13-5d76c2c779fd tempest-VolumesListAdminTestJSON-1293302386 None] Volume c8345122-ad95-4d6f-82e6-90fa09abf578: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8345122-ad95-4d6f-82e6-90fa09abf578', 'volume_size': 1} Apr 30 21:29:41.528299 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-d843f925-5641-4349-9d13-5d76c2c779fd tempest-VolumesListAdminTestJSON-1293302386 None] creating volume 'volume-c8345122-ad95-4d6f-82e6-90fa09abf578' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:29:41.528978 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-d843f925-5641-4349-9d13-5d76c2c779fd tempest-VolumesListAdminTestJSON-1293302386 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:41.591529 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-6674840e-a5ed-4a18-ad73-e4e248e9942b tempest-VolumeQuotasNegativeTestJSON-1343541694 None] Lock "b'cinder-6927c29e-ccec-4643-ba4d-750d273b2e12-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:29:41.713929 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-6674840e-a5ed-4a18-ad73-e4e248e9942b tempest-VolumeQuotasNegativeTestJSON-1343541694 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:42.112792 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-6674840e-a5ed-4a18-ad73-e4e248e9942b tempest-VolumeQuotasNegativeTestJSON-1343541694 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:29:42.118275 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-6674840e-a5ed-4a18-ad73-e4e248e9942b tempest-VolumeQuotasNegativeTestJSON-1343541694 None] Volume volume-6927c29e-ccec-4643-ba4d-750d273b2e12 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:29:42.445798 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-6674840e-a5ed-4a18-ad73-e4e248e9942b tempest-VolumeQuotasNegativeTestJSON-1343541694 None] deleting rbd volume volume-6927c29e-ccec-4643-ba4d-750d273b2e12 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:29:42.459919 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-d843f925-5641-4349-9d13-5d76c2c779fd tempest-VolumesListAdminTestJSON-1293302386 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:29:42.462360 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-d843f925-5641-4349-9d13-5d76c2c779fd tempest-VolumesListAdminTestJSON-1293302386 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:29:42.466319 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d843f925-5641-4349-9d13-5d76c2c779fd tempest-VolumesListAdminTestJSON-1293302386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cfce94f-a28b-4cd7-aa66-328007b6dcf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8345122-ad95-4d6f-82e6-90fa09abf578', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:42.483146 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d843f925-5641-4349-9d13-5d76c2c779fd tempest-VolumesListAdminTestJSON-1293302386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bc1e0a5-02f8-499b-8467-d954ef452ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:42.561791 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-d843f925-5641-4349-9d13-5d76c2c779fd tempest-VolumesListAdminTestJSON-1293302386 None] Volume volume-c8345122-ad95-4d6f-82e6-90fa09abf578 (c8345122-ad95-4d6f-82e6-90fa09abf578): created successfully Apr 30 21:29:42.566606 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d843f925-5641-4349-9d13-5d76c2c779fd tempest-VolumesListAdminTestJSON-1293302386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bc1e0a5-02f8-499b-8467-d954ef452ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:42.572574 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d843f925-5641-4349-9d13-5d76c2c779fd tempest-VolumesListAdminTestJSON-1293302386 None] Flow 'volume_create_manager' (3f1e3f64-64be-4de2-b54a-b09b2896d7ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:29:42.648406 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-d843f925-5641-4349-9d13-5d76c2c779fd tempest-VolumesListAdminTestJSON-1293302386 None] Created volume successfully. Apr 30 21:29:44.512045 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-5100cfac-518d-4a7b-98a6-49007ab5539c tempest-VolumesListAdminTestJSON-1293302386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:29:44.559305 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5100cfac-518d-4a7b-98a6-49007ab5539c tempest-VolumesListAdminTestJSON-1293302386 None] Flow 'volume_create_manager' (98d4d6a5-687f-4a9b-8f8d-800ac6953edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:29:44.569880 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5100cfac-518d-4a7b-98a6-49007ab5539c tempest-VolumesListAdminTestJSON-1293302386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82535c82-a037-47f2-b422-6cd27c5aa7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:44.586981 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5100cfac-518d-4a7b-98a6-49007ab5539c tempest-VolumesListAdminTestJSON-1293302386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82535c82-a037-47f2-b422-6cd27c5aa7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1884866032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a9d3ede6-63e4-4026-a830-d633a6cb27ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe19df8503d40afbdd17781c0cf915c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:29:44Z,use_quota=True,user_id='666ed7c4c48b4a9886026bcb6151f3bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:44.595457 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5100cfac-518d-4a7b-98a6-49007ab5539c tempest-VolumesListAdminTestJSON-1293302386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cbed044-e4f3-4c2f-bfda-7433fa77f835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:44.603444 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5100cfac-518d-4a7b-98a6-49007ab5539c tempest-VolumesListAdminTestJSON-1293302386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cbed044-e4f3-4c2f-bfda-7433fa77f835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:44.610018 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5100cfac-518d-4a7b-98a6-49007ab5539c tempest-VolumesListAdminTestJSON-1293302386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf1e8982-b449-4c78-ab8c-5ccb2e7fca6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:44.617913 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5100cfac-518d-4a7b-98a6-49007ab5539c tempest-VolumesListAdminTestJSON-1293302386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf1e8982-b449-4c78-ab8c-5ccb2e7fca6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9d3ede6-63e4-4026-a830-d633a6cb27ed', 'volume_name': 'volume-a9d3ede6-63e4-4026-a830-d633a6cb27ed', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:44.624567 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5100cfac-518d-4a7b-98a6-49007ab5539c tempest-VolumesListAdminTestJSON-1293302386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cdad695-97c2-4a53-beea-fe87ff3601c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:44.655738 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5100cfac-518d-4a7b-98a6-49007ab5539c tempest-VolumesListAdminTestJSON-1293302386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cdad695-97c2-4a53-beea-fe87ff3601c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:44.662968 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5100cfac-518d-4a7b-98a6-49007ab5539c tempest-VolumesListAdminTestJSON-1293302386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c215254-ddfb-4fe5-83d1-afc97cdbd5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:44.664097 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-5100cfac-518d-4a7b-98a6-49007ab5539c tempest-VolumesListAdminTestJSON-1293302386 None] Volume a9d3ede6-63e4-4026-a830-d633a6cb27ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9d3ede6-63e4-4026-a830-d633a6cb27ed', 'volume_size': 1} Apr 30 21:29:44.667759 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-5100cfac-518d-4a7b-98a6-49007ab5539c tempest-VolumesListAdminTestJSON-1293302386 None] creating volume 'volume-a9d3ede6-63e4-4026-a830-d633a6cb27ed' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:29:44.667759 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-5100cfac-518d-4a7b-98a6-49007ab5539c tempest-VolumesListAdminTestJSON-1293302386 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:45.594207 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-5100cfac-518d-4a7b-98a6-49007ab5539c tempest-VolumesListAdminTestJSON-1293302386 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:29:45.596113 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-5100cfac-518d-4a7b-98a6-49007ab5539c tempest-VolumesListAdminTestJSON-1293302386 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:29:45.602870 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5100cfac-518d-4a7b-98a6-49007ab5539c tempest-VolumesListAdminTestJSON-1293302386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c215254-ddfb-4fe5-83d1-afc97cdbd5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9d3ede6-63e4-4026-a830-d633a6cb27ed', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:45.610000 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5100cfac-518d-4a7b-98a6-49007ab5539c tempest-VolumesListAdminTestJSON-1293302386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fb9cdc2-e28a-4238-b736-2552bf028583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:45.716375 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-5100cfac-518d-4a7b-98a6-49007ab5539c tempest-VolumesListAdminTestJSON-1293302386 None] Volume volume-a9d3ede6-63e4-4026-a830-d633a6cb27ed (a9d3ede6-63e4-4026-a830-d633a6cb27ed): created successfully Apr 30 21:29:45.720102 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5100cfac-518d-4a7b-98a6-49007ab5539c tempest-VolumesListAdminTestJSON-1293302386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fb9cdc2-e28a-4238-b736-2552bf028583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:45.726364 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5100cfac-518d-4a7b-98a6-49007ab5539c tempest-VolumesListAdminTestJSON-1293302386 None] Flow 'volume_create_manager' (98d4d6a5-687f-4a9b-8f8d-800ac6953edf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:29:45.787541 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-5100cfac-518d-4a7b-98a6-49007ab5539c tempest-VolumesListAdminTestJSON-1293302386 None] Created volume successfully. Apr 30 21:29:46.908174 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-6674840e-a5ed-4a18-ad73-e4e248e9942b tempest-VolumeQuotasNegativeTestJSON-1343541694 None] Created reservations ['13ef8b87-b3fe-4b6a-b8eb-341288783188', '7a874f52-d74e-4d6b-ac43-9d358e914a79', 'a71e4c30-0d45-4463-b244-6ea408233b19', 'e1c85388-92cc-4d77-8041-3c4a7926853b'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:29:47.367808 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-6674840e-a5ed-4a18-ad73-e4e248e9942b tempest-VolumeQuotasNegativeTestJSON-1343541694 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:47.481958 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-6674840e-a5ed-4a18-ad73-e4e248e9942b tempest-VolumeQuotasNegativeTestJSON-1343541694 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:47.532687 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-6674840e-a5ed-4a18-ad73-e4e248e9942b tempest-VolumeQuotasNegativeTestJSON-1343541694 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:29:47.541488 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-6674840e-a5ed-4a18-ad73-e4e248e9942b tempest-VolumeQuotasNegativeTestJSON-1343541694 None] Deleted volume successfully. Apr 30 21:29:47.658530 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-6674840e-a5ed-4a18-ad73-e4e248e9942b tempest-VolumeQuotasNegativeTestJSON-1343541694 None] Lock "b'cinder-6927c29e-ccec-4643-ba4d-750d273b2e12-delete_volume'" released by "delete_volume" :: held 6.067s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:29:48.163155 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b8e0aa1-1c63-4032-8133-b22aa48a310f tempest-VolumesListAdminTestJSON-935149300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:29:48.196022 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0b8e0aa1-1c63-4032-8133-b22aa48a310f tempest-VolumesListAdminTestJSON-935149300 None] Flow 'volume_create_manager' (598801f7-7161-4263-8668-31ba295ee1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:29:48.202867 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0b8e0aa1-1c63-4032-8133-b22aa48a310f tempest-VolumesListAdminTestJSON-935149300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a52c7deb-9d9f-4606-942a-41ee18ea74de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:48.225494 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0b8e0aa1-1c63-4032-8133-b22aa48a310f tempest-VolumesListAdminTestJSON-935149300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a52c7deb-9d9f-4606-942a-41ee18ea74de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=10260c46-b09e-4e1d-b0df-9da85586cede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e8211ae0294466dad4012b125fc416f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:29:48Z,use_quota=True,user_id='a69b7272fff74daf96829bc4645b6639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:48.231411 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0b8e0aa1-1c63-4032-8133-b22aa48a310f tempest-VolumesListAdminTestJSON-935149300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e78337e3-4b19-4d85-9b5d-e60f3a5c0952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:48.236345 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0b8e0aa1-1c63-4032-8133-b22aa48a310f tempest-VolumesListAdminTestJSON-935149300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e78337e3-4b19-4d85-9b5d-e60f3a5c0952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:48.241955 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0b8e0aa1-1c63-4032-8133-b22aa48a310f tempest-VolumesListAdminTestJSON-935149300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ca90090-185d-4008-aeca-ec745a77c28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:48.246409 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0b8e0aa1-1c63-4032-8133-b22aa48a310f tempest-VolumesListAdminTestJSON-935149300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ca90090-185d-4008-aeca-ec745a77c28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10260c46-b09e-4e1d-b0df-9da85586cede', 'volume_name': 'volume-10260c46-b09e-4e1d-b0df-9da85586cede', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:48.251594 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0b8e0aa1-1c63-4032-8133-b22aa48a310f tempest-VolumesListAdminTestJSON-935149300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a9eaa6f-4fce-4349-aa63-60f570713260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:48.256392 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0b8e0aa1-1c63-4032-8133-b22aa48a310f tempest-VolumesListAdminTestJSON-935149300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a9eaa6f-4fce-4349-aa63-60f570713260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:48.266233 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0b8e0aa1-1c63-4032-8133-b22aa48a310f tempest-VolumesListAdminTestJSON-935149300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7528af98-1bef-42f9-a2e8-e97f411d488e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:48.272250 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-0b8e0aa1-1c63-4032-8133-b22aa48a310f tempest-VolumesListAdminTestJSON-935149300 None] Volume 10260c46-b09e-4e1d-b0df-9da85586cede: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10260c46-b09e-4e1d-b0df-9da85586cede', 'volume_size': 1} Apr 30 21:29:48.272670 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-0b8e0aa1-1c63-4032-8133-b22aa48a310f tempest-VolumesListAdminTestJSON-935149300 None] creating volume 'volume-10260c46-b09e-4e1d-b0df-9da85586cede' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:29:48.273508 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-0b8e0aa1-1c63-4032-8133-b22aa48a310f tempest-VolumesListAdminTestJSON-935149300 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:49.008657 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-0b8e0aa1-1c63-4032-8133-b22aa48a310f tempest-VolumesListAdminTestJSON-935149300 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:29:49.009291 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-0b8e0aa1-1c63-4032-8133-b22aa48a310f tempest-VolumesListAdminTestJSON-935149300 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:29:49.014849 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0b8e0aa1-1c63-4032-8133-b22aa48a310f tempest-VolumesListAdminTestJSON-935149300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7528af98-1bef-42f9-a2e8-e97f411d488e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10260c46-b09e-4e1d-b0df-9da85586cede', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:49.024380 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0b8e0aa1-1c63-4032-8133-b22aa48a310f tempest-VolumesListAdminTestJSON-935149300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d04c532f-1941-47dd-aedd-d6a844b07dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:29:49.155961 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-0b8e0aa1-1c63-4032-8133-b22aa48a310f tempest-VolumesListAdminTestJSON-935149300 None] Volume volume-10260c46-b09e-4e1d-b0df-9da85586cede (10260c46-b09e-4e1d-b0df-9da85586cede): created successfully Apr 30 21:29:49.161506 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0b8e0aa1-1c63-4032-8133-b22aa48a310f tempest-VolumesListAdminTestJSON-935149300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d04c532f-1941-47dd-aedd-d6a844b07dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:29:49.173114 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0b8e0aa1-1c63-4032-8133-b22aa48a310f tempest-VolumesListAdminTestJSON-935149300 None] Flow 'volume_create_manager' (598801f7-7161-4263-8668-31ba295ee1ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:29:49.299280 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-0b8e0aa1-1c63-4032-8133-b22aa48a310f tempest-VolumesListAdminTestJSON-935149300 None] Created volume successfully. Apr 30 21:29:50.337186 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-6560462b-0a9a-4e06-bdab-e8cac32de840 tempest-VolumesListAdminTestJSON-935149300 None] Lock "b'cinder-10260c46-b09e-4e1d-b0df-9da85586cede-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:29:50.475174 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-6560462b-0a9a-4e06-bdab-e8cac32de840 tempest-VolumesListAdminTestJSON-935149300 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:50.675542 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-6560462b-0a9a-4e06-bdab-e8cac32de840 tempest-VolumesListAdminTestJSON-935149300 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:29:50.676223 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-6560462b-0a9a-4e06-bdab-e8cac32de840 tempest-VolumesListAdminTestJSON-935149300 None] Volume volume-10260c46-b09e-4e1d-b0df-9da85586cede is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:29:50.808179 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-6560462b-0a9a-4e06-bdab-e8cac32de840 tempest-VolumesListAdminTestJSON-935149300 None] deleting rbd volume volume-10260c46-b09e-4e1d-b0df-9da85586cede {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:29:50.860678 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-e7140d5d-f3f8-442a-b9e1-af436e05d20a tempest-VolumesListAdminTestJSON-1293302386 None] Lock "b'cinder-a9d3ede6-63e4-4026-a830-d633a6cb27ed-delete_volume'" acquired by "delete_volume" :: waited 0.035s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:29:51.125014 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e7140d5d-f3f8-442a-b9e1-af436e05d20a tempest-VolumesListAdminTestJSON-1293302386 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:51.503945 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e7140d5d-f3f8-442a-b9e1-af436e05d20a tempest-VolumesListAdminTestJSON-1293302386 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:29:51.504552 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e7140d5d-f3f8-442a-b9e1-af436e05d20a tempest-VolumesListAdminTestJSON-1293302386 None] Volume volume-a9d3ede6-63e4-4026-a830-d633a6cb27ed is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:29:51.714373 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e7140d5d-f3f8-442a-b9e1-af436e05d20a tempest-VolumesListAdminTestJSON-1293302386 None] deleting rbd volume volume-a9d3ede6-63e4-4026-a830-d633a6cb27ed {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:29:51.743446 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-01485c5f-375c-4e9a-a67d-c087e5c16cdc tempest-AttachVolumeNegativeTest-612541851 None] Lock "b'cinder-b08ce48b-427b-4e2c-8fb6-29fce76e8e58-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:29:51.884471 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-01485c5f-375c-4e9a-a67d-c087e5c16cdc tempest-AttachVolumeNegativeTest-612541851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:52.081318 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-01485c5f-375c-4e9a-a67d-c087e5c16cdc tempest-AttachVolumeNegativeTest-612541851 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:29:52.082069 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-01485c5f-375c-4e9a-a67d-c087e5c16cdc tempest-AttachVolumeNegativeTest-612541851 None] Volume volume-b08ce48b-427b-4e2c-8fb6-29fce76e8e58 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:29:52.368374 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-01485c5f-375c-4e9a-a67d-c087e5c16cdc tempest-AttachVolumeNegativeTest-612541851 None] deleting rbd volume volume-b08ce48b-427b-4e2c-8fb6-29fce76e8e58 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:29:58.356292 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-6560462b-0a9a-4e06-bdab-e8cac32de840 tempest-VolumesListAdminTestJSON-935149300 None] Created reservations ['185003f8-4996-4611-b0bb-989030f268f5', '150e3ab5-3458-4cf3-b988-87ce0efc2d79', '1b591c3a-e2f5-484f-a059-a86a2bdae413', '35bb31ff-e791-4c03-99c7-c3c800eb5d29'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:29:58.701010 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-6560462b-0a9a-4e06-bdab-e8cac32de840 tempest-VolumesListAdminTestJSON-935149300 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:58.777608 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-6560462b-0a9a-4e06-bdab-e8cac32de840 tempest-VolumesListAdminTestJSON-935149300 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:58.859084 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-6560462b-0a9a-4e06-bdab-e8cac32de840 tempest-VolumesListAdminTestJSON-935149300 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:29:58.873449 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-6560462b-0a9a-4e06-bdab-e8cac32de840 tempest-VolumesListAdminTestJSON-935149300 None] Deleted volume successfully. Apr 30 21:29:58.954555 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-6560462b-0a9a-4e06-bdab-e8cac32de840 tempest-VolumesListAdminTestJSON-935149300 None] Lock "b'cinder-10260c46-b09e-4e1d-b0df-9da85586cede-delete_volume'" released by "delete_volume" :: held 8.614s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:29:59.505717 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-e7140d5d-f3f8-442a-b9e1-af436e05d20a tempest-VolumesListAdminTestJSON-1293302386 None] Created reservations ['5d97bd63-ac1e-46f4-92ca-832f1dbe1186', '5f78bf8c-9bd6-4b5e-be92-414b95a19c05', '73fe2ad9-7b07-423c-a9c7-deb883cd274a', 'd3004e21-0af1-41b4-94be-1924b2f51da5'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:29:59.765020 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e7140d5d-f3f8-442a-b9e1-af436e05d20a tempest-VolumesListAdminTestJSON-1293302386 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:59.817574 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e7140d5d-f3f8-442a-b9e1-af436e05d20a tempest-VolumesListAdminTestJSON-1293302386 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:29:59.871567 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-e7140d5d-f3f8-442a-b9e1-af436e05d20a tempest-VolumesListAdminTestJSON-1293302386 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:29:59.877601 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-e7140d5d-f3f8-442a-b9e1-af436e05d20a tempest-VolumesListAdminTestJSON-1293302386 None] Deleted volume successfully. Apr 30 21:29:59.963177 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-e7140d5d-f3f8-442a-b9e1-af436e05d20a tempest-VolumesListAdminTestJSON-1293302386 None] Lock "b'cinder-a9d3ede6-63e4-4026-a830-d633a6cb27ed-delete_volume'" released by "delete_volume" :: held 9.102s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:30:00.015428 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-01485c5f-375c-4e9a-a67d-c087e5c16cdc tempest-AttachVolumeNegativeTest-612541851 None] Created reservations ['0f82a041-dcb3-49a9-8470-4aa6898997af', 'bc16cbbf-4218-41fb-b6bd-80f69dbc1d62', '20657742-1efc-4b8d-a9e9-4bbbb893fd48', 'a18502db-e7fe-4716-9e3e-f0d5b6cfa7e0'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:30:00.240745 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-01485c5f-375c-4e9a-a67d-c087e5c16cdc tempest-AttachVolumeNegativeTest-612541851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:30:00.318174 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-01485c5f-375c-4e9a-a67d-c087e5c16cdc tempest-AttachVolumeNegativeTest-612541851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:30:00.397465 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-01485c5f-375c-4e9a-a67d-c087e5c16cdc tempest-AttachVolumeNegativeTest-612541851 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:30:00.401864 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-01485c5f-375c-4e9a-a67d-c087e5c16cdc tempest-AttachVolumeNegativeTest-612541851 None] Deleted volume successfully. Apr 30 21:30:00.548811 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-01485c5f-375c-4e9a-a67d-c087e5c16cdc tempest-AttachVolumeNegativeTest-612541851 None] Lock "b'cinder-b08ce48b-427b-4e2c-8fb6-29fce76e8e58-delete_volume'" released by "delete_volume" :: held 8.804s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:30:00.602519 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-27667273-d5c4-48f4-b56c-846ae1461496 tempest-VolumesListAdminTestJSON-1293302386 None] Lock "b'cinder-c8345122-ad95-4d6f-82e6-90fa09abf578-delete_volume'" acquired by "delete_volume" :: waited 0.062s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:30:00.771864 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-27667273-d5c4-48f4-b56c-846ae1461496 tempest-VolumesListAdminTestJSON-1293302386 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:30:01.098111 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-27667273-d5c4-48f4-b56c-846ae1461496 tempest-VolumesListAdminTestJSON-1293302386 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:30:01.099675 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-27667273-d5c4-48f4-b56c-846ae1461496 tempest-VolumesListAdminTestJSON-1293302386 None] Volume volume-c8345122-ad95-4d6f-82e6-90fa09abf578 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:30:01.244970 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-27667273-d5c4-48f4-b56c-846ae1461496 tempest-VolumesListAdminTestJSON-1293302386 None] deleting rbd volume volume-c8345122-ad95-4d6f-82e6-90fa09abf578 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:30:01.291634 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-6950dc7d-e532-44d7-8013-d2374c8ba3f1 tempest-AttachVolumeNegativeTest-612541851 None] Lock "b'cinder-5f41c7c8-f686-4ee6-9456-ce2b755ded8d-delete_volume'" acquired by "delete_volume" :: waited 0.036s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:30:01.513953 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-6950dc7d-e532-44d7-8013-d2374c8ba3f1 tempest-AttachVolumeNegativeTest-612541851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:30:01.743417 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-6950dc7d-e532-44d7-8013-d2374c8ba3f1 tempest-AttachVolumeNegativeTest-612541851 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:30:01.744073 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-6950dc7d-e532-44d7-8013-d2374c8ba3f1 tempest-AttachVolumeNegativeTest-612541851 None] Volume volume-5f41c7c8-f686-4ee6-9456-ce2b755ded8d is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:30:01.950612 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-6950dc7d-e532-44d7-8013-d2374c8ba3f1 tempest-AttachVolumeNegativeTest-612541851 None] deleting rbd volume volume-5f41c7c8-f686-4ee6-9456-ce2b755ded8d {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:30:01.959039 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-9470ae3e-008d-4e5c-9a8b-f991732d9114 tempest-ServersNegativeTestJSON-461111943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:30:01.998313 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9470ae3e-008d-4e5c-9a8b-f991732d9114 tempest-ServersNegativeTestJSON-461111943 None] Flow 'volume_create_manager' (7f42cdc9-d496-4514-bafc-2414f51fb301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:30:02.007948 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9470ae3e-008d-4e5c-9a8b-f991732d9114 tempest-ServersNegativeTestJSON-461111943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc0382c3-9d2b-4fbf-89ff-aa0be9f4d0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:30:02.044185 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9470ae3e-008d-4e5c-9a8b-f991732d9114 tempest-ServersNegativeTestJSON-461111943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc0382c3-9d2b-4fbf-89ff-aa0be9f4d0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1379236508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0fe89388-81fb-4f6e-b86b-d1159cdf1d17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3383c2433214484eb41e99aacb653b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:30:01Z,use_quota=True,user_id='baf1d13615bc491ab98d2a644e681c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:30:02.071586 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9470ae3e-008d-4e5c-9a8b-f991732d9114 tempest-ServersNegativeTestJSON-461111943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (270feae1-94cc-40e0-b33a-bf434767d115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:30:02.082150 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9470ae3e-008d-4e5c-9a8b-f991732d9114 tempest-ServersNegativeTestJSON-461111943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (270feae1-94cc-40e0-b33a-bf434767d115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:30:02.087618 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9470ae3e-008d-4e5c-9a8b-f991732d9114 tempest-ServersNegativeTestJSON-461111943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (434c575a-19c3-45b5-ac2c-2bf4bd2bd036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:30:02.095962 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9470ae3e-008d-4e5c-9a8b-f991732d9114 tempest-ServersNegativeTestJSON-461111943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (434c575a-19c3-45b5-ac2c-2bf4bd2bd036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fe89388-81fb-4f6e-b86b-d1159cdf1d17', 'volume_name': 'volume-0fe89388-81fb-4f6e-b86b-d1159cdf1d17', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:30:02.111127 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9470ae3e-008d-4e5c-9a8b-f991732d9114 tempest-ServersNegativeTestJSON-461111943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1118e93-4431-47a5-8dbe-443b61f5763a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:30:02.115834 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9470ae3e-008d-4e5c-9a8b-f991732d9114 tempest-ServersNegativeTestJSON-461111943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1118e93-4431-47a5-8dbe-443b61f5763a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:30:02.135547 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9470ae3e-008d-4e5c-9a8b-f991732d9114 tempest-ServersNegativeTestJSON-461111943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d5b58d-c8f9-474e-8114-bf32b595eac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:30:02.137125 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-9470ae3e-008d-4e5c-9a8b-f991732d9114 tempest-ServersNegativeTestJSON-461111943 None] Volume 0fe89388-81fb-4f6e-b86b-d1159cdf1d17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fe89388-81fb-4f6e-b86b-d1159cdf1d17', 'volume_size': 1} Apr 30 21:30:02.139662 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9470ae3e-008d-4e5c-9a8b-f991732d9114 tempest-ServersNegativeTestJSON-461111943 None] creating volume 'volume-0fe89388-81fb-4f6e-b86b-d1159cdf1d17' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:30:02.140476 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9470ae3e-008d-4e5c-9a8b-f991732d9114 tempest-ServersNegativeTestJSON-461111943 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:30:03.618954 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9470ae3e-008d-4e5c-9a8b-f991732d9114 tempest-ServersNegativeTestJSON-461111943 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:30:03.619662 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9470ae3e-008d-4e5c-9a8b-f991732d9114 tempest-ServersNegativeTestJSON-461111943 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:30:03.623169 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9470ae3e-008d-4e5c-9a8b-f991732d9114 tempest-ServersNegativeTestJSON-461111943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d5b58d-c8f9-474e-8114-bf32b595eac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fe89388-81fb-4f6e-b86b-d1159cdf1d17', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:30:03.627739 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9470ae3e-008d-4e5c-9a8b-f991732d9114 tempest-ServersNegativeTestJSON-461111943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccfc4d29-6c2a-4d9d-86a7-bccdb69a1cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:30:03.732164 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-9470ae3e-008d-4e5c-9a8b-f991732d9114 tempest-ServersNegativeTestJSON-461111943 None] Volume volume-0fe89388-81fb-4f6e-b86b-d1159cdf1d17 (0fe89388-81fb-4f6e-b86b-d1159cdf1d17): created successfully Apr 30 21:30:03.735864 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9470ae3e-008d-4e5c-9a8b-f991732d9114 tempest-ServersNegativeTestJSON-461111943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccfc4d29-6c2a-4d9d-86a7-bccdb69a1cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:30:03.741838 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9470ae3e-008d-4e5c-9a8b-f991732d9114 tempest-ServersNegativeTestJSON-461111943 None] Flow 'volume_create_manager' (7f42cdc9-d496-4514-bafc-2414f51fb301) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:30:03.932347 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-9470ae3e-008d-4e5c-9a8b-f991732d9114 tempest-ServersNegativeTestJSON-461111943 None] Created volume successfully. Apr 30 21:30:04.380276 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bc36d52-63c4-4899-8f69-ddac9aef2a81 tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:30:04.407897 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-6bc36d52-63c4-4899-8f69-ddac9aef2a81 tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] Flow 'volume_create_manager' (3501bf11-6c7b-47f5-8b5a-e49d165a3889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:30:04.418037 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-6bc36d52-63c4-4899-8f69-ddac9aef2a81 tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (244e0dab-793f-4f8a-af14-bcc6461e4d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:30:04.442155 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-6bc36d52-63c4-4899-8f69-ddac9aef2a81 tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (244e0dab-793f-4f8a-af14-bcc6461e4d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2060796872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=576a70ac-3477-4b8d-938d-1681aec70e0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9ed3ab456a94753a4fe68a0c8e85e65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:30:04Z,use_quota=True,user_id='a81f55b9657543adb46748a08ef1e6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:30:04.449909 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-6bc36d52-63c4-4899-8f69-ddac9aef2a81 tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe87190b-428a-4f6e-9e08-ad50f64b7256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:30:04.454724 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-6bc36d52-63c4-4899-8f69-ddac9aef2a81 tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe87190b-428a-4f6e-9e08-ad50f64b7256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:30:04.461356 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-6bc36d52-63c4-4899-8f69-ddac9aef2a81 tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e16d9d45-cad4-464a-8c2a-0691258146fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:30:04.466211 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-6bc36d52-63c4-4899-8f69-ddac9aef2a81 tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e16d9d45-cad4-464a-8c2a-0691258146fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '576a70ac-3477-4b8d-938d-1681aec70e0c', 'volume_name': 'volume-576a70ac-3477-4b8d-938d-1681aec70e0c', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:30:04.473221 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-6bc36d52-63c4-4899-8f69-ddac9aef2a81 tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6820e716-dab7-4568-b4f1-a1a35702efab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:30:04.477865 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-6bc36d52-63c4-4899-8f69-ddac9aef2a81 tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6820e716-dab7-4568-b4f1-a1a35702efab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:30:04.483049 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-6bc36d52-63c4-4899-8f69-ddac9aef2a81 tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62d36891-8e2f-49d3-ad19-22b12df460ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:30:04.486052 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-6bc36d52-63c4-4899-8f69-ddac9aef2a81 tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] Volume 576a70ac-3477-4b8d-938d-1681aec70e0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-576a70ac-3477-4b8d-938d-1681aec70e0c', 'volume_size': 1} Apr 30 21:30:04.486052 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-6bc36d52-63c4-4899-8f69-ddac9aef2a81 tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] creating volume 'volume-576a70ac-3477-4b8d-938d-1681aec70e0c' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:30:04.486052 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-6bc36d52-63c4-4899-8f69-ddac9aef2a81 tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:30:05.446643 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-6bc36d52-63c4-4899-8f69-ddac9aef2a81 tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:30:05.447743 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-6bc36d52-63c4-4899-8f69-ddac9aef2a81 tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:30:05.453473 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-6bc36d52-63c4-4899-8f69-ddac9aef2a81 tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62d36891-8e2f-49d3-ad19-22b12df460ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-576a70ac-3477-4b8d-938d-1681aec70e0c', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:30:05.459404 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-6bc36d52-63c4-4899-8f69-ddac9aef2a81 tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7e82268-88a1-494c-9135-24f688ae86b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:30:05.538511 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-6bc36d52-63c4-4899-8f69-ddac9aef2a81 tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] Volume volume-576a70ac-3477-4b8d-938d-1681aec70e0c (576a70ac-3477-4b8d-938d-1681aec70e0c): created successfully Apr 30 21:30:05.542476 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-6bc36d52-63c4-4899-8f69-ddac9aef2a81 tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7e82268-88a1-494c-9135-24f688ae86b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:30:05.551578 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-6bc36d52-63c4-4899-8f69-ddac9aef2a81 tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] Flow 'volume_create_manager' (3501bf11-6c7b-47f5-8b5a-e49d165a3889) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:30:05.632914 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-6bc36d52-63c4-4899-8f69-ddac9aef2a81 tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] Created volume successfully. Apr 30 21:30:06.074341 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-f27d0e41-0226-4e69-b77e-a1e81a002c21 tempest-ServersNegativeTestJSON-461111943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:30:06.141663 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f27d0e41-0226-4e69-b77e-a1e81a002c21 tempest-ServersNegativeTestJSON-461111943 None] Flow 'volume_create_manager' (94595b53-d223-41b5-8af6-aa5080bf7368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:30:06.161380 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f27d0e41-0226-4e69-b77e-a1e81a002c21 tempest-ServersNegativeTestJSON-461111943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e8405c0-6940-43ef-893b-116522d7979e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:30:06.225564 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f27d0e41-0226-4e69-b77e-a1e81a002c21 tempest-ServersNegativeTestJSON-461111943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e8405c0-6940-43ef-893b-116522d7979e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-160678434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=af5d97e7-2077-48c5-a106-53d364f2886a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3383c2433214484eb41e99aacb653b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:30:06Z,use_quota=True,user_id='baf1d13615bc491ab98d2a644e681c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:30:06.243349 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f27d0e41-0226-4e69-b77e-a1e81a002c21 tempest-ServersNegativeTestJSON-461111943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc9fc2bb-d18c-4d0e-aa3a-fa74f7345013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:30:06.254779 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f27d0e41-0226-4e69-b77e-a1e81a002c21 tempest-ServersNegativeTestJSON-461111943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc9fc2bb-d18c-4d0e-aa3a-fa74f7345013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:30:06.271050 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f27d0e41-0226-4e69-b77e-a1e81a002c21 tempest-ServersNegativeTestJSON-461111943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3991039-816a-474a-9972-003eaff08299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:30:06.292330 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f27d0e41-0226-4e69-b77e-a1e81a002c21 tempest-ServersNegativeTestJSON-461111943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3991039-816a-474a-9972-003eaff08299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af5d97e7-2077-48c5-a106-53d364f2886a', 'volume_name': 'volume-af5d97e7-2077-48c5-a106-53d364f2886a', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:30:06.331966 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f27d0e41-0226-4e69-b77e-a1e81a002c21 tempest-ServersNegativeTestJSON-461111943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eae6e04d-5e09-4c85-9279-2827edd600a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:30:06.338545 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f27d0e41-0226-4e69-b77e-a1e81a002c21 tempest-ServersNegativeTestJSON-461111943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eae6e04d-5e09-4c85-9279-2827edd600a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:30:06.349863 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f27d0e41-0226-4e69-b77e-a1e81a002c21 tempest-ServersNegativeTestJSON-461111943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7013529e-5c51-4edb-9657-93394d853733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:30:06.351339 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-f27d0e41-0226-4e69-b77e-a1e81a002c21 tempest-ServersNegativeTestJSON-461111943 None] Volume af5d97e7-2077-48c5-a106-53d364f2886a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af5d97e7-2077-48c5-a106-53d364f2886a', 'volume_size': 1} Apr 30 21:30:06.351943 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f27d0e41-0226-4e69-b77e-a1e81a002c21 tempest-ServersNegativeTestJSON-461111943 None] creating volume 'volume-af5d97e7-2077-48c5-a106-53d364f2886a' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:30:06.352872 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f27d0e41-0226-4e69-b77e-a1e81a002c21 tempest-ServersNegativeTestJSON-461111943 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:30:07.334866 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8d875892-1e9f-45a0-82a1-dfc47081934a tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:30:07.743208 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f27d0e41-0226-4e69-b77e-a1e81a002c21 tempest-ServersNegativeTestJSON-461111943 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:30:07.743963 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f27d0e41-0226-4e69-b77e-a1e81a002c21 tempest-ServersNegativeTestJSON-461111943 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:30:07.749515 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f27d0e41-0226-4e69-b77e-a1e81a002c21 tempest-ServersNegativeTestJSON-461111943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7013529e-5c51-4edb-9657-93394d853733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af5d97e7-2077-48c5-a106-53d364f2886a', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:30:07.767145 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f27d0e41-0226-4e69-b77e-a1e81a002c21 tempest-ServersNegativeTestJSON-461111943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9b82863-b118-48fd-a322-b136c7cf819e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:30:07.895428 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-f27d0e41-0226-4e69-b77e-a1e81a002c21 tempest-ServersNegativeTestJSON-461111943 None] Volume volume-af5d97e7-2077-48c5-a106-53d364f2886a (af5d97e7-2077-48c5-a106-53d364f2886a): created successfully Apr 30 21:30:07.904298 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f27d0e41-0226-4e69-b77e-a1e81a002c21 tempest-ServersNegativeTestJSON-461111943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9b82863-b118-48fd-a322-b136c7cf819e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:30:07.911372 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f27d0e41-0226-4e69-b77e-a1e81a002c21 tempest-ServersNegativeTestJSON-461111943 None] Flow 'volume_create_manager' (94595b53-d223-41b5-8af6-aa5080bf7368) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:30:08.337595 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-f27d0e41-0226-4e69-b77e-a1e81a002c21 tempest-ServersNegativeTestJSON-461111943 None] Created volume successfully. Apr 30 21:30:09.453572 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-27667273-d5c4-48f4-b56c-846ae1461496 tempest-VolumesListAdminTestJSON-1293302386 None] Created reservations ['016b67cd-e9af-49b4-8fd4-fa7b3dd6e687', '5ae1b162-771a-4889-afee-aabc3fa0e00b', 'f79db89f-7e2c-4ff7-b8b8-8fb201619787', '7b15a5ec-8a41-4d4f-842e-d836dd70fbe6'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:30:10.027452 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-27667273-d5c4-48f4-b56c-846ae1461496 tempest-VolumesListAdminTestJSON-1293302386 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:30:10.297058 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-27667273-d5c4-48f4-b56c-846ae1461496 tempest-VolumesListAdminTestJSON-1293302386 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:30:10.357487 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-27667273-d5c4-48f4-b56c-846ae1461496 tempest-VolumesListAdminTestJSON-1293302386 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:30:10.372334 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-27667273-d5c4-48f4-b56c-846ae1461496 tempest-VolumesListAdminTestJSON-1293302386 None] Deleted volume successfully. Apr 30 21:30:10.541343 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-27667273-d5c4-48f4-b56c-846ae1461496 tempest-VolumesListAdminTestJSON-1293302386 None] Lock "b'cinder-c8345122-ad95-4d6f-82e6-90fa09abf578-delete_volume'" released by "delete_volume" :: held 9.939s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:30:10.591261 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-6950dc7d-e532-44d7-8013-d2374c8ba3f1 tempest-AttachVolumeNegativeTest-612541851 None] Created reservations ['40da4bc5-dd3d-4b98-aefb-d78f8ca1dc58', '1ae82ac8-0249-4723-8c55-8c1070b4d36a', '8d3936c5-45ce-4016-90fd-4ec739236477', '9c8a5948-1e7c-495c-afe6-14d2e3983560'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:30:10.778812 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-4f238206-448c-4aba-b6cd-723d5cf9faee tempest-VolumesListAdminTestJSON-1293302386 None] Lock "b'cinder-836d8edf-24bd-4958-8d3e-b153af99ed49-delete_volume'" acquired by "delete_volume" :: waited 0.059s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:30:10.983639 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-6950dc7d-e532-44d7-8013-d2374c8ba3f1 tempest-AttachVolumeNegativeTest-612541851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:30:11.092446 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-6950dc7d-e532-44d7-8013-d2374c8ba3f1 tempest-AttachVolumeNegativeTest-612541851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:30:11.161072 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-6950dc7d-e532-44d7-8013-d2374c8ba3f1 tempest-AttachVolumeNegativeTest-612541851 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:30:11.179853 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-6950dc7d-e532-44d7-8013-d2374c8ba3f1 tempest-AttachVolumeNegativeTest-612541851 None] Deleted volume successfully. Apr 30 21:30:11.190210 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-4f238206-448c-4aba-b6cd-723d5cf9faee tempest-VolumesListAdminTestJSON-1293302386 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:30:11.417898 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-4f238206-448c-4aba-b6cd-723d5cf9faee tempest-VolumesListAdminTestJSON-1293302386 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:30:11.418576 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-4f238206-448c-4aba-b6cd-723d5cf9faee tempest-VolumesListAdminTestJSON-1293302386 None] Volume volume-836d8edf-24bd-4958-8d3e-b153af99ed49 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:30:11.544350 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-4f238206-448c-4aba-b6cd-723d5cf9faee tempest-VolumesListAdminTestJSON-1293302386 None] deleting rbd volume volume-836d8edf-24bd-4958-8d3e-b153af99ed49 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:30:11.569744 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-6950dc7d-e532-44d7-8013-d2374c8ba3f1 tempest-AttachVolumeNegativeTest-612541851 None] Lock "b'cinder-5f41c7c8-f686-4ee6-9456-ce2b755ded8d-delete_volume'" released by "delete_volume" :: held 10.278s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:30:12.340833 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-62772ff3-7cf1-43ea-8f56-9fdfc1388f19 tempest-AttachVolumeNegativeTest-612541851 None] Lock "b'cinder-28cf7446-872a-4b61-8092-677879a5220a-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:30:12.507377 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-8d875892-1e9f-45a0-82a1-dfc47081934a tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] Create snapshot completed successfully Apr 30 21:30:12.576142 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-62772ff3-7cf1-43ea-8f56-9fdfc1388f19 tempest-AttachVolumeNegativeTest-612541851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:30:13.069084 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-62772ff3-7cf1-43ea-8f56-9fdfc1388f19 tempest-AttachVolumeNegativeTest-612541851 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:30:13.071333 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-62772ff3-7cf1-43ea-8f56-9fdfc1388f19 tempest-AttachVolumeNegativeTest-612541851 None] Volume volume-28cf7446-872a-4b61-8092-677879a5220a is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:30:13.390925 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-62772ff3-7cf1-43ea-8f56-9fdfc1388f19 tempest-AttachVolumeNegativeTest-612541851 None] deleting rbd volume volume-28cf7446-872a-4b61-8092-677879a5220a {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:30:14.808753 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-477f5c2b-783e-44ab-a869-986294eabba2 tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] Lock "b'cinder-eb9dc0f1-7fc3-4493-ad95-af94199ad909-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.022s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:30:14.815515 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-477f5c2b-783e-44ab-a869-986294eabba2 tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:30:19.180652 ncdv-master-1 cinder-volume[123855]: WARNING cinder.quota [None req-477f5c2b-783e-44ab-a869-986294eabba2 tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] Deprecated: Default quota for resource: snapshots_ceph is set by the default quota flag: quota_snapshots_ceph, it is now deprecated. Please use the default quota class for default quota. Apr 30 21:30:19.331357 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-477f5c2b-783e-44ab-a869-986294eabba2 tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] Created reservations ['2bd95484-23c1-4f72-b0bd-cfb52e7943f8', '4edebca3-0d8c-4188-ba71-06475750485e', '8ca27dfb-8950-4156-a42e-931392685d9e', '5e63378a-843e-4335-a245-767e08cb7f9f'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:30:19.518269 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-4f238206-448c-4aba-b6cd-723d5cf9faee tempest-VolumesListAdminTestJSON-1293302386 None] Created reservations ['4ff68de6-f0fc-421a-93d7-6344f430c4de', 'c176bf98-1885-490f-bbf1-cf14c04f8e3b', 'b51b5ef5-a5b4-4dfe-aef5-2fd5a426a350', '47b26f2b-250e-4714-bff6-63a94b23828d'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:30:19.696503 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-477f5c2b-783e-44ab-a869-986294eabba2 tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] Delete snapshot completed successfully. Apr 30 21:30:19.705555 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-477f5c2b-783e-44ab-a869-986294eabba2 tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] Lock "b'cinder-eb9dc0f1-7fc3-4493-ad95-af94199ad909-delete_snapshot'" released by "delete_snapshot" :: held 4.897s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:30:19.822060 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-4f238206-448c-4aba-b6cd-723d5cf9faee tempest-VolumesListAdminTestJSON-1293302386 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:30:19.912587 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-4f238206-448c-4aba-b6cd-723d5cf9faee tempest-VolumesListAdminTestJSON-1293302386 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:30:19.978342 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-4f238206-448c-4aba-b6cd-723d5cf9faee tempest-VolumesListAdminTestJSON-1293302386 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:30:19.989145 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-4f238206-448c-4aba-b6cd-723d5cf9faee tempest-VolumesListAdminTestJSON-1293302386 None] Deleted volume successfully. Apr 30 21:30:20.105114 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-4f238206-448c-4aba-b6cd-723d5cf9faee tempest-VolumesListAdminTestJSON-1293302386 None] Lock "b'cinder-836d8edf-24bd-4958-8d3e-b153af99ed49-delete_volume'" released by "delete_volume" :: held 9.324s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:30:20.384609 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-337df2ea-9353-471d-9212-638962850dc1 tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] Lock "b'cinder-576a70ac-3477-4b8d-938d-1681aec70e0c-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:30:20.569295 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-337df2ea-9353-471d-9212-638962850dc1 tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:30:20.787062 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-337df2ea-9353-471d-9212-638962850dc1 tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:30:20.788022 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-337df2ea-9353-471d-9212-638962850dc1 tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] Volume volume-576a70ac-3477-4b8d-938d-1681aec70e0c is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:30:20.878385 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-337df2ea-9353-471d-9212-638962850dc1 tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] deleting rbd volume volume-576a70ac-3477-4b8d-938d-1681aec70e0c {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:30:20.882262 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-62772ff3-7cf1-43ea-8f56-9fdfc1388f19 tempest-AttachVolumeNegativeTest-612541851 None] Created reservations ['2d7684de-6a2e-4076-9de1-928b8ecd4864', '448a8f6a-6002-4bb1-ab9d-a861cd474a26', '1f18dc9f-4966-41dc-b8f2-b6c458c944d9', 'f7ac7a77-f70b-4f09-9f79-0c2393732339'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:30:21.258731 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-62772ff3-7cf1-43ea-8f56-9fdfc1388f19 tempest-AttachVolumeNegativeTest-612541851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:30:21.378922 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-62772ff3-7cf1-43ea-8f56-9fdfc1388f19 tempest-AttachVolumeNegativeTest-612541851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:30:21.496052 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-62772ff3-7cf1-43ea-8f56-9fdfc1388f19 tempest-AttachVolumeNegativeTest-612541851 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:30:21.518514 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-62772ff3-7cf1-43ea-8f56-9fdfc1388f19 tempest-AttachVolumeNegativeTest-612541851 None] Deleted volume successfully. Apr 30 21:30:21.706662 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-62772ff3-7cf1-43ea-8f56-9fdfc1388f19 tempest-AttachVolumeNegativeTest-612541851 None] Lock "b'cinder-28cf7446-872a-4b61-8092-677879a5220a-delete_volume'" released by "delete_volume" :: held 9.367s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:30:25.126662 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-337df2ea-9353-471d-9212-638962850dc1 tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] Created reservations ['5fa40754-2d65-402a-9999-f4fe79ff73dd', 'fd275e60-c87e-4b3f-bbe1-97dc3b88f09f', '38e58f18-7f65-4cda-9345-f16cd4cdea2b', '02c3e98c-ce0b-47f6-909f-10e191248a50'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:30:25.424375 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-337df2ea-9353-471d-9212-638962850dc1 tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:30:25.487786 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-337df2ea-9353-471d-9212-638962850dc1 tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:30:25.584262 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-337df2ea-9353-471d-9212-638962850dc1 tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:30:25.588384 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-337df2ea-9353-471d-9212-638962850dc1 tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] Deleted volume successfully. Apr 30 21:30:25.749390 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-337df2ea-9353-471d-9212-638962850dc1 tempest-VolumeSnapshotQuotasNegativeTestJSON-50587830 None] Lock "b'cinder-576a70ac-3477-4b8d-938d-1681aec70e0c-delete_volume'" released by "delete_volume" :: held 5.365s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:30:28.953242 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:30:28.955243 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:30:29.023915 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:30:29.110304 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:30:33.812835 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e247f06-4caf-4e41-bab4-63066f9126dc tempest-VolumesMetadataTest-1629187277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:30:33.851317 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-6e247f06-4caf-4e41-bab4-63066f9126dc tempest-VolumesMetadataTest-1629187277 None] Flow 'volume_create_manager' (808a9783-6f85-4f4b-91a1-067699b769f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:30:33.890448 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-6e247f06-4caf-4e41-bab4-63066f9126dc tempest-VolumesMetadataTest-1629187277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f97413a7-de65-455b-8590-d973c1ad21bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:30:33.933076 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-6e247f06-4caf-4e41-bab4-63066f9126dc tempest-VolumesMetadataTest-1629187277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f97413a7-de65-455b-8590-d973c1ad21bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2116762569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0ab5b895-233d-4622-9af2-b7b027008d53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3aa141f37814c6cac51868379a14d43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:30:34Z,use_quota=True,user_id='9dd0b7edccf949e3864c3e2210b64a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:30:33.946100 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-6e247f06-4caf-4e41-bab4-63066f9126dc tempest-VolumesMetadataTest-1629187277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffbb8e80-f605-43ba-bff0-99250596accf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:30:33.961050 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-6e247f06-4caf-4e41-bab4-63066f9126dc tempest-VolumesMetadataTest-1629187277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffbb8e80-f605-43ba-bff0-99250596accf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:30:33.970687 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-6e247f06-4caf-4e41-bab4-63066f9126dc tempest-VolumesMetadataTest-1629187277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (372ff71e-557e-4a06-b1e3-7b20681583c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:30:33.981570 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-6e247f06-4caf-4e41-bab4-63066f9126dc tempest-VolumesMetadataTest-1629187277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (372ff71e-557e-4a06-b1e3-7b20681583c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ab5b895-233d-4622-9af2-b7b027008d53', 'volume_name': 'volume-0ab5b895-233d-4622-9af2-b7b027008d53', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:30:33.994398 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-6e247f06-4caf-4e41-bab4-63066f9126dc tempest-VolumesMetadataTest-1629187277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0386f42b-c256-424b-a147-bcd94a046c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:30:34.006500 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-6e247f06-4caf-4e41-bab4-63066f9126dc tempest-VolumesMetadataTest-1629187277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0386f42b-c256-424b-a147-bcd94a046c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:30:34.023832 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-6e247f06-4caf-4e41-bab4-63066f9126dc tempest-VolumesMetadataTest-1629187277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3454d7c-249c-473f-90f3-6fdf5a0ecd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:30:34.027611 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-6e247f06-4caf-4e41-bab4-63066f9126dc tempest-VolumesMetadataTest-1629187277 None] Volume 0ab5b895-233d-4622-9af2-b7b027008d53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ab5b895-233d-4622-9af2-b7b027008d53', 'volume_size': 1} Apr 30 21:30:34.027611 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-6e247f06-4caf-4e41-bab4-63066f9126dc tempest-VolumesMetadataTest-1629187277 None] creating volume 'volume-0ab5b895-233d-4622-9af2-b7b027008d53' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:30:34.027611 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-6e247f06-4caf-4e41-bab4-63066f9126dc tempest-VolumesMetadataTest-1629187277 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:30:34.852132 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-6e247f06-4caf-4e41-bab4-63066f9126dc tempest-VolumesMetadataTest-1629187277 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:30:34.854833 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-6e247f06-4caf-4e41-bab4-63066f9126dc tempest-VolumesMetadataTest-1629187277 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:30:34.866959 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-6e247f06-4caf-4e41-bab4-63066f9126dc tempest-VolumesMetadataTest-1629187277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3454d7c-249c-473f-90f3-6fdf5a0ecd64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ab5b895-233d-4622-9af2-b7b027008d53', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:30:34.873085 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-6e247f06-4caf-4e41-bab4-63066f9126dc tempest-VolumesMetadataTest-1629187277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9806088-c474-4a1b-9ed8-876d49b1745e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:30:34.897461 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d643236-3c2d-4aa3-a2c2-8374b70fa25e tempest-VolumesBackupsV39Test-430797569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:30:34.917553 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3d643236-3c2d-4aa3-a2c2-8374b70fa25e tempest-VolumesBackupsV39Test-430797569 None] Flow 'volume_create_manager' (a143f30a-dc16-4239-ba06-775255702245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:30:34.924450 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3d643236-3c2d-4aa3-a2c2-8374b70fa25e tempest-VolumesBackupsV39Test-430797569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d790a58e-4ec2-4d0b-848d-c6462e85d809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:30:34.939949 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3d643236-3c2d-4aa3-a2c2-8374b70fa25e tempest-VolumesBackupsV39Test-430797569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d790a58e-4ec2-4d0b-848d-c6462e85d809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Volume-142658247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3da6d027-86b7-4190-8ea8-d6457ddb2f80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d69ac7619c6f4a80866c33aabb8c3f05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:30:35Z,use_quota=True,user_id='4f01361dce6742beb239f0dc2525b05c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:30:34.949136 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3d643236-3c2d-4aa3-a2c2-8374b70fa25e tempest-VolumesBackupsV39Test-430797569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (235be335-4557-4621-8ae9-203374298c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:30:34.953906 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3d643236-3c2d-4aa3-a2c2-8374b70fa25e tempest-VolumesBackupsV39Test-430797569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (235be335-4557-4621-8ae9-203374298c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:30:34.960981 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3d643236-3c2d-4aa3-a2c2-8374b70fa25e tempest-VolumesBackupsV39Test-430797569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f15714-9db8-4938-b9eb-ac3e31c12df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:30:34.965860 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3d643236-3c2d-4aa3-a2c2-8374b70fa25e tempest-VolumesBackupsV39Test-430797569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f15714-9db8-4938-b9eb-ac3e31c12df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3da6d027-86b7-4190-8ea8-d6457ddb2f80', 'volume_name': 'volume-3da6d027-86b7-4190-8ea8-d6457ddb2f80', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:30:34.972000 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3d643236-3c2d-4aa3-a2c2-8374b70fa25e tempest-VolumesBackupsV39Test-430797569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f367d2a-bf79-4049-bf00-3ea46503f656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:30:34.991230 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3d643236-3c2d-4aa3-a2c2-8374b70fa25e tempest-VolumesBackupsV39Test-430797569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f367d2a-bf79-4049-bf00-3ea46503f656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:30:34.997643 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3d643236-3c2d-4aa3-a2c2-8374b70fa25e tempest-VolumesBackupsV39Test-430797569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4cb30c6-c0cd-43a4-939c-21fea54319f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:30:34.999110 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-3d643236-3c2d-4aa3-a2c2-8374b70fa25e tempest-VolumesBackupsV39Test-430797569 None] Volume 3da6d027-86b7-4190-8ea8-d6457ddb2f80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3da6d027-86b7-4190-8ea8-d6457ddb2f80', 'volume_size': 1} Apr 30 21:30:34.999732 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-3d643236-3c2d-4aa3-a2c2-8374b70fa25e tempest-VolumesBackupsV39Test-430797569 None] creating volume 'volume-3da6d027-86b7-4190-8ea8-d6457ddb2f80' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:30:35.000609 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-3d643236-3c2d-4aa3-a2c2-8374b70fa25e tempest-VolumesBackupsV39Test-430797569 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:30:35.058858 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-6e247f06-4caf-4e41-bab4-63066f9126dc tempest-VolumesMetadataTest-1629187277 None] Volume volume-0ab5b895-233d-4622-9af2-b7b027008d53 (0ab5b895-233d-4622-9af2-b7b027008d53): created successfully Apr 30 21:30:35.066518 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-6e247f06-4caf-4e41-bab4-63066f9126dc tempest-VolumesMetadataTest-1629187277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9806088-c474-4a1b-9ed8-876d49b1745e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:30:35.074747 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-6e247f06-4caf-4e41-bab4-63066f9126dc tempest-VolumesMetadataTest-1629187277 None] Flow 'volume_create_manager' (808a9783-6f85-4f4b-91a1-067699b769f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:30:35.243738 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-6e247f06-4caf-4e41-bab4-63066f9126dc tempest-VolumesMetadataTest-1629187277 None] Created volume successfully. Apr 30 21:30:35.736503 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-3d643236-3c2d-4aa3-a2c2-8374b70fa25e tempest-VolumesBackupsV39Test-430797569 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:30:35.737106 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-3d643236-3c2d-4aa3-a2c2-8374b70fa25e tempest-VolumesBackupsV39Test-430797569 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:30:35.744826 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3d643236-3c2d-4aa3-a2c2-8374b70fa25e tempest-VolumesBackupsV39Test-430797569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4cb30c6-c0cd-43a4-939c-21fea54319f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3da6d027-86b7-4190-8ea8-d6457ddb2f80', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:30:35.772697 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3d643236-3c2d-4aa3-a2c2-8374b70fa25e tempest-VolumesBackupsV39Test-430797569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ff27dc9-9b9f-483e-ab16-947f1f3230b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:30:35.912139 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-3d643236-3c2d-4aa3-a2c2-8374b70fa25e tempest-VolumesBackupsV39Test-430797569 None] Volume volume-3da6d027-86b7-4190-8ea8-d6457ddb2f80 (3da6d027-86b7-4190-8ea8-d6457ddb2f80): created successfully Apr 30 21:30:35.916008 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3d643236-3c2d-4aa3-a2c2-8374b70fa25e tempest-VolumesBackupsV39Test-430797569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ff27dc9-9b9f-483e-ab16-947f1f3230b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:30:35.922221 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3d643236-3c2d-4aa3-a2c2-8374b70fa25e tempest-VolumesBackupsV39Test-430797569 None] Flow 'volume_create_manager' (a143f30a-dc16-4239-ba06-775255702245) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:30:36.040225 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-3d643236-3c2d-4aa3-a2c2-8374b70fa25e tempest-VolumesBackupsV39Test-430797569 None] Created volume successfully. Apr 30 21:30:37.767476 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-72f51e8b-1786-4e38-81fb-505c0d5d9eb6 tempest-VolumesMetadataTest-1629187277 None] Lock "b'cinder-0ab5b895-233d-4622-9af2-b7b027008d53-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:30:37.837683 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-1ec59648-17ff-46e1-9497-14fb57fc2229 tempest-VolumesBackupsV39Test-430797569 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-04-30T21:30:37Z,data_timestamp=2022-04-30T21:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Backup-283491856',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=a514519c-dcef-43fe-883f-df15a868493f,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='d69ac7619c6f4a80866c33aabb8c3f05',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='4f01361dce6742beb239f0dc2525b05c',volume_id=3da6d027-86b7-4190-8ea8-d6457ddb2f80) Apr 30 21:30:37.846835 ncdv-master-1 cinder-volume[123855]: INFO cinder.rpc [None req-1ec59648-17ff-46e1-9497-14fb57fc2229 tempest-VolumesBackupsV39Test-430797569 None] Automatically selected cinder-backup objects version 1.39 as minimum service version. Apr 30 21:30:37.856912 ncdv-master-1 cinder-volume[123855]: INFO cinder.rpc [None req-1ec59648-17ff-46e1-9497-14fb57fc2229 tempest-VolumesBackupsV39Test-430797569 None] Automatically selected cinder-backup RPC version 2.3 as minimum service version. Apr 30 21:30:37.857794 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.backup.rpcapi [None req-1ec59648-17ff-46e1-9497-14fb57fc2229 tempest-VolumesBackupsV39Test-430797569 None] continue_backup in rpcapi backup_id a514519c-dcef-43fe-883f-df15a868493f {{(pid=123855) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Apr 30 21:30:38.028485 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-72f51e8b-1786-4e38-81fb-505c0d5d9eb6 tempest-VolumesMetadataTest-1629187277 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:30:38.399845 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-72f51e8b-1786-4e38-81fb-505c0d5d9eb6 tempest-VolumesMetadataTest-1629187277 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:30:38.400271 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-72f51e8b-1786-4e38-81fb-505c0d5d9eb6 tempest-VolumesMetadataTest-1629187277 None] Volume volume-0ab5b895-233d-4622-9af2-b7b027008d53 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:30:38.562558 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-72f51e8b-1786-4e38-81fb-505c0d5d9eb6 tempest-VolumesMetadataTest-1629187277 None] deleting rbd volume volume-0ab5b895-233d-4622-9af2-b7b027008d53 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:30:43.211369 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-72f51e8b-1786-4e38-81fb-505c0d5d9eb6 tempest-VolumesMetadataTest-1629187277 None] Created reservations ['b180b24f-5ce6-4bdd-84dc-afd037025400', '4714e7d4-4e2c-4615-8951-0e26c7668a2d', 'c0b5a7f8-9d30-4c1b-a3d0-1334324fe93a', 'ef4482fe-d05f-4e24-b83f-70c729101c2a'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:30:43.502305 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-72f51e8b-1786-4e38-81fb-505c0d5d9eb6 tempest-VolumesMetadataTest-1629187277 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:30:43.820901 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-72f51e8b-1786-4e38-81fb-505c0d5d9eb6 tempest-VolumesMetadataTest-1629187277 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:30:43.820901 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-72f51e8b-1786-4e38-81fb-505c0d5d9eb6 tempest-VolumesMetadataTest-1629187277 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:30:43.820901 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-72f51e8b-1786-4e38-81fb-505c0d5d9eb6 tempest-VolumesMetadataTest-1629187277 None] Deleted volume successfully. Apr 30 21:30:43.820901 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-72f51e8b-1786-4e38-81fb-505c0d5d9eb6 tempest-VolumesMetadataTest-1629187277 None] Lock "b'cinder-0ab5b895-233d-4622-9af2-b7b027008d53-delete_volume'" released by "delete_volume" :: held 6.014s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:30:46.199204 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [None req-1ec59648-17ff-46e1-9497-14fb57fc2229 tempest-VolumesBackupsV39Test-430797569 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:30:47.606859 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [None req-1ec59648-17ff-46e1-9497-14fb57fc2229 tempest-VolumesBackupsV39Test-430797569 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.407s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:30:47.607707 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-1ec59648-17ff-46e1-9497-14fb57fc2229 tempest-VolumesBackupsV39Test-430797569 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3da6d027-86b7-4190-8ea8-d6457ddb2f80', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': '3da6d027-86b7-4190-8ea8-d6457ddb2f80', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:30:47.635182 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-1ec59648-17ff-46e1-9497-14fb57fc2229 tempest-VolumesBackupsV39Test-430797569 None] Initialize volume connection completed successfully. Apr 30 21:30:56.537421 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-dae22fdf-92ab-4886-affd-4c08ccbeabfd tempest-VolumesActionsTest-178027447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:30:56.559324 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-dae22fdf-92ab-4886-affd-4c08ccbeabfd tempest-VolumesActionsTest-178027447 None] Flow 'volume_create_manager' (ca836b23-12b4-4947-a992-0e8e7962bcce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:30:56.567095 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-dae22fdf-92ab-4886-affd-4c08ccbeabfd tempest-VolumesActionsTest-178027447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5beace2-7ad7-4a8e-8b4f-47a36fedafdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:30:56.588685 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-dae22fdf-92ab-4886-affd-4c08ccbeabfd tempest-VolumesActionsTest-178027447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5beace2-7ad7-4a8e-8b4f-47a36fedafdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-858754734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=aab87269-e0c1-49b1-ad65-c2340d3615fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83c1c99c0d904b58946a2a623c674759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:30:56Z,use_quota=True,user_id='1e5bf319f22145459e3c71d158430d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:30:56.594598 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-dae22fdf-92ab-4886-affd-4c08ccbeabfd tempest-VolumesActionsTest-178027447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd46b643-600c-42e7-96b1-ac4f4c437fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:30:56.599085 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-dae22fdf-92ab-4886-affd-4c08ccbeabfd tempest-VolumesActionsTest-178027447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd46b643-600c-42e7-96b1-ac4f4c437fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:30:56.604508 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-dae22fdf-92ab-4886-affd-4c08ccbeabfd tempest-VolumesActionsTest-178027447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (784728d4-3b5b-41ab-b845-6c568c1101bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:30:56.608802 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-dae22fdf-92ab-4886-affd-4c08ccbeabfd tempest-VolumesActionsTest-178027447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (784728d4-3b5b-41ab-b845-6c568c1101bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aab87269-e0c1-49b1-ad65-c2340d3615fb', 'volume_name': 'volume-aab87269-e0c1-49b1-ad65-c2340d3615fb', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:30:56.613905 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-dae22fdf-92ab-4886-affd-4c08ccbeabfd tempest-VolumesActionsTest-178027447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c798074e-f460-4e15-a8a9-28ed3607b14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:30:56.618234 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-dae22fdf-92ab-4886-affd-4c08ccbeabfd tempest-VolumesActionsTest-178027447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c798074e-f460-4e15-a8a9-28ed3607b14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:30:56.623008 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-dae22fdf-92ab-4886-affd-4c08ccbeabfd tempest-VolumesActionsTest-178027447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5a90df4-d556-4f99-b2df-8b9aa307d4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:30:56.624188 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-dae22fdf-92ab-4886-affd-4c08ccbeabfd tempest-VolumesActionsTest-178027447 None] Volume aab87269-e0c1-49b1-ad65-c2340d3615fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aab87269-e0c1-49b1-ad65-c2340d3615fb', 'volume_size': 1} Apr 30 21:30:56.624579 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-dae22fdf-92ab-4886-affd-4c08ccbeabfd tempest-VolumesActionsTest-178027447 None] creating volume 'volume-aab87269-e0c1-49b1-ad65-c2340d3615fb' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:30:56.625879 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-dae22fdf-92ab-4886-affd-4c08ccbeabfd tempest-VolumesActionsTest-178027447 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:30:57.753645 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-dae22fdf-92ab-4886-affd-4c08ccbeabfd tempest-VolumesActionsTest-178027447 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:30:57.759234 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-dae22fdf-92ab-4886-affd-4c08ccbeabfd tempest-VolumesActionsTest-178027447 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:30:57.762993 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-dae22fdf-92ab-4886-affd-4c08ccbeabfd tempest-VolumesActionsTest-178027447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5a90df4-d556-4f99-b2df-8b9aa307d4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aab87269-e0c1-49b1-ad65-c2340d3615fb', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:30:57.770004 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-dae22fdf-92ab-4886-affd-4c08ccbeabfd tempest-VolumesActionsTest-178027447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (073d43f8-0bed-4502-8ba4-1d80fe574399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:30:57.916682 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-dae22fdf-92ab-4886-affd-4c08ccbeabfd tempest-VolumesActionsTest-178027447 None] Volume volume-aab87269-e0c1-49b1-ad65-c2340d3615fb (aab87269-e0c1-49b1-ad65-c2340d3615fb): created successfully Apr 30 21:30:57.920613 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-dae22fdf-92ab-4886-affd-4c08ccbeabfd tempest-VolumesActionsTest-178027447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (073d43f8-0bed-4502-8ba4-1d80fe574399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:30:57.927566 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-dae22fdf-92ab-4886-affd-4c08ccbeabfd tempest-VolumesActionsTest-178027447 None] Flow 'volume_create_manager' (ca836b23-12b4-4947-a992-0e8e7962bcce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:30:58.056674 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-dae22fdf-92ab-4886-affd-4c08ccbeabfd tempest-VolumesActionsTest-178027447 None] Created volume successfully. Apr 30 21:30:58.475319 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-1ec59648-17ff-46e1-9497-14fb57fc2229 tempest-VolumesBackupsV39Test-430797569 None] Terminate volume connection completed successfully. Apr 30 21:30:58.512696 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-1ec59648-17ff-46e1-9497-14fb57fc2229 tempest-VolumesBackupsV39Test-430797569 None] Remove volume export completed successfully. Apr 30 21:31:07.663469 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-66cc8872-c416-429b-a6d1-7f03c27ed931 tempest-VolumesBackupsV39Test-430797569 None] Lock "b'cinder-3da6d027-86b7-4190-8ea8-d6457ddb2f80-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:31:07.819125 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-66cc8872-c416-429b-a6d1-7f03c27ed931 tempest-VolumesBackupsV39Test-430797569 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:31:10.190385 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-66cc8872-c416-429b-a6d1-7f03c27ed931 tempest-VolumesBackupsV39Test-430797569 None] Volume volume-3da6d027-86b7-4190-8ea8-d6457ddb2f80 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:31:10.574494 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-66cc8872-c416-429b-a6d1-7f03c27ed931 tempest-VolumesBackupsV39Test-430797569 None] deleting rbd volume volume-3da6d027-86b7-4190-8ea8-d6457ddb2f80 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:31:14.301409 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-66cc8872-c416-429b-a6d1-7f03c27ed931 tempest-VolumesBackupsV39Test-430797569 None] Created reservations ['a18313e9-2aba-4145-9d7e-0ae1e0a95bf7', '1db34a9a-13f9-48cc-a39b-882c49b105d3', '082d6f72-f1ce-47c7-83f8-b33bd79d6f3a', 'ea2b7d3f-18be-4c1f-a5f5-6680e54e17cb'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:31:14.528610 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-66cc8872-c416-429b-a6d1-7f03c27ed931 tempest-VolumesBackupsV39Test-430797569 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:31:14.586336 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-66cc8872-c416-429b-a6d1-7f03c27ed931 tempest-VolumesBackupsV39Test-430797569 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:31:14.637130 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-66cc8872-c416-429b-a6d1-7f03c27ed931 tempest-VolumesBackupsV39Test-430797569 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:31:14.641796 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-66cc8872-c416-429b-a6d1-7f03c27ed931 tempest-VolumesBackupsV39Test-430797569 None] Deleted volume successfully. Apr 30 21:31:14.765147 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-66cc8872-c416-429b-a6d1-7f03c27ed931 tempest-VolumesBackupsV39Test-430797569 None] Lock "b'cinder-3da6d027-86b7-4190-8ea8-d6457ddb2f80-delete_volume'" released by "delete_volume" :: held 7.102s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:31:19.487385 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-f2715fef-9e87-48ef-8b81-34b038f88603 tempest-VolumesActionsTest-178027447 None] Lock "b'cinder-aab87269-e0c1-49b1-ad65-c2340d3615fb'" acquired by "attach_volume" :: waited 0.014s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:31:19.760829 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-f2715fef-9e87-48ef-8b81-34b038f88603 tempest-VolumesActionsTest-178027447 None] Attaching volume aab87269-e0c1-49b1-ad65-c2340d3615fb to instance 2cb12917-3c9f-44fb-b85c-89430e043c23 at mountpoint /dev/sdb on host None. Apr 30 21:31:19.882811 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-f2715fef-9e87-48ef-8b81-34b038f88603 tempest-VolumesActionsTest-178027447 None] Attach volume completed successfully. Apr 30 21:31:19.890970 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-f2715fef-9e87-48ef-8b81-34b038f88603 tempest-VolumesActionsTest-178027447 None] Lock "b'cinder-aab87269-e0c1-49b1-ad65-c2340d3615fb'" released by "attach_volume" :: held 0.405s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:31:20.108165 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-008e8501-c573-44a9-82f4-83599054f821 tempest-VolumesActionsTest-178027447 None] Lock "b'cinder-aab87269-e0c1-49b1-ad65-c2340d3615fb-detach_volume'" acquired by "detach_volume" :: waited 0.026s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:31:20.109408 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-008e8501-c573-44a9-82f4-83599054f821 tempest-VolumesActionsTest-178027447 None] Detaching volume aab87269-e0c1-49b1-ad65-c2340d3615fb from instance 2cb12917-3c9f-44fb-b85c-89430e043c23. Apr 30 21:31:20.349608 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-008e8501-c573-44a9-82f4-83599054f821 tempest-VolumesActionsTest-178027447 None] Detach volume completed successfully. Apr 30 21:31:20.354587 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-008e8501-c573-44a9-82f4-83599054f821 tempest-VolumesActionsTest-178027447 None] Lock "b'cinder-aab87269-e0c1-49b1-ad65-c2340d3615fb-detach_volume'" released by "detach_volume" :: held 0.246s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:31:28.965096 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:31:28.965096 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:31:29.056310 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:31:29.159389 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:31:42.874486 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-04f4baf0-8180-437e-b669-0dc8656e2eff tempest-ServerRescueNegativeTestJSON-1665530689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:31:42.952149 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-04f4baf0-8180-437e-b669-0dc8656e2eff tempest-ServerRescueNegativeTestJSON-1665530689 None] Flow 'volume_create_manager' (b3b0ec7b-94c7-4e5b-aa64-34e5b758f39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:31:42.967509 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-04f4baf0-8180-437e-b669-0dc8656e2eff tempest-ServerRescueNegativeTestJSON-1665530689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cdcc8c5-341d-4e07-a3a9-da6cd4c92f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:31:43.016957 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-04f4baf0-8180-437e-b669-0dc8656e2eff tempest-ServerRescueNegativeTestJSON-1665530689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cdcc8c5-341d-4e07-a3a9-da6cd4c92f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1405615192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a3025c91-4710-444f-a17e-e4de84b6c2f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef2f32360be4d6c87d31bb5307ad696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:31:43Z,use_quota=True,user_id='41a26877b24c4687a0c8cc4ffc6d69dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:31:43.023595 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-04f4baf0-8180-437e-b669-0dc8656e2eff tempest-ServerRescueNegativeTestJSON-1665530689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e38ba2ca-3921-47a8-9631-ddfb069d548f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:31:43.028395 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-04f4baf0-8180-437e-b669-0dc8656e2eff tempest-ServerRescueNegativeTestJSON-1665530689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e38ba2ca-3921-47a8-9631-ddfb069d548f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:31:43.035797 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-04f4baf0-8180-437e-b669-0dc8656e2eff tempest-ServerRescueNegativeTestJSON-1665530689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a915dae9-3caa-455f-8dd2-33f00dddec55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:31:43.040408 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-04f4baf0-8180-437e-b669-0dc8656e2eff tempest-ServerRescueNegativeTestJSON-1665530689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a915dae9-3caa-455f-8dd2-33f00dddec55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3025c91-4710-444f-a17e-e4de84b6c2f1', 'volume_name': 'volume-a3025c91-4710-444f-a17e-e4de84b6c2f1', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:31:43.049486 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-04f4baf0-8180-437e-b669-0dc8656e2eff tempest-ServerRescueNegativeTestJSON-1665530689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50dbebf6-d597-4934-a009-3a3a02064feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:31:43.051557 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-04f4baf0-8180-437e-b669-0dc8656e2eff tempest-ServerRescueNegativeTestJSON-1665530689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50dbebf6-d597-4934-a009-3a3a02064feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:31:43.057429 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-04f4baf0-8180-437e-b669-0dc8656e2eff tempest-ServerRescueNegativeTestJSON-1665530689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20b5fea8-0944-46f0-b415-bf1e2455534c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:31:43.058729 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-04f4baf0-8180-437e-b669-0dc8656e2eff tempest-ServerRescueNegativeTestJSON-1665530689 None] Volume a3025c91-4710-444f-a17e-e4de84b6c2f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3025c91-4710-444f-a17e-e4de84b6c2f1', 'volume_size': 1} Apr 30 21:31:43.059479 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-04f4baf0-8180-437e-b669-0dc8656e2eff tempest-ServerRescueNegativeTestJSON-1665530689 None] creating volume 'volume-a3025c91-4710-444f-a17e-e4de84b6c2f1' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:31:43.060414 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-04f4baf0-8180-437e-b669-0dc8656e2eff tempest-ServerRescueNegativeTestJSON-1665530689 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:31:43.759926 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-04f4baf0-8180-437e-b669-0dc8656e2eff tempest-ServerRescueNegativeTestJSON-1665530689 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:31:43.760635 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-04f4baf0-8180-437e-b669-0dc8656e2eff tempest-ServerRescueNegativeTestJSON-1665530689 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:31:43.766494 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-04f4baf0-8180-437e-b669-0dc8656e2eff tempest-ServerRescueNegativeTestJSON-1665530689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20b5fea8-0944-46f0-b415-bf1e2455534c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3025c91-4710-444f-a17e-e4de84b6c2f1', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:31:43.772094 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-04f4baf0-8180-437e-b669-0dc8656e2eff tempest-ServerRescueNegativeTestJSON-1665530689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d7ec80b-5ae7-498f-b0b6-15a87ed029c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:31:43.884647 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-04f4baf0-8180-437e-b669-0dc8656e2eff tempest-ServerRescueNegativeTestJSON-1665530689 None] Volume volume-a3025c91-4710-444f-a17e-e4de84b6c2f1 (a3025c91-4710-444f-a17e-e4de84b6c2f1): created successfully Apr 30 21:31:43.890837 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-04f4baf0-8180-437e-b669-0dc8656e2eff tempest-ServerRescueNegativeTestJSON-1665530689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d7ec80b-5ae7-498f-b0b6-15a87ed029c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:31:43.902523 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-04f4baf0-8180-437e-b669-0dc8656e2eff tempest-ServerRescueNegativeTestJSON-1665530689 None] Flow 'volume_create_manager' (b3b0ec7b-94c7-4e5b-aa64-34e5b758f39a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:31:44.018771 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-04f4baf0-8180-437e-b669-0dc8656e2eff tempest-ServerRescueNegativeTestJSON-1665530689 None] Created volume successfully. Apr 30 21:31:47.532137 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-35df40f5-0633-49fc-b7ca-bc012dc57fe1 tempest-VolumesActionsTest-178027447 None] Lock "b'cinder-aab87269-e0c1-49b1-ad65-c2340d3615fb'" acquired by "attach_volume" :: waited 0.011s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:31:47.815981 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-35df40f5-0633-49fc-b7ca-bc012dc57fe1 tempest-VolumesActionsTest-178027447 None] Attaching volume aab87269-e0c1-49b1-ad65-c2340d3615fb to instance a8fa7242-dfe6-4127-9f9a-b113bd888d22 at mountpoint /dev/sdb on host None. Apr 30 21:31:47.914223 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-35df40f5-0633-49fc-b7ca-bc012dc57fe1 tempest-VolumesActionsTest-178027447 None] Attach volume completed successfully. Apr 30 21:31:47.918625 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-35df40f5-0633-49fc-b7ca-bc012dc57fe1 tempest-VolumesActionsTest-178027447 None] Lock "b'cinder-aab87269-e0c1-49b1-ad65-c2340d3615fb'" released by "attach_volume" :: held 0.391s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:31:48.225745 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-6eea12a4-db04-493f-bbf4-d28b71c059d1 tempest-VolumesActionsTest-178027447 None] Lock "b'cinder-aab87269-e0c1-49b1-ad65-c2340d3615fb-detach_volume'" acquired by "detach_volume" :: waited 0.011s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:31:48.226187 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-6eea12a4-db04-493f-bbf4-d28b71c059d1 tempest-VolumesActionsTest-178027447 None] Detaching volume aab87269-e0c1-49b1-ad65-c2340d3615fb from instance a8fa7242-dfe6-4127-9f9a-b113bd888d22. Apr 30 21:31:48.458992 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-6eea12a4-db04-493f-bbf4-d28b71c059d1 tempest-VolumesActionsTest-178027447 None] Detach volume completed successfully. Apr 30 21:31:48.470880 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-6eea12a4-db04-493f-bbf4-d28b71c059d1 tempest-VolumesActionsTest-178027447 None] Lock "b'cinder-aab87269-e0c1-49b1-ad65-c2340d3615fb-detach_volume'" released by "detach_volume" :: held 0.245s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:31:55.124517 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [None req-8e3ca0cb-660d-4434-9ea4-5eb7e7bfae89 tempest-VolumesActionsTest-178027447 None] Running cmd (subprocess): rbd export --pool volumes volume-aab87269-e0c1-49b1-ad65-c2340d3615fb /opt/stack/data/cinder/conversion/volume-aab87269-e0c1-49b1-ad65-c2340d3615fb-03052b2c-094b-4df4-9547-e352b5ecc926 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:31:56.248356 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [None req-8e3ca0cb-660d-4434-9ea4-5eb7e7bfae89 tempest-VolumesActionsTest-178027447 None] CMD "rbd export --pool volumes volume-aab87269-e0c1-49b1-ad65-c2340d3615fb /opt/stack/data/cinder/conversion/volume-aab87269-e0c1-49b1-ad65-c2340d3615fb-03052b2c-094b-4df4-9547-e352b5ecc926 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.123s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:31:56.261148 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.image_utils [None req-8e3ca0cb-660d-4434-9ea4-5eb7e7bfae89 tempest-VolumesActionsTest-178027447 None] 03052b2c-094b-4df4-9547-e352b5ecc926 was raw, no need to convert to raw {{(pid=123855) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:815}} Apr 30 21:32:16.344549 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3e93f0a-54e3-46d0-a28f-ef9784a20701 tempest-ServerRescueNegativeTestJSON-1665530689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:32:16.376568 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e3e93f0a-54e3-46d0-a28f-ef9784a20701 tempest-ServerRescueNegativeTestJSON-1665530689 None] Flow 'volume_create_manager' (d44250d0-c3d1-488e-b19d-7f746fcc921b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:32:16.387194 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e3e93f0a-54e3-46d0-a28f-ef9784a20701 tempest-ServerRescueNegativeTestJSON-1665530689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3ebe871-2063-4815-96a3-bf5159fbedeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:32:16.407471 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e3e93f0a-54e3-46d0-a28f-ef9784a20701 tempest-ServerRescueNegativeTestJSON-1665530689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3ebe871-2063-4815-96a3-bf5159fbedeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1455671483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=145fbe2b-80e0-425d-8ae1-fb6fd5400018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef2f32360be4d6c87d31bb5307ad696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:32:16Z,use_quota=True,user_id='41a26877b24c4687a0c8cc4ffc6d69dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:32:16.414511 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e3e93f0a-54e3-46d0-a28f-ef9784a20701 tempest-ServerRescueNegativeTestJSON-1665530689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b63af174-29eb-488e-ae65-3f6fca41280a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:32:16.421743 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e3e93f0a-54e3-46d0-a28f-ef9784a20701 tempest-ServerRescueNegativeTestJSON-1665530689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b63af174-29eb-488e-ae65-3f6fca41280a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:32:16.441907 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e3e93f0a-54e3-46d0-a28f-ef9784a20701 tempest-ServerRescueNegativeTestJSON-1665530689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a31cf31-f9a9-415a-a9b3-4f68bd1a85d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:32:16.451077 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e3e93f0a-54e3-46d0-a28f-ef9784a20701 tempest-ServerRescueNegativeTestJSON-1665530689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a31cf31-f9a9-415a-a9b3-4f68bd1a85d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '145fbe2b-80e0-425d-8ae1-fb6fd5400018', 'volume_name': 'volume-145fbe2b-80e0-425d-8ae1-fb6fd5400018', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:32:16.467060 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e3e93f0a-54e3-46d0-a28f-ef9784a20701 tempest-ServerRescueNegativeTestJSON-1665530689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119d9ea1-1d07-44e8-816e-759d790c1965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:32:16.473190 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e3e93f0a-54e3-46d0-a28f-ef9784a20701 tempest-ServerRescueNegativeTestJSON-1665530689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119d9ea1-1d07-44e8-816e-759d790c1965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:32:16.479836 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e3e93f0a-54e3-46d0-a28f-ef9784a20701 tempest-ServerRescueNegativeTestJSON-1665530689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (155b569b-d8b0-407a-9441-d27d5b023800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:32:16.481135 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-e3e93f0a-54e3-46d0-a28f-ef9784a20701 tempest-ServerRescueNegativeTestJSON-1665530689 None] Volume 145fbe2b-80e0-425d-8ae1-fb6fd5400018: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-145fbe2b-80e0-425d-8ae1-fb6fd5400018', 'volume_size': 1} Apr 30 21:32:16.481744 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e3e93f0a-54e3-46d0-a28f-ef9784a20701 tempest-ServerRescueNegativeTestJSON-1665530689 None] creating volume 'volume-145fbe2b-80e0-425d-8ae1-fb6fd5400018' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:32:16.482800 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e3e93f0a-54e3-46d0-a28f-ef9784a20701 tempest-ServerRescueNegativeTestJSON-1665530689 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:32:17.220617 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e3e93f0a-54e3-46d0-a28f-ef9784a20701 tempest-ServerRescueNegativeTestJSON-1665530689 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:32:17.221008 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e3e93f0a-54e3-46d0-a28f-ef9784a20701 tempest-ServerRescueNegativeTestJSON-1665530689 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:32:17.228074 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e3e93f0a-54e3-46d0-a28f-ef9784a20701 tempest-ServerRescueNegativeTestJSON-1665530689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (155b569b-d8b0-407a-9441-d27d5b023800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-145fbe2b-80e0-425d-8ae1-fb6fd5400018', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:32:17.234347 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e3e93f0a-54e3-46d0-a28f-ef9784a20701 tempest-ServerRescueNegativeTestJSON-1665530689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15fdb7a5-15ea-4e13-bc3a-5b631dd6a879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:32:17.329191 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-e3e93f0a-54e3-46d0-a28f-ef9784a20701 tempest-ServerRescueNegativeTestJSON-1665530689 None] Volume volume-145fbe2b-80e0-425d-8ae1-fb6fd5400018 (145fbe2b-80e0-425d-8ae1-fb6fd5400018): created successfully Apr 30 21:32:17.333402 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e3e93f0a-54e3-46d0-a28f-ef9784a20701 tempest-ServerRescueNegativeTestJSON-1665530689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15fdb7a5-15ea-4e13-bc3a-5b631dd6a879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:32:17.345654 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e3e93f0a-54e3-46d0-a28f-ef9784a20701 tempest-ServerRescueNegativeTestJSON-1665530689 None] Flow 'volume_create_manager' (d44250d0-c3d1-488e-b19d-7f746fcc921b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:32:17.449178 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-e3e93f0a-54e3-46d0-a28f-ef9784a20701 tempest-ServerRescueNegativeTestJSON-1665530689 None] Created volume successfully. Apr 30 21:32:28.956143 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:32:28.956962 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:32:29.027123 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:32:29.116993 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:32:35.548118 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8e3ca0cb-660d-4434-9ea4-5eb7e7bfae89 tempest-VolumesActionsTest-178027447 None] Uploaded volume to glance image-id: 03052b2c-094b-4df4-9547-e352b5ecc926. {{(pid=123855) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1747}} Apr 30 21:32:35.682463 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-8e3ca0cb-660d-4434-9ea4-5eb7e7bfae89 tempest-VolumesActionsTest-178027447 None] Copy volume to image completed successfully. Apr 30 21:32:37.981669 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-17d9ad63-7eda-423f-bbc3-196c815020fc tempest-VolumesActionsTest-178027447 None] Lock "b'cinder-aab87269-e0c1-49b1-ad65-c2340d3615fb-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:32:38.189127 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-17d9ad63-7eda-423f-bbc3-196c815020fc tempest-VolumesActionsTest-178027447 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:32:38.453601 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-17d9ad63-7eda-423f-bbc3-196c815020fc tempest-VolumesActionsTest-178027447 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:32:38.454401 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-17d9ad63-7eda-423f-bbc3-196c815020fc tempest-VolumesActionsTest-178027447 None] Volume volume-aab87269-e0c1-49b1-ad65-c2340d3615fb is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:32:38.578595 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-17d9ad63-7eda-423f-bbc3-196c815020fc tempest-VolumesActionsTest-178027447 None] deleting rbd volume volume-aab87269-e0c1-49b1-ad65-c2340d3615fb {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:32:42.390686 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-17d9ad63-7eda-423f-bbc3-196c815020fc tempest-VolumesActionsTest-178027447 None] Created reservations ['96c4cbeb-4b22-4271-a6f9-bf3e18a7267f', '979ef6a2-3fa6-47cf-892a-269df8cfcfde', '5104b1e4-313a-47bf-9c07-c02869bb0202', '0af68496-99c9-49cb-8b2f-345c2d356c06'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:32:42.596925 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-17d9ad63-7eda-423f-bbc3-196c815020fc tempest-VolumesActionsTest-178027447 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:32:42.653829 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-17d9ad63-7eda-423f-bbc3-196c815020fc tempest-VolumesActionsTest-178027447 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:32:42.733365 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-17d9ad63-7eda-423f-bbc3-196c815020fc tempest-VolumesActionsTest-178027447 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:32:42.743122 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-17d9ad63-7eda-423f-bbc3-196c815020fc tempest-VolumesActionsTest-178027447 None] Deleted volume successfully. Apr 30 21:32:42.821797 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-17d9ad63-7eda-423f-bbc3-196c815020fc tempest-VolumesActionsTest-178027447 None] Lock "b'cinder-aab87269-e0c1-49b1-ad65-c2340d3615fb-delete_volume'" released by "delete_volume" :: held 4.839s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:32:47.523466 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-71e0d1cc-83e6-4eaf-acc0-c4da8419dd1c tempest-ServersNegativeTestJSON-461111943 None] Lock "b'cinder-af5d97e7-2077-48c5-a106-53d364f2886a-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:32:47.664662 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-71e0d1cc-83e6-4eaf-acc0-c4da8419dd1c tempest-ServersNegativeTestJSON-461111943 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:32:47.829932 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-71e0d1cc-83e6-4eaf-acc0-c4da8419dd1c tempest-ServersNegativeTestJSON-461111943 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:32:47.830361 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-71e0d1cc-83e6-4eaf-acc0-c4da8419dd1c tempest-ServersNegativeTestJSON-461111943 None] Volume volume-af5d97e7-2077-48c5-a106-53d364f2886a is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:32:47.957920 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-71e0d1cc-83e6-4eaf-acc0-c4da8419dd1c tempest-ServersNegativeTestJSON-461111943 None] deleting rbd volume volume-af5d97e7-2077-48c5-a106-53d364f2886a {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:32:49.012055 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-d855d281-6e0e-4387-ba5e-997b05dcc3ba tempest-VolumesBackupsTest-2062082737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:32:49.063904 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d855d281-6e0e-4387-ba5e-997b05dcc3ba tempest-VolumesBackupsTest-2062082737 None] Flow 'volume_create_manager' (3b49d534-d981-4cab-b0ed-ebba9c8264c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:32:49.085624 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d855d281-6e0e-4387-ba5e-997b05dcc3ba tempest-VolumesBackupsTest-2062082737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (230cf6f8-9a4c-4593-90e0-36670bb63191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:32:49.124746 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d855d281-6e0e-4387-ba5e-997b05dcc3ba tempest-VolumesBackupsTest-2062082737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (230cf6f8-9a4c-4593-90e0-36670bb63191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-600279749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=75ec996f-b0b5-4141-a09f-8a7066dc3547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='280a6ce7a084421bbd267c7ac5c907ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:32:49Z,use_quota=True,user_id='7757dd58d9db44f89d86bf2217719d09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:32:49.148221 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d855d281-6e0e-4387-ba5e-997b05dcc3ba tempest-VolumesBackupsTest-2062082737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d58121-1971-42bc-b99d-0fb01c7e5cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:32:49.164749 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d855d281-6e0e-4387-ba5e-997b05dcc3ba tempest-VolumesBackupsTest-2062082737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d58121-1971-42bc-b99d-0fb01c7e5cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:32:49.178491 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d855d281-6e0e-4387-ba5e-997b05dcc3ba tempest-VolumesBackupsTest-2062082737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4e5baba-8d5b-4a7e-ad42-dc1398a1822f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:32:49.182903 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d855d281-6e0e-4387-ba5e-997b05dcc3ba tempest-VolumesBackupsTest-2062082737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4e5baba-8d5b-4a7e-ad42-dc1398a1822f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75ec996f-b0b5-4141-a09f-8a7066dc3547', 'volume_name': 'volume-75ec996f-b0b5-4141-a09f-8a7066dc3547', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:32:49.191152 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d855d281-6e0e-4387-ba5e-997b05dcc3ba tempest-VolumesBackupsTest-2062082737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69690f68-bf78-4c83-bdd8-0328f62a5b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:32:49.205909 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d855d281-6e0e-4387-ba5e-997b05dcc3ba tempest-VolumesBackupsTest-2062082737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69690f68-bf78-4c83-bdd8-0328f62a5b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:32:49.224708 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d855d281-6e0e-4387-ba5e-997b05dcc3ba tempest-VolumesBackupsTest-2062082737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e877240-3389-4e66-855b-173de60485cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:32:49.226001 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-d855d281-6e0e-4387-ba5e-997b05dcc3ba tempest-VolumesBackupsTest-2062082737 None] Volume 75ec996f-b0b5-4141-a09f-8a7066dc3547: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75ec996f-b0b5-4141-a09f-8a7066dc3547', 'volume_size': 1} Apr 30 21:32:49.226401 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-d855d281-6e0e-4387-ba5e-997b05dcc3ba tempest-VolumesBackupsTest-2062082737 None] creating volume 'volume-75ec996f-b0b5-4141-a09f-8a7066dc3547' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:32:49.227555 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-d855d281-6e0e-4387-ba5e-997b05dcc3ba tempest-VolumesBackupsTest-2062082737 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:32:50.380907 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-d855d281-6e0e-4387-ba5e-997b05dcc3ba tempest-VolumesBackupsTest-2062082737 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:32:50.383307 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-d855d281-6e0e-4387-ba5e-997b05dcc3ba tempest-VolumesBackupsTest-2062082737 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:32:50.391272 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d855d281-6e0e-4387-ba5e-997b05dcc3ba tempest-VolumesBackupsTest-2062082737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e877240-3389-4e66-855b-173de60485cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75ec996f-b0b5-4141-a09f-8a7066dc3547', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:32:50.407796 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d855d281-6e0e-4387-ba5e-997b05dcc3ba tempest-VolumesBackupsTest-2062082737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84b02748-2124-47b8-84f1-0714a623b0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:32:50.543040 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-d855d281-6e0e-4387-ba5e-997b05dcc3ba tempest-VolumesBackupsTest-2062082737 None] Volume volume-75ec996f-b0b5-4141-a09f-8a7066dc3547 (75ec996f-b0b5-4141-a09f-8a7066dc3547): created successfully Apr 30 21:32:50.544813 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d855d281-6e0e-4387-ba5e-997b05dcc3ba tempest-VolumesBackupsTest-2062082737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84b02748-2124-47b8-84f1-0714a623b0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:32:50.554235 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d855d281-6e0e-4387-ba5e-997b05dcc3ba tempest-VolumesBackupsTest-2062082737 None] Flow 'volume_create_manager' (3b49d534-d981-4cab-b0ed-ebba9c8264c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:32:50.702527 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-d855d281-6e0e-4387-ba5e-997b05dcc3ba tempest-VolumesBackupsTest-2062082737 None] Created volume successfully. Apr 30 21:32:52.602065 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-71e0d1cc-83e6-4eaf-acc0-c4da8419dd1c tempest-ServersNegativeTestJSON-461111943 None] Created reservations ['0fd7c9f6-4dac-405d-9f9d-61f7b1a3da98', '74474425-82ef-4d5f-a736-dbb8bdf9da84', '3d9db655-61c6-4909-91e6-c0aee805cfd2', '17d7859a-fe02-4a3d-9668-b94959646bdb'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:32:52.817862 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-71e0d1cc-83e6-4eaf-acc0-c4da8419dd1c tempest-ServersNegativeTestJSON-461111943 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:32:52.878304 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-71e0d1cc-83e6-4eaf-acc0-c4da8419dd1c tempest-ServersNegativeTestJSON-461111943 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:32:52.936831 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-71e0d1cc-83e6-4eaf-acc0-c4da8419dd1c tempest-ServersNegativeTestJSON-461111943 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:32:52.943799 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-71e0d1cc-83e6-4eaf-acc0-c4da8419dd1c tempest-ServersNegativeTestJSON-461111943 None] Deleted volume successfully. Apr 30 21:32:53.034476 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-71e0d1cc-83e6-4eaf-acc0-c4da8419dd1c tempest-ServersNegativeTestJSON-461111943 None] Lock "b'cinder-af5d97e7-2077-48c5-a106-53d364f2886a-delete_volume'" released by "delete_volume" :: held 5.508s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:32:53.453059 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-b48fe9bc-9c83-4134-9fd2-7a880b2f074d tempest-ServersNegativeTestJSON-461111943 None] Lock "b'cinder-0fe89388-81fb-4f6e-b86b-d1159cdf1d17-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:32:53.617434 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b48fe9bc-9c83-4134-9fd2-7a880b2f074d tempest-ServersNegativeTestJSON-461111943 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:32:53.822330 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b48fe9bc-9c83-4134-9fd2-7a880b2f074d tempest-ServersNegativeTestJSON-461111943 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:32:53.822745 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b48fe9bc-9c83-4134-9fd2-7a880b2f074d tempest-ServersNegativeTestJSON-461111943 None] Volume volume-0fe89388-81fb-4f6e-b86b-d1159cdf1d17 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:32:53.921703 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b48fe9bc-9c83-4134-9fd2-7a880b2f074d tempest-ServersNegativeTestJSON-461111943 None] deleting rbd volume volume-0fe89388-81fb-4f6e-b86b-d1159cdf1d17 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:32:57.955945 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-b48fe9bc-9c83-4134-9fd2-7a880b2f074d tempest-ServersNegativeTestJSON-461111943 None] Created reservations ['c2b33107-70d1-4a3a-9901-980dccc65e55', '3b0e5b4f-2c9b-4727-b054-93ed667a8005', '51e30439-14e6-4d0d-b65c-bddc2d6f40fb', 'd0ed66f8-d435-4d34-88ce-4b6242f03766'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:32:58.110811 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b48fe9bc-9c83-4134-9fd2-7a880b2f074d tempest-ServersNegativeTestJSON-461111943 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:32:58.177478 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b48fe9bc-9c83-4134-9fd2-7a880b2f074d tempest-ServersNegativeTestJSON-461111943 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:32:58.230237 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-b48fe9bc-9c83-4134-9fd2-7a880b2f074d tempest-ServersNegativeTestJSON-461111943 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:32:58.240408 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-b48fe9bc-9c83-4134-9fd2-7a880b2f074d tempest-ServersNegativeTestJSON-461111943 None] Deleted volume successfully. Apr 30 21:32:58.400797 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-b48fe9bc-9c83-4134-9fd2-7a880b2f074d tempest-ServersNegativeTestJSON-461111943 None] Lock "b'cinder-0fe89388-81fb-4f6e-b86b-d1159cdf1d17-delete_volume'" released by "delete_volume" :: held 4.948s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:33:13.268760 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-dd599d51-49e1-4afe-93ba-b62c35e94506 req-2ff70313-20ad-4d53-937b-c7eaf5faa595 tempest-VolumesBackupsTest-2062082737 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:33:14.605321 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-dd599d51-49e1-4afe-93ba-b62c35e94506 req-2ff70313-20ad-4d53-937b-c7eaf5faa595 tempest-VolumesBackupsTest-2062082737 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.339s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:33:14.607540 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-dd599d51-49e1-4afe-93ba-b62c35e94506 req-2ff70313-20ad-4d53-937b-c7eaf5faa595 tempest-VolumesBackupsTest-2062082737 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-75ec996f-b0b5-4141-a09f-8a7066dc3547', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': '75ec996f-b0b5-4141-a09f-8a7066dc3547', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:33:14.703556 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-dd599d51-49e1-4afe-93ba-b62c35e94506 req-2ff70313-20ad-4d53-937b-c7eaf5faa595 tempest-VolumesBackupsTest-2062082737 None] Connection info returned from driver {'name': 'volumes/volume-75ec996f-b0b5-4141-a09f-8a7066dc3547', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '75ec996f-b0b5-4141-a09f-8a7066dc3547', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f62b5a23-be6c-41ed-b827-eba506763362'} {{(pid=123855) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Apr 30 21:33:14.863747 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-dd599d51-49e1-4afe-93ba-b62c35e94506 req-2ff70313-20ad-4d53-937b-c7eaf5faa595 tempest-VolumesBackupsTest-2062082737 None] attachment_update completed successfully. Apr 30 21:33:18.499305 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-d2627bd3-7347-4086-a90c-75bca1ea2cca tempest-VolumesBackupsTest-2062082737 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-04-30T21:33:17Z,data_timestamp=2022-04-30T21:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1593053476',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=831339c2-4068-41c2-b8b1-ed85d4d21418,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='280a6ce7a084421bbd267c7ac5c907ca',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='7757dd58d9db44f89d86bf2217719d09',volume_id=75ec996f-b0b5-4141-a09f-8a7066dc3547) Apr 30 21:33:18.501021 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.backup.rpcapi [None req-d2627bd3-7347-4086-a90c-75bca1ea2cca tempest-VolumesBackupsTest-2062082737 None] continue_backup in rpcapi backup_id 831339c2-4068-41c2-b8b1-ed85d4d21418 {{(pid=123855) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Apr 30 21:33:18.890863 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [None req-d2627bd3-7347-4086-a90c-75bca1ea2cca tempest-VolumesBackupsTest-2062082737 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:33:19.715639 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [None req-d2627bd3-7347-4086-a90c-75bca1ea2cca tempest-VolumesBackupsTest-2062082737 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.828s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:33:19.718018 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-d2627bd3-7347-4086-a90c-75bca1ea2cca tempest-VolumesBackupsTest-2062082737 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-75ec996f-b0b5-4141-a09f-8a7066dc3547', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': '75ec996f-b0b5-4141-a09f-8a7066dc3547', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:33:19.772318 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-d2627bd3-7347-4086-a90c-75bca1ea2cca tempest-VolumesBackupsTest-2062082737 None] Initialize volume connection completed successfully. Apr 30 21:33:25.838050 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-d2627bd3-7347-4086-a90c-75bca1ea2cca tempest-VolumesBackupsTest-2062082737 None] Terminate volume connection completed successfully. Apr 30 21:33:25.878473 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-d2627bd3-7347-4086-a90c-75bca1ea2cca tempest-VolumesBackupsTest-2062082737 None] Remove volume export completed successfully. Apr 30 21:33:26.880573 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-ca62eb96-1d18-41e0-87f4-a39e2df2917c req-855f204b-4d4d-43a0-8b19-f787e6f09639 tempest-ServerRescueNegativeTestJSON-1665530689 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:33:27.597783 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-ca62eb96-1d18-41e0-87f4-a39e2df2917c req-855f204b-4d4d-43a0-8b19-f787e6f09639 tempest-ServerRescueNegativeTestJSON-1665530689 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.719s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:33:27.598765 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-ca62eb96-1d18-41e0-87f4-a39e2df2917c req-855f204b-4d4d-43a0-8b19-f787e6f09639 tempest-ServerRescueNegativeTestJSON-1665530689 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-145fbe2b-80e0-425d-8ae1-fb6fd5400018', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': '145fbe2b-80e0-425d-8ae1-fb6fd5400018', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:33:27.710467 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-ca62eb96-1d18-41e0-87f4-a39e2df2917c req-855f204b-4d4d-43a0-8b19-f787e6f09639 tempest-ServerRescueNegativeTestJSON-1665530689 None] Connection info returned from driver {'name': 'volumes/volume-145fbe2b-80e0-425d-8ae1-fb6fd5400018', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '145fbe2b-80e0-425d-8ae1-fb6fd5400018', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '440a7cdf-949b-471d-b70b-2dff6bf78f78'} {{(pid=123855) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Apr 30 21:33:27.857808 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-ca62eb96-1d18-41e0-87f4-a39e2df2917c req-855f204b-4d4d-43a0-8b19-f787e6f09639 tempest-ServerRescueNegativeTestJSON-1665530689 None] attachment_update completed successfully. Apr 30 21:33:28.958596 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:33:28.960369 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:33:29.054578 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:33:29.218550 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:33:35.422602 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-d14ab5aa-72b9-4bdd-98ea-bd8dc1387181 req-13cdd836-c75a-4fb0-aae5-3fc6d5c0d6ec tempest-VolumesBackupsTest-2062082737 None] Terminate volume connection completed successfully. Apr 30 21:33:35.423278 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-d14ab5aa-72b9-4bdd-98ea-bd8dc1387181 req-13cdd836-c75a-4fb0-aae5-3fc6d5c0d6ec tempest-VolumesBackupsTest-2062082737 None] Deleting attachment f62b5a23-be6c-41ed-b827-eba506763362. {{(pid=123855) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} Apr 30 21:33:41.440883 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-313e8079-28e8-4a33-8acb-ffd69b47d3c9 tempest-VolumesBackupsTest-2062082737 None] Lock "b'cinder-75ec996f-b0b5-4141-a09f-8a7066dc3547-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:33:41.559513 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-313e8079-28e8-4a33-8acb-ffd69b47d3c9 tempest-VolumesBackupsTest-2062082737 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:33:43.841475 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-313e8079-28e8-4a33-8acb-ffd69b47d3c9 tempest-VolumesBackupsTest-2062082737 None] Volume volume-75ec996f-b0b5-4141-a09f-8a7066dc3547 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:33:44.360450 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-313e8079-28e8-4a33-8acb-ffd69b47d3c9 tempest-VolumesBackupsTest-2062082737 None] deleting rbd volume volume-75ec996f-b0b5-4141-a09f-8a7066dc3547 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:33:48.319895 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-313e8079-28e8-4a33-8acb-ffd69b47d3c9 tempest-VolumesBackupsTest-2062082737 None] Created reservations ['8d2d0787-acca-4f29-97f5-2738fbed7276', '74672bc3-ef81-498d-9f8d-bb140d17c738', '16505581-e597-4245-9755-c4ca556571b7', '94f74c50-f95e-4eee-accb-ad3cc5052165'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:33:48.503008 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-313e8079-28e8-4a33-8acb-ffd69b47d3c9 tempest-VolumesBackupsTest-2062082737 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:33:48.533661 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-313e8079-28e8-4a33-8acb-ffd69b47d3c9 tempest-VolumesBackupsTest-2062082737 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:33:48.573403 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-313e8079-28e8-4a33-8acb-ffd69b47d3c9 tempest-VolumesBackupsTest-2062082737 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:33:48.579712 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-313e8079-28e8-4a33-8acb-ffd69b47d3c9 tempest-VolumesBackupsTest-2062082737 None] Deleted volume successfully. Apr 30 21:33:48.645643 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-313e8079-28e8-4a33-8acb-ffd69b47d3c9 tempest-VolumesBackupsTest-2062082737 None] Lock "b'cinder-75ec996f-b0b5-4141-a09f-8a7066dc3547-delete_volume'" released by "delete_volume" :: held 7.204s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:33:50.230152 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-bac756a3-873f-4b71-82d5-7aa78e9c6506 tempest-VolumesBackupsTest-2062082737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:33:50.250598 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bac756a3-873f-4b71-82d5-7aa78e9c6506 tempest-VolumesBackupsTest-2062082737 None] Flow 'volume_create_manager' (33ffd3b0-d789-4dfb-a49b-0abdcc945d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:33:50.257675 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bac756a3-873f-4b71-82d5-7aa78e9c6506 tempest-VolumesBackupsTest-2062082737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a69ed2cd-135f-4bce-b5ac-0eb5492ab2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:33:50.273785 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bac756a3-873f-4b71-82d5-7aa78e9c6506 tempest-VolumesBackupsTest-2062082737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a69ed2cd-135f-4bce-b5ac-0eb5492ab2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1700123934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8ce30ce0-c386-4270-a5c8-e069bf2e80aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='280a6ce7a084421bbd267c7ac5c907ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:33:50Z,use_quota=True,user_id='7757dd58d9db44f89d86bf2217719d09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:33:50.280191 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bac756a3-873f-4b71-82d5-7aa78e9c6506 tempest-VolumesBackupsTest-2062082737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (587c1090-481e-42b6-a4e6-4b69b7102122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:33:50.284743 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bac756a3-873f-4b71-82d5-7aa78e9c6506 tempest-VolumesBackupsTest-2062082737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (587c1090-481e-42b6-a4e6-4b69b7102122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:33:50.289908 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bac756a3-873f-4b71-82d5-7aa78e9c6506 tempest-VolumesBackupsTest-2062082737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b9d652e-f504-47ec-8772-de973c3aa29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:33:50.376988 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bac756a3-873f-4b71-82d5-7aa78e9c6506 tempest-VolumesBackupsTest-2062082737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b9d652e-f504-47ec-8772-de973c3aa29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8ce30ce0-c386-4270-a5c8-e069bf2e80aa', 'volume_name': 'volume-8ce30ce0-c386-4270-a5c8-e069bf2e80aa', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:33:50.382258 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bac756a3-873f-4b71-82d5-7aa78e9c6506 tempest-VolumesBackupsTest-2062082737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d781feca-ac92-4d20-91c7-b77a9b9d7a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:33:50.386270 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bac756a3-873f-4b71-82d5-7aa78e9c6506 tempest-VolumesBackupsTest-2062082737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d781feca-ac92-4d20-91c7-b77a9b9d7a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:33:50.390978 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bac756a3-873f-4b71-82d5-7aa78e9c6506 tempest-VolumesBackupsTest-2062082737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a00a1c0e-523f-4ed8-8b45-676262ba49fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:33:50.392133 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-bac756a3-873f-4b71-82d5-7aa78e9c6506 tempest-VolumesBackupsTest-2062082737 None] Volume 8ce30ce0-c386-4270-a5c8-e069bf2e80aa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8ce30ce0-c386-4270-a5c8-e069bf2e80aa', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 30 21:33:50.392711 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-bac756a3-873f-4b71-82d5-7aa78e9c6506 tempest-VolumesBackupsTest-2062082737 None] Cloning 8ce30ce0-c386-4270-a5c8-e069bf2e80aa from image a5b0850f-3b24-4bcb-b0a7-351c3216b27d at location (None, None). {{(pid=123855) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Apr 30 21:33:50.403397 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-bac756a3-873f-4b71-82d5-7aa78e9c6506 tempest-VolumesBackupsTest-2062082737 None] Lock "b'cinder-a5b0850f-3b24-4bcb-b0a7-351c3216b27d'" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:33:50.460798 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-bac756a3-873f-4b71-82d5-7aa78e9c6506 tempest-VolumesBackupsTest-2062082737 None] Found image-volume cache entry: {'id': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'volume_id': '5772aef0-721f-450a-93ff-02cc6a41edcc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7), 'last_used': datetime.datetime(2022, 4, 30, 21, 33, 50, 408152)}. {{(pid=123855) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 30 21:33:50.461261 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-bac756a3-873f-4b71-82d5-7aa78e9c6506 tempest-VolumesBackupsTest-2062082737 None] Image-volume cache entry image_update_at = 2022-04-30 21:01:07+00:00, requested image updated_at = 2022-04-30 21:01:07+00:00. {{(pid=123855) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 30 21:33:50.461659 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-bac756a3-873f-4b71-82d5-7aa78e9c6506 tempest-VolumesBackupsTest-2062082737 None] Found cache entry for image = a5b0850f-3b24-4bcb-b0a7-351c3216b27d on host ncdv-master-1@ceph#ceph. {{(pid=123855) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Apr 30 21:33:50.466143 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-bac756a3-873f-4b71-82d5-7aa78e9c6506 tempest-VolumesBackupsTest-2062082737 None] Lock "b'cinder-a5b0850f-3b24-4bcb-b0a7-351c3216b27d'" released by "_prepare_image_cache_entry" :: held 0.063s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:33:50.467165 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-bac756a3-873f-4b71-82d5-7aa78e9c6506 tempest-VolumesBackupsTest-2062082737 None] Attempting to retrieve cache entry for image = a5b0850f-3b24-4bcb-b0a7-351c3216b27d on host ncdv-master-1@ceph#ceph. {{(pid=123855) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Apr 30 21:33:50.473325 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-bac756a3-873f-4b71-82d5-7aa78e9c6506 tempest-VolumesBackupsTest-2062082737 None] Found image-volume cache entry: {'id': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'volume_id': '5772aef0-721f-450a-93ff-02cc6a41edcc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7), 'last_used': datetime.datetime(2022, 4, 30, 21, 33, 50, 471059)}. {{(pid=123855) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 30 21:33:50.473742 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-bac756a3-873f-4b71-82d5-7aa78e9c6506 tempest-VolumesBackupsTest-2062082737 None] Image-volume cache entry image_update_at = 2022-04-30 21:01:07+00:00, requested image updated_at = 2022-04-30 21:01:07+00:00. {{(pid=123855) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 30 21:33:50.474165 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-bac756a3-873f-4b71-82d5-7aa78e9c6506 tempest-VolumesBackupsTest-2062082737 None] Creating from source image-volume 5772aef0-721f-450a-93ff-02cc6a41edcc {{(pid=123855) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Apr 30 21:33:50.488533 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bac756a3-873f-4b71-82d5-7aa78e9c6506 tempest-VolumesBackupsTest-2062082737 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:33:50.788619 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bac756a3-873f-4b71-82d5-7aa78e9c6506 tempest-VolumesBackupsTest-2062082737 None] creating snapshot='volume-8ce30ce0-c386-4270-a5c8-e069bf2e80aa.clone_snap' {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} Apr 30 21:33:53.101976 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bac756a3-873f-4b71-82d5-7aa78e9c6506 tempest-VolumesBackupsTest-2062082737 None] cloning 'volume-5772aef0-721f-450a-93ff-02cc6a41edcc@volume-8ce30ce0-c386-4270-a5c8-e069bf2e80aa.clone_snap' to 'volume-8ce30ce0-c386-4270-a5c8-e069bf2e80aa' {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} Apr 30 21:33:54.346684 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bac756a3-873f-4b71-82d5-7aa78e9c6506 tempest-VolumesBackupsTest-2062082737 None] Volume volume-632a7810-1a6f-420a-a6fd-57675408a8f7.deleted is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:33:54.349050 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bac756a3-873f-4b71-82d5-7aa78e9c6506 tempest-VolumesBackupsTest-2062082737 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:33:54.349700 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bac756a3-873f-4b71-82d5-7aa78e9c6506 tempest-VolumesBackupsTest-2062082737 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:33:54.823521 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bac756a3-873f-4b71-82d5-7aa78e9c6506 tempest-VolumesBackupsTest-2062082737 None] clone created successfully {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} Apr 30 21:33:54.824157 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.volume_utils [None req-bac756a3-873f-4b71-82d5-7aa78e9c6506 tempest-VolumesBackupsTest-2062082737 None] Marking volume 8ce30ce0-c386-4270-a5c8-e069bf2e80aa as bootable. {{(pid=123855) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Apr 30 21:33:54.890892 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-bac756a3-873f-4b71-82d5-7aa78e9c6506 tempest-VolumesBackupsTest-2062082737 None] Copying metadata from image a5b0850f-3b24-4bcb-b0a7-351c3216b27d to 8ce30ce0-c386-4270-a5c8-e069bf2e80aa. {{(pid=123855) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Apr 30 21:33:54.891352 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-bac756a3-873f-4b71-82d5-7aa78e9c6506 tempest-VolumesBackupsTest-2062082737 None] Creating volume glance metadata for volume 8ce30ce0-c386-4270-a5c8-e069bf2e80aa backed by image a5b0850f-3b24-4bcb-b0a7-351c3216b27d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123855) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Apr 30 21:33:55.117673 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bac756a3-873f-4b71-82d5-7aa78e9c6506 tempest-VolumesBackupsTest-2062082737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a00a1c0e-523f-4ed8-8b45-676262ba49fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ce30ce0-c386-4270-a5c8-e069bf2e80aa', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:33:55.122378 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bac756a3-873f-4b71-82d5-7aa78e9c6506 tempest-VolumesBackupsTest-2062082737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaa20b3b-7b27-4fc6-a591-6c435eab585f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:33:55.195417 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-bac756a3-873f-4b71-82d5-7aa78e9c6506 tempest-VolumesBackupsTest-2062082737 None] Volume volume-8ce30ce0-c386-4270-a5c8-e069bf2e80aa (8ce30ce0-c386-4270-a5c8-e069bf2e80aa): created successfully Apr 30 21:33:55.204750 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bac756a3-873f-4b71-82d5-7aa78e9c6506 tempest-VolumesBackupsTest-2062082737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaa20b3b-7b27-4fc6-a591-6c435eab585f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:33:55.227560 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bac756a3-873f-4b71-82d5-7aa78e9c6506 tempest-VolumesBackupsTest-2062082737 None] Flow 'volume_create_manager' (33ffd3b0-d789-4dfb-a49b-0abdcc945d51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:33:55.325397 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-bac756a3-873f-4b71-82d5-7aa78e9c6506 tempest-VolumesBackupsTest-2062082737 None] Created volume successfully. Apr 30 21:33:56.110097 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-ec15904e-a98d-4e54-88e8-42dd3572bbcc tempest-VolumesBackupsTest-2062082737 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-04-30T21:33:55Z,data_timestamp=2022-04-30T21:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-25707100',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=5db77d48-9011-4eba-911c-56a7d36278cf,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='280a6ce7a084421bbd267c7ac5c907ca',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='7757dd58d9db44f89d86bf2217719d09',volume_id=8ce30ce0-c386-4270-a5c8-e069bf2e80aa) Apr 30 21:33:56.111558 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.backup.rpcapi [None req-ec15904e-a98d-4e54-88e8-42dd3572bbcc tempest-VolumesBackupsTest-2062082737 None] continue_backup in rpcapi backup_id 5db77d48-9011-4eba-911c-56a7d36278cf {{(pid=123855) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Apr 30 21:33:56.250400 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [None req-ec15904e-a98d-4e54-88e8-42dd3572bbcc tempest-VolumesBackupsTest-2062082737 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:33:57.152915 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [None req-ec15904e-a98d-4e54-88e8-42dd3572bbcc tempest-VolumesBackupsTest-2062082737 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.902s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:33:57.154201 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ec15904e-a98d-4e54-88e8-42dd3572bbcc tempest-VolumesBackupsTest-2062082737 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8ce30ce0-c386-4270-a5c8-e069bf2e80aa', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': '8ce30ce0-c386-4270-a5c8-e069bf2e80aa', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:33:57.174170 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-ec15904e-a98d-4e54-88e8-42dd3572bbcc tempest-VolumesBackupsTest-2062082737 None] Initialize volume connection completed successfully. Apr 30 21:34:10.464051 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-824ed2c1-3307-4bf8-bc47-b12d5524055e tempest-GroupSnapshotsTest-1939666493 None] Group tempest-GroupSnapshotsTest-Group-721968416: creating Apr 30 21:34:10.676010 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-824ed2c1-3307-4bf8-bc47-b12d5524055e tempest-GroupSnapshotsTest-1939666493 None] Group tempest-GroupSnapshotsTest-Group-721968416: created successfully Apr 30 21:34:10.695323 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-824ed2c1-3307-4bf8-bc47-b12d5524055e tempest-GroupSnapshotsTest-1939666493 None] Create group completed successfully. Apr 30 21:34:12.644912 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-847be9f6-e2af-4012-904b-54c7379cea29 tempest-GroupSnapshotsTest-1939666493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:34:12.696480 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-847be9f6-e2af-4012-904b-54c7379cea29 tempest-GroupSnapshotsTest-1939666493 None] Flow 'volume_create_manager' (94d206a5-8217-46a7-9f68-23fa5877abdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:34:12.705909 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-847be9f6-e2af-4012-904b-54c7379cea29 tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (040e56e7-8f11-4b6d-a142-4f431c48b2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:34:12.723363 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-847be9f6-e2af-4012-904b-54c7379cea29 tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (040e56e7-8f11-4b6d-a142-4f431c48b2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-700701119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=debfac38-d691-4d5d-99d1-fb258adda656,host='ncdv-master-1@ceph#ceph',id=eb1612f8-3291-4556-b15a-1ee990e577d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e755f57c175e43d7b08df778af0e3b04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:34:12Z,use_quota=True,user_id='7195793f260a45659c4c2ca5feb83928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1aa73b63-4aae-4fe2-b231-36c6907e8b54),volume_type_id=1aa73b63-4aae-4fe2-b231-36c6907e8b54)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:34:12.730205 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-847be9f6-e2af-4012-904b-54c7379cea29 tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ece7ad1-1054-40d2-bc67-e724738eac51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:34:12.735734 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-847be9f6-e2af-4012-904b-54c7379cea29 tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ece7ad1-1054-40d2-bc67-e724738eac51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:34:12.743002 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-847be9f6-e2af-4012-904b-54c7379cea29 tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d26de1b4-cdc3-429c-8c78-190cb70c1e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:34:12.749344 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-847be9f6-e2af-4012-904b-54c7379cea29 tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d26de1b4-cdc3-429c-8c78-190cb70c1e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb1612f8-3291-4556-b15a-1ee990e577d4', 'volume_name': 'volume-eb1612f8-3291-4556-b15a-1ee990e577d4', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:34:12.755023 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-847be9f6-e2af-4012-904b-54c7379cea29 tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (591d5b4d-3cd9-4828-bda4-f853c5596a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:34:12.759829 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-847be9f6-e2af-4012-904b-54c7379cea29 tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (591d5b4d-3cd9-4828-bda4-f853c5596a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:34:12.765138 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-847be9f6-e2af-4012-904b-54c7379cea29 tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (922fe8b0-d97a-44f3-93ca-e7e5cb15faec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:34:12.766470 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-847be9f6-e2af-4012-904b-54c7379cea29 tempest-GroupSnapshotsTest-1939666493 None] Volume eb1612f8-3291-4556-b15a-1ee990e577d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb1612f8-3291-4556-b15a-1ee990e577d4', 'volume_size': 1} Apr 30 21:34:12.766870 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-847be9f6-e2af-4012-904b-54c7379cea29 tempest-GroupSnapshotsTest-1939666493 None] creating volume 'volume-eb1612f8-3291-4556-b15a-1ee990e577d4' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:34:12.768144 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-847be9f6-e2af-4012-904b-54c7379cea29 tempest-GroupSnapshotsTest-1939666493 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:34:14.477119 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-847be9f6-e2af-4012-904b-54c7379cea29 tempest-GroupSnapshotsTest-1939666493 None] extra_specs: {} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:34:14.478449 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-847be9f6-e2af-4012-904b-54c7379cea29 tempest-GroupSnapshotsTest-1939666493 None] extra_specs: {} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:34:14.484610 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-847be9f6-e2af-4012-904b-54c7379cea29 tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (922fe8b0-d97a-44f3-93ca-e7e5cb15faec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb1612f8-3291-4556-b15a-1ee990e577d4', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:34:14.492180 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-847be9f6-e2af-4012-904b-54c7379cea29 tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3f53874-9dfd-4c22-8337-944308715466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:34:14.634062 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-847be9f6-e2af-4012-904b-54c7379cea29 tempest-GroupSnapshotsTest-1939666493 None] Volume volume-eb1612f8-3291-4556-b15a-1ee990e577d4 (eb1612f8-3291-4556-b15a-1ee990e577d4): created successfully Apr 30 21:34:14.641424 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-847be9f6-e2af-4012-904b-54c7379cea29 tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3f53874-9dfd-4c22-8337-944308715466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:34:14.661566 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-847be9f6-e2af-4012-904b-54c7379cea29 tempest-GroupSnapshotsTest-1939666493 None] Flow 'volume_create_manager' (94d206a5-8217-46a7-9f68-23fa5877abdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:34:14.793433 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-847be9f6-e2af-4012-904b-54c7379cea29 tempest-GroupSnapshotsTest-1939666493 None] Created volume successfully. Apr 30 21:34:16.306322 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-33e5abef-a138-4d3a-8ee8-27155f1d4aca tempest-GroupSnapshotsTest-1939666493 None] GroupSnapshot e864caff-1ce4-4944-aafd-105baf65959b: creating. Apr 30 21:34:16.380633 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-33e5abef-a138-4d3a-8ee8-27155f1d4aca tempest-GroupSnapshotsTest-1939666493 None] Group snapshot e864caff-1ce4-4944-aafd-105baf65959b: creating. {{(pid=123855) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} Apr 30 21:34:16.406839 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-33e5abef-a138-4d3a-8ee8-27155f1d4aca tempest-GroupSnapshotsTest-1939666493 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:34:21.394049 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-33e5abef-a138-4d3a-8ee8-27155f1d4aca tempest-GroupSnapshotsTest-1939666493 None] group_snapshot e864caff-1ce4-4944-aafd-105baf65959b: created successfully Apr 30 21:34:22.917559 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-4bb69430-9399-4796-ab55-87278c8082fb tempest-GroupSnapshotsTest-1939666493 None] cloning volumes/volume-eb1612f8-3291-4556-b15a-1ee990e577d4@snapshot-a00dd0a1-6d2e-41b6-8662-5a8e14ce11b2 to volume-8308d20f-651d-44b8-aeb5-c8cdbfcfd013 {{(pid=123855) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1091}} Apr 30 21:34:22.918289 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-4bb69430-9399-4796-ab55-87278c8082fb tempest-GroupSnapshotsTest-1939666493 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:34:23.915819 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-4bb69430-9399-4796-ab55-87278c8082fb tempest-GroupSnapshotsTest-1939666493 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:34:28.485495 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-4bb69430-9399-4796-ab55-87278c8082fb tempest-GroupSnapshotsTest-1939666493 None] extra_specs: {} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:34:28.486687 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-4bb69430-9399-4796-ab55-87278c8082fb tempest-GroupSnapshotsTest-1939666493 None] extra_specs: {} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:34:28.494973 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-4bb69430-9399-4796-ab55-87278c8082fb tempest-GroupSnapshotsTest-1939666493 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:34:28.765697 ncdv-master-1 cinder-volume[123855]: WARNING cinder.volume.drivers.rbd [None req-4bb69430-9399-4796-ab55-87278c8082fb tempest-GroupSnapshotsTest-1939666493 None] Not using v2 clone API, please upgrade to mimic+ and set the OSD minimum client compat version to mimic for better performance, fewer deletion issues: NotImplementedError Apr 30 21:34:28.954717 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:34:28.955503 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:34:29.038091 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:34:29.101500 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:34:29.340330 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-4bb69430-9399-4796-ab55-87278c8082fb tempest-GroupSnapshotsTest-1939666493 None] Create group from source-snapshot-e864caff-1ce4-4944-aafd-105baf65959b completed successfully. Apr 30 21:34:30.667056 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-83655197-7597-4b10-9c40-b4eb57ba284c tempest-GroupSnapshotsTest-1939666493 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:34:31.518143 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-83655197-7597-4b10-9c40-b4eb57ba284c tempest-GroupSnapshotsTest-1939666493 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:34:31.838528 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-83655197-7597-4b10-9c40-b4eb57ba284c tempest-GroupSnapshotsTest-1939666493 None] deleting rbd volume volume-8308d20f-651d-44b8-aeb5-c8cdbfcfd013 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:34:38.970389 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-746b9efe-c372-4808-bfe3-4355d0701bd9 req-fae496a3-1e26-4888-b15b-6a3e153a721b tempest-ServerRescueNegativeTestJSON-1665530689 None] Terminate volume connection completed successfully. Apr 30 21:34:38.972331 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-746b9efe-c372-4808-bfe3-4355d0701bd9 req-fae496a3-1e26-4888-b15b-6a3e153a721b tempest-ServerRescueNegativeTestJSON-1665530689 None] Deleting attachment 440a7cdf-949b-471d-b70b-2dff6bf78f78. {{(pid=123855) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} Apr 30 21:34:43.197027 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-83655197-7597-4b10-9c40-b4eb57ba284c tempest-GroupSnapshotsTest-1939666493 None] Created reservations ['be033941-345c-476b-a247-e2e8b29e73df'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:34:43.235329 ncdv-master-1 cinder-volume[123855]: WARNING cinder.quota [None req-83655197-7597-4b10-9c40-b4eb57ba284c tempest-GroupSnapshotsTest-1939666493 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-782476534 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-782476534, it is now deprecated. Please use the default quota class for default quota. Apr 30 21:34:43.237004 ncdv-master-1 cinder-volume[123855]: WARNING cinder.quota [None req-83655197-7597-4b10-9c40-b4eb57ba284c tempest-GroupSnapshotsTest-1939666493 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-782476534 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-782476534, it is now deprecated. Please use the default quota class for default quota. Apr 30 21:34:43.409651 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-83655197-7597-4b10-9c40-b4eb57ba284c tempest-GroupSnapshotsTest-1939666493 None] Created reservations ['8a1f4893-6a6f-458b-b828-dd7a25860b1b', '993d13fd-a916-47c5-aa71-e7e3fd6ec1e4', 'e09c069b-04f0-42be-908f-134cf296d797', '51cf5a9d-4e25-4460-ad55-d3ff17e4ae0a'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:34:43.886001 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-83655197-7597-4b10-9c40-b4eb57ba284c tempest-GroupSnapshotsTest-1939666493 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:34:44.063444 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-83655197-7597-4b10-9c40-b4eb57ba284c tempest-GroupSnapshotsTest-1939666493 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:34:44.250120 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-83655197-7597-4b10-9c40-b4eb57ba284c tempest-GroupSnapshotsTest-1939666493 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:34:44.254905 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-83655197-7597-4b10-9c40-b4eb57ba284c tempest-GroupSnapshotsTest-1939666493 None] Delete group completed successfully. Apr 30 21:34:44.409156 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-65391c1f-4e09-4482-bd2e-babd3b24646a tempest-GroupSnapshotsTest-1939666493 None] group_snapshot e864caff-1ce4-4944-aafd-105baf65959b: deleting Apr 30 21:34:44.431581 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-65391c1f-4e09-4482-bd2e-babd3b24646a tempest-GroupSnapshotsTest-1939666493 None] group_snapshot e864caff-1ce4-4944-aafd-105baf65959b: deleting {{(pid=123855) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} Apr 30 21:34:44.454804 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-65391c1f-4e09-4482-bd2e-babd3b24646a tempest-GroupSnapshotsTest-1939666493 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:34:49.337941 ncdv-master-1 cinder-volume[123855]: WARNING cinder.quota [None req-65391c1f-4e09-4482-bd2e-babd3b24646a tempest-GroupSnapshotsTest-1939666493 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-782476534 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-782476534, it is now deprecated. Please use the default quota class for default quota. Apr 30 21:34:49.488116 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-65391c1f-4e09-4482-bd2e-babd3b24646a tempest-GroupSnapshotsTest-1939666493 None] Created reservations ['84e62abd-b0a5-41d8-81a9-d321db799246', '58513911-eb81-4969-838d-b2ce962cf611', 'f15ad2af-1622-43b1-b805-c6669d911c63', '0860d129-c02f-4a10-9a77-52c2965c313a'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:34:49.955933 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-65391c1f-4e09-4482-bd2e-babd3b24646a tempest-GroupSnapshotsTest-1939666493 None] group_snapshot e864caff-1ce4-4944-aafd-105baf65959b: deleted successfully Apr 30 21:34:50.466916 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-4c8371dd-cd7d-4173-be96-8eafd6f4e1c8 tempest-GroupSnapshotsTest-1939666493 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:34:50.689209 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-4c8371dd-cd7d-4173-be96-8eafd6f4e1c8 tempest-GroupSnapshotsTest-1939666493 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:34:50.689823 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-4c8371dd-cd7d-4173-be96-8eafd6f4e1c8 tempest-GroupSnapshotsTest-1939666493 None] Volume volume-eb1612f8-3291-4556-b15a-1ee990e577d4 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:34:51.020089 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-4c8371dd-cd7d-4173-be96-8eafd6f4e1c8 tempest-GroupSnapshotsTest-1939666493 None] deleting rbd volume volume-eb1612f8-3291-4556-b15a-1ee990e577d4 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:34:51.047369 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-0cdbb5d7-495a-4c38-882d-3d75eaa85e03 tempest-ServerRescueNegativeTestJSON-1665530689 None] Lock "b'cinder-145fbe2b-80e0-425d-8ae1-fb6fd5400018-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:34:51.189271 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-0cdbb5d7-495a-4c38-882d-3d75eaa85e03 tempest-ServerRescueNegativeTestJSON-1665530689 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:34:51.420430 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-0cdbb5d7-495a-4c38-882d-3d75eaa85e03 tempest-ServerRescueNegativeTestJSON-1665530689 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:34:51.421080 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-0cdbb5d7-495a-4c38-882d-3d75eaa85e03 tempest-ServerRescueNegativeTestJSON-1665530689 None] Volume volume-145fbe2b-80e0-425d-8ae1-fb6fd5400018 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:34:51.672540 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-0cdbb5d7-495a-4c38-882d-3d75eaa85e03 tempest-ServerRescueNegativeTestJSON-1665530689 None] deleting rbd volume volume-145fbe2b-80e0-425d-8ae1-fb6fd5400018 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:34:52.307362 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-ec15904e-a98d-4e54-88e8-42dd3572bbcc tempest-VolumesBackupsTest-2062082737 None] Terminate volume connection completed successfully. Apr 30 21:34:52.334712 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-ec15904e-a98d-4e54-88e8-42dd3572bbcc tempest-VolumesBackupsTest-2062082737 None] Remove volume export completed successfully. Apr 30 21:34:54.290024 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-54dbf914-5635-41e9-b6d8-b6eb54e2df67 tempest-VolumesBackupsTest-2062082737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:34:54.310188 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-54dbf914-5635-41e9-b6d8-b6eb54e2df67 tempest-VolumesBackupsTest-2062082737 None] Flow 'volume_create_manager' (ee4a5ead-fe47-4c15-b544-1395bcb678db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:34:54.317437 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-54dbf914-5635-41e9-b6d8-b6eb54e2df67 tempest-VolumesBackupsTest-2062082737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (265679d6-9a16-4094-8b38-d6704ae743da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:34:54.358639 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-54dbf914-5635-41e9-b6d8-b6eb54e2df67 tempest-VolumesBackupsTest-2062082737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (265679d6-9a16-4094-8b38-d6704ae743da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:34:54Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_5db77d48-9011-4eba-911c-56a7d36278cf',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7f665430-43af-4d95-94d7-2f39dfbc7c9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='280a6ce7a084421bbd267c7ac5c907ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:34:54Z,use_quota=True,user_id='7757dd58d9db44f89d86bf2217719d09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:34:54.366955 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-54dbf914-5635-41e9-b6d8-b6eb54e2df67 tempest-VolumesBackupsTest-2062082737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88c9e487-028e-480a-aee9-e72ef6a7df7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:34:54.384505 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-54dbf914-5635-41e9-b6d8-b6eb54e2df67 tempest-VolumesBackupsTest-2062082737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88c9e487-028e-480a-aee9-e72ef6a7df7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:34:54.392856 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-54dbf914-5635-41e9-b6d8-b6eb54e2df67 tempest-VolumesBackupsTest-2062082737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e03dfd38-9f7f-4fa1-bd5a-2d139db0f2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:34:54.399894 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-54dbf914-5635-41e9-b6d8-b6eb54e2df67 tempest-VolumesBackupsTest-2062082737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e03dfd38-9f7f-4fa1-bd5a-2d139db0f2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f665430-43af-4d95-94d7-2f39dfbc7c9b', 'volume_name': 'volume-7f665430-43af-4d95-94d7-2f39dfbc7c9b', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:34:54.404400 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-54dbf914-5635-41e9-b6d8-b6eb54e2df67 tempest-VolumesBackupsTest-2062082737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a50b9da9-643e-4142-bda1-c6730f21936b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:34:54.409522 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-54dbf914-5635-41e9-b6d8-b6eb54e2df67 tempest-VolumesBackupsTest-2062082737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a50b9da9-643e-4142-bda1-c6730f21936b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:34:54.416309 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-54dbf914-5635-41e9-b6d8-b6eb54e2df67 tempest-VolumesBackupsTest-2062082737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88c31c6a-e16f-4b34-94ad-77de53a6d0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:34:54.417921 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-54dbf914-5635-41e9-b6d8-b6eb54e2df67 tempest-VolumesBackupsTest-2062082737 None] Volume 7f665430-43af-4d95-94d7-2f39dfbc7c9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f665430-43af-4d95-94d7-2f39dfbc7c9b', 'volume_size': 1} Apr 30 21:34:54.418533 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-54dbf914-5635-41e9-b6d8-b6eb54e2df67 tempest-VolumesBackupsTest-2062082737 None] creating volume 'volume-7f665430-43af-4d95-94d7-2f39dfbc7c9b' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:34:54.419588 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-54dbf914-5635-41e9-b6d8-b6eb54e2df67 tempest-VolumesBackupsTest-2062082737 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:34:55.460700 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-54dbf914-5635-41e9-b6d8-b6eb54e2df67 tempest-VolumesBackupsTest-2062082737 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:34:55.460700 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-54dbf914-5635-41e9-b6d8-b6eb54e2df67 tempest-VolumesBackupsTest-2062082737 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:34:55.465159 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-54dbf914-5635-41e9-b6d8-b6eb54e2df67 tempest-VolumesBackupsTest-2062082737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88c31c6a-e16f-4b34-94ad-77de53a6d0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f665430-43af-4d95-94d7-2f39dfbc7c9b', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:34:55.470981 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-54dbf914-5635-41e9-b6d8-b6eb54e2df67 tempest-VolumesBackupsTest-2062082737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c505cfe1-92d3-4daa-a686-a89d823d60ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:34:55.541190 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-54dbf914-5635-41e9-b6d8-b6eb54e2df67 tempest-VolumesBackupsTest-2062082737 None] Volume volume-7f665430-43af-4d95-94d7-2f39dfbc7c9b (7f665430-43af-4d95-94d7-2f39dfbc7c9b): created successfully Apr 30 21:34:55.546949 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-54dbf914-5635-41e9-b6d8-b6eb54e2df67 tempest-VolumesBackupsTest-2062082737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c505cfe1-92d3-4daa-a686-a89d823d60ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:34:55.552225 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-54dbf914-5635-41e9-b6d8-b6eb54e2df67 tempest-VolumesBackupsTest-2062082737 None] Flow 'volume_create_manager' (ee4a5ead-fe47-4c15-b544-1395bcb678db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:34:55.643125 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-54dbf914-5635-41e9-b6d8-b6eb54e2df67 tempest-VolumesBackupsTest-2062082737 None] Created volume successfully. Apr 30 21:34:56.450103 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [None req-54dbf914-5635-41e9-b6d8-b6eb54e2df67 tempest-VolumesBackupsTest-2062082737 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:34:57.338097 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [None req-54dbf914-5635-41e9-b6d8-b6eb54e2df67 tempest-VolumesBackupsTest-2062082737 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.888s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:34:57.339678 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-54dbf914-5635-41e9-b6d8-b6eb54e2df67 tempest-VolumesBackupsTest-2062082737 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7f665430-43af-4d95-94d7-2f39dfbc7c9b', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': '7f665430-43af-4d95-94d7-2f39dfbc7c9b', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:34:57.388832 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-54dbf914-5635-41e9-b6d8-b6eb54e2df67 tempest-VolumesBackupsTest-2062082737 None] Initialize volume connection completed successfully. Apr 30 21:34:59.086122 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-0cdbb5d7-495a-4c38-882d-3d75eaa85e03 tempest-ServerRescueNegativeTestJSON-1665530689 None] Created reservations ['6e95d0e5-581c-47be-b1a1-fd41a074aee4', '29ac175b-4527-4cce-acbe-ad383703ec95', 'f546766b-6878-4fbb-862b-ed0bafea14ea', 'c4a36f9e-4d46-42d0-b3c2-319e06b3c785'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:34:59.169486 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-4c8371dd-cd7d-4173-be96-8eafd6f4e1c8 tempest-GroupSnapshotsTest-1939666493 None] Created reservations ['7f9f6260-c73b-46b2-bdeb-d056b709d557'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:34:59.227867 ncdv-master-1 cinder-volume[123855]: WARNING cinder.db.sqlalchemy.api [None req-4c8371dd-cd7d-4173-be96-8eafd6f4e1c8 tempest-GroupSnapshotsTest-1939666493 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-782476534'] Apr 30 21:34:59.383595 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-4c8371dd-cd7d-4173-be96-8eafd6f4e1c8 tempest-GroupSnapshotsTest-1939666493 None] Created reservations ['a79c0f20-bfe6-4e1c-9b8e-18c5ef384723', '7813ae16-9536-46d4-9b46-3bab808ad811', '3f8a980f-7a64-46db-b404-7033e1f9f7f8', 'dfd4ccff-032f-49c6-a15c-5721b75da12f'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:34:59.393412 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-0cdbb5d7-495a-4c38-882d-3d75eaa85e03 tempest-ServerRescueNegativeTestJSON-1665530689 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:34:59.471202 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-0cdbb5d7-495a-4c38-882d-3d75eaa85e03 tempest-ServerRescueNegativeTestJSON-1665530689 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:34:59.556567 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-0cdbb5d7-495a-4c38-882d-3d75eaa85e03 tempest-ServerRescueNegativeTestJSON-1665530689 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:34:59.566569 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-0cdbb5d7-495a-4c38-882d-3d75eaa85e03 tempest-ServerRescueNegativeTestJSON-1665530689 None] Deleted volume successfully. Apr 30 21:34:59.666678 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-0cdbb5d7-495a-4c38-882d-3d75eaa85e03 tempest-ServerRescueNegativeTestJSON-1665530689 None] Lock "b'cinder-145fbe2b-80e0-425d-8ae1-fb6fd5400018-delete_volume'" released by "delete_volume" :: held 8.620s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:34:59.981876 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-1a6b5da4-7381-4b8b-8051-fc0f4e5522cb tempest-ServerRescueNegativeTestJSON-1665530689 None] Lock "b'cinder-a3025c91-4710-444f-a17e-e4de84b6c2f1-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:35:00.096795 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-4c8371dd-cd7d-4173-be96-8eafd6f4e1c8 tempest-GroupSnapshotsTest-1939666493 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:35:00.156558 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-4c8371dd-cd7d-4173-be96-8eafd6f4e1c8 tempest-GroupSnapshotsTest-1939666493 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:35:00.203316 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-4c8371dd-cd7d-4173-be96-8eafd6f4e1c8 tempest-GroupSnapshotsTest-1939666493 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:35:00.208175 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-4c8371dd-cd7d-4173-be96-8eafd6f4e1c8 tempest-GroupSnapshotsTest-1939666493 None] Delete group completed successfully. Apr 30 21:35:00.229855 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-1a6b5da4-7381-4b8b-8051-fc0f4e5522cb tempest-ServerRescueNegativeTestJSON-1665530689 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:35:01.466756 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-1a6b5da4-7381-4b8b-8051-fc0f4e5522cb tempest-ServerRescueNegativeTestJSON-1665530689 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:35:01.467439 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-1a6b5da4-7381-4b8b-8051-fc0f4e5522cb tempest-ServerRescueNegativeTestJSON-1665530689 None] Volume volume-a3025c91-4710-444f-a17e-e4de84b6c2f1 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:35:01.829062 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-1a6b5da4-7381-4b8b-8051-fc0f4e5522cb tempest-ServerRescueNegativeTestJSON-1665530689 None] deleting rbd volume volume-a3025c91-4710-444f-a17e-e4de84b6c2f1 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:35:01.849695 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-229deebe-7423-4fba-9778-be72fd424443 tempest-GroupSnapshotsTest-1939666493 None] Group tempest-GroupSnapshotsTest-Group-573312998: creating Apr 30 21:35:01.923802 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-229deebe-7423-4fba-9778-be72fd424443 tempest-GroupSnapshotsTest-1939666493 None] Group tempest-GroupSnapshotsTest-Group-573312998: created successfully Apr 30 21:35:01.936861 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-229deebe-7423-4fba-9778-be72fd424443 tempest-GroupSnapshotsTest-1939666493 None] Create group completed successfully. Apr 30 21:35:03.703566 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-08404b45-7426-4b61-a5c6-700b006ca6d1 tempest-GroupSnapshotsTest-1939666493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:35:03.726821 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-08404b45-7426-4b61-a5c6-700b006ca6d1 tempest-GroupSnapshotsTest-1939666493 None] Flow 'volume_create_manager' (d3133628-3389-4e60-a94f-eeb94119cd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:35:03.735497 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-08404b45-7426-4b61-a5c6-700b006ca6d1 tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a32ff34-19d3-4fd7-be56-66d181440464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:35:03.755566 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-08404b45-7426-4b61-a5c6-700b006ca6d1 tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a32ff34-19d3-4fd7-be56-66d181440464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1328514933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=84b45732-3644-4a76-ac21-d1d4dd33a169,host='ncdv-master-1@ceph#ceph',id=d0c77025-9289-407b-a5fc-6b84af21ccd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e755f57c175e43d7b08df778af0e3b04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:35:03Z,use_quota=True,user_id='7195793f260a45659c4c2ca5feb83928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c862985-5177-450c-b590-8454b9c0599e),volume_type_id=1c862985-5177-450c-b590-8454b9c0599e)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:35:03.762134 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-08404b45-7426-4b61-a5c6-700b006ca6d1 tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5d3fc7b-3a71-4f0a-a611-1dc00b17f377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:35:03.766235 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-08404b45-7426-4b61-a5c6-700b006ca6d1 tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5d3fc7b-3a71-4f0a-a611-1dc00b17f377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:35:03.772059 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-08404b45-7426-4b61-a5c6-700b006ca6d1 tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d61163f-e851-4882-a949-8b71f2cf31f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:35:03.776190 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-08404b45-7426-4b61-a5c6-700b006ca6d1 tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d61163f-e851-4882-a949-8b71f2cf31f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0c77025-9289-407b-a5fc-6b84af21ccd8', 'volume_name': 'volume-d0c77025-9289-407b-a5fc-6b84af21ccd8', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:35:03.781490 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-08404b45-7426-4b61-a5c6-700b006ca6d1 tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ae60cd4-f541-4dca-9a05-dbfe520b2338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:35:03.786003 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-08404b45-7426-4b61-a5c6-700b006ca6d1 tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ae60cd4-f541-4dca-9a05-dbfe520b2338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:35:03.791926 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-08404b45-7426-4b61-a5c6-700b006ca6d1 tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bad04533-e45a-44fb-9c2b-4a59a9ab74d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:35:03.793338 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-08404b45-7426-4b61-a5c6-700b006ca6d1 tempest-GroupSnapshotsTest-1939666493 None] Volume d0c77025-9289-407b-a5fc-6b84af21ccd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0c77025-9289-407b-a5fc-6b84af21ccd8', 'volume_size': 1} Apr 30 21:35:03.793747 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-08404b45-7426-4b61-a5c6-700b006ca6d1 tempest-GroupSnapshotsTest-1939666493 None] creating volume 'volume-d0c77025-9289-407b-a5fc-6b84af21ccd8' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:35:03.794573 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-08404b45-7426-4b61-a5c6-700b006ca6d1 tempest-GroupSnapshotsTest-1939666493 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:35:05.653825 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-08404b45-7426-4b61-a5c6-700b006ca6d1 tempest-GroupSnapshotsTest-1939666493 None] extra_specs: {} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:35:05.658089 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-08404b45-7426-4b61-a5c6-700b006ca6d1 tempest-GroupSnapshotsTest-1939666493 None] extra_specs: {} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:35:05.665283 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-08404b45-7426-4b61-a5c6-700b006ca6d1 tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bad04533-e45a-44fb-9c2b-4a59a9ab74d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0c77025-9289-407b-a5fc-6b84af21ccd8', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:35:05.671054 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-08404b45-7426-4b61-a5c6-700b006ca6d1 tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63482a2c-b357-4346-8066-164081cea21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:35:05.745601 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-08404b45-7426-4b61-a5c6-700b006ca6d1 tempest-GroupSnapshotsTest-1939666493 None] Volume volume-d0c77025-9289-407b-a5fc-6b84af21ccd8 (d0c77025-9289-407b-a5fc-6b84af21ccd8): created successfully Apr 30 21:35:05.749657 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-08404b45-7426-4b61-a5c6-700b006ca6d1 tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63482a2c-b357-4346-8066-164081cea21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:35:05.758210 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-08404b45-7426-4b61-a5c6-700b006ca6d1 tempest-GroupSnapshotsTest-1939666493 None] Flow 'volume_create_manager' (d3133628-3389-4e60-a94f-eeb94119cd9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:35:05.836182 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-08404b45-7426-4b61-a5c6-700b006ca6d1 tempest-GroupSnapshotsTest-1939666493 None] Created volume successfully. Apr 30 21:35:07.982084 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a0bedff-25ae-4ecb-9868-899fae69f488 tempest-GroupSnapshotsTest-1939666493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:35:08.025924 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-2a0bedff-25ae-4ecb-9868-899fae69f488 tempest-GroupSnapshotsTest-1939666493 None] Flow 'volume_create_manager' (cdac37e1-1ca7-45aa-8b18-a3e918078f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:35:08.033700 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-2a0bedff-25ae-4ecb-9868-899fae69f488 tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8164262e-ff18-4933-af70-e2202684d22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:35:08.049916 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-2a0bedff-25ae-4ecb-9868-899fae69f488 tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8164262e-ff18-4933-af70-e2202684d22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-789520740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=84b45732-3644-4a76-ac21-d1d4dd33a169,host='ncdv-master-1@ceph#ceph',id=1d7c9b7c-0af3-4be5-9e9d-72dc7bf856f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e755f57c175e43d7b08df778af0e3b04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:35:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:35:08Z,use_quota=True,user_id='7195793f260a45659c4c2ca5feb83928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c862985-5177-450c-b590-8454b9c0599e),volume_type_id=1c862985-5177-450c-b590-8454b9c0599e)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:35:08.056406 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-2a0bedff-25ae-4ecb-9868-899fae69f488 tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03e1e13d-ebc6-4258-8559-9fb0e7109199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:35:08.061335 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-2a0bedff-25ae-4ecb-9868-899fae69f488 tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03e1e13d-ebc6-4258-8559-9fb0e7109199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:35:08.067317 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-2a0bedff-25ae-4ecb-9868-899fae69f488 tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d41f70a0-8211-434a-a86a-cf637e8a0630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:35:08.072456 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-2a0bedff-25ae-4ecb-9868-899fae69f488 tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d41f70a0-8211-434a-a86a-cf637e8a0630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d7c9b7c-0af3-4be5-9e9d-72dc7bf856f8', 'volume_name': 'volume-1d7c9b7c-0af3-4be5-9e9d-72dc7bf856f8', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:35:08.079223 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-2a0bedff-25ae-4ecb-9868-899fae69f488 tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b07154dc-de13-4f8d-b410-172fb71d2c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:35:08.083508 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-2a0bedff-25ae-4ecb-9868-899fae69f488 tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b07154dc-de13-4f8d-b410-172fb71d2c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:35:08.088615 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-2a0bedff-25ae-4ecb-9868-899fae69f488 tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (747a67d1-1890-49a5-a37d-f10ec2f5a981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:35:08.089885 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-2a0bedff-25ae-4ecb-9868-899fae69f488 tempest-GroupSnapshotsTest-1939666493 None] Volume 1d7c9b7c-0af3-4be5-9e9d-72dc7bf856f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d7c9b7c-0af3-4be5-9e9d-72dc7bf856f8', 'volume_size': 1} Apr 30 21:35:08.090929 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-2a0bedff-25ae-4ecb-9868-899fae69f488 tempest-GroupSnapshotsTest-1939666493 None] creating volume 'volume-1d7c9b7c-0af3-4be5-9e9d-72dc7bf856f8' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:35:08.091606 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-2a0bedff-25ae-4ecb-9868-899fae69f488 tempest-GroupSnapshotsTest-1939666493 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:35:09.670213 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-2a0bedff-25ae-4ecb-9868-899fae69f488 tempest-GroupSnapshotsTest-1939666493 None] extra_specs: {} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:35:09.670213 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-2a0bedff-25ae-4ecb-9868-899fae69f488 tempest-GroupSnapshotsTest-1939666493 None] extra_specs: {} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:35:09.674259 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-2a0bedff-25ae-4ecb-9868-899fae69f488 tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (747a67d1-1890-49a5-a37d-f10ec2f5a981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d7c9b7c-0af3-4be5-9e9d-72dc7bf856f8', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:35:09.678976 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-2a0bedff-25ae-4ecb-9868-899fae69f488 tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c5d2ac-7881-437e-8c4c-7d0cecb029f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:35:09.773793 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-2a0bedff-25ae-4ecb-9868-899fae69f488 tempest-GroupSnapshotsTest-1939666493 None] Volume volume-1d7c9b7c-0af3-4be5-9e9d-72dc7bf856f8 (1d7c9b7c-0af3-4be5-9e9d-72dc7bf856f8): created successfully Apr 30 21:35:09.779008 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-2a0bedff-25ae-4ecb-9868-899fae69f488 tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c5d2ac-7881-437e-8c4c-7d0cecb029f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:35:09.785744 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-2a0bedff-25ae-4ecb-9868-899fae69f488 tempest-GroupSnapshotsTest-1939666493 None] Flow 'volume_create_manager' (cdac37e1-1ca7-45aa-8b18-a3e918078f2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:35:09.873986 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-2a0bedff-25ae-4ecb-9868-899fae69f488 tempest-GroupSnapshotsTest-1939666493 None] Created volume successfully. Apr 30 21:35:10.476526 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-a7586119-5543-4c8c-b1fb-e14dd780302a tempest-GroupSnapshotsTest-1939666493 None] Update group completed successfully. Apr 30 21:35:11.796850 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-cbf161a7-d2ac-465f-8728-fdd4ad0808b5 tempest-GroupSnapshotsTest-1939666493 None] Update group completed successfully. Apr 30 21:35:12.785313 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-1a6b5da4-7381-4b8b-8051-fc0f4e5522cb tempest-ServerRescueNegativeTestJSON-1665530689 None] Created reservations ['02fc2bc1-ef87-4022-9cac-745438303070', 'f62d6ca3-e3c1-4574-9c11-dbe12e5bc4c2', '90f468f9-4710-4ac3-ae49-4c4c9d14a2c5', 'fe6f2169-3355-45d9-87ab-882d2d6856e9'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:35:13.073470 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-022deace-7965-4469-b9ea-9c6a39fff3e7 tempest-GroupSnapshotsTest-1939666493 None] Update group completed successfully. Apr 30 21:35:13.158588 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-1a6b5da4-7381-4b8b-8051-fc0f4e5522cb tempest-ServerRescueNegativeTestJSON-1665530689 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:35:13.244124 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-1a6b5da4-7381-4b8b-8051-fc0f4e5522cb tempest-ServerRescueNegativeTestJSON-1665530689 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:35:13.344945 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-1a6b5da4-7381-4b8b-8051-fc0f4e5522cb tempest-ServerRescueNegativeTestJSON-1665530689 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:35:13.373680 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-1a6b5da4-7381-4b8b-8051-fc0f4e5522cb tempest-ServerRescueNegativeTestJSON-1665530689 None] Deleted volume successfully. Apr 30 21:35:13.514477 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-1a6b5da4-7381-4b8b-8051-fc0f4e5522cb tempest-ServerRescueNegativeTestJSON-1665530689 None] Lock "b'cinder-a3025c91-4710-444f-a17e-e4de84b6c2f1-delete_volume'" released by "delete_volume" :: held 13.531s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:35:14.237037 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-2155ba4b-452d-4040-861f-9e9b3f5c5b82 tempest-GroupSnapshotsTest-1939666493 None] Update group completed successfully. Apr 30 21:35:16.147219 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-8e3ca2b0-b66f-4a25-b4c3-1cee92b134a7 tempest-GroupSnapshotsTest-1939666493 None] GroupSnapshot 9f8930b4-6954-4c34-b641-b34e2a7356d0: creating. Apr 30 21:35:16.199739 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8e3ca2b0-b66f-4a25-b4c3-1cee92b134a7 tempest-GroupSnapshotsTest-1939666493 None] Group snapshot 9f8930b4-6954-4c34-b641-b34e2a7356d0: creating. {{(pid=123855) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} Apr 30 21:35:16.231105 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8e3ca2b0-b66f-4a25-b4c3-1cee92b134a7 tempest-GroupSnapshotsTest-1939666493 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:35:22.155233 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8e3ca2b0-b66f-4a25-b4c3-1cee92b134a7 tempest-GroupSnapshotsTest-1939666493 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:35:28.081440 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-8e3ca2b0-b66f-4a25-b4c3-1cee92b134a7 tempest-GroupSnapshotsTest-1939666493 None] group_snapshot 9f8930b4-6954-4c34-b641-b34e2a7356d0: created successfully Apr 30 21:35:28.954335 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:35:28.955052 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:35:29.042964 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:35:29.104065 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:35:29.339247 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-58d29af5-5e54-40ad-a1a5-090e3db10ce4 tempest-GroupSnapshotsTest-1939666493 None] group_snapshot 9f8930b4-6954-4c34-b641-b34e2a7356d0: deleting Apr 30 21:35:29.379134 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-58d29af5-5e54-40ad-a1a5-090e3db10ce4 tempest-GroupSnapshotsTest-1939666493 None] group_snapshot 9f8930b4-6954-4c34-b641-b34e2a7356d0: deleting {{(pid=123855) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} Apr 30 21:35:29.428022 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-58d29af5-5e54-40ad-a1a5-090e3db10ce4 tempest-GroupSnapshotsTest-1939666493 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:35:34.998036 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-58d29af5-5e54-40ad-a1a5-090e3db10ce4 tempest-GroupSnapshotsTest-1939666493 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:35:39.918195 ncdv-master-1 cinder-volume[123855]: WARNING cinder.quota [None req-58d29af5-5e54-40ad-a1a5-090e3db10ce4 tempest-GroupSnapshotsTest-1939666493 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1008116467 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1008116467, it is now deprecated. Please use the default quota class for default quota. Apr 30 21:35:39.918986 ncdv-master-1 cinder-volume[123855]: WARNING cinder.quota [None req-58d29af5-5e54-40ad-a1a5-090e3db10ce4 tempest-GroupSnapshotsTest-1939666493 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1008116467 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1008116467, it is now deprecated. Please use the default quota class for default quota. Apr 30 21:35:40.075903 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-58d29af5-5e54-40ad-a1a5-090e3db10ce4 tempest-GroupSnapshotsTest-1939666493 None] Created reservations ['94f1ba1b-25e8-49fe-befa-b1d4358bf01f', '182b9880-cf7c-4740-9a53-e65360675049', 'c51f5e91-a258-486c-9674-b9bced056d4f', '5cb3e6c5-92c3-445c-9cac-4a28dd6fdaa8'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:35:40.512755 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-58d29af5-5e54-40ad-a1a5-090e3db10ce4 tempest-GroupSnapshotsTest-1939666493 None] Created reservations ['bb7d1fc2-c4a9-40d8-b1e4-d504f7e76402', 'c4bf5db7-b2f3-4977-bcd0-607306904e78', 'e0a984f1-46aa-4ded-8bc3-ff7735f14b65', '1ac9014d-0ddd-47be-bcea-280baa291599'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:35:40.792366 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-58d29af5-5e54-40ad-a1a5-090e3db10ce4 tempest-GroupSnapshotsTest-1939666493 None] group_snapshot 9f8930b4-6954-4c34-b641-b34e2a7356d0: deleted successfully Apr 30 21:35:41.977919 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-979b1acd-ef1e-432e-99e0-6a9ac11f057d tempest-GroupSnapshotsTest-1939666493 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:35:43.027833 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-979b1acd-ef1e-432e-99e0-6a9ac11f057d tempest-GroupSnapshotsTest-1939666493 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:35:43.027833 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-979b1acd-ef1e-432e-99e0-6a9ac11f057d tempest-GroupSnapshotsTest-1939666493 None] Volume volume-1d7c9b7c-0af3-4be5-9e9d-72dc7bf856f8 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:35:43.151717 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-979b1acd-ef1e-432e-99e0-6a9ac11f057d tempest-GroupSnapshotsTest-1939666493 None] deleting rbd volume volume-1d7c9b7c-0af3-4be5-9e9d-72dc7bf856f8 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:35:47.709952 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-54dbf914-5635-41e9-b6d8-b6eb54e2df67 tempest-VolumesBackupsTest-2062082737 None] Terminate volume connection completed successfully. Apr 30 21:35:47.728185 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-54dbf914-5635-41e9-b6d8-b6eb54e2df67 tempest-VolumesBackupsTest-2062082737 None] Remove volume export completed successfully. Apr 30 21:35:47.799820 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-979b1acd-ef1e-432e-99e0-6a9ac11f057d tempest-GroupSnapshotsTest-1939666493 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:35:48.019332 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-979b1acd-ef1e-432e-99e0-6a9ac11f057d tempest-GroupSnapshotsTest-1939666493 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:35:48.020176 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-979b1acd-ef1e-432e-99e0-6a9ac11f057d tempest-GroupSnapshotsTest-1939666493 None] Volume volume-d0c77025-9289-407b-a5fc-6b84af21ccd8 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:35:48.219109 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-979b1acd-ef1e-432e-99e0-6a9ac11f057d tempest-GroupSnapshotsTest-1939666493 None] deleting rbd volume volume-d0c77025-9289-407b-a5fc-6b84af21ccd8 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:35:49.203233 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-bf8620f3-4c97-4f11-87a8-36478943ef25 tempest-VolumesBackupsTest-2062082737 None] Lock "b'cinder-7f665430-43af-4d95-94d7-2f39dfbc7c9b-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:35:49.344696 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bf8620f3-4c97-4f11-87a8-36478943ef25 tempest-VolumesBackupsTest-2062082737 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:35:52.054538 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bf8620f3-4c97-4f11-87a8-36478943ef25 tempest-VolumesBackupsTest-2062082737 None] Volume volume-7f665430-43af-4d95-94d7-2f39dfbc7c9b is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:35:52.893296 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bf8620f3-4c97-4f11-87a8-36478943ef25 tempest-VolumesBackupsTest-2062082737 None] deleting rbd volume volume-7f665430-43af-4d95-94d7-2f39dfbc7c9b {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:35:52.912864 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-1feb5473-e66c-4849-afad-52e5c33bd6bc tempest-GroupsTest-951278808 None] Group tempest-Group1-328150397: creating Apr 30 21:35:53.006763 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-1feb5473-e66c-4849-afad-52e5c33bd6bc tempest-GroupsTest-951278808 None] Group tempest-Group1-328150397: created successfully Apr 30 21:35:53.015960 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-1feb5473-e66c-4849-afad-52e5c33bd6bc tempest-GroupsTest-951278808 None] Create group completed successfully. Apr 30 21:35:54.730510 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-81ca865a-3e35-4066-90d9-8310494e8040 tempest-GroupsTest-951278808 None] Group tempest-Group2-1839254918: creating Apr 30 21:35:54.852937 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-979b1acd-ef1e-432e-99e0-6a9ac11f057d tempest-GroupSnapshotsTest-1939666493 None] Created reservations ['4d4155e1-97f1-4e6e-a810-5ba29f54971a'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:35:54.872091 ncdv-master-1 cinder-volume[123855]: WARNING cinder.quota [None req-979b1acd-ef1e-432e-99e0-6a9ac11f057d tempest-GroupSnapshotsTest-1939666493 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1008116467 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1008116467, it is now deprecated. Please use the default quota class for default quota. Apr 30 21:35:54.888062 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-81ca865a-3e35-4066-90d9-8310494e8040 tempest-GroupsTest-951278808 None] Group tempest-Group2-1839254918: created successfully Apr 30 21:35:54.897958 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-81ca865a-3e35-4066-90d9-8310494e8040 tempest-GroupsTest-951278808 None] Create group completed successfully. Apr 30 21:35:54.978768 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-979b1acd-ef1e-432e-99e0-6a9ac11f057d tempest-GroupSnapshotsTest-1939666493 None] Created reservations ['64135b25-25c0-44f0-b7e0-b38c460dc6c6', '2adf6947-7687-4aed-9d8e-35eb6bb71cf9', 'a608a54f-be53-4960-83ff-9937458eeede', 'dcc391e8-5a0c-475e-a0b2-a5961db9903e'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:35:55.344057 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-979b1acd-ef1e-432e-99e0-6a9ac11f057d tempest-GroupSnapshotsTest-1939666493 None] Created reservations ['e947a75d-96bc-4cb5-ace8-39dabb8b83ef', '16b310bc-2080-4061-9287-6613d17f6a2d', '25c828e2-fe2b-44f7-a829-33c026955637', '52affa38-d6d5-446e-a8f6-1bb6b9400b6b'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:35:55.768081 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-979b1acd-ef1e-432e-99e0-6a9ac11f057d tempest-GroupSnapshotsTest-1939666493 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:35:55.828926 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-979b1acd-ef1e-432e-99e0-6a9ac11f057d tempest-GroupSnapshotsTest-1939666493 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:35:55.881138 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-979b1acd-ef1e-432e-99e0-6a9ac11f057d tempest-GroupSnapshotsTest-1939666493 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:35:55.885517 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-979b1acd-ef1e-432e-99e0-6a9ac11f057d tempest-GroupSnapshotsTest-1939666493 None] Delete group completed successfully. Apr 30 21:35:56.932115 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-a80f8ce1-6430-481a-a1c6-e68596067d9a tempest-GroupsTest-951278808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:35:56.982569 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a80f8ce1-6430-481a-a1c6-e68596067d9a tempest-GroupsTest-951278808 None] Flow 'volume_create_manager' (f1fcfc7d-9ceb-4dbd-8dd3-f1dfc595c00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:35:57.003351 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a80f8ce1-6430-481a-a1c6-e68596067d9a tempest-GroupsTest-951278808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aeac793-f74b-4c7b-ae00-575e38befec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:35:57.026301 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a80f8ce1-6430-481a-a1c6-e68596067d9a tempest-GroupsTest-951278808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aeac793-f74b-4c7b-ae00-575e38befec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1410428575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e93cd187-78e9-4a13-8df9-b78a2e612d8d,host='ncdv-master-1@ceph#ceph',id=aea47ce5-85ed-4fcc-b63e-cad45e6e3469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='228c9fcbe55946858e8c46db94e0f921',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:35:57Z,use_quota=True,user_id='5ee252de0fb74adda84ee09c01e84eeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d407a61-ee12-42a4-a43b-5c56fa08759b),volume_type_id=2d407a61-ee12-42a4-a43b-5c56fa08759b)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:35:57.032872 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a80f8ce1-6430-481a-a1c6-e68596067d9a tempest-GroupsTest-951278808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17731b0b-1afc-4db7-8f7e-bfa0f1dbc13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:35:57.037861 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a80f8ce1-6430-481a-a1c6-e68596067d9a tempest-GroupsTest-951278808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17731b0b-1afc-4db7-8f7e-bfa0f1dbc13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:35:57.044195 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a80f8ce1-6430-481a-a1c6-e68596067d9a tempest-GroupsTest-951278808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ab4de86-7017-49bd-8cfb-f7b45a2ead4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:35:57.048746 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a80f8ce1-6430-481a-a1c6-e68596067d9a tempest-GroupsTest-951278808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ab4de86-7017-49bd-8cfb-f7b45a2ead4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aea47ce5-85ed-4fcc-b63e-cad45e6e3469', 'volume_name': 'volume-aea47ce5-85ed-4fcc-b63e-cad45e6e3469', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:35:57.058630 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a80f8ce1-6430-481a-a1c6-e68596067d9a tempest-GroupsTest-951278808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5229d200-3ee4-4562-a33d-4282a7947769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:35:57.068943 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a80f8ce1-6430-481a-a1c6-e68596067d9a tempest-GroupsTest-951278808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5229d200-3ee4-4562-a33d-4282a7947769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:35:57.069824 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a80f8ce1-6430-481a-a1c6-e68596067d9a tempest-GroupsTest-951278808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc5bba74-87ab-4043-afdf-b35bf68d5846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:35:57.071476 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-a80f8ce1-6430-481a-a1c6-e68596067d9a tempest-GroupsTest-951278808 None] Volume aea47ce5-85ed-4fcc-b63e-cad45e6e3469: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aea47ce5-85ed-4fcc-b63e-cad45e6e3469', 'volume_size': 1} Apr 30 21:35:57.072065 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a80f8ce1-6430-481a-a1c6-e68596067d9a tempest-GroupsTest-951278808 None] creating volume 'volume-aea47ce5-85ed-4fcc-b63e-cad45e6e3469' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:35:57.073103 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a80f8ce1-6430-481a-a1c6-e68596067d9a tempest-GroupsTest-951278808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:35:57.554225 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-709c14f6-579a-4ddf-a6b2-25ccb5f490e0 tempest-GroupSnapshotsTest-1939666493 None] Group tempest-GroupSnapshotsTest-Group-712215116: creating Apr 30 21:35:57.633306 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-709c14f6-579a-4ddf-a6b2-25ccb5f490e0 tempest-GroupSnapshotsTest-1939666493 None] Group tempest-GroupSnapshotsTest-Group-712215116: created successfully Apr 30 21:35:57.648419 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-709c14f6-579a-4ddf-a6b2-25ccb5f490e0 tempest-GroupSnapshotsTest-1939666493 None] Create group completed successfully. Apr 30 21:35:58.137910 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a80f8ce1-6430-481a-a1c6-e68596067d9a tempest-GroupsTest-951278808 None] extra_specs: {} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:35:58.145934 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a80f8ce1-6430-481a-a1c6-e68596067d9a tempest-GroupsTest-951278808 None] extra_specs: {} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:35:58.145934 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a80f8ce1-6430-481a-a1c6-e68596067d9a tempest-GroupsTest-951278808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc5bba74-87ab-4043-afdf-b35bf68d5846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aea47ce5-85ed-4fcc-b63e-cad45e6e3469', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:35:58.150857 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a80f8ce1-6430-481a-a1c6-e68596067d9a tempest-GroupsTest-951278808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a95e223c-2f4d-46d2-ab78-fd8d684401b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:35:58.224601 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-a80f8ce1-6430-481a-a1c6-e68596067d9a tempest-GroupsTest-951278808 None] Volume volume-aea47ce5-85ed-4fcc-b63e-cad45e6e3469 (aea47ce5-85ed-4fcc-b63e-cad45e6e3469): created successfully Apr 30 21:35:58.228421 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a80f8ce1-6430-481a-a1c6-e68596067d9a tempest-GroupsTest-951278808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a95e223c-2f4d-46d2-ab78-fd8d684401b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:35:58.234757 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a80f8ce1-6430-481a-a1c6-e68596067d9a tempest-GroupsTest-951278808 None] Flow 'volume_create_manager' (f1fcfc7d-9ceb-4dbd-8dd3-f1dfc595c00d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:35:58.333709 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-a80f8ce1-6430-481a-a1c6-e68596067d9a tempest-GroupsTest-951278808 None] Created volume successfully. Apr 30 21:35:59.549190 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a20c71af-edc7-4486-be7a-5e8e46e8a113 tempest-GroupsTest-951278808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:35:59.855320 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a20c71af-edc7-4486-be7a-5e8e46e8a113 tempest-GroupsTest-951278808 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:35:59.855748 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a20c71af-edc7-4486-be7a-5e8e46e8a113 tempest-GroupsTest-951278808 None] Volume volume-aea47ce5-85ed-4fcc-b63e-cad45e6e3469 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:36:00.093181 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a20c71af-edc7-4486-be7a-5e8e46e8a113 tempest-GroupsTest-951278808 None] deleting rbd volume volume-aea47ce5-85ed-4fcc-b63e-cad45e6e3469 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:36:00.099565 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b134da8-6d8d-4446-a78e-5a3fb55db01f tempest-GroupSnapshotsTest-1939666493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:36:00.208001 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3b134da8-6d8d-4446-a78e-5a3fb55db01f tempest-GroupSnapshotsTest-1939666493 None] Flow 'volume_create_manager' (972e84bd-8492-48d3-bb7c-fcda224f1b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:36:00.220231 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3b134da8-6d8d-4446-a78e-5a3fb55db01f tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e8bec9-96cf-44b8-88f4-79970756ec54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:00.247055 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3b134da8-6d8d-4446-a78e-5a3fb55db01f tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e8bec9-96cf-44b8-88f4-79970756ec54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1084930774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9ab26445-918b-429c-8ef7-dbabb7a80366,host='ncdv-master-1@ceph#ceph',id=8b2483c9-d9d5-454f-89a5-59198be00ac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e755f57c175e43d7b08df778af0e3b04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:35:59Z,use_quota=True,user_id='7195793f260a45659c4c2ca5feb83928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c58fade1-1cdf-47a1-85bc-e70c89986a32),volume_type_id=c58fade1-1cdf-47a1-85bc-e70c89986a32)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:00.253360 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3b134da8-6d8d-4446-a78e-5a3fb55db01f tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d39b696-055b-401a-ad44-9832c64dae6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:00.258538 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3b134da8-6d8d-4446-a78e-5a3fb55db01f tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d39b696-055b-401a-ad44-9832c64dae6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:00.264588 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3b134da8-6d8d-4446-a78e-5a3fb55db01f tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c38871e-4602-482b-886e-14b4de0198fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:00.298787 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3b134da8-6d8d-4446-a78e-5a3fb55db01f tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c38871e-4602-482b-886e-14b4de0198fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b2483c9-d9d5-454f-89a5-59198be00ac8', 'volume_name': 'volume-8b2483c9-d9d5-454f-89a5-59198be00ac8', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:00.306358 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3b134da8-6d8d-4446-a78e-5a3fb55db01f tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79fe3b46-254c-457b-a7d1-4424b72500eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:00.311487 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3b134da8-6d8d-4446-a78e-5a3fb55db01f tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79fe3b46-254c-457b-a7d1-4424b72500eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:00.317307 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3b134da8-6d8d-4446-a78e-5a3fb55db01f tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (394194de-e6b5-4535-9372-61315c33e3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:00.318568 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-3b134da8-6d8d-4446-a78e-5a3fb55db01f tempest-GroupSnapshotsTest-1939666493 None] Volume 8b2483c9-d9d5-454f-89a5-59198be00ac8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b2483c9-d9d5-454f-89a5-59198be00ac8', 'volume_size': 1} Apr 30 21:36:00.318978 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-3b134da8-6d8d-4446-a78e-5a3fb55db01f tempest-GroupSnapshotsTest-1939666493 None] creating volume 'volume-8b2483c9-d9d5-454f-89a5-59198be00ac8' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:36:00.319772 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-3b134da8-6d8d-4446-a78e-5a3fb55db01f tempest-GroupSnapshotsTest-1939666493 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:36:01.565301 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-3b134da8-6d8d-4446-a78e-5a3fb55db01f tempest-GroupSnapshotsTest-1939666493 None] extra_specs: {} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:36:01.565949 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-3b134da8-6d8d-4446-a78e-5a3fb55db01f tempest-GroupSnapshotsTest-1939666493 None] extra_specs: {} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:36:01.570195 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3b134da8-6d8d-4446-a78e-5a3fb55db01f tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (394194de-e6b5-4535-9372-61315c33e3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b2483c9-d9d5-454f-89a5-59198be00ac8', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:01.575840 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3b134da8-6d8d-4446-a78e-5a3fb55db01f tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bac7dd55-a2ab-4179-8ca1-77319a4ec935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:01.692539 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-3b134da8-6d8d-4446-a78e-5a3fb55db01f tempest-GroupSnapshotsTest-1939666493 None] Volume volume-8b2483c9-d9d5-454f-89a5-59198be00ac8 (8b2483c9-d9d5-454f-89a5-59198be00ac8): created successfully Apr 30 21:36:01.697122 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3b134da8-6d8d-4446-a78e-5a3fb55db01f tempest-GroupSnapshotsTest-1939666493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bac7dd55-a2ab-4179-8ca1-77319a4ec935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:01.702809 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3b134da8-6d8d-4446-a78e-5a3fb55db01f tempest-GroupSnapshotsTest-1939666493 None] Flow 'volume_create_manager' (972e84bd-8492-48d3-bb7c-fcda224f1b4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:36:01.818980 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-3b134da8-6d8d-4446-a78e-5a3fb55db01f tempest-GroupSnapshotsTest-1939666493 None] Created volume successfully. Apr 30 21:36:03.417106 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-c6d11a12-b563-4a00-93a1-ab36d156b2fc tempest-GroupSnapshotsTest-1939666493 None] GroupSnapshot 399f7eea-49d3-4623-abcd-0d34d53e5522: creating. Apr 30 21:36:03.498223 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c6d11a12-b563-4a00-93a1-ab36d156b2fc tempest-GroupSnapshotsTest-1939666493 None] Group snapshot 399f7eea-49d3-4623-abcd-0d34d53e5522: creating. {{(pid=123855) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} Apr 30 21:36:03.528461 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c6d11a12-b563-4a00-93a1-ab36d156b2fc tempest-GroupSnapshotsTest-1939666493 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:36:03.802775 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-bf8620f3-4c97-4f11-87a8-36478943ef25 tempest-VolumesBackupsTest-2062082737 None] Created reservations ['b5dfa3eb-b1f0-4558-9ffc-47fb01e3e0fe', '54d7d637-b4c2-4fa2-ba8b-8996237ab0db', 'ab06dab0-1417-4ecb-8cea-5f930402974b', 'ae833bd4-99f6-4d25-8d16-8bb795d6b194'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:36:03.996128 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bf8620f3-4c97-4f11-87a8-36478943ef25 tempest-VolumesBackupsTest-2062082737 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:36:04.049067 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bf8620f3-4c97-4f11-87a8-36478943ef25 tempest-VolumesBackupsTest-2062082737 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:36:04.098596 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-bf8620f3-4c97-4f11-87a8-36478943ef25 tempest-VolumesBackupsTest-2062082737 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:36:04.104942 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-bf8620f3-4c97-4f11-87a8-36478943ef25 tempest-VolumesBackupsTest-2062082737 None] Deleted volume successfully. Apr 30 21:36:04.217545 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-bf8620f3-4c97-4f11-87a8-36478943ef25 tempest-VolumesBackupsTest-2062082737 None] Lock "b'cinder-7f665430-43af-4d95-94d7-2f39dfbc7c9b-delete_volume'" released by "delete_volume" :: held 15.014s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:36:07.250718 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-c6d11a12-b563-4a00-93a1-ab36d156b2fc tempest-GroupSnapshotsTest-1939666493 None] group_snapshot 399f7eea-49d3-4623-abcd-0d34d53e5522: created successfully Apr 30 21:36:07.789901 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-a20c71af-edc7-4486-be7a-5e8e46e8a113 tempest-GroupsTest-951278808 None] Created reservations ['7c2b3a9d-ecbd-4f61-a385-02ab5415b97e'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:36:07.856824 ncdv-master-1 cinder-volume[123855]: WARNING cinder.quota [None req-a20c71af-edc7-4486-be7a-5e8e46e8a113 tempest-GroupsTest-951278808 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1306707229 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1306707229, it is now deprecated. Please use the default quota class for default quota. Apr 30 21:36:07.856824 ncdv-master-1 cinder-volume[123855]: WARNING cinder.quota [None req-a20c71af-edc7-4486-be7a-5e8e46e8a113 tempest-GroupsTest-951278808 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1306707229 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1306707229, it is now deprecated. Please use the default quota class for default quota. Apr 30 21:36:07.977865 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-a20c71af-edc7-4486-be7a-5e8e46e8a113 tempest-GroupsTest-951278808 None] Created reservations ['d1fcc160-3e21-47a3-a05f-54349fe97791', '88b1e211-a463-4c44-a602-6688e75beb0e', 'db523eea-28ae-4e5e-b6de-5fe4310a5cdd', 'd63ae90f-ccc2-4864-8b4e-06ad186a5b04'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:36:08.053308 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-17b2fc40-f1ed-4c7d-bc39-bf9d46e91e9a tempest-GroupSnapshotsTest-1939666493 None] group_snapshot 399f7eea-49d3-4623-abcd-0d34d53e5522: deleting Apr 30 21:36:08.146156 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-17b2fc40-f1ed-4c7d-bc39-bf9d46e91e9a tempest-GroupSnapshotsTest-1939666493 None] group_snapshot 399f7eea-49d3-4623-abcd-0d34d53e5522: deleting {{(pid=123855) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} Apr 30 21:36:08.171364 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-17b2fc40-f1ed-4c7d-bc39-bf9d46e91e9a tempest-GroupSnapshotsTest-1939666493 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:36:08.696545 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a20c71af-edc7-4486-be7a-5e8e46e8a113 tempest-GroupsTest-951278808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:36:08.748440 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a20c71af-edc7-4486-be7a-5e8e46e8a113 tempest-GroupsTest-951278808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:36:08.792450 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-a20c71af-edc7-4486-be7a-5e8e46e8a113 tempest-GroupsTest-951278808 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:36:08.796817 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-a20c71af-edc7-4486-be7a-5e8e46e8a113 tempest-GroupsTest-951278808 None] Delete group completed successfully. Apr 30 21:36:09.834771 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-0c1f0d75-bf62-4183-af25-0c766ce5671f tempest-GroupsTest-951278808 None] Created reservations ['7dcc73b4-8b7d-4dde-a839-831fd2e57239'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:36:10.153717 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-0c1f0d75-bf62-4183-af25-0c766ce5671f tempest-GroupsTest-951278808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:36:10.217653 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-0c1f0d75-bf62-4183-af25-0c766ce5671f tempest-GroupsTest-951278808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:36:10.299436 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-0c1f0d75-bf62-4183-af25-0c766ce5671f tempest-GroupsTest-951278808 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:36:10.301236 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-0c1f0d75-bf62-4183-af25-0c766ce5671f tempest-GroupsTest-951278808 None] Delete group completed successfully. Apr 30 21:36:12.054351 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-54d77ca2-c56a-4eba-b0d0-c9e2c2b2baf9 tempest-GroupsTest-951278808 None] Group tempest-GroupsTest-Group-433517424: creating Apr 30 21:36:12.223882 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-54d77ca2-c56a-4eba-b0d0-c9e2c2b2baf9 tempest-GroupsTest-951278808 None] Group tempest-GroupsTest-Group-433517424: created successfully Apr 30 21:36:12.235558 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-54d77ca2-c56a-4eba-b0d0-c9e2c2b2baf9 tempest-GroupsTest-951278808 None] Create group completed successfully. Apr 30 21:36:12.584467 ncdv-master-1 cinder-volume[123855]: WARNING cinder.quota [None req-17b2fc40-f1ed-4c7d-bc39-bf9d46e91e9a tempest-GroupSnapshotsTest-1939666493 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1949637365 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1949637365, it is now deprecated. Please use the default quota class for default quota. Apr 30 21:36:12.585252 ncdv-master-1 cinder-volume[123855]: WARNING cinder.quota [None req-17b2fc40-f1ed-4c7d-bc39-bf9d46e91e9a tempest-GroupSnapshotsTest-1939666493 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1949637365 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1949637365, it is now deprecated. Please use the default quota class for default quota. Apr 30 21:36:12.704722 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-17b2fc40-f1ed-4c7d-bc39-bf9d46e91e9a tempest-GroupSnapshotsTest-1939666493 None] Created reservations ['b5b921be-810d-484f-ab16-c1639bcfd59a', '9ad94ca5-f2a5-47e5-b89b-bd0136471d18', '77ccc2f8-3d8d-4368-b679-ba7d4d801101', 'b262f051-44a7-48f6-8ada-a3bd40c4d477'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:36:12.949477 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-17b2fc40-f1ed-4c7d-bc39-bf9d46e91e9a tempest-GroupSnapshotsTest-1939666493 None] group_snapshot 399f7eea-49d3-4623-abcd-0d34d53e5522: deleted successfully Apr 30 21:36:14.239910 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a9ac63c3-837b-450d-ab9c-c1afb7602dda tempest-GroupSnapshotsTest-1939666493 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:36:14.712693 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a9ac63c3-837b-450d-ab9c-c1afb7602dda tempest-GroupSnapshotsTest-1939666493 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:36:14.713177 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a9ac63c3-837b-450d-ab9c-c1afb7602dda tempest-GroupSnapshotsTest-1939666493 None] Volume volume-8b2483c9-d9d5-454f-89a5-59198be00ac8 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:36:14.926765 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a9ac63c3-837b-450d-ab9c-c1afb7602dda tempest-GroupSnapshotsTest-1939666493 None] deleting rbd volume volume-8b2483c9-d9d5-454f-89a5-59198be00ac8 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:36:14.931249 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-85934656-a2fa-4649-ac7b-8210c17ad432 tempest-GroupsTest-951278808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:36:14.951389 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-85934656-a2fa-4649-ac7b-8210c17ad432 tempest-GroupsTest-951278808 None] Flow 'volume_create_manager' (9b1c3147-15ce-443c-913b-f40be258760d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:36:14.959107 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-85934656-a2fa-4649-ac7b-8210c17ad432 tempest-GroupsTest-951278808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59a36c00-614b-447e-8988-b0e43acbd9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:15.000651 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-85934656-a2fa-4649-ac7b-8210c17ad432 tempest-GroupsTest-951278808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59a36c00-614b-447e-8988-b0e43acbd9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-684306168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cf26319f-34f0-4bdc-92b9-edc6a3b3bb1f,host='ncdv-master-1@ceph#ceph',id=739119df-6885-456c-ba82-356ade4c1d38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='228c9fcbe55946858e8c46db94e0f921',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:36:14Z,use_quota=True,user_id='5ee252de0fb74adda84ee09c01e84eeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30943ffe-ad36-41a0-8f5c-3bd1e2962ac3),volume_type_id=30943ffe-ad36-41a0-8f5c-3bd1e2962ac3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:15.006387 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-85934656-a2fa-4649-ac7b-8210c17ad432 tempest-GroupsTest-951278808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37374f77-9900-420d-9e4e-66dff8c73a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:15.011276 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-85934656-a2fa-4649-ac7b-8210c17ad432 tempest-GroupsTest-951278808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37374f77-9900-420d-9e4e-66dff8c73a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:15.019835 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-85934656-a2fa-4649-ac7b-8210c17ad432 tempest-GroupsTest-951278808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (437dc33d-c033-4682-9539-900031b6cb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:15.024664 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-85934656-a2fa-4649-ac7b-8210c17ad432 tempest-GroupsTest-951278808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (437dc33d-c033-4682-9539-900031b6cb48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '739119df-6885-456c-ba82-356ade4c1d38', 'volume_name': 'volume-739119df-6885-456c-ba82-356ade4c1d38', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:15.030579 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-85934656-a2fa-4649-ac7b-8210c17ad432 tempest-GroupsTest-951278808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0cc689d-9682-437c-9322-27be71b0fa0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:15.035280 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-85934656-a2fa-4649-ac7b-8210c17ad432 tempest-GroupsTest-951278808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0cc689d-9682-437c-9322-27be71b0fa0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:15.040432 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-85934656-a2fa-4649-ac7b-8210c17ad432 tempest-GroupsTest-951278808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa3e1b3f-d84a-46f6-b5ca-9ad7459d1d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:15.041886 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-85934656-a2fa-4649-ac7b-8210c17ad432 tempest-GroupsTest-951278808 None] Volume 739119df-6885-456c-ba82-356ade4c1d38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-739119df-6885-456c-ba82-356ade4c1d38', 'volume_size': 1} Apr 30 21:36:15.042507 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-85934656-a2fa-4649-ac7b-8210c17ad432 tempest-GroupsTest-951278808 None] creating volume 'volume-739119df-6885-456c-ba82-356ade4c1d38' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:36:15.043522 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-85934656-a2fa-4649-ac7b-8210c17ad432 tempest-GroupsTest-951278808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:36:16.011073 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-85934656-a2fa-4649-ac7b-8210c17ad432 tempest-GroupsTest-951278808 None] extra_specs: {} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:36:16.011763 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-85934656-a2fa-4649-ac7b-8210c17ad432 tempest-GroupsTest-951278808 None] extra_specs: {} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:36:16.015829 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-85934656-a2fa-4649-ac7b-8210c17ad432 tempest-GroupsTest-951278808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa3e1b3f-d84a-46f6-b5ca-9ad7459d1d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-739119df-6885-456c-ba82-356ade4c1d38', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:16.023654 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-85934656-a2fa-4649-ac7b-8210c17ad432 tempest-GroupsTest-951278808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (602cf1f4-6841-4fc4-9137-bc9d05ef26e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:16.126767 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-85934656-a2fa-4649-ac7b-8210c17ad432 tempest-GroupsTest-951278808 None] Volume volume-739119df-6885-456c-ba82-356ade4c1d38 (739119df-6885-456c-ba82-356ade4c1d38): created successfully Apr 30 21:36:16.131262 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-85934656-a2fa-4649-ac7b-8210c17ad432 tempest-GroupsTest-951278808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (602cf1f4-6841-4fc4-9137-bc9d05ef26e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:16.147221 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-85934656-a2fa-4649-ac7b-8210c17ad432 tempest-GroupsTest-951278808 None] Flow 'volume_create_manager' (9b1c3147-15ce-443c-913b-f40be258760d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:36:16.230184 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-85934656-a2fa-4649-ac7b-8210c17ad432 tempest-GroupsTest-951278808 None] Created volume successfully. Apr 30 21:36:18.100010 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9cfa514-1844-41e6-a645-6ae65e2b370b tempest-GroupsTest-951278808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:36:18.149346 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b9cfa514-1844-41e6-a645-6ae65e2b370b tempest-GroupsTest-951278808 None] Flow 'volume_create_manager' (ad8bd311-c2ec-4166-b911-be1261556015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:36:18.149346 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b9cfa514-1844-41e6-a645-6ae65e2b370b tempest-GroupsTest-951278808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26c3edc5-d0dc-4172-a76f-28def1a87ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:18.162188 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b9cfa514-1844-41e6-a645-6ae65e2b370b tempest-GroupsTest-951278808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26c3edc5-d0dc-4172-a76f-28def1a87ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-1593072443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cf26319f-34f0-4bdc-92b9-edc6a3b3bb1f,host='ncdv-master-1@ceph#ceph',id=e1d02a47-30af-4e5b-874a-564cfea7ba49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='228c9fcbe55946858e8c46db94e0f921',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:36:18Z,use_quota=True,user_id='5ee252de0fb74adda84ee09c01e84eeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30943ffe-ad36-41a0-8f5c-3bd1e2962ac3),volume_type_id=30943ffe-ad36-41a0-8f5c-3bd1e2962ac3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:18.167416 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b9cfa514-1844-41e6-a645-6ae65e2b370b tempest-GroupsTest-951278808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a2c9533-126e-4f18-aa8a-93941a5e83e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:18.171730 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b9cfa514-1844-41e6-a645-6ae65e2b370b tempest-GroupsTest-951278808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a2c9533-126e-4f18-aa8a-93941a5e83e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:18.177342 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b9cfa514-1844-41e6-a645-6ae65e2b370b tempest-GroupsTest-951278808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ebe2080-1861-49a4-9c10-9238a21c2da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:18.181359 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b9cfa514-1844-41e6-a645-6ae65e2b370b tempest-GroupsTest-951278808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ebe2080-1861-49a4-9c10-9238a21c2da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1d02a47-30af-4e5b-874a-564cfea7ba49', 'volume_name': 'volume-e1d02a47-30af-4e5b-874a-564cfea7ba49', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:18.187138 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b9cfa514-1844-41e6-a645-6ae65e2b370b tempest-GroupsTest-951278808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aac5b29-c3e6-460a-9637-95de87e51af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:18.191898 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b9cfa514-1844-41e6-a645-6ae65e2b370b tempest-GroupsTest-951278808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aac5b29-c3e6-460a-9637-95de87e51af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:18.197154 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b9cfa514-1844-41e6-a645-6ae65e2b370b tempest-GroupsTest-951278808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51e1ed84-b91d-4ba1-8a56-0828c69ac246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:18.198323 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-b9cfa514-1844-41e6-a645-6ae65e2b370b tempest-GroupsTest-951278808 None] Volume e1d02a47-30af-4e5b-874a-564cfea7ba49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1d02a47-30af-4e5b-874a-564cfea7ba49', 'volume_size': 1} Apr 30 21:36:18.198875 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b9cfa514-1844-41e6-a645-6ae65e2b370b tempest-GroupsTest-951278808 None] creating volume 'volume-e1d02a47-30af-4e5b-874a-564cfea7ba49' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:36:18.199551 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b9cfa514-1844-41e6-a645-6ae65e2b370b tempest-GroupsTest-951278808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:36:19.262358 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b9cfa514-1844-41e6-a645-6ae65e2b370b tempest-GroupsTest-951278808 None] extra_specs: {} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:36:19.263036 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b9cfa514-1844-41e6-a645-6ae65e2b370b tempest-GroupsTest-951278808 None] extra_specs: {} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:36:19.283966 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b9cfa514-1844-41e6-a645-6ae65e2b370b tempest-GroupsTest-951278808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51e1ed84-b91d-4ba1-8a56-0828c69ac246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1d02a47-30af-4e5b-874a-564cfea7ba49', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:19.290863 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b9cfa514-1844-41e6-a645-6ae65e2b370b tempest-GroupsTest-951278808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (791c0556-4345-47c7-8060-4701f0bf463b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:19.446535 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-b9cfa514-1844-41e6-a645-6ae65e2b370b tempest-GroupsTest-951278808 None] Volume volume-e1d02a47-30af-4e5b-874a-564cfea7ba49 (e1d02a47-30af-4e5b-874a-564cfea7ba49): created successfully Apr 30 21:36:19.450612 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b9cfa514-1844-41e6-a645-6ae65e2b370b tempest-GroupsTest-951278808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (791c0556-4345-47c7-8060-4701f0bf463b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:19.456366 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b9cfa514-1844-41e6-a645-6ae65e2b370b tempest-GroupsTest-951278808 None] Flow 'volume_create_manager' (ad8bd311-c2ec-4166-b911-be1261556015) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:36:19.549305 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-b9cfa514-1844-41e6-a645-6ae65e2b370b tempest-GroupsTest-951278808 None] Created volume successfully. Apr 30 21:36:20.579980 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-69979c62-c88b-4616-b4d0-2a3af625e0ee tempest-GroupsTest-951278808 None] Update group completed successfully. Apr 30 21:36:20.796399 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-a262535f-981c-4b9c-a433-bd7e45bc803b tempest-VolumesBackupsTest-2062082737 None] Lock "b'cinder-8ce30ce0-c386-4270-a5c8-e069bf2e80aa-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:36:20.942315 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a262535f-981c-4b9c-a433-bd7e45bc803b tempest-VolumesBackupsTest-2062082737 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:36:22.899523 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a262535f-981c-4b9c-a433-bd7e45bc803b tempest-VolumesBackupsTest-2062082737 None] deleting rbd volume volume-8ce30ce0-c386-4270-a5c8-e069bf2e80aa {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:36:22.913649 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-a9ac63c3-837b-450d-ab9c-c1afb7602dda tempest-GroupSnapshotsTest-1939666493 None] Created reservations ['236b6a9d-f3b7-489c-91a3-451df61ae87e'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:36:23.033298 ncdv-master-1 cinder-volume[123855]: WARNING cinder.quota [None req-a9ac63c3-837b-450d-ab9c-c1afb7602dda tempest-GroupSnapshotsTest-1939666493 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1949637365 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1949637365, it is now deprecated. Please use the default quota class for default quota. Apr 30 21:36:23.175520 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-a9ac63c3-837b-450d-ab9c-c1afb7602dda tempest-GroupSnapshotsTest-1939666493 None] Created reservations ['784ae170-88e6-4d42-9de7-87293cb64acc', '7e4b6c0f-0290-4f6b-9d6e-8cb08a97fc1b', '167c444c-aa85-4280-98aa-a2e47915d750', '474e1670-bc7b-4081-83ad-73d5747415ec'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:36:23.233790 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-62749ed3-fbaf-40db-b8d5-81c258c2d478 tempest-GroupsTest-951278808 None] Update group completed successfully. Apr 30 21:36:23.570715 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a9ac63c3-837b-450d-ab9c-c1afb7602dda tempest-GroupSnapshotsTest-1939666493 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:36:23.624288 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a9ac63c3-837b-450d-ab9c-c1afb7602dda tempest-GroupSnapshotsTest-1939666493 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:36:23.698047 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-a9ac63c3-837b-450d-ab9c-c1afb7602dda tempest-GroupSnapshotsTest-1939666493 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:36:23.703090 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-a9ac63c3-837b-450d-ab9c-c1afb7602dda tempest-GroupSnapshotsTest-1939666493 None] Delete group completed successfully. Apr 30 21:36:25.297304 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f6256c72-ccc6-4853-ac35-f5647b39d84a tempest-GroupsTest-951278808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:36:25.623413 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f6256c72-ccc6-4853-ac35-f5647b39d84a tempest-GroupsTest-951278808 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:36:25.623845 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f6256c72-ccc6-4853-ac35-f5647b39d84a tempest-GroupsTest-951278808 None] Volume volume-739119df-6885-456c-ba82-356ade4c1d38 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:36:25.846684 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f6256c72-ccc6-4853-ac35-f5647b39d84a tempest-GroupsTest-951278808 None] deleting rbd volume volume-739119df-6885-456c-ba82-356ade4c1d38 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:36:27.813570 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a262535f-981c-4b9c-a433-bd7e45bc803b tempest-VolumesBackupsTest-2062082737 None] volume is a clone so cleaning references {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} Apr 30 21:36:28.048630 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a262535f-981c-4b9c-a433-bd7e45bc803b tempest-VolumesBackupsTest-2062082737 None] deleting parent snapshot volume-8ce30ce0-c386-4270-a5c8-e069bf2e80aa.clone_snap {{(pid=123855) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} Apr 30 21:36:31.329095 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:36:31.329672 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:36:31.379177 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:36:31.457794 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:36:31.706136 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-a262535f-981c-4b9c-a433-bd7e45bc803b tempest-VolumesBackupsTest-2062082737 None] Created reservations ['04684eba-a154-4935-898a-69a1f0c95877', '150bcbac-d330-4b75-950d-924ea07888d4', 'fb44412a-7794-407a-a9c0-99efa77a2301', '2231d285-79ef-47ed-8e5e-b7936d14c464'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:36:31.851054 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f6256c72-ccc6-4853-ac35-f5647b39d84a tempest-GroupsTest-951278808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:36:32.034527 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f6256c72-ccc6-4853-ac35-f5647b39d84a tempest-GroupsTest-951278808 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:36:32.034963 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f6256c72-ccc6-4853-ac35-f5647b39d84a tempest-GroupsTest-951278808 None] Volume volume-e1d02a47-30af-4e5b-874a-564cfea7ba49 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:36:32.113531 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f6256c72-ccc6-4853-ac35-f5647b39d84a tempest-GroupsTest-951278808 None] deleting rbd volume volume-e1d02a47-30af-4e5b-874a-564cfea7ba49 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:36:32.286435 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a262535f-981c-4b9c-a433-bd7e45bc803b tempest-VolumesBackupsTest-2062082737 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:36:32.339842 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a262535f-981c-4b9c-a433-bd7e45bc803b tempest-VolumesBackupsTest-2062082737 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:36:32.530217 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-a262535f-981c-4b9c-a433-bd7e45bc803b tempest-VolumesBackupsTest-2062082737 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:36:32.535599 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-a262535f-981c-4b9c-a433-bd7e45bc803b tempest-VolumesBackupsTest-2062082737 None] Deleted volume successfully. Apr 30 21:36:32.687607 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-a262535f-981c-4b9c-a433-bd7e45bc803b tempest-VolumesBackupsTest-2062082737 None] Lock "b'cinder-8ce30ce0-c386-4270-a5c8-e069bf2e80aa-delete_volume'" released by "delete_volume" :: held 11.892s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:36:33.459467 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-55457839-6655-440b-98c2-b5b9bdffa644 tempest-AttachVolumeTestJSON-628843456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:36:33.499480 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-55457839-6655-440b-98c2-b5b9bdffa644 tempest-AttachVolumeTestJSON-628843456 None] Flow 'volume_create_manager' (1c83281d-3e6a-4e4f-aa3b-c68e0cc95f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:36:33.517240 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-55457839-6655-440b-98c2-b5b9bdffa644 tempest-AttachVolumeTestJSON-628843456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aaf5af2-f1bb-4893-8341-3355807e9a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:33.537534 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-55457839-6655-440b-98c2-b5b9bdffa644 tempest-AttachVolumeTestJSON-628843456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aaf5af2-f1bb-4893-8341-3355807e9a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1743520750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1f48d4d5-94cc-4387-97f6-69de0a01a3d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b74e36d3bb384eeb92da16d1b201fc9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:36:33Z,use_quota=True,user_id='e9fa67fb4ad4472183b95067597f043e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:33.543072 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-55457839-6655-440b-98c2-b5b9bdffa644 tempest-AttachVolumeTestJSON-628843456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e31be2d-ffb0-41f1-98b4-50e6566a66cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:33.547533 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-55457839-6655-440b-98c2-b5b9bdffa644 tempest-AttachVolumeTestJSON-628843456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e31be2d-ffb0-41f1-98b4-50e6566a66cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:33.552958 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-55457839-6655-440b-98c2-b5b9bdffa644 tempest-AttachVolumeTestJSON-628843456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e568844c-8139-4dd9-a74d-6b437ed41037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:33.557213 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-55457839-6655-440b-98c2-b5b9bdffa644 tempest-AttachVolumeTestJSON-628843456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e568844c-8139-4dd9-a74d-6b437ed41037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f48d4d5-94cc-4387-97f6-69de0a01a3d8', 'volume_name': 'volume-1f48d4d5-94cc-4387-97f6-69de0a01a3d8', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:33.562749 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-55457839-6655-440b-98c2-b5b9bdffa644 tempest-AttachVolumeTestJSON-628843456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a33ac75-a2ad-41f3-b56d-839e1d086a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:33.566777 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-55457839-6655-440b-98c2-b5b9bdffa644 tempest-AttachVolumeTestJSON-628843456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a33ac75-a2ad-41f3-b56d-839e1d086a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:33.571733 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-55457839-6655-440b-98c2-b5b9bdffa644 tempest-AttachVolumeTestJSON-628843456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a23293c6-3ee3-4cbb-8540-a8e65d4e6022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:33.573098 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-55457839-6655-440b-98c2-b5b9bdffa644 tempest-AttachVolumeTestJSON-628843456 None] Volume 1f48d4d5-94cc-4387-97f6-69de0a01a3d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f48d4d5-94cc-4387-97f6-69de0a01a3d8', 'volume_size': 1} Apr 30 21:36:33.573677 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-55457839-6655-440b-98c2-b5b9bdffa644 tempest-AttachVolumeTestJSON-628843456 None] creating volume 'volume-1f48d4d5-94cc-4387-97f6-69de0a01a3d8' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:36:33.574642 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-55457839-6655-440b-98c2-b5b9bdffa644 tempest-AttachVolumeTestJSON-628843456 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:36:34.303766 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-55457839-6655-440b-98c2-b5b9bdffa644 tempest-AttachVolumeTestJSON-628843456 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:36:34.304843 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-55457839-6655-440b-98c2-b5b9bdffa644 tempest-AttachVolumeTestJSON-628843456 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:36:34.320508 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-55457839-6655-440b-98c2-b5b9bdffa644 tempest-AttachVolumeTestJSON-628843456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a23293c6-3ee3-4cbb-8540-a8e65d4e6022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f48d4d5-94cc-4387-97f6-69de0a01a3d8', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:34.337399 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-55457839-6655-440b-98c2-b5b9bdffa644 tempest-AttachVolumeTestJSON-628843456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a454667-6f3a-41f1-ba6a-872c9da18043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:34.429464 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-55457839-6655-440b-98c2-b5b9bdffa644 tempest-AttachVolumeTestJSON-628843456 None] Volume volume-1f48d4d5-94cc-4387-97f6-69de0a01a3d8 (1f48d4d5-94cc-4387-97f6-69de0a01a3d8): created successfully Apr 30 21:36:34.433415 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-55457839-6655-440b-98c2-b5b9bdffa644 tempest-AttachVolumeTestJSON-628843456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a454667-6f3a-41f1-ba6a-872c9da18043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:34.441745 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-55457839-6655-440b-98c2-b5b9bdffa644 tempest-AttachVolumeTestJSON-628843456 None] Flow 'volume_create_manager' (1c83281d-3e6a-4e4f-aa3b-c68e0cc95f34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:36:34.544350 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-55457839-6655-440b-98c2-b5b9bdffa644 tempest-AttachVolumeTestJSON-628843456 None] Created volume successfully. Apr 30 21:36:36.344624 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-f6256c72-ccc6-4853-ac35-f5647b39d84a tempest-GroupsTest-951278808 None] Created reservations ['9714ed8e-ee09-452f-a960-6a254d743b03'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:36:36.382189 ncdv-master-1 cinder-volume[123855]: WARNING cinder.quota [None req-f6256c72-ccc6-4853-ac35-f5647b39d84a tempest-GroupsTest-951278808 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-965065911 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-965065911, it is now deprecated. Please use the default quota class for default quota. Apr 30 21:36:36.383349 ncdv-master-1 cinder-volume[123855]: WARNING cinder.quota [None req-f6256c72-ccc6-4853-ac35-f5647b39d84a tempest-GroupsTest-951278808 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-965065911 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-965065911, it is now deprecated. Please use the default quota class for default quota. Apr 30 21:36:36.491215 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-f6256c72-ccc6-4853-ac35-f5647b39d84a tempest-GroupsTest-951278808 None] Created reservations ['50736e79-a9af-4776-b699-2d22a51eabaa', '240ac6d5-698a-456f-baff-e63034b4935c', '86df800d-fe3c-443f-9841-9fe1fcad8ff4', 'cf0437d4-24bb-4b4c-9fad-8ae2b7682eca'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:36:36.915632 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-f6256c72-ccc6-4853-ac35-f5647b39d84a tempest-GroupsTest-951278808 None] Created reservations ['a18ce96a-95e7-4e47-836d-489aed8aa789', 'ec5cafdd-5379-4897-baa7-705bf076fe98', 'd5ee7d60-7d24-4bcc-a9b7-58d29f5413a6', '7330ad09-006f-41e0-b4fd-824cfb1d0641'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:36:37.049579 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-257b27a7-8bd6-4383-b443-2eda65ef9afb req-f6126dc2-0770-487c-b35b-7b5af10dd0e6 tempest-AttachVolumeTestJSON-628843456 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:36:37.299487 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-10c129af-37e7-423b-a07f-6875bbbb82d7 tempest-VolumesCloneTest-1015091794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:36:37.361790 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-10c129af-37e7-423b-a07f-6875bbbb82d7 tempest-VolumesCloneTest-1015091794 None] Flow 'volume_create_manager' (4dcb7f4e-0cba-43d4-a7a7-929aefb8941f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:36:37.388560 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-10c129af-37e7-423b-a07f-6875bbbb82d7 tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0640025b-0396-446f-b199-9537925e74bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:37.419281 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-10c129af-37e7-423b-a07f-6875bbbb82d7 tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0640025b-0396-446f-b199-9537925e74bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:36:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2044835260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=716b8ed6-820c-4b42-84c8-5b9a8d40bb4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d24ab3357252430bb71551114c9bf7a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:36:37Z,use_quota=True,user_id='06938e94defa4e68b43b0ea0477b8995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:37.427573 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-10c129af-37e7-423b-a07f-6875bbbb82d7 tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf92010-f899-4274-a7ef-95b619e9acda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:37.432850 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-10c129af-37e7-423b-a07f-6875bbbb82d7 tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf92010-f899-4274-a7ef-95b619e9acda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:37.438855 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-10c129af-37e7-423b-a07f-6875bbbb82d7 tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b28219de-56a0-4de0-acbe-fdb218d2d70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:37.455644 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f6256c72-ccc6-4853-ac35-f5647b39d84a tempest-GroupsTest-951278808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:36:37.581717 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f6256c72-ccc6-4853-ac35-f5647b39d84a tempest-GroupsTest-951278808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:36:37.668183 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-f6256c72-ccc6-4853-ac35-f5647b39d84a tempest-GroupsTest-951278808 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:36:37.690286 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-f6256c72-ccc6-4853-ac35-f5647b39d84a tempest-GroupsTest-951278808 None] Delete group completed successfully. Apr 30 21:36:37.792004 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-10c129af-37e7-423b-a07f-6875bbbb82d7 tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b28219de-56a0-4de0-acbe-fdb218d2d70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '716b8ed6-820c-4b42-84c8-5b9a8d40bb4b', 'volume_name': 'volume-716b8ed6-820c-4b42-84c8-5b9a8d40bb4b', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:37.801596 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-10c129af-37e7-423b-a07f-6875bbbb82d7 tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb220bc-6fab-43a6-8193-d7e4a89ab5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:37.802611 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-10c129af-37e7-423b-a07f-6875bbbb82d7 tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb220bc-6fab-43a6-8193-d7e4a89ab5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:37.808398 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-10c129af-37e7-423b-a07f-6875bbbb82d7 tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (592b564e-5bd4-43fb-92d9-cde2656e40f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:37.809833 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-10c129af-37e7-423b-a07f-6875bbbb82d7 tempest-VolumesCloneTest-1015091794 None] Volume 716b8ed6-820c-4b42-84c8-5b9a8d40bb4b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-716b8ed6-820c-4b42-84c8-5b9a8d40bb4b', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 30 21:36:37.810727 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-10c129af-37e7-423b-a07f-6875bbbb82d7 tempest-VolumesCloneTest-1015091794 None] Cloning 716b8ed6-820c-4b42-84c8-5b9a8d40bb4b from image a5b0850f-3b24-4bcb-b0a7-351c3216b27d at location (None, None). {{(pid=123855) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Apr 30 21:36:37.823555 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-10c129af-37e7-423b-a07f-6875bbbb82d7 tempest-VolumesCloneTest-1015091794 None] Lock "b'cinder-a5b0850f-3b24-4bcb-b0a7-351c3216b27d'" acquired by "_prepare_image_cache_entry" :: waited 0.012s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:36:37.886185 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-10c129af-37e7-423b-a07f-6875bbbb82d7 tempest-VolumesCloneTest-1015091794 None] Found image-volume cache entry: {'id': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'volume_id': '5772aef0-721f-450a-93ff-02cc6a41edcc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7), 'last_used': datetime.datetime(2022, 4, 30, 21, 36, 37, 833894)}. {{(pid=123855) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 30 21:36:37.886629 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-10c129af-37e7-423b-a07f-6875bbbb82d7 tempest-VolumesCloneTest-1015091794 None] Image-volume cache entry image_update_at = 2022-04-30 21:01:07+00:00, requested image updated_at = 2022-04-30 21:01:07+00:00. {{(pid=123855) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 30 21:36:37.887120 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-10c129af-37e7-423b-a07f-6875bbbb82d7 tempest-VolumesCloneTest-1015091794 None] Found cache entry for image = a5b0850f-3b24-4bcb-b0a7-351c3216b27d on host ncdv-master-1@ceph#ceph. {{(pid=123855) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Apr 30 21:36:37.892764 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-10c129af-37e7-423b-a07f-6875bbbb82d7 tempest-VolumesCloneTest-1015091794 None] Lock "b'cinder-a5b0850f-3b24-4bcb-b0a7-351c3216b27d'" released by "_prepare_image_cache_entry" :: held 0.069s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:36:37.893825 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-10c129af-37e7-423b-a07f-6875bbbb82d7 tempest-VolumesCloneTest-1015091794 None] Attempting to retrieve cache entry for image = a5b0850f-3b24-4bcb-b0a7-351c3216b27d on host ncdv-master-1@ceph#ceph. {{(pid=123855) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Apr 30 21:36:37.909780 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-10c129af-37e7-423b-a07f-6875bbbb82d7 tempest-VolumesCloneTest-1015091794 None] Found image-volume cache entry: {'id': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'volume_id': '5772aef0-721f-450a-93ff-02cc6a41edcc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7), 'last_used': datetime.datetime(2022, 4, 30, 21, 36, 37, 898388)}. {{(pid=123855) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 30 21:36:37.909780 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-10c129af-37e7-423b-a07f-6875bbbb82d7 tempest-VolumesCloneTest-1015091794 None] Image-volume cache entry image_update_at = 2022-04-30 21:01:07+00:00, requested image updated_at = 2022-04-30 21:01:07+00:00. {{(pid=123855) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 30 21:36:37.909780 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-10c129af-37e7-423b-a07f-6875bbbb82d7 tempest-VolumesCloneTest-1015091794 None] Creating from source image-volume 5772aef0-721f-450a-93ff-02cc6a41edcc {{(pid=123855) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Apr 30 21:36:37.964351 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-10c129af-37e7-423b-a07f-6875bbbb82d7 tempest-VolumesCloneTest-1015091794 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:36:38.269924 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-10c129af-37e7-423b-a07f-6875bbbb82d7 tempest-VolumesCloneTest-1015091794 None] creating snapshot='volume-716b8ed6-820c-4b42-84c8-5b9a8d40bb4b.clone_snap' {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} Apr 30 21:36:39.498129 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-10c129af-37e7-423b-a07f-6875bbbb82d7 tempest-VolumesCloneTest-1015091794 None] cloning 'volume-5772aef0-721f-450a-93ff-02cc6a41edcc@volume-716b8ed6-820c-4b42-84c8-5b9a8d40bb4b.clone_snap' to 'volume-716b8ed6-820c-4b42-84c8-5b9a8d40bb4b' {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} Apr 30 21:36:39.506697 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-257b27a7-8bd6-4383-b443-2eda65ef9afb req-f6126dc2-0770-487c-b35b-7b5af10dd0e6 tempest-AttachVolumeTestJSON-628843456 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.458s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:36:39.507714 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-257b27a7-8bd6-4383-b443-2eda65ef9afb req-f6126dc2-0770-487c-b35b-7b5af10dd0e6 tempest-AttachVolumeTestJSON-628843456 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1f48d4d5-94cc-4387-97f6-69de0a01a3d8', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': '1f48d4d5-94cc-4387-97f6-69de0a01a3d8', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:36:39.599903 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-257b27a7-8bd6-4383-b443-2eda65ef9afb req-f6126dc2-0770-487c-b35b-7b5af10dd0e6 tempest-AttachVolumeTestJSON-628843456 None] Connection info returned from driver {'name': 'volumes/volume-1f48d4d5-94cc-4387-97f6-69de0a01a3d8', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1f48d4d5-94cc-4387-97f6-69de0a01a3d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7bbabaf5-582f-4d25-9c33-82817b1ce43d'} {{(pid=123855) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Apr 30 21:36:39.742510 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-257b27a7-8bd6-4383-b443-2eda65ef9afb req-f6126dc2-0770-487c-b35b-7b5af10dd0e6 tempest-AttachVolumeTestJSON-628843456 None] attachment_update completed successfully. Apr 30 21:36:40.665633 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-10c129af-37e7-423b-a07f-6875bbbb82d7 tempest-VolumesCloneTest-1015091794 None] Volume volume-632a7810-1a6f-420a-a6fd-57675408a8f7.deleted is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:36:40.667017 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-10c129af-37e7-423b-a07f-6875bbbb82d7 tempest-VolumesCloneTest-1015091794 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:36:40.667405 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-10c129af-37e7-423b-a07f-6875bbbb82d7 tempest-VolumesCloneTest-1015091794 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:36:41.355496 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-10c129af-37e7-423b-a07f-6875bbbb82d7 tempest-VolumesCloneTest-1015091794 None] clone created successfully {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} Apr 30 21:36:41.356360 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.volume_utils [None req-10c129af-37e7-423b-a07f-6875bbbb82d7 tempest-VolumesCloneTest-1015091794 None] Marking volume 716b8ed6-820c-4b42-84c8-5b9a8d40bb4b as bootable. {{(pid=123855) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Apr 30 21:36:41.423350 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-10c129af-37e7-423b-a07f-6875bbbb82d7 tempest-VolumesCloneTest-1015091794 None] Copying metadata from image a5b0850f-3b24-4bcb-b0a7-351c3216b27d to 716b8ed6-820c-4b42-84c8-5b9a8d40bb4b. {{(pid=123855) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Apr 30 21:36:41.424388 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-10c129af-37e7-423b-a07f-6875bbbb82d7 tempest-VolumesCloneTest-1015091794 None] Creating volume glance metadata for volume 716b8ed6-820c-4b42-84c8-5b9a8d40bb4b backed by image a5b0850f-3b24-4bcb-b0a7-351c3216b27d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123855) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Apr 30 21:36:41.585160 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-10c129af-37e7-423b-a07f-6875bbbb82d7 tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (592b564e-5bd4-43fb-92d9-cde2656e40f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-716b8ed6-820c-4b42-84c8-5b9a8d40bb4b', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:41.593362 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-10c129af-37e7-423b-a07f-6875bbbb82d7 tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55065910-72f6-4b9c-a650-ff841360b248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:41.657684 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-10c129af-37e7-423b-a07f-6875bbbb82d7 tempest-VolumesCloneTest-1015091794 None] Volume volume-716b8ed6-820c-4b42-84c8-5b9a8d40bb4b (716b8ed6-820c-4b42-84c8-5b9a8d40bb4b): created successfully Apr 30 21:36:41.671549 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-10c129af-37e7-423b-a07f-6875bbbb82d7 tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55065910-72f6-4b9c-a650-ff841360b248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:41.692914 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-10c129af-37e7-423b-a07f-6875bbbb82d7 tempest-VolumesCloneTest-1015091794 None] Flow 'volume_create_manager' (4dcb7f4e-0cba-43d4-a7a7-929aefb8941f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:36:41.786529 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-10c129af-37e7-423b-a07f-6875bbbb82d7 tempest-VolumesCloneTest-1015091794 None] Created volume successfully. Apr 30 21:36:43.760937 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8195e33-269f-40c1-a91d-3a348f15ae04 tempest-VolumesCloneTest-1015091794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:36:43.834786 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b8195e33-269f-40c1-a91d-3a348f15ae04 tempest-VolumesCloneTest-1015091794 None] Flow 'volume_create_manager' (675651fe-d20c-4b69-8f3b-fd09048d9da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:36:43.854152 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b8195e33-269f-40c1-a91d-3a348f15ae04 tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f14ca8c-dee4-44d3-bbdc-7ea1dba7890c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:43.879487 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b8195e33-269f-40c1-a91d-3a348f15ae04 tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f14ca8c-dee4-44d3-bbdc-7ea1dba7890c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-790964254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=20c58c1f-0e97-49c0-a126-d6644eeb7588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d24ab3357252430bb71551114c9bf7a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=716b8ed6-820c-4b42-84c8-5b9a8d40bb4b,status='creating',terminated_at=None,updated_at=2022-04-30T21:36:44Z,use_quota=True,user_id='06938e94defa4e68b43b0ea0477b8995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:43.886876 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b8195e33-269f-40c1-a91d-3a348f15ae04 tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e08c44d7-6ddd-4f64-8177-33a39e7a7922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:43.893612 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b8195e33-269f-40c1-a91d-3a348f15ae04 tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e08c44d7-6ddd-4f64-8177-33a39e7a7922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:43.899348 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b8195e33-269f-40c1-a91d-3a348f15ae04 tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4acc2cc-1251-43e7-ac15-47aa58a1ab0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:43.919377 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b8195e33-269f-40c1-a91d-3a348f15ae04 tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4acc2cc-1251-43e7-ac15-47aa58a1ab0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '20c58c1f-0e97-49c0-a126-d6644eeb7588', 'volume_name': 'volume-20c58c1f-0e97-49c0-a126-d6644eeb7588', 'volume_size': 1, 'source_volid': '716b8ed6-820c-4b42-84c8-5b9a8d40bb4b', 'source_volstatus': 'available'}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:43.926585 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b8195e33-269f-40c1-a91d-3a348f15ae04 tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdbb5c52-f7cd-4358-99de-27acc5f9f69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:43.936634 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b8195e33-269f-40c1-a91d-3a348f15ae04 tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdbb5c52-f7cd-4358-99de-27acc5f9f69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:43.936634 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b8195e33-269f-40c1-a91d-3a348f15ae04 tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ed9dd43-f37d-47aa-94fd-f843cd8781a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:43.938228 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-b8195e33-269f-40c1-a91d-3a348f15ae04 tempest-VolumesCloneTest-1015091794 None] Volume 20c58c1f-0e97-49c0-a126-d6644eeb7588: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-20c58c1f-0e97-49c0-a126-d6644eeb7588', 'volume_size': 1, 'source_volid': '716b8ed6-820c-4b42-84c8-5b9a8d40bb4b', 'source_volstatus': 'available'} Apr 30 21:36:43.960884 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b8195e33-269f-40c1-a91d-3a348f15ae04 tempest-VolumesCloneTest-1015091794 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:36:44.176774 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b8195e33-269f-40c1-a91d-3a348f15ae04 tempest-VolumesCloneTest-1015091794 None] creating snapshot='volume-20c58c1f-0e97-49c0-a126-d6644eeb7588.clone_snap' {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} Apr 30 21:36:45.527508 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b8195e33-269f-40c1-a91d-3a348f15ae04 tempest-VolumesCloneTest-1015091794 None] cloning 'volume-716b8ed6-820c-4b42-84c8-5b9a8d40bb4b@volume-20c58c1f-0e97-49c0-a126-d6644eeb7588.clone_snap' to 'volume-20c58c1f-0e97-49c0-a126-d6644eeb7588' {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} Apr 30 21:36:46.749108 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b8195e33-269f-40c1-a91d-3a348f15ae04 tempest-VolumesCloneTest-1015091794 None] Volume volume-632a7810-1a6f-420a-a6fd-57675408a8f7.deleted is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:36:46.750365 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b8195e33-269f-40c1-a91d-3a348f15ae04 tempest-VolumesCloneTest-1015091794 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:36:46.750743 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b8195e33-269f-40c1-a91d-3a348f15ae04 tempest-VolumesCloneTest-1015091794 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:36:47.065638 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b8195e33-269f-40c1-a91d-3a348f15ae04 tempest-VolumesCloneTest-1015091794 None] clone created successfully {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} Apr 30 21:36:47.072769 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.volume_utils [None req-b8195e33-269f-40c1-a91d-3a348f15ae04 tempest-VolumesCloneTest-1015091794 None] Marking volume 20c58c1f-0e97-49c0-a126-d6644eeb7588 as bootable. {{(pid=123855) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Apr 30 21:36:47.148901 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8195e33-269f-40c1-a91d-3a348f15ae04 tempest-VolumesCloneTest-1015091794 None] Copying metadata from source volume 716b8ed6-820c-4b42-84c8-5b9a8d40bb4b to 20c58c1f-0e97-49c0-a126-d6644eeb7588. {{(pid=123855) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:436}} Apr 30 21:36:47.252495 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b8195e33-269f-40c1-a91d-3a348f15ae04 tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ed9dd43-f37d-47aa-94fd-f843cd8781a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20c58c1f-0e97-49c0-a126-d6644eeb7588', 'volume_size': 1, 'source_volid': '716b8ed6-820c-4b42-84c8-5b9a8d40bb4b', 'source_volstatus': 'available'}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:47.259614 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b8195e33-269f-40c1-a91d-3a348f15ae04 tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b5c3d2a-980d-4793-a75a-add201132f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:47.337518 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-b8195e33-269f-40c1-a91d-3a348f15ae04 tempest-VolumesCloneTest-1015091794 None] Volume volume-20c58c1f-0e97-49c0-a126-d6644eeb7588 (20c58c1f-0e97-49c0-a126-d6644eeb7588): created successfully Apr 30 21:36:47.342444 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b8195e33-269f-40c1-a91d-3a348f15ae04 tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b5c3d2a-980d-4793-a75a-add201132f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:47.359372 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b8195e33-269f-40c1-a91d-3a348f15ae04 tempest-VolumesCloneTest-1015091794 None] Flow 'volume_create_manager' (675651fe-d20c-4b69-8f3b-fd09048d9da2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:36:47.531025 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-b8195e33-269f-40c1-a91d-3a348f15ae04 tempest-VolumesCloneTest-1015091794 None] Created volume successfully. Apr 30 21:36:48.315995 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-4919d123-896c-4165-8c3e-2287c2dcbcda tempest-VolumesServicesTestJSON-1548447146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:36:48.338960 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4919d123-896c-4165-8c3e-2287c2dcbcda tempest-VolumesServicesTestJSON-1548447146 None] Flow 'volume_create_manager' (7226f80a-6cfb-4918-a2d9-2a8f78c0e9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:36:48.348341 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4919d123-896c-4165-8c3e-2287c2dcbcda tempest-VolumesServicesTestJSON-1548447146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6af86a45-bcb7-4a57-ae27-31bf01ab37da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:48.365212 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4919d123-896c-4165-8c3e-2287c2dcbcda tempest-VolumesServicesTestJSON-1548447146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6af86a45-bcb7-4a57-ae27-31bf01ab37da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-319799987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=950180c1-f99f-4402-b75d-e337a3af9e82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39de769226a747dcb4299123cbd102ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:36:48Z,use_quota=True,user_id='1322fb2495ad42779699d4802f222ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:48.371198 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4919d123-896c-4165-8c3e-2287c2dcbcda tempest-VolumesServicesTestJSON-1548447146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4a2f0a-24e7-437e-88b8-884f20a103c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:48.376205 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4919d123-896c-4165-8c3e-2287c2dcbcda tempest-VolumesServicesTestJSON-1548447146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4a2f0a-24e7-437e-88b8-884f20a103c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:48.382496 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4919d123-896c-4165-8c3e-2287c2dcbcda tempest-VolumesServicesTestJSON-1548447146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35107e25-920d-40fa-9432-536e68a041f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:48.398957 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4919d123-896c-4165-8c3e-2287c2dcbcda tempest-VolumesServicesTestJSON-1548447146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35107e25-920d-40fa-9432-536e68a041f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '950180c1-f99f-4402-b75d-e337a3af9e82', 'volume_name': 'volume-950180c1-f99f-4402-b75d-e337a3af9e82', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:48.405938 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4919d123-896c-4165-8c3e-2287c2dcbcda tempest-VolumesServicesTestJSON-1548447146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28e1da2f-993a-41ff-8d7a-215d94e31189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:48.411778 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4919d123-896c-4165-8c3e-2287c2dcbcda tempest-VolumesServicesTestJSON-1548447146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28e1da2f-993a-41ff-8d7a-215d94e31189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:48.417091 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4919d123-896c-4165-8c3e-2287c2dcbcda tempest-VolumesServicesTestJSON-1548447146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f362ed9f-e7cb-4660-bd92-b3cb46d64046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:48.421092 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-4919d123-896c-4165-8c3e-2287c2dcbcda tempest-VolumesServicesTestJSON-1548447146 None] Volume 950180c1-f99f-4402-b75d-e337a3af9e82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-950180c1-f99f-4402-b75d-e337a3af9e82', 'volume_size': 1} Apr 30 21:36:48.421561 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-4919d123-896c-4165-8c3e-2287c2dcbcda tempest-VolumesServicesTestJSON-1548447146 None] creating volume 'volume-950180c1-f99f-4402-b75d-e337a3af9e82' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:36:48.422426 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-4919d123-896c-4165-8c3e-2287c2dcbcda tempest-VolumesServicesTestJSON-1548447146 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:36:48.886679 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-750df99b-0e79-4e2e-a7f3-92a3d2cd3a22 tempest-VolumesCloneTest-1015091794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:36:48.913066 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-750df99b-0e79-4e2e-a7f3-92a3d2cd3a22 tempest-VolumesCloneTest-1015091794 None] Flow 'volume_create_manager' (8f28113c-53e0-4500-9f42-554b792ceee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:36:48.920944 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-750df99b-0e79-4e2e-a7f3-92a3d2cd3a22 tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e55b214b-bb6e-4bed-aacd-aeb27e48cdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:48.954414 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-750df99b-0e79-4e2e-a7f3-92a3d2cd3a22 tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e55b214b-bb6e-4bed-aacd-aeb27e48cdb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1889700969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9b8c9824-cd15-47fc-ac06-a5dc5bf2f130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d24ab3357252430bb71551114c9bf7a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:36:49Z,use_quota=True,user_id='06938e94defa4e68b43b0ea0477b8995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:48.962795 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-750df99b-0e79-4e2e-a7f3-92a3d2cd3a22 tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (413bf78e-9bb3-4b91-8bab-a0c52ab04518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:48.968427 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-750df99b-0e79-4e2e-a7f3-92a3d2cd3a22 tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (413bf78e-9bb3-4b91-8bab-a0c52ab04518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:48.979881 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-750df99b-0e79-4e2e-a7f3-92a3d2cd3a22 tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d2d1d12-3dc3-4cd4-aa2b-740794ec482e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:48.984564 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-750df99b-0e79-4e2e-a7f3-92a3d2cd3a22 tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d2d1d12-3dc3-4cd4-aa2b-740794ec482e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b8c9824-cd15-47fc-ac06-a5dc5bf2f130', 'volume_name': 'volume-9b8c9824-cd15-47fc-ac06-a5dc5bf2f130', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:48.990920 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-750df99b-0e79-4e2e-a7f3-92a3d2cd3a22 tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (108be36b-bd7d-44e9-b398-301b29fd9dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:48.995964 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-750df99b-0e79-4e2e-a7f3-92a3d2cd3a22 tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (108be36b-bd7d-44e9-b398-301b29fd9dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:49.005278 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-750df99b-0e79-4e2e-a7f3-92a3d2cd3a22 tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be7c32d3-22f1-424d-a029-9f4a9025841a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:49.006473 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-750df99b-0e79-4e2e-a7f3-92a3d2cd3a22 tempest-VolumesCloneTest-1015091794 None] Volume 9b8c9824-cd15-47fc-ac06-a5dc5bf2f130: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b8c9824-cd15-47fc-ac06-a5dc5bf2f130', 'volume_size': 1} Apr 30 21:36:49.006870 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-750df99b-0e79-4e2e-a7f3-92a3d2cd3a22 tempest-VolumesCloneTest-1015091794 None] creating volume 'volume-9b8c9824-cd15-47fc-ac06-a5dc5bf2f130' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:36:49.007552 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-750df99b-0e79-4e2e-a7f3-92a3d2cd3a22 tempest-VolumesCloneTest-1015091794 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:36:49.131602 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-4919d123-896c-4165-8c3e-2287c2dcbcda tempest-VolumesServicesTestJSON-1548447146 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:36:49.131900 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-4919d123-896c-4165-8c3e-2287c2dcbcda tempest-VolumesServicesTestJSON-1548447146 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:36:49.136114 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4919d123-896c-4165-8c3e-2287c2dcbcda tempest-VolumesServicesTestJSON-1548447146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f362ed9f-e7cb-4660-bd92-b3cb46d64046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-950180c1-f99f-4402-b75d-e337a3af9e82', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:49.140971 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4919d123-896c-4165-8c3e-2287c2dcbcda tempest-VolumesServicesTestJSON-1548447146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad6bad7b-2fa7-4739-944d-9033d185e7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:49.211787 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-4919d123-896c-4165-8c3e-2287c2dcbcda tempest-VolumesServicesTestJSON-1548447146 None] Volume volume-950180c1-f99f-4402-b75d-e337a3af9e82 (950180c1-f99f-4402-b75d-e337a3af9e82): created successfully Apr 30 21:36:49.219976 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4919d123-896c-4165-8c3e-2287c2dcbcda tempest-VolumesServicesTestJSON-1548447146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad6bad7b-2fa7-4739-944d-9033d185e7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:49.225552 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4919d123-896c-4165-8c3e-2287c2dcbcda tempest-VolumesServicesTestJSON-1548447146 None] Flow 'volume_create_manager' (7226f80a-6cfb-4918-a2d9-2a8f78c0e9ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:36:49.312789 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-4919d123-896c-4165-8c3e-2287c2dcbcda tempest-VolumesServicesTestJSON-1548447146 None] Created volume successfully. Apr 30 21:36:49.662100 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-750df99b-0e79-4e2e-a7f3-92a3d2cd3a22 tempest-VolumesCloneTest-1015091794 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:36:49.663242 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-750df99b-0e79-4e2e-a7f3-92a3d2cd3a22 tempest-VolumesCloneTest-1015091794 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:36:49.667615 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-750df99b-0e79-4e2e-a7f3-92a3d2cd3a22 tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be7c32d3-22f1-424d-a029-9f4a9025841a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b8c9824-cd15-47fc-ac06-a5dc5bf2f130', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:49.673218 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-750df99b-0e79-4e2e-a7f3-92a3d2cd3a22 tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (242ea1fc-c6d9-4d75-b22a-bba8f13e0cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:49.744492 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-750df99b-0e79-4e2e-a7f3-92a3d2cd3a22 tempest-VolumesCloneTest-1015091794 None] Volume volume-9b8c9824-cd15-47fc-ac06-a5dc5bf2f130 (9b8c9824-cd15-47fc-ac06-a5dc5bf2f130): created successfully Apr 30 21:36:49.749896 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-750df99b-0e79-4e2e-a7f3-92a3d2cd3a22 tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (242ea1fc-c6d9-4d75-b22a-bba8f13e0cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:49.755878 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-750df99b-0e79-4e2e-a7f3-92a3d2cd3a22 tempest-VolumesCloneTest-1015091794 None] Flow 'volume_create_manager' (8f28113c-53e0-4500-9f42-554b792ceee5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:36:49.817271 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-750df99b-0e79-4e2e-a7f3-92a3d2cd3a22 tempest-VolumesCloneTest-1015091794 None] Created volume successfully. Apr 30 21:36:50.684427 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-7386931b-cb61-41b6-84ac-07cb069e4a0e tempest-VolumesServicesTestJSON-1548447146 None] Lock "b'cinder-950180c1-f99f-4402-b75d-e337a3af9e82-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:36:50.791190 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-7386931b-cb61-41b6-84ac-07cb069e4a0e tempest-VolumesServicesTestJSON-1548447146 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:36:50.987881 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-7386931b-cb61-41b6-84ac-07cb069e4a0e tempest-VolumesServicesTestJSON-1548447146 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:36:50.988643 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-7386931b-cb61-41b6-84ac-07cb069e4a0e tempest-VolumesServicesTestJSON-1548447146 None] Volume volume-950180c1-f99f-4402-b75d-e337a3af9e82 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:36:51.086748 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-7386931b-cb61-41b6-84ac-07cb069e4a0e tempest-VolumesServicesTestJSON-1548447146 None] deleting rbd volume volume-950180c1-f99f-4402-b75d-e337a3af9e82 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:36:51.784403 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3bdbfc8-2c27-4fa7-82d9-c8b86079854d tempest-VolumesCloneTest-1015091794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:36:51.835483 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e3bdbfc8-2c27-4fa7-82d9-c8b86079854d tempest-VolumesCloneTest-1015091794 None] Flow 'volume_create_manager' (9da985d8-4c91-408b-8c5a-a8f4d0b1a7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:36:51.840633 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e3bdbfc8-2c27-4fa7-82d9-c8b86079854d tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0542fe75-6a9e-4542-8a17-6a0c03201544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:51.866248 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e3bdbfc8-2c27-4fa7-82d9-c8b86079854d tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0542fe75-6a9e-4542-8a17-6a0c03201544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1490473359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=646f2b7e-ba19-4524-8d49-991b3c45da44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d24ab3357252430bb71551114c9bf7a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:36:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=9b8c9824-cd15-47fc-ac06-a5dc5bf2f130,status='creating',terminated_at=None,updated_at=2022-04-30T21:36:52Z,use_quota=True,user_id='06938e94defa4e68b43b0ea0477b8995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:51.871910 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e3bdbfc8-2c27-4fa7-82d9-c8b86079854d tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffbf60c0-305b-47e3-bd70-a3ec9a5c99bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:51.876420 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e3bdbfc8-2c27-4fa7-82d9-c8b86079854d tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffbf60c0-305b-47e3-bd70-a3ec9a5c99bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:51.887575 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e3bdbfc8-2c27-4fa7-82d9-c8b86079854d tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e3c3508-2d24-4097-a245-b72763eeaa84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:51.897795 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e3bdbfc8-2c27-4fa7-82d9-c8b86079854d tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e3c3508-2d24-4097-a245-b72763eeaa84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '646f2b7e-ba19-4524-8d49-991b3c45da44', 'volume_name': 'volume-646f2b7e-ba19-4524-8d49-991b3c45da44', 'volume_size': 2, 'source_volid': '9b8c9824-cd15-47fc-ac06-a5dc5bf2f130', 'source_volstatus': 'available'}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:51.903431 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e3bdbfc8-2c27-4fa7-82d9-c8b86079854d tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (721a0859-6437-45af-b583-6f043e43a557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:51.908101 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e3bdbfc8-2c27-4fa7-82d9-c8b86079854d tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (721a0859-6437-45af-b583-6f043e43a557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:51.912959 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e3bdbfc8-2c27-4fa7-82d9-c8b86079854d tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d35a5a0-567c-474d-95f5-50949e3ff5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:51.916336 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-e3bdbfc8-2c27-4fa7-82d9-c8b86079854d tempest-VolumesCloneTest-1015091794 None] Volume 646f2b7e-ba19-4524-8d49-991b3c45da44: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-646f2b7e-ba19-4524-8d49-991b3c45da44', 'volume_size': 2, 'source_volid': '9b8c9824-cd15-47fc-ac06-a5dc5bf2f130', 'source_volstatus': 'available'} Apr 30 21:36:51.926353 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e3bdbfc8-2c27-4fa7-82d9-c8b86079854d tempest-VolumesCloneTest-1015091794 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:36:52.132302 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e3bdbfc8-2c27-4fa7-82d9-c8b86079854d tempest-VolumesCloneTest-1015091794 None] creating snapshot='volume-646f2b7e-ba19-4524-8d49-991b3c45da44.clone_snap' {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} Apr 30 21:36:54.445916 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e3bdbfc8-2c27-4fa7-82d9-c8b86079854d tempest-VolumesCloneTest-1015091794 None] cloning 'volume-9b8c9824-cd15-47fc-ac06-a5dc5bf2f130@volume-646f2b7e-ba19-4524-8d49-991b3c45da44.clone_snap' to 'volume-646f2b7e-ba19-4524-8d49-991b3c45da44' {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} Apr 30 21:36:54.634170 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-7386931b-cb61-41b6-84ac-07cb069e4a0e tempest-VolumesServicesTestJSON-1548447146 None] Created reservations ['f9a4af0c-24a5-46e0-9fe1-03e2056b27f0', '69230e74-9ca0-4522-a220-7894df4bda5a', '781756f3-036d-4fcd-a3a7-9a301bc03974', '4b451786-b93c-451a-ace2-03ceef0e917c'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:36:54.886601 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-7386931b-cb61-41b6-84ac-07cb069e4a0e tempest-VolumesServicesTestJSON-1548447146 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:36:54.956856 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-7386931b-cb61-41b6-84ac-07cb069e4a0e tempest-VolumesServicesTestJSON-1548447146 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:36:55.042649 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-7386931b-cb61-41b6-84ac-07cb069e4a0e tempest-VolumesServicesTestJSON-1548447146 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:36:55.050411 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-7386931b-cb61-41b6-84ac-07cb069e4a0e tempest-VolumesServicesTestJSON-1548447146 None] Deleted volume successfully. Apr 30 21:36:55.128320 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-7386931b-cb61-41b6-84ac-07cb069e4a0e tempest-VolumesServicesTestJSON-1548447146 None] Lock "b'cinder-950180c1-f99f-4402-b75d-e337a3af9e82-delete_volume'" released by "delete_volume" :: held 4.448s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:36:55.250767 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e3bdbfc8-2c27-4fa7-82d9-c8b86079854d tempest-VolumesCloneTest-1015091794 None] Volume volume-9b8c9824-cd15-47fc-ac06-a5dc5bf2f130 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:36:55.252691 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e3bdbfc8-2c27-4fa7-82d9-c8b86079854d tempest-VolumesCloneTest-1015091794 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:36:55.253251 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e3bdbfc8-2c27-4fa7-82d9-c8b86079854d tempest-VolumesCloneTest-1015091794 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:36:55.462715 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e3bdbfc8-2c27-4fa7-82d9-c8b86079854d tempest-VolumesCloneTest-1015091794 None] resize volume 'volume-646f2b7e-ba19-4524-8d49-991b3c45da44' from 1 to 2 {{(pid=123855) _extend_if_required /opt/stack/cinder/cinder/volume/drivers/rbd.py:743}} Apr 30 21:36:55.463433 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e3bdbfc8-2c27-4fa7-82d9-c8b86079854d tempest-VolumesCloneTest-1015091794 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:36:56.321572 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e3bdbfc8-2c27-4fa7-82d9-c8b86079854d tempest-VolumesCloneTest-1015091794 None] clone created successfully {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} Apr 30 21:36:56.325679 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e3bdbfc8-2c27-4fa7-82d9-c8b86079854d tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d35a5a0-567c-474d-95f5-50949e3ff5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-646f2b7e-ba19-4524-8d49-991b3c45da44', 'volume_size': 2, 'source_volid': '9b8c9824-cd15-47fc-ac06-a5dc5bf2f130', 'source_volstatus': 'available'}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:56.337169 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e3bdbfc8-2c27-4fa7-82d9-c8b86079854d tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af17365-2d9a-4eb2-be34-611519cd3c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:36:56.422520 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-e3bdbfc8-2c27-4fa7-82d9-c8b86079854d tempest-VolumesCloneTest-1015091794 None] Volume volume-646f2b7e-ba19-4524-8d49-991b3c45da44 (646f2b7e-ba19-4524-8d49-991b3c45da44): created successfully Apr 30 21:36:56.428172 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e3bdbfc8-2c27-4fa7-82d9-c8b86079854d tempest-VolumesCloneTest-1015091794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af17365-2d9a-4eb2-be34-611519cd3c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:36:56.437906 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e3bdbfc8-2c27-4fa7-82d9-c8b86079854d tempest-VolumesCloneTest-1015091794 None] Flow 'volume_create_manager' (9da985d8-4c91-408b-8c5a-a8f4d0b1a7cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:36:56.553686 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-e3bdbfc8-2c27-4fa7-82d9-c8b86079854d tempest-VolumesCloneTest-1015091794 None] Created volume successfully. Apr 30 21:36:57.315264 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-cf498bef-8689-4e7c-af5c-cc0feed26516 tempest-VolumesCloneTest-1015091794 None] Lock "b'cinder-646f2b7e-ba19-4524-8d49-991b3c45da44-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:36:57.445138 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-cf498bef-8689-4e7c-af5c-cc0feed26516 tempest-VolumesCloneTest-1015091794 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:36:57.759707 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-cf498bef-8689-4e7c-af5c-cc0feed26516 tempest-VolumesCloneTest-1015091794 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:36:57.874809 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-cf498bef-8689-4e7c-af5c-cc0feed26516 tempest-VolumesCloneTest-1015091794 None] deleting rbd volume volume-646f2b7e-ba19-4524-8d49-991b3c45da44 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:37:00.287973 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-cf498bef-8689-4e7c-af5c-cc0feed26516 tempest-VolumesCloneTest-1015091794 None] volume is a clone so cleaning references {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} Apr 30 21:37:00.436036 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-cf498bef-8689-4e7c-af5c-cc0feed26516 tempest-VolumesCloneTest-1015091794 None] Volume volume-9b8c9824-cd15-47fc-ac06-a5dc5bf2f130 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:37:00.436801 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-cf498bef-8689-4e7c-af5c-cc0feed26516 tempest-VolumesCloneTest-1015091794 None] deleting parent snapshot volume-646f2b7e-ba19-4524-8d49-991b3c45da44.clone_snap {{(pid=123855) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} Apr 30 21:37:02.418852 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8ca3e27-673c-4a86-8c35-0635af974b3d tempest-VolumeRetypeWithoutMigrationTest-2040320425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:37:02.439668 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b8ca3e27-673c-4a86-8c35-0635af974b3d tempest-VolumeRetypeWithoutMigrationTest-2040320425 None] Flow 'volume_create_manager' (66c3f613-918b-4270-a7ce-75c4db847e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:37:02.446433 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b8ca3e27-673c-4a86-8c35-0635af974b3d tempest-VolumeRetypeWithoutMigrationTest-2040320425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (849b9c41-19c3-49db-9e08-523b9e730524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:02.475615 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e57d633-9869-4840-bf9f-8c5c3d6caf4b tempest-VolumesImageMetadata-1631285009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:37:02.494794 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8e57d633-9869-4840-bf9f-8c5c3d6caf4b tempest-VolumesImageMetadata-1631285009 None] Flow 'volume_create_manager' (6fd32f34-38c3-410a-88d4-7106b4b617e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:37:02.501236 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8e57d633-9869-4840-bf9f-8c5c3d6caf4b tempest-VolumesImageMetadata-1631285009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e16b8e9-7c54-42f9-9fce-19adadde4edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:02.529595 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-cf498bef-8689-4e7c-af5c-cc0feed26516 tempest-VolumesCloneTest-1015091794 None] Created reservations ['58f9622c-b02a-4634-acb8-72396fe81f5f', '4c1d2e45-dfeb-47f9-83b0-c78fc5c4ab7d', 'de18a925-7214-4980-8d31-69259b80acc5', '05bd6a23-8256-406c-8265-11ee2e673eac'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:37:02.543205 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8e57d633-9869-4840-bf9f-8c5c3d6caf4b tempest-VolumesImageMetadata-1631285009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e16b8e9-7c54-42f9-9fce-19adadde4edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1117980635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4c5d0e64-d4bb-46a3-9308-f451b5386bc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c29522e8468947d1a9d7f16b9c0f56b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:37:01Z,use_quota=True,user_id='c77af801c8e44efca3c7298ecb02d047',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:02.549371 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8e57d633-9869-4840-bf9f-8c5c3d6caf4b tempest-VolumesImageMetadata-1631285009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c6909a6-0694-4d4b-8de6-13736be253e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:02.553643 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8e57d633-9869-4840-bf9f-8c5c3d6caf4b tempest-VolumesImageMetadata-1631285009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c6909a6-0694-4d4b-8de6-13736be253e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:02.558870 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8e57d633-9869-4840-bf9f-8c5c3d6caf4b tempest-VolumesImageMetadata-1631285009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (489f9d08-d3c2-49f9-9d57-5c6f541c5d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:02.568773 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b8ca3e27-673c-4a86-8c35-0635af974b3d tempest-VolumeRetypeWithoutMigrationTest-2040320425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (849b9c41-19c3-49db-9e08-523b9e730524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1127972866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=488ad424-2b3c-487c-9d12-2bc0a7e256a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b0dafa61cd40f3988d5f44276dda51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:37:02Z,use_quota=True,user_id='478a318833914f869d7874fc4af07ede',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b945083f-2601-4a0a-b33f-0db851df8974),volume_type_id=b945083f-2601-4a0a-b33f-0db851df8974)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:02.574328 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b8ca3e27-673c-4a86-8c35-0635af974b3d tempest-VolumeRetypeWithoutMigrationTest-2040320425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ef5b8a-032f-4e23-8cf7-bc99ad688d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:02.578601 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b8ca3e27-673c-4a86-8c35-0635af974b3d tempest-VolumeRetypeWithoutMigrationTest-2040320425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ef5b8a-032f-4e23-8cf7-bc99ad688d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:02.585256 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b8ca3e27-673c-4a86-8c35-0635af974b3d tempest-VolumeRetypeWithoutMigrationTest-2040320425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e5a766-c95b-47e7-8f99-06341a98a71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:02.595606 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b8ca3e27-673c-4a86-8c35-0635af974b3d tempest-VolumeRetypeWithoutMigrationTest-2040320425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e5a766-c95b-47e7-8f99-06341a98a71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '488ad424-2b3c-487c-9d12-2bc0a7e256a1', 'volume_name': 'volume-488ad424-2b3c-487c-9d12-2bc0a7e256a1', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:02.601714 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b8ca3e27-673c-4a86-8c35-0635af974b3d tempest-VolumeRetypeWithoutMigrationTest-2040320425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ed7671-29f6-4207-ad37-069e33bc825d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:02.606310 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b8ca3e27-673c-4a86-8c35-0635af974b3d tempest-VolumeRetypeWithoutMigrationTest-2040320425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ed7671-29f6-4207-ad37-069e33bc825d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:02.611273 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b8ca3e27-673c-4a86-8c35-0635af974b3d tempest-VolumeRetypeWithoutMigrationTest-2040320425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa45c04-54fd-466c-b491-1110a722bb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:02.612388 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-b8ca3e27-673c-4a86-8c35-0635af974b3d tempest-VolumeRetypeWithoutMigrationTest-2040320425 None] Volume 488ad424-2b3c-487c-9d12-2bc0a7e256a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-488ad424-2b3c-487c-9d12-2bc0a7e256a1', 'volume_size': 1} Apr 30 21:37:02.612782 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b8ca3e27-673c-4a86-8c35-0635af974b3d tempest-VolumeRetypeWithoutMigrationTest-2040320425 None] creating volume 'volume-488ad424-2b3c-487c-9d12-2bc0a7e256a1' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:37:02.613916 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b8ca3e27-673c-4a86-8c35-0635af974b3d tempest-VolumeRetypeWithoutMigrationTest-2040320425 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:02.780740 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-edbae3cf-8f79-44dc-9773-752687ee9bbd tempest-SnapshotMetadataTestJSON-1112869917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:37:02.799315 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-edbae3cf-8f79-44dc-9773-752687ee9bbd tempest-SnapshotMetadataTestJSON-1112869917 None] Flow 'volume_create_manager' (ce8d6152-d8d9-4d25-b258-fba90d06357b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:37:02.806057 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-edbae3cf-8f79-44dc-9773-752687ee9bbd tempest-SnapshotMetadataTestJSON-1112869917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1209d84e-2f4e-4b7d-b08f-d9abf63fb6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:02.829369 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-edbae3cf-8f79-44dc-9773-752687ee9bbd tempest-SnapshotMetadataTestJSON-1112869917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1209d84e-2f4e-4b7d-b08f-d9abf63fb6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1509579365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c90c53df-9308-43ae-b60b-697e2a742755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea6a94bdaaa74acc884e368018624221',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:37:02Z,use_quota=True,user_id='2f563accc2f64beaa8e03e66615fa360',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:02.835232 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-edbae3cf-8f79-44dc-9773-752687ee9bbd tempest-SnapshotMetadataTestJSON-1112869917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66ab560e-70f0-4f4b-bb59-18a53592c45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:02.840523 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-edbae3cf-8f79-44dc-9773-752687ee9bbd tempest-SnapshotMetadataTestJSON-1112869917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66ab560e-70f0-4f4b-bb59-18a53592c45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:02.845110 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-edbae3cf-8f79-44dc-9773-752687ee9bbd tempest-SnapshotMetadataTestJSON-1112869917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001eeb04-eb2b-4582-8d6c-37611fef084f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:02.849183 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-edbae3cf-8f79-44dc-9773-752687ee9bbd tempest-SnapshotMetadataTestJSON-1112869917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001eeb04-eb2b-4582-8d6c-37611fef084f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c90c53df-9308-43ae-b60b-697e2a742755', 'volume_name': 'volume-c90c53df-9308-43ae-b60b-697e2a742755', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:02.854082 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-edbae3cf-8f79-44dc-9773-752687ee9bbd tempest-SnapshotMetadataTestJSON-1112869917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c94a52c-2231-469d-9a5e-20a7a4d9826c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:02.858195 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-edbae3cf-8f79-44dc-9773-752687ee9bbd tempest-SnapshotMetadataTestJSON-1112869917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c94a52c-2231-469d-9a5e-20a7a4d9826c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:02.862904 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-edbae3cf-8f79-44dc-9773-752687ee9bbd tempest-SnapshotMetadataTestJSON-1112869917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a862565f-4fe3-4a00-ba0c-482d089c8a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:02.869393 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-edbae3cf-8f79-44dc-9773-752687ee9bbd tempest-SnapshotMetadataTestJSON-1112869917 None] Volume c90c53df-9308-43ae-b60b-697e2a742755: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c90c53df-9308-43ae-b60b-697e2a742755', 'volume_size': 1} Apr 30 21:37:02.869393 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-edbae3cf-8f79-44dc-9773-752687ee9bbd tempest-SnapshotMetadataTestJSON-1112869917 None] creating volume 'volume-c90c53df-9308-43ae-b60b-697e2a742755' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:37:02.869393 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-edbae3cf-8f79-44dc-9773-752687ee9bbd tempest-SnapshotMetadataTestJSON-1112869917 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:02.909126 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8e57d633-9869-4840-bf9f-8c5c3d6caf4b tempest-VolumesImageMetadata-1631285009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (489f9d08-d3c2-49f9-9d57-5c6f541c5d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4c5d0e64-d4bb-46a3-9308-f451b5386bc0', 'volume_name': 'volume-4c5d0e64-d4bb-46a3-9308-f451b5386bc0', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:02.914219 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8e57d633-9869-4840-bf9f-8c5c3d6caf4b tempest-VolumesImageMetadata-1631285009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76ba8f06-5e22-40e5-960b-f1902a7f10c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:02.918246 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8e57d633-9869-4840-bf9f-8c5c3d6caf4b tempest-VolumesImageMetadata-1631285009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76ba8f06-5e22-40e5-960b-f1902a7f10c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:02.923044 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8e57d633-9869-4840-bf9f-8c5c3d6caf4b tempest-VolumesImageMetadata-1631285009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03d4c7cd-d74a-49dd-9fd2-0a7434b0233c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:02.924191 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-8e57d633-9869-4840-bf9f-8c5c3d6caf4b tempest-VolumesImageMetadata-1631285009 None] Volume 4c5d0e64-d4bb-46a3-9308-f451b5386bc0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4c5d0e64-d4bb-46a3-9308-f451b5386bc0', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 30 21:37:02.924755 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e57d633-9869-4840-bf9f-8c5c3d6caf4b tempest-VolumesImageMetadata-1631285009 None] Cloning 4c5d0e64-d4bb-46a3-9308-f451b5386bc0 from image a5b0850f-3b24-4bcb-b0a7-351c3216b27d at location (None, None). {{(pid=123855) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Apr 30 21:37:02.941322 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-8e57d633-9869-4840-bf9f-8c5c3d6caf4b tempest-VolumesImageMetadata-1631285009 None] Lock "b'cinder-a5b0850f-3b24-4bcb-b0a7-351c3216b27d'" acquired by "_prepare_image_cache_entry" :: waited 0.013s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:37:03.035438 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-8e57d633-9869-4840-bf9f-8c5c3d6caf4b tempest-VolumesImageMetadata-1631285009 None] Found image-volume cache entry: {'id': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'volume_id': '5772aef0-721f-450a-93ff-02cc6a41edcc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7), 'last_used': datetime.datetime(2022, 4, 30, 21, 37, 2, 944918)}. {{(pid=123855) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 30 21:37:03.036013 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-8e57d633-9869-4840-bf9f-8c5c3d6caf4b tempest-VolumesImageMetadata-1631285009 None] Image-volume cache entry image_update_at = 2022-04-30 21:01:07+00:00, requested image updated_at = 2022-04-30 21:01:07+00:00. {{(pid=123855) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 30 21:37:03.041566 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e57d633-9869-4840-bf9f-8c5c3d6caf4b tempest-VolumesImageMetadata-1631285009 None] Found cache entry for image = a5b0850f-3b24-4bcb-b0a7-351c3216b27d on host ncdv-master-1@ceph#ceph. {{(pid=123855) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Apr 30 21:37:03.041566 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-8e57d633-9869-4840-bf9f-8c5c3d6caf4b tempest-VolumesImageMetadata-1631285009 None] Lock "b'cinder-a5b0850f-3b24-4bcb-b0a7-351c3216b27d'" released by "_prepare_image_cache_entry" :: held 0.103s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:37:03.042383 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e57d633-9869-4840-bf9f-8c5c3d6caf4b tempest-VolumesImageMetadata-1631285009 None] Attempting to retrieve cache entry for image = a5b0850f-3b24-4bcb-b0a7-351c3216b27d on host ncdv-master-1@ceph#ceph. {{(pid=123855) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Apr 30 21:37:03.049290 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-8e57d633-9869-4840-bf9f-8c5c3d6caf4b tempest-VolumesImageMetadata-1631285009 None] Found image-volume cache entry: {'id': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'volume_id': '5772aef0-721f-450a-93ff-02cc6a41edcc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7), 'last_used': datetime.datetime(2022, 4, 30, 21, 37, 3, 45690)}. {{(pid=123855) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 30 21:37:03.049712 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-8e57d633-9869-4840-bf9f-8c5c3d6caf4b tempest-VolumesImageMetadata-1631285009 None] Image-volume cache entry image_update_at = 2022-04-30 21:01:07+00:00, requested image updated_at = 2022-04-30 21:01:07+00:00. {{(pid=123855) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 30 21:37:03.050395 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e57d633-9869-4840-bf9f-8c5c3d6caf4b tempest-VolumesImageMetadata-1631285009 None] Creating from source image-volume 5772aef0-721f-450a-93ff-02cc6a41edcc {{(pid=123855) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Apr 30 21:37:03.064149 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8e57d633-9869-4840-bf9f-8c5c3d6caf4b tempest-VolumesImageMetadata-1631285009 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:03.352930 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8e57d633-9869-4840-bf9f-8c5c3d6caf4b tempest-VolumesImageMetadata-1631285009 None] creating snapshot='volume-4c5d0e64-d4bb-46a3-9308-f451b5386bc0.clone_snap' {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} Apr 30 21:37:04.657429 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8e57d633-9869-4840-bf9f-8c5c3d6caf4b tempest-VolumesImageMetadata-1631285009 None] cloning 'volume-5772aef0-721f-450a-93ff-02cc6a41edcc@volume-4c5d0e64-d4bb-46a3-9308-f451b5386bc0.clone_snap' to 'volume-4c5d0e64-d4bb-46a3-9308-f451b5386bc0' {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} Apr 30 21:37:04.667400 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b8ca3e27-673c-4a86-8c35-0635af974b3d tempest-VolumeRetypeWithoutMigrationTest-2040320425 None] extra_specs: {} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:37:04.667767 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b8ca3e27-673c-4a86-8c35-0635af974b3d tempest-VolumeRetypeWithoutMigrationTest-2040320425 None] extra_specs: {} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:37:04.671678 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b8ca3e27-673c-4a86-8c35-0635af974b3d tempest-VolumeRetypeWithoutMigrationTest-2040320425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa45c04-54fd-466c-b491-1110a722bb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-488ad424-2b3c-487c-9d12-2bc0a7e256a1', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:04.681501 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b8ca3e27-673c-4a86-8c35-0635af974b3d tempest-VolumeRetypeWithoutMigrationTest-2040320425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08a32316-83b7-45e9-8fb3-fd72b6cf6560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:04.692840 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-edbae3cf-8f79-44dc-9773-752687ee9bbd tempest-SnapshotMetadataTestJSON-1112869917 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:37:04.693965 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-edbae3cf-8f79-44dc-9773-752687ee9bbd tempest-SnapshotMetadataTestJSON-1112869917 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:37:04.700340 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-edbae3cf-8f79-44dc-9773-752687ee9bbd tempest-SnapshotMetadataTestJSON-1112869917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a862565f-4fe3-4a00-ba0c-482d089c8a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c90c53df-9308-43ae-b60b-697e2a742755', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:04.705729 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-edbae3cf-8f79-44dc-9773-752687ee9bbd tempest-SnapshotMetadataTestJSON-1112869917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67f4a3fe-5c74-47dc-8602-721aa25b3c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:04.716307 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-cf498bef-8689-4e7c-af5c-cc0feed26516 tempest-VolumesCloneTest-1015091794 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:04.741450 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-cf498bef-8689-4e7c-af5c-cc0feed26516 tempest-VolumesCloneTest-1015091794 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:04.763729 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-cf498bef-8689-4e7c-af5c-cc0feed26516 tempest-VolumesCloneTest-1015091794 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:37:04.771446 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-cf498bef-8689-4e7c-af5c-cc0feed26516 tempest-VolumesCloneTest-1015091794 None] Deleted volume successfully. Apr 30 21:37:04.777677 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-3bc8e512-ea10-44a9-9def-e4905e4e4c57 tempest-VolumesCloneTest-1015091794 None] Lock "b'cinder-9b8c9824-cd15-47fc-ac06-a5dc5bf2f130-delete_volume'" acquired by "delete_volume" :: waited 0.066s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:37:04.828094 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-b8ca3e27-673c-4a86-8c35-0635af974b3d tempest-VolumeRetypeWithoutMigrationTest-2040320425 None] Volume volume-488ad424-2b3c-487c-9d12-2bc0a7e256a1 (488ad424-2b3c-487c-9d12-2bc0a7e256a1): created successfully Apr 30 21:37:04.832074 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b8ca3e27-673c-4a86-8c35-0635af974b3d tempest-VolumeRetypeWithoutMigrationTest-2040320425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08a32316-83b7-45e9-8fb3-fd72b6cf6560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:04.837782 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b8ca3e27-673c-4a86-8c35-0635af974b3d tempest-VolumeRetypeWithoutMigrationTest-2040320425 None] Flow 'volume_create_manager' (66c3f613-918b-4270-a7ce-75c4db847e9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:37:04.842451 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-edbae3cf-8f79-44dc-9773-752687ee9bbd tempest-SnapshotMetadataTestJSON-1112869917 None] Volume volume-c90c53df-9308-43ae-b60b-697e2a742755 (c90c53df-9308-43ae-b60b-697e2a742755): created successfully Apr 30 21:37:04.846536 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-edbae3cf-8f79-44dc-9773-752687ee9bbd tempest-SnapshotMetadataTestJSON-1112869917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67f4a3fe-5c74-47dc-8602-721aa25b3c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:04.852022 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-edbae3cf-8f79-44dc-9773-752687ee9bbd tempest-SnapshotMetadataTestJSON-1112869917 None] Flow 'volume_create_manager' (ce8d6152-d8d9-4d25-b258-fba90d06357b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:37:04.892415 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-cf498bef-8689-4e7c-af5c-cc0feed26516 tempest-VolumesCloneTest-1015091794 None] Lock "b'cinder-646f2b7e-ba19-4524-8d49-991b3c45da44-delete_volume'" released by "delete_volume" :: held 7.577s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:37:04.901567 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-3bc8e512-ea10-44a9-9def-e4905e4e4c57 tempest-VolumesCloneTest-1015091794 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:05.118858 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-3bc8e512-ea10-44a9-9def-e4905e4e4c57 tempest-VolumesCloneTest-1015091794 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:37:05.119284 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-3bc8e512-ea10-44a9-9def-e4905e4e4c57 tempest-VolumesCloneTest-1015091794 None] Volume volume-9b8c9824-cd15-47fc-ac06-a5dc5bf2f130 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:37:05.336977 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-3bc8e512-ea10-44a9-9def-e4905e4e4c57 tempest-VolumesCloneTest-1015091794 None] deleting rbd volume volume-9b8c9824-cd15-47fc-ac06-a5dc5bf2f130 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:37:05.340342 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-edbae3cf-8f79-44dc-9773-752687ee9bbd tempest-SnapshotMetadataTestJSON-1112869917 None] Created volume successfully. Apr 30 21:37:05.350307 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-b8ca3e27-673c-4a86-8c35-0635af974b3d tempest-VolumeRetypeWithoutMigrationTest-2040320425 None] Created volume successfully. Apr 30 21:37:05.784276 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8e57d633-9869-4840-bf9f-8c5c3d6caf4b tempest-VolumesImageMetadata-1631285009 None] Volume volume-632a7810-1a6f-420a-a6fd-57675408a8f7.deleted is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:37:05.785742 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8e57d633-9869-4840-bf9f-8c5c3d6caf4b tempest-VolumesImageMetadata-1631285009 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:37:05.786771 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8e57d633-9869-4840-bf9f-8c5c3d6caf4b tempest-VolumesImageMetadata-1631285009 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:37:06.237714 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8e57d633-9869-4840-bf9f-8c5c3d6caf4b tempest-VolumesImageMetadata-1631285009 None] clone created successfully {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} Apr 30 21:37:06.238434 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.volume_utils [None req-8e57d633-9869-4840-bf9f-8c5c3d6caf4b tempest-VolumesImageMetadata-1631285009 None] Marking volume 4c5d0e64-d4bb-46a3-9308-f451b5386bc0 as bootable. {{(pid=123855) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Apr 30 21:37:06.354116 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e57d633-9869-4840-bf9f-8c5c3d6caf4b tempest-VolumesImageMetadata-1631285009 None] Copying metadata from image a5b0850f-3b24-4bcb-b0a7-351c3216b27d to 4c5d0e64-d4bb-46a3-9308-f451b5386bc0. {{(pid=123855) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Apr 30 21:37:06.354532 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e57d633-9869-4840-bf9f-8c5c3d6caf4b tempest-VolumesImageMetadata-1631285009 None] Creating volume glance metadata for volume 4c5d0e64-d4bb-46a3-9308-f451b5386bc0 backed by image a5b0850f-3b24-4bcb-b0a7-351c3216b27d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123855) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Apr 30 21:37:06.369693 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-0a15dea8-12d3-4b55-978e-005bc5bba69e tempest-SnapshotMetadataTestJSON-1112869917 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:06.791335 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8e57d633-9869-4840-bf9f-8c5c3d6caf4b tempest-VolumesImageMetadata-1631285009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03d4c7cd-d74a-49dd-9fd2-0a7434b0233c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c5d0e64-d4bb-46a3-9308-f451b5386bc0', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:06.796999 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8e57d633-9869-4840-bf9f-8c5c3d6caf4b tempest-VolumesImageMetadata-1631285009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a51864b-8053-4a5d-ab63-8531b965e6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:06.810744 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-276257da-83ed-4d47-8439-f4f2b96c1e75 tempest-VolumeRetypeWithoutMigrationTest-2040320425 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:06.879821 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-276257da-83ed-4d47-8439-f4f2b96c1e75 tempest-VolumeRetypeWithoutMigrationTest-2040320425 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:06.921807 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-276257da-83ed-4d47-8439-f4f2b96c1e75 tempest-VolumeRetypeWithoutMigrationTest-2040320425 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:37:06.926594 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-276257da-83ed-4d47-8439-f4f2b96c1e75 tempest-VolumeRetypeWithoutMigrationTest-2040320425 None] Retype volume completed successfully. Apr 30 21:37:06.937777 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-8e57d633-9869-4840-bf9f-8c5c3d6caf4b tempest-VolumesImageMetadata-1631285009 None] Volume volume-4c5d0e64-d4bb-46a3-9308-f451b5386bc0 (4c5d0e64-d4bb-46a3-9308-f451b5386bc0): created successfully Apr 30 21:37:06.941589 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8e57d633-9869-4840-bf9f-8c5c3d6caf4b tempest-VolumesImageMetadata-1631285009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a51864b-8053-4a5d-ab63-8531b965e6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:06.947704 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8e57d633-9869-4840-bf9f-8c5c3d6caf4b tempest-VolumesImageMetadata-1631285009 None] Flow 'volume_create_manager' (6fd32f34-38c3-410a-88d4-7106b4b617e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:37:07.033749 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-8e57d633-9869-4840-bf9f-8c5c3d6caf4b tempest-VolumesImageMetadata-1631285009 None] Created volume successfully. Apr 30 21:37:07.255278 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-55d6500c-74eb-4d56-855f-4d1dc1e72c99 tempest-VolumeRetypeWithoutMigrationTest-2040320425 None] Lock "b'cinder-488ad424-2b3c-487c-9d12-2bc0a7e256a1-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:37:07.363898 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-55d6500c-74eb-4d56-855f-4d1dc1e72c99 tempest-VolumeRetypeWithoutMigrationTest-2040320425 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:07.513048 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-55d6500c-74eb-4d56-855f-4d1dc1e72c99 tempest-VolumeRetypeWithoutMigrationTest-2040320425 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:37:07.513479 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-55d6500c-74eb-4d56-855f-4d1dc1e72c99 tempest-VolumeRetypeWithoutMigrationTest-2040320425 None] Volume volume-488ad424-2b3c-487c-9d12-2bc0a7e256a1 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:37:07.627668 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-55d6500c-74eb-4d56-855f-4d1dc1e72c99 tempest-VolumeRetypeWithoutMigrationTest-2040320425 None] deleting rbd volume volume-488ad424-2b3c-487c-9d12-2bc0a7e256a1 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:37:07.866072 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-ff8ae6a9-8b3a-4669-a36d-f1d30ca7f410 tempest-VolumesImageMetadata-1631285009 None] Lock "b'cinder-4c5d0e64-d4bb-46a3-9308-f451b5386bc0-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:37:07.977749 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ff8ae6a9-8b3a-4669-a36d-f1d30ca7f410 tempest-VolumesImageMetadata-1631285009 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:08.318977 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ff8ae6a9-8b3a-4669-a36d-f1d30ca7f410 tempest-VolumesImageMetadata-1631285009 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:37:08.448022 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ff8ae6a9-8b3a-4669-a36d-f1d30ca7f410 tempest-VolumesImageMetadata-1631285009 None] deleting rbd volume volume-4c5d0e64-d4bb-46a3-9308-f451b5386bc0 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:37:09.302684 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-0a15dea8-12d3-4b55-978e-005bc5bba69e tempest-SnapshotMetadataTestJSON-1112869917 None] Create snapshot completed successfully Apr 30 21:37:09.363397 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-3bc8e512-ea10-44a9-9def-e4905e4e4c57 tempest-VolumesCloneTest-1015091794 None] Created reservations ['d1306e94-a63e-44a4-af44-a7d98f2b4cc2', 'b221a304-48a8-406e-b7e4-a16cb8e6ea79', '762b0aee-00ec-4247-9ed8-8c43187be00b', 'eb259d9c-47d7-4a8f-95e2-b1b98ad03467'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:37:09.642272 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-3bc8e512-ea10-44a9-9def-e4905e4e4c57 tempest-VolumesCloneTest-1015091794 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:09.666816 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-3bc8e512-ea10-44a9-9def-e4905e4e4c57 tempest-VolumesCloneTest-1015091794 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:09.690332 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-3bc8e512-ea10-44a9-9def-e4905e4e4c57 tempest-VolumesCloneTest-1015091794 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:37:09.694708 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-3bc8e512-ea10-44a9-9def-e4905e4e4c57 tempest-VolumesCloneTest-1015091794 None] Deleted volume successfully. Apr 30 21:37:09.749856 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-218b18e9-3ab6-4ff1-9f7b-f0119120f5f4 tempest-VolumesCloneTest-1015091794 None] Lock "b'cinder-20c58c1f-0e97-49c0-a126-d6644eeb7588-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:37:09.765243 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-3bc8e512-ea10-44a9-9def-e4905e4e4c57 tempest-VolumesCloneTest-1015091794 None] Lock "b'cinder-9b8c9824-cd15-47fc-ac06-a5dc5bf2f130-delete_volume'" released by "delete_volume" :: held 4.988s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:37:09.828088 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-218b18e9-3ab6-4ff1-9f7b-f0119120f5f4 tempest-VolumesCloneTest-1015091794 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:10.152827 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-218b18e9-3ab6-4ff1-9f7b-f0119120f5f4 tempest-VolumesCloneTest-1015091794 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:37:10.558818 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-218b18e9-3ab6-4ff1-9f7b-f0119120f5f4 tempest-VolumesCloneTest-1015091794 None] deleting rbd volume volume-20c58c1f-0e97-49c0-a126-d6644eeb7588 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:37:11.540652 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-bd31e4bb-b55a-4ab9-989c-c13c3a161749 tempest-SnapshotMetadataTestJSON-1112869917 None] Lock "b'cinder-96395392-dbec-4cac-8d3e-4c0240033d2b-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:37:11.542498 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bd31e4bb-b55a-4ab9-989c-c13c3a161749 tempest-SnapshotMetadataTestJSON-1112869917 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:12.331020 ncdv-master-1 cinder-volume[123855]: WARNING cinder.quota [None req-55d6500c-74eb-4d56-855f-4d1dc1e72c99 tempest-VolumeRetypeWithoutMigrationTest-2040320425 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 30 21:37:12.331937 ncdv-master-1 cinder-volume[123855]: WARNING cinder.quota [None req-55d6500c-74eb-4d56-855f-4d1dc1e72c99 tempest-VolumeRetypeWithoutMigrationTest-2040320425 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 30 21:37:12.440683 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-55d6500c-74eb-4d56-855f-4d1dc1e72c99 tempest-VolumeRetypeWithoutMigrationTest-2040320425 None] Created reservations ['67fdef5a-91e2-414d-9061-0e1ae04cd4a4', 'd2157b35-2da5-4476-b07c-ef254eda1775', '90106af6-c84d-4ad2-a863-8cae42554c75', '69a1cb87-e2cc-4132-97a2-15d5648bb4bb'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:37:12.605263 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-55d6500c-74eb-4d56-855f-4d1dc1e72c99 tempest-VolumeRetypeWithoutMigrationTest-2040320425 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:12.631498 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-55d6500c-74eb-4d56-855f-4d1dc1e72c99 tempest-VolumeRetypeWithoutMigrationTest-2040320425 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:12.655852 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-55d6500c-74eb-4d56-855f-4d1dc1e72c99 tempest-VolumeRetypeWithoutMigrationTest-2040320425 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:37:12.660526 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-55d6500c-74eb-4d56-855f-4d1dc1e72c99 tempest-VolumeRetypeWithoutMigrationTest-2040320425 None] Deleted volume successfully. Apr 30 21:37:12.734726 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-55d6500c-74eb-4d56-855f-4d1dc1e72c99 tempest-VolumeRetypeWithoutMigrationTest-2040320425 None] Lock "b'cinder-488ad424-2b3c-487c-9d12-2bc0a7e256a1-delete_volume'" released by "delete_volume" :: held 5.482s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:37:13.091785 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ff8ae6a9-8b3a-4669-a36d-f1d30ca7f410 tempest-VolumesImageMetadata-1631285009 None] volume is a clone so cleaning references {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} Apr 30 21:37:13.291259 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ff8ae6a9-8b3a-4669-a36d-f1d30ca7f410 tempest-VolumesImageMetadata-1631285009 None] deleting parent snapshot volume-4c5d0e64-d4bb-46a3-9308-f451b5386bc0.clone_snap {{(pid=123855) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} Apr 30 21:37:15.758485 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-218b18e9-3ab6-4ff1-9f7b-f0119120f5f4 tempest-VolumesCloneTest-1015091794 None] volume is a clone so cleaning references {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} Apr 30 21:37:15.979852 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-218b18e9-3ab6-4ff1-9f7b-f0119120f5f4 tempest-VolumesCloneTest-1015091794 None] deleting parent snapshot volume-20c58c1f-0e97-49c0-a126-d6644eeb7588.clone_snap {{(pid=123855) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} Apr 30 21:37:18.502085 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-6067d005-60b7-4207-a935-2a7ef655abfb tempest-GroupsV314Test-1914113507 None] Group tempest-GroupsV314Test-Group-1107836238: creating Apr 30 21:37:18.633612 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-6067d005-60b7-4207-a935-2a7ef655abfb tempest-GroupsV314Test-1914113507 None] Group tempest-GroupsV314Test-Group-1107836238: created successfully Apr 30 21:37:18.643048 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-6067d005-60b7-4207-a935-2a7ef655abfb tempest-GroupsV314Test-1914113507 None] Create group completed successfully. Apr 30 21:37:18.656281 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-ff8ae6a9-8b3a-4669-a36d-f1d30ca7f410 tempest-VolumesImageMetadata-1631285009 None] Created reservations ['7a9ee41b-253b-4b38-96f3-a8775825e5c4', 'b8301f62-169e-4c80-bef9-428889d7272a', 'c6974a98-54d7-4d86-aae8-ab5bd6037edc', '8039d9a9-9dab-4f07-a2e9-a5d3630f4e13'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:37:18.659398 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-218b18e9-3ab6-4ff1-9f7b-f0119120f5f4 tempest-VolumesCloneTest-1015091794 None] Created reservations ['637222ef-2ec0-4e35-a6c4-618299b29f4c', '91a9a7aa-0815-4448-8a9f-057783a56bbd', 'a0237db1-34ef-45af-a55c-59a1ec946903', '3e9c60a1-09f4-4fb4-b3ec-8c2b7de29aa8'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:37:18.695691 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-bd31e4bb-b55a-4ab9-989c-c13c3a161749 tempest-SnapshotMetadataTestJSON-1112869917 None] Created reservations ['7743ca09-c88d-413f-afdb-1bcd3cfbe91f', '956c7adb-521e-4842-a295-d931155f85d8', '3fe6920c-2938-41c8-848e-ab798bbcb61a', '6542337d-e906-4929-8f6a-b43a16994d4d'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:37:18.822027 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-218b18e9-3ab6-4ff1-9f7b-f0119120f5f4 tempest-VolumesCloneTest-1015091794 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:18.844031 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-218b18e9-3ab6-4ff1-9f7b-f0119120f5f4 tempest-VolumesCloneTest-1015091794 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:18.869148 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-218b18e9-3ab6-4ff1-9f7b-f0119120f5f4 tempest-VolumesCloneTest-1015091794 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:37:18.873362 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-218b18e9-3ab6-4ff1-9f7b-f0119120f5f4 tempest-VolumesCloneTest-1015091794 None] Deleted volume successfully. Apr 30 21:37:18.896530 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ff8ae6a9-8b3a-4669-a36d-f1d30ca7f410 tempest-VolumesImageMetadata-1631285009 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:18.928704 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ff8ae6a9-8b3a-4669-a36d-f1d30ca7f410 tempest-VolumesImageMetadata-1631285009 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:18.957375 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ff8ae6a9-8b3a-4669-a36d-f1d30ca7f410 tempest-VolumesImageMetadata-1631285009 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:37:18.959390 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-bd31e4bb-b55a-4ab9-989c-c13c3a161749 tempest-SnapshotMetadataTestJSON-1112869917 None] Delete snapshot completed successfully. Apr 30 21:37:18.965105 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-ff8ae6a9-8b3a-4669-a36d-f1d30ca7f410 tempest-VolumesImageMetadata-1631285009 None] Deleted volume successfully. Apr 30 21:37:18.969017 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-bd31e4bb-b55a-4ab9-989c-c13c3a161749 tempest-SnapshotMetadataTestJSON-1112869917 None] Lock "b'cinder-96395392-dbec-4cac-8d3e-4c0240033d2b-delete_snapshot'" released by "delete_snapshot" :: held 7.428s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:37:18.978670 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-218b18e9-3ab6-4ff1-9f7b-f0119120f5f4 tempest-VolumesCloneTest-1015091794 None] Lock "b'cinder-20c58c1f-0e97-49c0-a126-d6644eeb7588-delete_volume'" released by "delete_volume" :: held 9.229s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:37:19.053872 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-ff8ae6a9-8b3a-4669-a36d-f1d30ca7f410 tempest-VolumesImageMetadata-1631285009 None] Lock "b'cinder-4c5d0e64-d4bb-46a3-9308-f451b5386bc0-delete_volume'" released by "delete_volume" :: held 11.188s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:37:19.453030 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-9ec9f7db-9b5d-4264-bf25-974dd0a16051 tempest-VolumesCloneTest-1015091794 None] Lock "b'cinder-716b8ed6-820c-4b42-84c8-5b9a8d40bb4b-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:37:19.542771 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9ec9f7db-9b5d-4264-bf25-974dd0a16051 tempest-VolumesCloneTest-1015091794 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:19.685879 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9ec9f7db-9b5d-4264-bf25-974dd0a16051 tempest-VolumesCloneTest-1015091794 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:37:19.765943 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9ec9f7db-9b5d-4264-bf25-974dd0a16051 tempest-VolumesCloneTest-1015091794 None] deleting rbd volume volume-716b8ed6-820c-4b42-84c8-5b9a8d40bb4b {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:37:20.491620 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3db936c-022b-478a-b137-153240a869d8 tempest-GroupsV314Test-1914113507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:37:20.510947 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b3db936c-022b-478a-b137-153240a869d8 tempest-GroupsV314Test-1914113507 None] Flow 'volume_create_manager' (7104c32a-8a1b-40d9-93f3-490b02e98679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:37:20.517414 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b3db936c-022b-478a-b137-153240a869d8 tempest-GroupsV314Test-1914113507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8a1d633-f22e-4e15-b6da-38bee7d52c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:20.540938 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b3db936c-022b-478a-b137-153240a869d8 tempest-GroupsV314Test-1914113507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8a1d633-f22e-4e15-b6da-38bee7d52c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsV314Test-Volume-1431291645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=04572595-ecc3-4588-a9d2-e3762fc69b9f,host='ncdv-master-1@ceph#ceph',id=07f1fe41-a251-44bd-81b5-77080df526c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba6f219a03684e02b7c38372cef6f3a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:37:20Z,use_quota=True,user_id='02f6985817d347d2b74ba939500f55a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9fe537-8304-4ffa-a553-9a4e089d9207),volume_type_id=0a9fe537-8304-4ffa-a553-9a4e089d9207)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:20.546383 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b3db936c-022b-478a-b137-153240a869d8 tempest-GroupsV314Test-1914113507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ffb9f51-2004-4fed-9f2f-9ce18a1cbc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:20.551315 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b3db936c-022b-478a-b137-153240a869d8 tempest-GroupsV314Test-1914113507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ffb9f51-2004-4fed-9f2f-9ce18a1cbc36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:20.556809 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b3db936c-022b-478a-b137-153240a869d8 tempest-GroupsV314Test-1914113507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90c8399b-c8a3-4224-a687-9808dddfdef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:20.560806 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b3db936c-022b-478a-b137-153240a869d8 tempest-GroupsV314Test-1914113507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90c8399b-c8a3-4224-a687-9808dddfdef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07f1fe41-a251-44bd-81b5-77080df526c0', 'volume_name': 'volume-07f1fe41-a251-44bd-81b5-77080df526c0', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:20.565784 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b3db936c-022b-478a-b137-153240a869d8 tempest-GroupsV314Test-1914113507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d866ea0-6dc4-4409-b460-fa5c20a84a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:20.569788 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b3db936c-022b-478a-b137-153240a869d8 tempest-GroupsV314Test-1914113507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d866ea0-6dc4-4409-b460-fa5c20a84a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:20.574523 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b3db936c-022b-478a-b137-153240a869d8 tempest-GroupsV314Test-1914113507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a9f441b-5323-49ef-9226-6d3d68da26ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:20.575699 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-b3db936c-022b-478a-b137-153240a869d8 tempest-GroupsV314Test-1914113507 None] Volume 07f1fe41-a251-44bd-81b5-77080df526c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07f1fe41-a251-44bd-81b5-77080df526c0', 'volume_size': 1} Apr 30 21:37:20.576038 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b3db936c-022b-478a-b137-153240a869d8 tempest-GroupsV314Test-1914113507 None] creating volume 'volume-07f1fe41-a251-44bd-81b5-77080df526c0' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:37:20.576822 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b3db936c-022b-478a-b137-153240a869d8 tempest-GroupsV314Test-1914113507 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:20.615093 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-a2177454-5d1b-4f5e-b486-9298c3a16455 tempest-SnapshotMetadataTestJSON-1112869917 None] Lock "b'cinder-c90c53df-9308-43ae-b60b-697e2a742755-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:37:20.663872 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-e96157be-4b52-4236-8de9-5dbce26e4ba8 tempest-VolumesTransfersTest-521662743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:37:20.683726 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e96157be-4b52-4236-8de9-5dbce26e4ba8 tempest-VolumesTransfersTest-521662743 None] Flow 'volume_create_manager' (87d11ddb-2346-417b-9b82-205e78bf497e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:37:20.690143 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e96157be-4b52-4236-8de9-5dbce26e4ba8 tempest-VolumesTransfersTest-521662743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c165b38-1b1c-4806-8069-a07c04bc41c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:20.705347 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e96157be-4b52-4236-8de9-5dbce26e4ba8 tempest-VolumesTransfersTest-521662743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c165b38-1b1c-4806-8069-a07c04bc41c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1022744839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=96d1ea3b-b458-477f-a8ba-0164409b2a0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cfecbeba61c420a8185d621647a8059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:37:20Z,use_quota=True,user_id='fc2dbf2ab81b4a6d921f2ef0c0bc345e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:20.710814 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e96157be-4b52-4236-8de9-5dbce26e4ba8 tempest-VolumesTransfersTest-521662743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1244d513-b86f-4890-8752-b7849e4b605a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:20.714932 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e96157be-4b52-4236-8de9-5dbce26e4ba8 tempest-VolumesTransfersTest-521662743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1244d513-b86f-4890-8752-b7849e4b605a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:20.720518 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e96157be-4b52-4236-8de9-5dbce26e4ba8 tempest-VolumesTransfersTest-521662743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97eba41e-fd7b-457c-9d42-7ad56a3bcdc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:20.725649 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e96157be-4b52-4236-8de9-5dbce26e4ba8 tempest-VolumesTransfersTest-521662743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97eba41e-fd7b-457c-9d42-7ad56a3bcdc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96d1ea3b-b458-477f-a8ba-0164409b2a0d', 'volume_name': 'volume-96d1ea3b-b458-477f-a8ba-0164409b2a0d', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:20.729566 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e96157be-4b52-4236-8de9-5dbce26e4ba8 tempest-VolumesTransfersTest-521662743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1289dda7-1c7e-4611-a65a-06940c96e729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:20.733450 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e96157be-4b52-4236-8de9-5dbce26e4ba8 tempest-VolumesTransfersTest-521662743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1289dda7-1c7e-4611-a65a-06940c96e729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:20.738777 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e96157be-4b52-4236-8de9-5dbce26e4ba8 tempest-VolumesTransfersTest-521662743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5178afbf-1f0b-4963-9863-e12f2d1b6b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:20.739851 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-e96157be-4b52-4236-8de9-5dbce26e4ba8 tempest-VolumesTransfersTest-521662743 None] Volume 96d1ea3b-b458-477f-a8ba-0164409b2a0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96d1ea3b-b458-477f-a8ba-0164409b2a0d', 'volume_size': 1} Apr 30 21:37:20.740267 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e96157be-4b52-4236-8de9-5dbce26e4ba8 tempest-VolumesTransfersTest-521662743 None] creating volume 'volume-96d1ea3b-b458-477f-a8ba-0164409b2a0d' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:37:20.740919 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e96157be-4b52-4236-8de9-5dbce26e4ba8 tempest-VolumesTransfersTest-521662743 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:20.808592 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a2177454-5d1b-4f5e-b486-9298c3a16455 tempest-SnapshotMetadataTestJSON-1112869917 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:20.919056 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a2177454-5d1b-4f5e-b486-9298c3a16455 tempest-SnapshotMetadataTestJSON-1112869917 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:37:20.919560 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a2177454-5d1b-4f5e-b486-9298c3a16455 tempest-SnapshotMetadataTestJSON-1112869917 None] Volume volume-c90c53df-9308-43ae-b60b-697e2a742755 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:37:21.188921 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a2177454-5d1b-4f5e-b486-9298c3a16455 tempest-SnapshotMetadataTestJSON-1112869917 None] deleting rbd volume volume-c90c53df-9308-43ae-b60b-697e2a742755 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:37:21.350772 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b3db936c-022b-478a-b137-153240a869d8 tempest-GroupsV314Test-1914113507 None] extra_specs: {} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:37:21.351170 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b3db936c-022b-478a-b137-153240a869d8 tempest-GroupsV314Test-1914113507 None] extra_specs: {} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:37:21.355623 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b3db936c-022b-478a-b137-153240a869d8 tempest-GroupsV314Test-1914113507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a9f441b-5323-49ef-9226-6d3d68da26ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07f1fe41-a251-44bd-81b5-77080df526c0', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:21.359788 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b3db936c-022b-478a-b137-153240a869d8 tempest-GroupsV314Test-1914113507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaa53021-91b9-477e-ad97-e35edd616451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:21.433014 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-b3db936c-022b-478a-b137-153240a869d8 tempest-GroupsV314Test-1914113507 None] Volume volume-07f1fe41-a251-44bd-81b5-77080df526c0 (07f1fe41-a251-44bd-81b5-77080df526c0): created successfully Apr 30 21:37:21.436742 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b3db936c-022b-478a-b137-153240a869d8 tempest-GroupsV314Test-1914113507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaa53021-91b9-477e-ad97-e35edd616451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:21.442706 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b3db936c-022b-478a-b137-153240a869d8 tempest-GroupsV314Test-1914113507 None] Flow 'volume_create_manager' (7104c32a-8a1b-40d9-93f3-490b02e98679) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:37:21.487061 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e96157be-4b52-4236-8de9-5dbce26e4ba8 tempest-VolumesTransfersTest-521662743 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:37:21.487443 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e96157be-4b52-4236-8de9-5dbce26e4ba8 tempest-VolumesTransfersTest-521662743 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:37:21.491404 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e96157be-4b52-4236-8de9-5dbce26e4ba8 tempest-VolumesTransfersTest-521662743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5178afbf-1f0b-4963-9863-e12f2d1b6b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96d1ea3b-b458-477f-a8ba-0164409b2a0d', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:21.496148 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e96157be-4b52-4236-8de9-5dbce26e4ba8 tempest-VolumesTransfersTest-521662743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcbcd429-5069-4c2b-94ed-206f2bad5663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:21.514382 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-b3db936c-022b-478a-b137-153240a869d8 tempest-GroupsV314Test-1914113507 None] Created volume successfully. Apr 30 21:37:21.570114 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-e96157be-4b52-4236-8de9-5dbce26e4ba8 tempest-VolumesTransfersTest-521662743 None] Volume volume-96d1ea3b-b458-477f-a8ba-0164409b2a0d (96d1ea3b-b458-477f-a8ba-0164409b2a0d): created successfully Apr 30 21:37:21.573701 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e96157be-4b52-4236-8de9-5dbce26e4ba8 tempest-VolumesTransfersTest-521662743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcbcd429-5069-4c2b-94ed-206f2bad5663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:21.579210 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e96157be-4b52-4236-8de9-5dbce26e4ba8 tempest-VolumesTransfersTest-521662743 None] Flow 'volume_create_manager' (87d11ddb-2346-417b-9b82-205e78bf497e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:37:21.661789 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-e96157be-4b52-4236-8de9-5dbce26e4ba8 tempest-VolumesTransfersTest-521662743 None] Created volume successfully. Apr 30 21:37:23.440047 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-99b86a70-7745-4fef-a95a-9d61d97dee77 tempest-GroupsV314Test-1914113507 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:23.587884 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-99b86a70-7745-4fef-a95a-9d61d97dee77 tempest-GroupsV314Test-1914113507 None] creating snapshot='volume-625bd375-9e7f-4e61-811a-9645517e53a6.clone_snap' {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} Apr 30 21:37:25.387375 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-99b86a70-7745-4fef-a95a-9d61d97dee77 tempest-GroupsV314Test-1914113507 None] cloning 'volume-07f1fe41-a251-44bd-81b5-77080df526c0@volume-625bd375-9e7f-4e61-811a-9645517e53a6.clone_snap' to 'volume-625bd375-9e7f-4e61-811a-9645517e53a6' {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} Apr 30 21:37:25.392214 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9ec9f7db-9b5d-4264-bf25-974dd0a16051 tempest-VolumesCloneTest-1015091794 None] volume is a clone so cleaning references {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} Apr 30 21:37:25.571825 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9ec9f7db-9b5d-4264-bf25-974dd0a16051 tempest-VolumesCloneTest-1015091794 None] deleting parent snapshot volume-716b8ed6-820c-4b42-84c8-5b9a8d40bb4b.clone_snap {{(pid=123855) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} Apr 30 21:37:27.691768 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-99b86a70-7745-4fef-a95a-9d61d97dee77 tempest-GroupsV314Test-1914113507 None] Volume volume-07f1fe41-a251-44bd-81b5-77080df526c0 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:37:27.709487 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-2eddd0ee-1247-4ef3-b598-f58d80d5c27a tempest-VolumesTransfersTest-822766230 None] Transfer volume completed successfully. Apr 30 21:37:27.714184 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-99b86a70-7745-4fef-a95a-9d61d97dee77 tempest-GroupsV314Test-1914113507 None] extra_specs: {} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:37:27.714550 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-99b86a70-7745-4fef-a95a-9d61d97dee77 tempest-GroupsV314Test-1914113507 None] extra_specs: {} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:37:27.933676 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-99b86a70-7745-4fef-a95a-9d61d97dee77 tempest-GroupsV314Test-1914113507 None] clone created successfully {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} Apr 30 21:37:28.025141 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-9ec9f7db-9b5d-4264-bf25-974dd0a16051 tempest-VolumesCloneTest-1015091794 None] Created reservations ['21974f50-8cc9-43e3-a79d-ba37c13938b6', 'd6445fcb-f358-48dd-b9e0-1f1d9023d746', 'ad5d2f7d-4104-4aae-845d-fd035b031dfa', 'd8b98373-d41d-4e74-8d11-1ffafe3bf936'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:37:28.066804 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-a2177454-5d1b-4f5e-b486-9298c3a16455 tempest-SnapshotMetadataTestJSON-1112869917 None] Created reservations ['b0d37b3e-420b-4c49-b974-36b5628ca357', '6ea51455-6601-4aef-93ad-c4163298f2ac', '915d5aaf-c065-47db-b677-d4cfb331c243', 'd3b2f583-c6f3-4cfb-980e-af942074c2eb'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:37:28.262016 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9ec9f7db-9b5d-4264-bf25-974dd0a16051 tempest-VolumesCloneTest-1015091794 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:28.288847 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9ec9f7db-9b5d-4264-bf25-974dd0a16051 tempest-VolumesCloneTest-1015091794 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:28.311306 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-9ec9f7db-9b5d-4264-bf25-974dd0a16051 tempest-VolumesCloneTest-1015091794 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:37:28.319659 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a2177454-5d1b-4f5e-b486-9298c3a16455 tempest-SnapshotMetadataTestJSON-1112869917 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:28.347402 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a2177454-5d1b-4f5e-b486-9298c3a16455 tempest-SnapshotMetadataTestJSON-1112869917 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:28.372342 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-a2177454-5d1b-4f5e-b486-9298c3a16455 tempest-SnapshotMetadataTestJSON-1112869917 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:37:28.376734 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-9ec9f7db-9b5d-4264-bf25-974dd0a16051 tempest-VolumesCloneTest-1015091794 None] Deleted volume successfully. Apr 30 21:37:28.389579 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-99b86a70-7745-4fef-a95a-9d61d97dee77 tempest-GroupsV314Test-1914113507 None] Create group from source-group-04572595-ecc3-4588-a9d2-e3762fc69b9f completed successfully. Apr 30 21:37:28.389579 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-a2177454-5d1b-4f5e-b486-9298c3a16455 tempest-SnapshotMetadataTestJSON-1112869917 None] Deleted volume successfully. Apr 30 21:37:28.480205 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-9ec9f7db-9b5d-4264-bf25-974dd0a16051 tempest-VolumesCloneTest-1015091794 None] Lock "b'cinder-716b8ed6-820c-4b42-84c8-5b9a8d40bb4b-delete_volume'" released by "delete_volume" :: held 9.027s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:37:28.499675 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-a2177454-5d1b-4f5e-b486-9298c3a16455 tempest-SnapshotMetadataTestJSON-1112869917 None] Lock "b'cinder-c90c53df-9308-43ae-b60b-697e2a742755-delete_volume'" released by "delete_volume" :: held 7.884s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:37:28.770034 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-2e93d536-a57f-44e2-babe-d83bc0ce5a18 tempest-VolumesTransfersTest-339247962 None] Lock "b'cinder-96d1ea3b-b458-477f-a8ba-0164409b2a0d-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:37:28.867619 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-2e93d536-a57f-44e2-babe-d83bc0ce5a18 tempest-VolumesTransfersTest-339247962 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:28.998250 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-2e93d536-a57f-44e2-babe-d83bc0ce5a18 tempest-VolumesTransfersTest-339247962 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:37:28.998735 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-2e93d536-a57f-44e2-babe-d83bc0ce5a18 tempest-VolumesTransfersTest-339247962 None] Volume volume-96d1ea3b-b458-477f-a8ba-0164409b2a0d is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:37:29.062066 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-2e93d536-a57f-44e2-babe-d83bc0ce5a18 tempest-VolumesTransfersTest-339247962 None] deleting rbd volume volume-96d1ea3b-b458-477f-a8ba-0164409b2a0d {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:37:29.497490 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bbe76dd0-e631-4e5b-9ee9-7881112bbf64 tempest-GroupsV314Test-1914113507 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:29.724531 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bbe76dd0-e631-4e5b-9ee9-7881112bbf64 tempest-GroupsV314Test-1914113507 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:37:29.817466 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bbe76dd0-e631-4e5b-9ee9-7881112bbf64 tempest-GroupsV314Test-1914113507 None] deleting rbd volume volume-625bd375-9e7f-4e61-811a-9645517e53a6 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:37:31.328560 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:37:31.329175 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:31.366333 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:31.391401 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:37:32.005775 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-cde8c2f3-3bfd-44d5-8e16-7d4242aa1db6 tempest-VolumesCloneNegativeTest-1000173837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:37:32.024797 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-cde8c2f3-3bfd-44d5-8e16-7d4242aa1db6 tempest-VolumesCloneNegativeTest-1000173837 None] Flow 'volume_create_manager' (27bf996f-cec2-44f8-8860-edd0a38fd5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:37:32.031548 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-cde8c2f3-3bfd-44d5-8e16-7d4242aa1db6 tempest-VolumesCloneNegativeTest-1000173837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f099d21-fc5e-484d-8096-1016708e4001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:32.046604 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-cde8c2f3-3bfd-44d5-8e16-7d4242aa1db6 tempest-VolumesCloneNegativeTest-1000173837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f099d21-fc5e-484d-8096-1016708e4001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1540700910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e68e2799-3846-4b8e-adc2-7eef6c391384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8388ff30f2f4f8f825c0cdf907c42a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:37:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:37:32Z,use_quota=True,user_id='32f360876ae54681813701845c90ff77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:32.052483 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-cde8c2f3-3bfd-44d5-8e16-7d4242aa1db6 tempest-VolumesCloneNegativeTest-1000173837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7c86271-54bf-4235-9ef6-d793066f5594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:32.056596 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-cde8c2f3-3bfd-44d5-8e16-7d4242aa1db6 tempest-VolumesCloneNegativeTest-1000173837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7c86271-54bf-4235-9ef6-d793066f5594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:32.061716 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-cde8c2f3-3bfd-44d5-8e16-7d4242aa1db6 tempest-VolumesCloneNegativeTest-1000173837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a751f51c-9cb7-4a87-9925-ff24f3679be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:32.066367 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-cde8c2f3-3bfd-44d5-8e16-7d4242aa1db6 tempest-VolumesCloneNegativeTest-1000173837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a751f51c-9cb7-4a87-9925-ff24f3679be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e68e2799-3846-4b8e-adc2-7eef6c391384', 'volume_name': 'volume-e68e2799-3846-4b8e-adc2-7eef6c391384', 'volume_size': 2}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:32.071330 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-cde8c2f3-3bfd-44d5-8e16-7d4242aa1db6 tempest-VolumesCloneNegativeTest-1000173837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8900c5f-0def-4896-8767-e0914fdeae78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:32.075186 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-cde8c2f3-3bfd-44d5-8e16-7d4242aa1db6 tempest-VolumesCloneNegativeTest-1000173837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8900c5f-0def-4896-8767-e0914fdeae78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:32.080010 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-cde8c2f3-3bfd-44d5-8e16-7d4242aa1db6 tempest-VolumesCloneNegativeTest-1000173837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9da7ad08-71c0-4272-b101-f685b52c7f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:32.081107 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-cde8c2f3-3bfd-44d5-8e16-7d4242aa1db6 tempest-VolumesCloneNegativeTest-1000173837 None] Volume e68e2799-3846-4b8e-adc2-7eef6c391384: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e68e2799-3846-4b8e-adc2-7eef6c391384', 'volume_size': 2} Apr 30 21:37:32.081517 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-cde8c2f3-3bfd-44d5-8e16-7d4242aa1db6 tempest-VolumesCloneNegativeTest-1000173837 None] creating volume 'volume-e68e2799-3846-4b8e-adc2-7eef6c391384' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:37:32.082326 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-cde8c2f3-3bfd-44d5-8e16-7d4242aa1db6 tempest-VolumesCloneNegativeTest-1000173837 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:32.205670 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-c400e866-9850-43e6-b21e-efcdb9829276 tempest-VolumesListTestJSON-1600106481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:37:32.224149 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c400e866-9850-43e6-b21e-efcdb9829276 tempest-VolumesListTestJSON-1600106481 None] Flow 'volume_create_manager' (95b18f46-0776-4382-aa65-c267cd6ec570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:37:32.230827 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c400e866-9850-43e6-b21e-efcdb9829276 tempest-VolumesListTestJSON-1600106481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edcc7c95-4ec3-4c03-9945-0b53f088d400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:32.246449 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c400e866-9850-43e6-b21e-efcdb9829276 tempest-VolumesListTestJSON-1600106481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edcc7c95-4ec3-4c03-9945-0b53f088d400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1241450377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ee9b895d-1576-4f63-bf0f-60cadaa52baa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bfe2a268b20142dd8f44d77ab5c8d3fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:37:32Z,use_quota=True,user_id='4f27f38b9e3b43d482c01038f0480fd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:32.252436 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c400e866-9850-43e6-b21e-efcdb9829276 tempest-VolumesListTestJSON-1600106481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d9dc178-5af0-41ef-91ba-da2810e68677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:32.256659 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c400e866-9850-43e6-b21e-efcdb9829276 tempest-VolumesListTestJSON-1600106481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d9dc178-5af0-41ef-91ba-da2810e68677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:32.263610 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c400e866-9850-43e6-b21e-efcdb9829276 tempest-VolumesListTestJSON-1600106481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (819c6567-4182-4ee6-862b-bd0562802430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:32.265897 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c400e866-9850-43e6-b21e-efcdb9829276 tempest-VolumesListTestJSON-1600106481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (819c6567-4182-4ee6-862b-bd0562802430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee9b895d-1576-4f63-bf0f-60cadaa52baa', 'volume_name': 'volume-ee9b895d-1576-4f63-bf0f-60cadaa52baa', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:32.270935 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c400e866-9850-43e6-b21e-efcdb9829276 tempest-VolumesListTestJSON-1600106481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b88cc7d-4d7d-4eb2-bb0c-56fdc3a0824d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:32.275128 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c400e866-9850-43e6-b21e-efcdb9829276 tempest-VolumesListTestJSON-1600106481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b88cc7d-4d7d-4eb2-bb0c-56fdc3a0824d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:32.279837 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c400e866-9850-43e6-b21e-efcdb9829276 tempest-VolumesListTestJSON-1600106481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f5c1a13-a9b7-472d-a3fb-d512dd9ee1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:32.280949 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-c400e866-9850-43e6-b21e-efcdb9829276 tempest-VolumesListTestJSON-1600106481 None] Volume ee9b895d-1576-4f63-bf0f-60cadaa52baa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee9b895d-1576-4f63-bf0f-60cadaa52baa', 'volume_size': 1} Apr 30 21:37:32.281353 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c400e866-9850-43e6-b21e-efcdb9829276 tempest-VolumesListTestJSON-1600106481 None] creating volume 'volume-ee9b895d-1576-4f63-bf0f-60cadaa52baa' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:37:32.282029 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c400e866-9850-43e6-b21e-efcdb9829276 tempest-VolumesListTestJSON-1600106481 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:32.581185 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-2e93d536-a57f-44e2-babe-d83bc0ce5a18 tempest-VolumesTransfersTest-339247962 None] Created reservations ['1073d636-a2ae-420d-a5ca-a4079ebe8948', '5f487e43-319d-414c-a3f5-734051d3a7c1', '51964002-2456-4781-ba0c-a77b8243b9ae', '852804d6-a1a4-442d-adb0-3f777a7216a7'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:37:32.747410 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-2e93d536-a57f-44e2-babe-d83bc0ce5a18 tempest-VolumesTransfersTest-339247962 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:32.772337 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-2e93d536-a57f-44e2-babe-d83bc0ce5a18 tempest-VolumesTransfersTest-339247962 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:32.807623 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-2e93d536-a57f-44e2-babe-d83bc0ce5a18 tempest-VolumesTransfersTest-339247962 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:37:32.813129 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-cde8c2f3-3bfd-44d5-8e16-7d4242aa1db6 tempest-VolumesCloneNegativeTest-1000173837 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:37:32.813509 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-cde8c2f3-3bfd-44d5-8e16-7d4242aa1db6 tempest-VolumesCloneNegativeTest-1000173837 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:37:32.817522 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-cde8c2f3-3bfd-44d5-8e16-7d4242aa1db6 tempest-VolumesCloneNegativeTest-1000173837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9da7ad08-71c0-4272-b101-f685b52c7f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e68e2799-3846-4b8e-adc2-7eef6c391384', 'volume_size': 2}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:32.822267 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-cde8c2f3-3bfd-44d5-8e16-7d4242aa1db6 tempest-VolumesCloneNegativeTest-1000173837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a4b251d-1a33-438b-b7ca-abca4fc93158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:32.835332 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-2e93d536-a57f-44e2-babe-d83bc0ce5a18 tempest-VolumesTransfersTest-339247962 None] Deleted volume successfully. Apr 30 21:37:32.872340 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-cde8c2f3-3bfd-44d5-8e16-7d4242aa1db6 tempest-VolumesCloneNegativeTest-1000173837 None] Volume volume-e68e2799-3846-4b8e-adc2-7eef6c391384 (e68e2799-3846-4b8e-adc2-7eef6c391384): created successfully Apr 30 21:37:32.876278 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-cde8c2f3-3bfd-44d5-8e16-7d4242aa1db6 tempest-VolumesCloneNegativeTest-1000173837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a4b251d-1a33-438b-b7ca-abca4fc93158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:32.881880 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-cde8c2f3-3bfd-44d5-8e16-7d4242aa1db6 tempest-VolumesCloneNegativeTest-1000173837 None] Flow 'volume_create_manager' (27bf996f-cec2-44f8-8860-edd0a38fd5d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:37:32.904914 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-2e93d536-a57f-44e2-babe-d83bc0ce5a18 tempest-VolumesTransfersTest-339247962 None] Lock "b'cinder-96d1ea3b-b458-477f-a8ba-0164409b2a0d-delete_volume'" released by "delete_volume" :: held 4.135s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:37:32.958407 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-cde8c2f3-3bfd-44d5-8e16-7d4242aa1db6 tempest-VolumesCloneNegativeTest-1000173837 None] Created volume successfully. Apr 30 21:37:32.963571 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c400e866-9850-43e6-b21e-efcdb9829276 tempest-VolumesListTestJSON-1600106481 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:37:32.963938 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c400e866-9850-43e6-b21e-efcdb9829276 tempest-VolumesListTestJSON-1600106481 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:37:32.967648 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c400e866-9850-43e6-b21e-efcdb9829276 tempest-VolumesListTestJSON-1600106481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f5c1a13-a9b7-472d-a3fb-d512dd9ee1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee9b895d-1576-4f63-bf0f-60cadaa52baa', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:32.973517 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c400e866-9850-43e6-b21e-efcdb9829276 tempest-VolumesListTestJSON-1600106481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (334772c5-a2b4-4667-a2db-0a2bed8313cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:33.044406 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-c400e866-9850-43e6-b21e-efcdb9829276 tempest-VolumesListTestJSON-1600106481 None] Volume volume-ee9b895d-1576-4f63-bf0f-60cadaa52baa (ee9b895d-1576-4f63-bf0f-60cadaa52baa): created successfully Apr 30 21:37:33.048833 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c400e866-9850-43e6-b21e-efcdb9829276 tempest-VolumesListTestJSON-1600106481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (334772c5-a2b4-4667-a2db-0a2bed8313cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:33.054667 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c400e866-9850-43e6-b21e-efcdb9829276 tempest-VolumesListTestJSON-1600106481 None] Flow 'volume_create_manager' (95b18f46-0776-4382-aa65-c267cd6ec570) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:37:33.111354 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-c400e866-9850-43e6-b21e-efcdb9829276 tempest-VolumesListTestJSON-1600106481 None] Created volume successfully. Apr 30 21:37:33.422585 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bbe76dd0-e631-4e5b-9ee9-7881112bbf64 tempest-GroupsV314Test-1914113507 None] volume is a clone so cleaning references {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} Apr 30 21:37:33.508167 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bbe76dd0-e631-4e5b-9ee9-7881112bbf64 tempest-GroupsV314Test-1914113507 None] Volume volume-07f1fe41-a251-44bd-81b5-77080df526c0 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:37:33.508726 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bbe76dd0-e631-4e5b-9ee9-7881112bbf64 tempest-GroupsV314Test-1914113507 None] deleting parent snapshot volume-625bd375-9e7f-4e61-811a-9645517e53a6.clone_snap {{(pid=123855) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} Apr 30 21:37:35.090817 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-87de3eb3-46a3-41ed-99db-13f4ba9158f2 tempest-VolumesCloneNegativeTest-1000173837 None] Lock "b'cinder-e68e2799-3846-4b8e-adc2-7eef6c391384-delete_volume'" acquired by "delete_volume" :: waited 0.033s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:37:35.160356 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe302221-9c07-440d-ac92-0e2a2130be13 tempest-VolumesTransfersTest-521662743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:37:35.180506 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-fe302221-9c07-440d-ac92-0e2a2130be13 tempest-VolumesTransfersTest-521662743 None] Flow 'volume_create_manager' (4588400a-1459-4c34-afc6-5b676a6a1f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:37:35.187246 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-fe302221-9c07-440d-ac92-0e2a2130be13 tempest-VolumesTransfersTest-521662743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f1c03f8-9887-4db6-813f-c25f4532da49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:35.195979 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-349231fe-6755-4bd5-b5ea-5490fd1345c6 tempest-VolumesListTestJSON-1600106481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:37:35.214545 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-349231fe-6755-4bd5-b5ea-5490fd1345c6 tempest-VolumesListTestJSON-1600106481 None] Flow 'volume_create_manager' (aca4b6c3-6b94-47ce-adda-5ca797f93775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:37:35.224075 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-349231fe-6755-4bd5-b5ea-5490fd1345c6 tempest-VolumesListTestJSON-1600106481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0133be46-a503-48a3-aa39-12b579c2a305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:35.255290 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-fe302221-9c07-440d-ac92-0e2a2130be13 tempest-VolumesTransfersTest-521662743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f1c03f8-9887-4db6-813f-c25f4532da49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-984401049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2ba4dde1-194e-4a68-9b2a-6f05f07fbb85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cfecbeba61c420a8185d621647a8059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:37:34Z,use_quota=True,user_id='fc2dbf2ab81b4a6d921f2ef0c0bc345e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:35.261120 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-fe302221-9c07-440d-ac92-0e2a2130be13 tempest-VolumesTransfersTest-521662743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f945b976-e983-4d8d-8833-0106b25dcc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:35.265305 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-fe302221-9c07-440d-ac92-0e2a2130be13 tempest-VolumesTransfersTest-521662743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f945b976-e983-4d8d-8833-0106b25dcc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:35.273827 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-fe302221-9c07-440d-ac92-0e2a2130be13 tempest-VolumesTransfersTest-521662743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5be0d06c-7c3b-4101-be4d-f3a63d26a657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:35.279565 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-fe302221-9c07-440d-ac92-0e2a2130be13 tempest-VolumesTransfersTest-521662743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5be0d06c-7c3b-4101-be4d-f3a63d26a657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ba4dde1-194e-4a68-9b2a-6f05f07fbb85', 'volume_name': 'volume-2ba4dde1-194e-4a68-9b2a-6f05f07fbb85', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:35.279874 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-fe302221-9c07-440d-ac92-0e2a2130be13 tempest-VolumesTransfersTest-521662743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92d69684-7655-43e4-8dd5-a1f52ac2e11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:35.283981 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-fe302221-9c07-440d-ac92-0e2a2130be13 tempest-VolumesTransfersTest-521662743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92d69684-7655-43e4-8dd5-a1f52ac2e11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:35.288698 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-fe302221-9c07-440d-ac92-0e2a2130be13 tempest-VolumesTransfersTest-521662743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (756ef9b9-493c-410a-b48f-e6c11ab7066e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:35.289795 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-fe302221-9c07-440d-ac92-0e2a2130be13 tempest-VolumesTransfersTest-521662743 None] Volume 2ba4dde1-194e-4a68-9b2a-6f05f07fbb85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ba4dde1-194e-4a68-9b2a-6f05f07fbb85', 'volume_size': 1} Apr 30 21:37:35.290192 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-fe302221-9c07-440d-ac92-0e2a2130be13 tempest-VolumesTransfersTest-521662743 None] creating volume 'volume-2ba4dde1-194e-4a68-9b2a-6f05f07fbb85' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:37:35.290975 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-fe302221-9c07-440d-ac92-0e2a2130be13 tempest-VolumesTransfersTest-521662743 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:35.321037 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-349231fe-6755-4bd5-b5ea-5490fd1345c6 tempest-VolumesListTestJSON-1600106481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0133be46-a503-48a3-aa39-12b579c2a305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1838219459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d7e1d71b-75c7-42ee-9e73-1591ff87b9c6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bfe2a268b20142dd8f44d77ab5c8d3fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:37:35Z,use_quota=True,user_id='4f27f38b9e3b43d482c01038f0480fd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:35.326690 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-349231fe-6755-4bd5-b5ea-5490fd1345c6 tempest-VolumesListTestJSON-1600106481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c20e5bf6-e1d8-4a77-8989-dfabb07be664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:35.330819 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-349231fe-6755-4bd5-b5ea-5490fd1345c6 tempest-VolumesListTestJSON-1600106481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c20e5bf6-e1d8-4a77-8989-dfabb07be664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:35.335973 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-349231fe-6755-4bd5-b5ea-5490fd1345c6 tempest-VolumesListTestJSON-1600106481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00b6dd30-474c-4d8d-8711-1b4052c77f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:35.340096 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-349231fe-6755-4bd5-b5ea-5490fd1345c6 tempest-VolumesListTestJSON-1600106481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00b6dd30-474c-4d8d-8711-1b4052c77f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7e1d71b-75c7-42ee-9e73-1591ff87b9c6', 'volume_name': 'volume-d7e1d71b-75c7-42ee-9e73-1591ff87b9c6', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:35.345000 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-349231fe-6755-4bd5-b5ea-5490fd1345c6 tempest-VolumesListTestJSON-1600106481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c032548-3e60-48b7-a07d-331c34fc7534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:35.349457 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-349231fe-6755-4bd5-b5ea-5490fd1345c6 tempest-VolumesListTestJSON-1600106481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c032548-3e60-48b7-a07d-331c34fc7534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:35.354175 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-349231fe-6755-4bd5-b5ea-5490fd1345c6 tempest-VolumesListTestJSON-1600106481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7223a85d-0905-4339-bed9-c9f7ef68aa72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:35.355246 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-349231fe-6755-4bd5-b5ea-5490fd1345c6 tempest-VolumesListTestJSON-1600106481 None] Volume d7e1d71b-75c7-42ee-9e73-1591ff87b9c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7e1d71b-75c7-42ee-9e73-1591ff87b9c6', 'volume_size': 1} Apr 30 21:37:35.355637 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-349231fe-6755-4bd5-b5ea-5490fd1345c6 tempest-VolumesListTestJSON-1600106481 None] creating volume 'volume-d7e1d71b-75c7-42ee-9e73-1591ff87b9c6' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:37:35.356288 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-349231fe-6755-4bd5-b5ea-5490fd1345c6 tempest-VolumesListTestJSON-1600106481 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:35.386724 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-87de3eb3-46a3-41ed-99db-13f4ba9158f2 tempest-VolumesCloneNegativeTest-1000173837 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:35.507377 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-87de3eb3-46a3-41ed-99db-13f4ba9158f2 tempest-VolumesCloneNegativeTest-1000173837 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:37:35.508021 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-87de3eb3-46a3-41ed-99db-13f4ba9158f2 tempest-VolumesCloneNegativeTest-1000173837 None] Volume volume-e68e2799-3846-4b8e-adc2-7eef6c391384 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:37:35.668074 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-87de3eb3-46a3-41ed-99db-13f4ba9158f2 tempest-VolumesCloneNegativeTest-1000173837 None] deleting rbd volume volume-e68e2799-3846-4b8e-adc2-7eef6c391384 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:37:35.769805 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-bbe76dd0-e631-4e5b-9ee9-7881112bbf64 tempest-GroupsV314Test-1914113507 None] Created reservations ['bf068cb6-c0fc-4520-9803-783dfe92561b'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:37:35.788782 ncdv-master-1 cinder-volume[123855]: WARNING cinder.quota [None req-bbe76dd0-e631-4e5b-9ee9-7881112bbf64 tempest-GroupsV314Test-1914113507 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-570334049 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-570334049, it is now deprecated. Please use the default quota class for default quota. Apr 30 21:37:35.789566 ncdv-master-1 cinder-volume[123855]: WARNING cinder.quota [None req-bbe76dd0-e631-4e5b-9ee9-7881112bbf64 tempest-GroupsV314Test-1914113507 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-570334049 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-570334049, it is now deprecated. Please use the default quota class for default quota. Apr 30 21:37:35.855586 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-bbe76dd0-e631-4e5b-9ee9-7881112bbf64 tempest-GroupsV314Test-1914113507 None] Created reservations ['f3fc6273-c970-429d-9f2a-e62c10b02707', 'a8a90888-e01c-4100-8ba2-a38b438fc120', 'cd55a3d8-654b-4412-bc15-c1a21193df4e', '84316d65-ca29-46ad-8bf7-ae35e55888d6'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:37:35.921744 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-fe302221-9c07-440d-ac92-0e2a2130be13 tempest-VolumesTransfersTest-521662743 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:37:35.922147 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-fe302221-9c07-440d-ac92-0e2a2130be13 tempest-VolumesTransfersTest-521662743 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:37:35.926115 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-fe302221-9c07-440d-ac92-0e2a2130be13 tempest-VolumesTransfersTest-521662743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (756ef9b9-493c-410a-b48f-e6c11ab7066e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ba4dde1-194e-4a68-9b2a-6f05f07fbb85', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:35.930742 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-fe302221-9c07-440d-ac92-0e2a2130be13 tempest-VolumesTransfersTest-521662743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b12b8aa-dc1d-4afe-a6e3-6c8b90951d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:36.010571 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-fe302221-9c07-440d-ac92-0e2a2130be13 tempest-VolumesTransfersTest-521662743 None] Volume volume-2ba4dde1-194e-4a68-9b2a-6f05f07fbb85 (2ba4dde1-194e-4a68-9b2a-6f05f07fbb85): created successfully Apr 30 21:37:36.014730 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-fe302221-9c07-440d-ac92-0e2a2130be13 tempest-VolumesTransfersTest-521662743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b12b8aa-dc1d-4afe-a6e3-6c8b90951d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:36.030292 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-fe302221-9c07-440d-ac92-0e2a2130be13 tempest-VolumesTransfersTest-521662743 None] Flow 'volume_create_manager' (4588400a-1459-4c34-afc6-5b676a6a1f21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:37:36.032987 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-349231fe-6755-4bd5-b5ea-5490fd1345c6 tempest-VolumesListTestJSON-1600106481 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:37:36.034155 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-349231fe-6755-4bd5-b5ea-5490fd1345c6 tempest-VolumesListTestJSON-1600106481 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:37:36.038198 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-349231fe-6755-4bd5-b5ea-5490fd1345c6 tempest-VolumesListTestJSON-1600106481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7223a85d-0905-4339-bed9-c9f7ef68aa72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7e1d71b-75c7-42ee-9e73-1591ff87b9c6', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:36.043107 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-349231fe-6755-4bd5-b5ea-5490fd1345c6 tempest-VolumesListTestJSON-1600106481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a9079ee-a47e-43e2-813d-aab0beec134a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:36.135803 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-fe302221-9c07-440d-ac92-0e2a2130be13 tempest-VolumesTransfersTest-521662743 None] Created volume successfully. Apr 30 21:37:36.158943 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-349231fe-6755-4bd5-b5ea-5490fd1345c6 tempest-VolumesListTestJSON-1600106481 None] Volume volume-d7e1d71b-75c7-42ee-9e73-1591ff87b9c6 (d7e1d71b-75c7-42ee-9e73-1591ff87b9c6): created successfully Apr 30 21:37:36.162645 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-349231fe-6755-4bd5-b5ea-5490fd1345c6 tempest-VolumesListTestJSON-1600106481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a9079ee-a47e-43e2-813d-aab0beec134a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:36.168145 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-349231fe-6755-4bd5-b5ea-5490fd1345c6 tempest-VolumesListTestJSON-1600106481 None] Flow 'volume_create_manager' (aca4b6c3-6b94-47ce-adda-5ca797f93775) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:37:36.233062 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-349231fe-6755-4bd5-b5ea-5490fd1345c6 tempest-VolumesListTestJSON-1600106481 None] Created volume successfully. Apr 30 21:37:36.246016 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bbe76dd0-e631-4e5b-9ee9-7881112bbf64 tempest-GroupsV314Test-1914113507 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:36.281445 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bbe76dd0-e631-4e5b-9ee9-7881112bbf64 tempest-GroupsV314Test-1914113507 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:36.306142 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-bbe76dd0-e631-4e5b-9ee9-7881112bbf64 tempest-GroupsV314Test-1914113507 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:37:36.313628 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-bbe76dd0-e631-4e5b-9ee9-7881112bbf64 tempest-GroupsV314Test-1914113507 None] Delete group completed successfully. Apr 30 21:37:37.551467 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-f7a75c43-062f-44da-836b-c3aa856520c3 tempest-VolumesTransfersTest-339247962 None] Lock "b'cinder-2ba4dde1-194e-4a68-9b2a-6f05f07fbb85-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:37:37.594034 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d01010a-c321-4871-a1ce-369f45ff84e3 tempest-VolumesListTestJSON-1600106481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:37:37.615158 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8d01010a-c321-4871-a1ce-369f45ff84e3 tempest-VolumesListTestJSON-1600106481 None] Flow 'volume_create_manager' (676601ee-35f2-444d-9a2e-67cce92b6cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:37:37.621827 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8d01010a-c321-4871-a1ce-369f45ff84e3 tempest-VolumesListTestJSON-1600106481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53fa8259-56ce-4ed4-bfbe-22d9ac11bb71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:37.650910 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8d01010a-c321-4871-a1ce-369f45ff84e3 tempest-VolumesListTestJSON-1600106481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53fa8259-56ce-4ed4-bfbe-22d9ac11bb71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1452621748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=59fe0b92-2713-49f2-9ee5-3d86fd7d5ac6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bfe2a268b20142dd8f44d77ab5c8d3fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:37:37Z,use_quota=True,user_id='4f27f38b9e3b43d482c01038f0480fd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:37.656524 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8d01010a-c321-4871-a1ce-369f45ff84e3 tempest-VolumesListTestJSON-1600106481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c5f746f-0586-41a3-b1f2-51c5c6bfa325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:37.660495 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8d01010a-c321-4871-a1ce-369f45ff84e3 tempest-VolumesListTestJSON-1600106481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c5f746f-0586-41a3-b1f2-51c5c6bfa325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:37.666581 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8d01010a-c321-4871-a1ce-369f45ff84e3 tempest-VolumesListTestJSON-1600106481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea48241-fb78-4a51-9d2d-f2e2f89b9461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:37.669789 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8d01010a-c321-4871-a1ce-369f45ff84e3 tempest-VolumesListTestJSON-1600106481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea48241-fb78-4a51-9d2d-f2e2f89b9461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59fe0b92-2713-49f2-9ee5-3d86fd7d5ac6', 'volume_name': 'volume-59fe0b92-2713-49f2-9ee5-3d86fd7d5ac6', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:37.674738 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8d01010a-c321-4871-a1ce-369f45ff84e3 tempest-VolumesListTestJSON-1600106481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95f4a3bd-be7e-4995-a239-f5e9401b7267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:37.678692 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8d01010a-c321-4871-a1ce-369f45ff84e3 tempest-VolumesListTestJSON-1600106481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95f4a3bd-be7e-4995-a239-f5e9401b7267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:37.683474 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8d01010a-c321-4871-a1ce-369f45ff84e3 tempest-VolumesListTestJSON-1600106481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edf08a68-0336-4a7a-849d-de3042e0b355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:37.692580 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-8d01010a-c321-4871-a1ce-369f45ff84e3 tempest-VolumesListTestJSON-1600106481 None] Volume 59fe0b92-2713-49f2-9ee5-3d86fd7d5ac6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59fe0b92-2713-49f2-9ee5-3d86fd7d5ac6', 'volume_size': 1} Apr 30 21:37:37.692580 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8d01010a-c321-4871-a1ce-369f45ff84e3 tempest-VolumesListTestJSON-1600106481 None] creating volume 'volume-59fe0b92-2713-49f2-9ee5-3d86fd7d5ac6' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:37:37.692580 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8d01010a-c321-4871-a1ce-369f45ff84e3 tempest-VolumesListTestJSON-1600106481 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:37.718447 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f7a75c43-062f-44da-836b-c3aa856520c3 tempest-VolumesTransfersTest-339247962 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:37.883934 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f7a75c43-062f-44da-836b-c3aa856520c3 tempest-VolumesTransfersTest-339247962 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:37:37.884296 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f7a75c43-062f-44da-836b-c3aa856520c3 tempest-VolumesTransfersTest-339247962 None] Volume volume-2ba4dde1-194e-4a68-9b2a-6f05f07fbb85 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:37:38.067209 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f7a75c43-062f-44da-836b-c3aa856520c3 tempest-VolumesTransfersTest-339247962 None] deleting rbd volume volume-2ba4dde1-194e-4a68-9b2a-6f05f07fbb85 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:37:38.088606 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-896e4ed2-d22a-4c9e-8f7b-85219c41f865 tempest-GroupsV314Test-1914113507 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:38.255172 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-896e4ed2-d22a-4c9e-8f7b-85219c41f865 tempest-GroupsV314Test-1914113507 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:37:38.255599 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-896e4ed2-d22a-4c9e-8f7b-85219c41f865 tempest-GroupsV314Test-1914113507 None] Volume volume-07f1fe41-a251-44bd-81b5-77080df526c0 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:37:38.566565 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-896e4ed2-d22a-4c9e-8f7b-85219c41f865 tempest-GroupsV314Test-1914113507 None] deleting rbd volume volume-07f1fe41-a251-44bd-81b5-77080df526c0 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:37:38.575112 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8d01010a-c321-4871-a1ce-369f45ff84e3 tempest-VolumesListTestJSON-1600106481 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:37:38.575508 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8d01010a-c321-4871-a1ce-369f45ff84e3 tempest-VolumesListTestJSON-1600106481 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:37:38.579200 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8d01010a-c321-4871-a1ce-369f45ff84e3 tempest-VolumesListTestJSON-1600106481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edf08a68-0336-4a7a-849d-de3042e0b355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59fe0b92-2713-49f2-9ee5-3d86fd7d5ac6', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:38.583785 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8d01010a-c321-4871-a1ce-369f45ff84e3 tempest-VolumesListTestJSON-1600106481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e37e43c7-f7a1-463c-94a3-c389a433a80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:38.713460 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-8d01010a-c321-4871-a1ce-369f45ff84e3 tempest-VolumesListTestJSON-1600106481 None] Volume volume-59fe0b92-2713-49f2-9ee5-3d86fd7d5ac6 (59fe0b92-2713-49f2-9ee5-3d86fd7d5ac6): created successfully Apr 30 21:37:38.717910 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8d01010a-c321-4871-a1ce-369f45ff84e3 tempest-VolumesListTestJSON-1600106481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e37e43c7-f7a1-463c-94a3-c389a433a80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:38.725184 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8d01010a-c321-4871-a1ce-369f45ff84e3 tempest-VolumesListTestJSON-1600106481 None] Flow 'volume_create_manager' (676601ee-35f2-444d-9a2e-67cce92b6cae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:37:38.736842 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-87de3eb3-46a3-41ed-99db-13f4ba9158f2 tempest-VolumesCloneNegativeTest-1000173837 None] Created reservations ['8c6e058a-dbbf-4677-8e02-4f95b62d8dc2', 'cb64dcf8-812c-4549-a76d-d669b07059ac', '0ec77ec2-4210-4b6c-a9cb-a9113209bced', 'e9e09a39-812d-479c-815a-7fea8a495745'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:37:38.878464 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-8d01010a-c321-4871-a1ce-369f45ff84e3 tempest-VolumesListTestJSON-1600106481 None] Created volume successfully. Apr 30 21:37:38.987344 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-87de3eb3-46a3-41ed-99db-13f4ba9158f2 tempest-VolumesCloneNegativeTest-1000173837 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:39.013143 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-87de3eb3-46a3-41ed-99db-13f4ba9158f2 tempest-VolumesCloneNegativeTest-1000173837 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:39.044386 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-87de3eb3-46a3-41ed-99db-13f4ba9158f2 tempest-VolumesCloneNegativeTest-1000173837 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:37:39.048354 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-87de3eb3-46a3-41ed-99db-13f4ba9158f2 tempest-VolumesCloneNegativeTest-1000173837 None] Deleted volume successfully. Apr 30 21:37:39.152016 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-87de3eb3-46a3-41ed-99db-13f4ba9158f2 tempest-VolumesCloneNegativeTest-1000173837 None] Lock "b'cinder-e68e2799-3846-4b8e-adc2-7eef6c391384-delete_volume'" released by "delete_volume" :: held 4.061s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:37:41.230091 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-cc136b0e-28cc-47cb-9f1c-70f3db407a12 req-fcca7734-8874-4a1a-9819-bc8354417b75 tempest-AttachVolumeTestJSON-628843456 None] Terminate volume connection completed successfully. Apr 30 21:37:41.230091 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-cc136b0e-28cc-47cb-9f1c-70f3db407a12 req-fcca7734-8874-4a1a-9819-bc8354417b75 tempest-AttachVolumeTestJSON-628843456 None] Deleting attachment 7bbabaf5-582f-4d25-9c33-82817b1ce43d. {{(pid=123855) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} Apr 30 21:37:42.311781 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-5855951a-0a84-47b8-9dc5-1984ec45ff40 tempest-VolumesListTestJSON-1600106481 None] Lock "b'cinder-59fe0b92-2713-49f2-9ee5-3d86fd7d5ac6-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:37:42.417613 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-5855951a-0a84-47b8-9dc5-1984ec45ff40 tempest-VolumesListTestJSON-1600106481 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:42.718000 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-5855951a-0a84-47b8-9dc5-1984ec45ff40 tempest-VolumesListTestJSON-1600106481 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:37:42.718433 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-5855951a-0a84-47b8-9dc5-1984ec45ff40 tempest-VolumesListTestJSON-1600106481 None] Volume volume-59fe0b92-2713-49f2-9ee5-3d86fd7d5ac6 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:37:42.895439 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-5855951a-0a84-47b8-9dc5-1984ec45ff40 tempest-VolumesListTestJSON-1600106481 None] deleting rbd volume volume-59fe0b92-2713-49f2-9ee5-3d86fd7d5ac6 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:37:43.159772 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-f7a75c43-062f-44da-836b-c3aa856520c3 tempest-VolumesTransfersTest-339247962 None] Created reservations ['417882f7-64b8-46ae-8546-a005a2cb39f4', 'b5f9ba59-86c9-4529-84af-91172d9e1cc1', 'c827ada2-7027-4e95-af8b-59687529d789', '285ced3a-c420-467b-9dc5-7a62cfdda6ed'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:37:43.235339 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-5839e77e-b559-43a3-98a2-1e3d76cbf9c8 tempest-VolumesExtendTest-1772170466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:37:43.256302 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5839e77e-b559-43a3-98a2-1e3d76cbf9c8 tempest-VolumesExtendTest-1772170466 None] Flow 'volume_create_manager' (9bd614dc-3caf-4272-965a-50b4ff711a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:37:43.263307 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5839e77e-b559-43a3-98a2-1e3d76cbf9c8 tempest-VolumesExtendTest-1772170466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1d83c57-af15-48a6-9310-ac70ffb3eb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:43.282581 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5839e77e-b559-43a3-98a2-1e3d76cbf9c8 tempest-VolumesExtendTest-1772170466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1d83c57-af15-48a6-9310-ac70ffb3eb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-133873923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1a334699-fd38-469c-9756-198b1eb6912e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfeeac0c49384132a08a8d0dd5654b73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:37:43Z,use_quota=True,user_id='f93380560fd14d50af229186796db509',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:43.288278 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5839e77e-b559-43a3-98a2-1e3d76cbf9c8 tempest-VolumesExtendTest-1772170466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d6da6ab-b893-4135-8584-ca8533438bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:43.292480 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5839e77e-b559-43a3-98a2-1e3d76cbf9c8 tempest-VolumesExtendTest-1772170466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d6da6ab-b893-4135-8584-ca8533438bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:43.297826 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5839e77e-b559-43a3-98a2-1e3d76cbf9c8 tempest-VolumesExtendTest-1772170466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea45562a-ac6d-443e-9acd-d1cc46b01c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:43.397841 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5839e77e-b559-43a3-98a2-1e3d76cbf9c8 tempest-VolumesExtendTest-1772170466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea45562a-ac6d-443e-9acd-d1cc46b01c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1a334699-fd38-469c-9756-198b1eb6912e', 'volume_name': 'volume-1a334699-fd38-469c-9756-198b1eb6912e', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:43.403090 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5839e77e-b559-43a3-98a2-1e3d76cbf9c8 tempest-VolumesExtendTest-1772170466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f24c0485-f693-4d8d-96a1-360ff0096d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:43.407015 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5839e77e-b559-43a3-98a2-1e3d76cbf9c8 tempest-VolumesExtendTest-1772170466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f24c0485-f693-4d8d-96a1-360ff0096d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:43.411701 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5839e77e-b559-43a3-98a2-1e3d76cbf9c8 tempest-VolumesExtendTest-1772170466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcad3228-d414-40a8-9d73-9dfb88801889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:43.412815 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-5839e77e-b559-43a3-98a2-1e3d76cbf9c8 tempest-VolumesExtendTest-1772170466 None] Volume 1a334699-fd38-469c-9756-198b1eb6912e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1a334699-fd38-469c-9756-198b1eb6912e', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 30 21:37:43.413365 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-5839e77e-b559-43a3-98a2-1e3d76cbf9c8 tempest-VolumesExtendTest-1772170466 None] Cloning 1a334699-fd38-469c-9756-198b1eb6912e from image a5b0850f-3b24-4bcb-b0a7-351c3216b27d at location (None, None). {{(pid=123855) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Apr 30 21:37:43.417208 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f7a75c43-062f-44da-836b-c3aa856520c3 tempest-VolumesTransfersTest-339247962 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:43.440164 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f7a75c43-062f-44da-836b-c3aa856520c3 tempest-VolumesTransfersTest-339247962 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:43.463208 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-f7a75c43-062f-44da-836b-c3aa856520c3 tempest-VolumesTransfersTest-339247962 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:37:43.473695 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-5839e77e-b559-43a3-98a2-1e3d76cbf9c8 tempest-VolumesExtendTest-1772170466 None] Lock "b'cinder-a5b0850f-3b24-4bcb-b0a7-351c3216b27d'" acquired by "_prepare_image_cache_entry" :: waited 0.059s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:37:43.475788 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-f7a75c43-062f-44da-836b-c3aa856520c3 tempest-VolumesTransfersTest-339247962 None] Deleted volume successfully. Apr 30 21:37:43.565602 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-5839e77e-b559-43a3-98a2-1e3d76cbf9c8 tempest-VolumesExtendTest-1772170466 None] Found image-volume cache entry: {'id': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'volume_id': '5772aef0-721f-450a-93ff-02cc6a41edcc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7), 'last_used': datetime.datetime(2022, 4, 30, 21, 37, 43, 481271)}. {{(pid=123855) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 30 21:37:43.566048 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-5839e77e-b559-43a3-98a2-1e3d76cbf9c8 tempest-VolumesExtendTest-1772170466 None] Image-volume cache entry image_update_at = 2022-04-30 21:01:07+00:00, requested image updated_at = 2022-04-30 21:01:07+00:00. {{(pid=123855) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 30 21:37:43.566444 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-5839e77e-b559-43a3-98a2-1e3d76cbf9c8 tempest-VolumesExtendTest-1772170466 None] Found cache entry for image = a5b0850f-3b24-4bcb-b0a7-351c3216b27d on host ncdv-master-1@ceph#ceph. {{(pid=123855) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Apr 30 21:37:43.570620 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-f7a75c43-062f-44da-836b-c3aa856520c3 tempest-VolumesTransfersTest-339247962 None] Lock "b'cinder-2ba4dde1-194e-4a68-9b2a-6f05f07fbb85-delete_volume'" released by "delete_volume" :: held 6.019s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:37:43.572198 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-5839e77e-b559-43a3-98a2-1e3d76cbf9c8 tempest-VolumesExtendTest-1772170466 None] Lock "b'cinder-a5b0850f-3b24-4bcb-b0a7-351c3216b27d'" released by "_prepare_image_cache_entry" :: held 0.099s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:37:43.573002 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-5839e77e-b559-43a3-98a2-1e3d76cbf9c8 tempest-VolumesExtendTest-1772170466 None] Attempting to retrieve cache entry for image = a5b0850f-3b24-4bcb-b0a7-351c3216b27d on host ncdv-master-1@ceph#ceph. {{(pid=123855) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Apr 30 21:37:43.654839 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-896e4ed2-d22a-4c9e-8f7b-85219c41f865 tempest-GroupsV314Test-1914113507 None] Created reservations ['92330808-f79f-47ae-86a8-149d3ea37646'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:37:43.682259 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-5839e77e-b559-43a3-98a2-1e3d76cbf9c8 tempest-VolumesExtendTest-1772170466 None] Found image-volume cache entry: {'id': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'volume_id': '5772aef0-721f-450a-93ff-02cc6a41edcc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7), 'last_used': datetime.datetime(2022, 4, 30, 21, 37, 43, 576295)}. {{(pid=123855) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 30 21:37:43.682259 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-5839e77e-b559-43a3-98a2-1e3d76cbf9c8 tempest-VolumesExtendTest-1772170466 None] Image-volume cache entry image_update_at = 2022-04-30 21:01:07+00:00, requested image updated_at = 2022-04-30 21:01:07+00:00. {{(pid=123855) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 30 21:37:43.682259 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-5839e77e-b559-43a3-98a2-1e3d76cbf9c8 tempest-VolumesExtendTest-1772170466 None] Creating from source image-volume 5772aef0-721f-450a-93ff-02cc6a41edcc {{(pid=123855) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Apr 30 21:37:43.693956 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-5839e77e-b559-43a3-98a2-1e3d76cbf9c8 tempest-VolumesExtendTest-1772170466 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:43.854710 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-5839e77e-b559-43a3-98a2-1e3d76cbf9c8 tempest-VolumesExtendTest-1772170466 None] creating snapshot='volume-1a334699-fd38-469c-9756-198b1eb6912e.clone_snap' {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} Apr 30 21:37:45.901399 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-5839e77e-b559-43a3-98a2-1e3d76cbf9c8 tempest-VolumesExtendTest-1772170466 None] cloning 'volume-5772aef0-721f-450a-93ff-02cc6a41edcc@volume-1a334699-fd38-469c-9756-198b1eb6912e.clone_snap' to 'volume-1a334699-fd38-469c-9756-198b1eb6912e' {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} Apr 30 21:37:45.911449 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-896e4ed2-d22a-4c9e-8f7b-85219c41f865 tempest-GroupsV314Test-1914113507 None] Created reservations ['58e3c352-405a-4316-80d6-bde776ba0378', 'ea3d493d-67f8-452c-93e1-94b475aea9e9', '10c5676c-47a8-4408-a098-536598074c8d', '267f9472-b4d3-44aa-8140-586e16cdbc99'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:37:46.060957 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-5855951a-0a84-47b8-9dc5-1984ec45ff40 tempest-VolumesListTestJSON-1600106481 None] Created reservations ['01e4c07d-b73f-4055-ae1a-2aafdb956cab', '86d1eeb3-e6b8-4157-866b-b7c4ec573235', 'd2499939-1e14-443b-8631-66babd56cc65', '5aa9744c-35c5-4cb8-9064-4fa70c8c3e6f'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:37:46.468806 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-896e4ed2-d22a-4c9e-8f7b-85219c41f865 tempest-GroupsV314Test-1914113507 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:46.506025 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-896e4ed2-d22a-4c9e-8f7b-85219c41f865 tempest-GroupsV314Test-1914113507 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:46.550025 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-896e4ed2-d22a-4c9e-8f7b-85219c41f865 tempest-GroupsV314Test-1914113507 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:37:46.555729 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-896e4ed2-d22a-4c9e-8f7b-85219c41f865 tempest-GroupsV314Test-1914113507 None] Delete group completed successfully. Apr 30 21:37:46.620941 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-5855951a-0a84-47b8-9dc5-1984ec45ff40 tempest-VolumesListTestJSON-1600106481 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:46.652177 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-5855951a-0a84-47b8-9dc5-1984ec45ff40 tempest-VolumesListTestJSON-1600106481 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:46.746844 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-5855951a-0a84-47b8-9dc5-1984ec45ff40 tempest-VolumesListTestJSON-1600106481 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:37:46.752289 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-5855951a-0a84-47b8-9dc5-1984ec45ff40 tempest-VolumesListTestJSON-1600106481 None] Deleted volume successfully. Apr 30 21:37:46.791188 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-ac9d68bb-76a3-483d-acd8-0bd9286b3546 tempest-VolumesListTestJSON-1600106481 None] Lock "b'cinder-d7e1d71b-75c7-42ee-9e73-1591ff87b9c6-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:37:46.820653 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-5855951a-0a84-47b8-9dc5-1984ec45ff40 tempest-VolumesListTestJSON-1600106481 None] Lock "b'cinder-59fe0b92-2713-49f2-9ee5-3d86fd7d5ac6-delete_volume'" released by "delete_volume" :: held 4.509s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:37:46.928007 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-5839e77e-b559-43a3-98a2-1e3d76cbf9c8 tempest-VolumesExtendTest-1772170466 None] Volume volume-632a7810-1a6f-420a-a6fd-57675408a8f7.deleted is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:37:46.929918 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-5839e77e-b559-43a3-98a2-1e3d76cbf9c8 tempest-VolumesExtendTest-1772170466 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:37:46.930448 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-5839e77e-b559-43a3-98a2-1e3d76cbf9c8 tempest-VolumesExtendTest-1772170466 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:37:47.088471 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-5839e77e-b559-43a3-98a2-1e3d76cbf9c8 tempest-VolumesExtendTest-1772170466 None] clone created successfully {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} Apr 30 21:37:47.092813 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.volume_utils [None req-5839e77e-b559-43a3-98a2-1e3d76cbf9c8 tempest-VolumesExtendTest-1772170466 None] Marking volume 1a334699-fd38-469c-9756-198b1eb6912e as bootable. {{(pid=123855) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Apr 30 21:37:47.112291 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ac9d68bb-76a3-483d-acd8-0bd9286b3546 tempest-VolumesListTestJSON-1600106481 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:47.231976 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ac9d68bb-76a3-483d-acd8-0bd9286b3546 tempest-VolumesListTestJSON-1600106481 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:37:47.236578 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ac9d68bb-76a3-483d-acd8-0bd9286b3546 tempest-VolumesListTestJSON-1600106481 None] Volume volume-d7e1d71b-75c7-42ee-9e73-1591ff87b9c6 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:37:47.307258 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ac9d68bb-76a3-483d-acd8-0bd9286b3546 tempest-VolumesListTestJSON-1600106481 None] deleting rbd volume volume-d7e1d71b-75c7-42ee-9e73-1591ff87b9c6 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:37:47.309842 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-5839e77e-b559-43a3-98a2-1e3d76cbf9c8 tempest-VolumesExtendTest-1772170466 None] Copying metadata from image a5b0850f-3b24-4bcb-b0a7-351c3216b27d to 1a334699-fd38-469c-9756-198b1eb6912e. {{(pid=123855) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Apr 30 21:37:47.316841 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-5839e77e-b559-43a3-98a2-1e3d76cbf9c8 tempest-VolumesExtendTest-1772170466 None] Creating volume glance metadata for volume 1a334699-fd38-469c-9756-198b1eb6912e backed by image a5b0850f-3b24-4bcb-b0a7-351c3216b27d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123855) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Apr 30 21:37:47.449401 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5839e77e-b559-43a3-98a2-1e3d76cbf9c8 tempest-VolumesExtendTest-1772170466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcad3228-d414-40a8-9d73-9dfb88801889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a334699-fd38-469c-9756-198b1eb6912e', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:47.455482 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5839e77e-b559-43a3-98a2-1e3d76cbf9c8 tempest-VolumesExtendTest-1772170466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96bde0d6-b32f-4fc4-88b3-3dfdf09a6df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:47.535388 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-5839e77e-b559-43a3-98a2-1e3d76cbf9c8 tempest-VolumesExtendTest-1772170466 None] Volume volume-1a334699-fd38-469c-9756-198b1eb6912e (1a334699-fd38-469c-9756-198b1eb6912e): created successfully Apr 30 21:37:47.539191 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5839e77e-b559-43a3-98a2-1e3d76cbf9c8 tempest-VolumesExtendTest-1772170466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96bde0d6-b32f-4fc4-88b3-3dfdf09a6df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:47.544808 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5839e77e-b559-43a3-98a2-1e3d76cbf9c8 tempest-VolumesExtendTest-1772170466 None] Flow 'volume_create_manager' (9bd614dc-3caf-4272-965a-50b4ff711a74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:37:47.609736 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-5839e77e-b559-43a3-98a2-1e3d76cbf9c8 tempest-VolumesExtendTest-1772170466 None] Created volume successfully. Apr 30 21:37:48.523346 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e68d0be9-26b4-4c67-84a3-e08cab53029c tempest-VolumesExtendTest-1772170466 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:49.855278 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e68d0be9-26b4-4c67-84a3-e08cab53029c tempest-VolumesExtendTest-1772170466 None] Extend volume from 1 GB to 2 GB. {{(pid=123855) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1875}} Apr 30 21:37:50.012253 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-e68d0be9-26b4-4c67-84a3-e08cab53029c tempest-VolumesExtendTest-1772170466 None] Extend volume completed successfully. Apr 30 21:37:50.199713 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-ac9d68bb-76a3-483d-acd8-0bd9286b3546 tempest-VolumesListTestJSON-1600106481 None] Created reservations ['82b562b9-e640-436b-8ff7-0dfd3e81065a', '54bbb4fa-9e76-47ac-8642-225123fcb713', '9f3de908-c5af-429e-bf3b-63b06000026a', 'cc69eed4-5687-45ff-871d-c69b45920677'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:37:50.422170 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ac9d68bb-76a3-483d-acd8-0bd9286b3546 tempest-VolumesListTestJSON-1600106481 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:50.467511 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ac9d68bb-76a3-483d-acd8-0bd9286b3546 tempest-VolumesListTestJSON-1600106481 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:50.502727 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ac9d68bb-76a3-483d-acd8-0bd9286b3546 tempest-VolumesListTestJSON-1600106481 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:37:50.508289 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-ac9d68bb-76a3-483d-acd8-0bd9286b3546 tempest-VolumesListTestJSON-1600106481 None] Deleted volume successfully. Apr 30 21:37:50.602740 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-ac9d68bb-76a3-483d-acd8-0bd9286b3546 tempest-VolumesListTestJSON-1600106481 None] Lock "b'cinder-d7e1d71b-75c7-42ee-9e73-1591ff87b9c6-delete_volume'" released by "delete_volume" :: held 3.811s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:37:51.318857 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-a72c87d1-f2cd-4719-89ac-206cfcfe93de tempest-VolumesListTestJSON-1600106481 None] Lock "b'cinder-ee9b895d-1576-4f63-bf0f-60cadaa52baa-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:37:51.464121 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a72c87d1-f2cd-4719-89ac-206cfcfe93de tempest-VolumesListTestJSON-1600106481 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:51.643692 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a72c87d1-f2cd-4719-89ac-206cfcfe93de tempest-VolumesListTestJSON-1600106481 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:37:51.644231 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a72c87d1-f2cd-4719-89ac-206cfcfe93de tempest-VolumesListTestJSON-1600106481 None] Volume volume-ee9b895d-1576-4f63-bf0f-60cadaa52baa is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:37:51.738009 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a72c87d1-f2cd-4719-89ac-206cfcfe93de tempest-VolumesListTestJSON-1600106481 None] deleting rbd volume volume-ee9b895d-1576-4f63-bf0f-60cadaa52baa {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:37:51.828410 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a1b139c-9bfb-4bf3-a809-d00f636678d3 tempest-VolumesExtendTest-1772170466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:37:51.863990 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8a1b139c-9bfb-4bf3-a809-d00f636678d3 tempest-VolumesExtendTest-1772170466 None] Flow 'volume_create_manager' (98583afa-41ac-433b-9f33-fe69fa91f5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:37:51.877334 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8a1b139c-9bfb-4bf3-a809-d00f636678d3 tempest-VolumesExtendTest-1772170466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffd06c33-6920-4907-8622-841f87c6db83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:51.930951 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8a1b139c-9bfb-4bf3-a809-d00f636678d3 tempest-VolumesExtendTest-1772170466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffd06c33-6920-4907-8622-841f87c6db83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1883558686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=63eed675-d58c-4194-ac38-ee3f4262e072,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfeeac0c49384132a08a8d0dd5654b73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:37:52Z,use_quota=True,user_id='f93380560fd14d50af229186796db509',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:51.949562 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8a1b139c-9bfb-4bf3-a809-d00f636678d3 tempest-VolumesExtendTest-1772170466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6683b20f-93c5-4f92-9041-ce6ec1f8b5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:51.962565 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8a1b139c-9bfb-4bf3-a809-d00f636678d3 tempest-VolumesExtendTest-1772170466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6683b20f-93c5-4f92-9041-ce6ec1f8b5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:51.978417 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8a1b139c-9bfb-4bf3-a809-d00f636678d3 tempest-VolumesExtendTest-1772170466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (346f9167-a0a5-4541-b18d-a16b523f08c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:51.998660 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8a1b139c-9bfb-4bf3-a809-d00f636678d3 tempest-VolumesExtendTest-1772170466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (346f9167-a0a5-4541-b18d-a16b523f08c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63eed675-d58c-4194-ac38-ee3f4262e072', 'volume_name': 'volume-63eed675-d58c-4194-ac38-ee3f4262e072', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:52.010998 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8a1b139c-9bfb-4bf3-a809-d00f636678d3 tempest-VolumesExtendTest-1772170466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14bcbcf-8021-41b6-9a39-979f3c3a9215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:52.024038 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8a1b139c-9bfb-4bf3-a809-d00f636678d3 tempest-VolumesExtendTest-1772170466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14bcbcf-8021-41b6-9a39-979f3c3a9215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:52.033958 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8a1b139c-9bfb-4bf3-a809-d00f636678d3 tempest-VolumesExtendTest-1772170466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (452fe7a7-615f-4786-9692-4a116ceb69ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:52.040605 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-8a1b139c-9bfb-4bf3-a809-d00f636678d3 tempest-VolumesExtendTest-1772170466 None] Volume 63eed675-d58c-4194-ac38-ee3f4262e072: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63eed675-d58c-4194-ac38-ee3f4262e072', 'volume_size': 1} Apr 30 21:37:52.041013 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8a1b139c-9bfb-4bf3-a809-d00f636678d3 tempest-VolumesExtendTest-1772170466 None] creating volume 'volume-63eed675-d58c-4194-ac38-ee3f4262e072' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:37:52.041860 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8a1b139c-9bfb-4bf3-a809-d00f636678d3 tempest-VolumesExtendTest-1772170466 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:52.750577 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8a1b139c-9bfb-4bf3-a809-d00f636678d3 tempest-VolumesExtendTest-1772170466 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:37:52.757729 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8a1b139c-9bfb-4bf3-a809-d00f636678d3 tempest-VolumesExtendTest-1772170466 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:37:52.757729 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8a1b139c-9bfb-4bf3-a809-d00f636678d3 tempest-VolumesExtendTest-1772170466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (452fe7a7-615f-4786-9692-4a116ceb69ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63eed675-d58c-4194-ac38-ee3f4262e072', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:52.763305 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8a1b139c-9bfb-4bf3-a809-d00f636678d3 tempest-VolumesExtendTest-1772170466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a0b2b6-6532-433d-8e04-9b34cd7bf94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:37:52.815417 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-8a1b139c-9bfb-4bf3-a809-d00f636678d3 tempest-VolumesExtendTest-1772170466 None] Volume volume-63eed675-d58c-4194-ac38-ee3f4262e072 (63eed675-d58c-4194-ac38-ee3f4262e072): created successfully Apr 30 21:37:52.820707 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8a1b139c-9bfb-4bf3-a809-d00f636678d3 tempest-VolumesExtendTest-1772170466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a0b2b6-6532-433d-8e04-9b34cd7bf94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:37:52.831306 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-8a1b139c-9bfb-4bf3-a809-d00f636678d3 tempest-VolumesExtendTest-1772170466 None] Flow 'volume_create_manager' (98583afa-41ac-433b-9f33-fe69fa91f5dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:37:52.896447 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-8a1b139c-9bfb-4bf3-a809-d00f636678d3 tempest-VolumesExtendTest-1772170466 None] Created volume successfully. Apr 30 21:37:54.269283 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-c366752e-c076-4040-9ced-651cb860ec1e tempest-GroupsV320Test-1967234360 None] Group tempest-GroupsV320Test-Group-1486527992: creating Apr 30 21:37:54.361342 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-c366752e-c076-4040-9ced-651cb860ec1e tempest-GroupsV320Test-1967234360 None] Group tempest-GroupsV320Test-Group-1486527992: created successfully Apr 30 21:37:54.369802 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-c366752e-c076-4040-9ced-651cb860ec1e tempest-GroupsV320Test-1967234360 None] Create group completed successfully. Apr 30 21:37:54.411186 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-5f2b30ac-7880-429b-89f0-1c0125eb9452 tempest-VolumesExtendTest-1772170466 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:54.659405 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-a72c87d1-f2cd-4719-89ac-206cfcfe93de tempest-VolumesListTestJSON-1600106481 None] Created reservations ['1004c6f2-8ccc-4fbc-810e-1992afec7512', '390df632-007c-4d9e-89e7-3a4b48dfc5cc', '699b07cc-14a6-4cf7-b5d6-feae34aae511', 'd77df9ff-f99d-4307-8714-e6134041a90e'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:37:54.812665 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a72c87d1-f2cd-4719-89ac-206cfcfe93de tempest-VolumesListTestJSON-1600106481 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:54.860670 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a72c87d1-f2cd-4719-89ac-206cfcfe93de tempest-VolumesListTestJSON-1600106481 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:54.926399 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-a72c87d1-f2cd-4719-89ac-206cfcfe93de tempest-VolumesListTestJSON-1600106481 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:37:54.930476 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-a72c87d1-f2cd-4719-89ac-206cfcfe93de tempest-VolumesListTestJSON-1600106481 None] Deleted volume successfully. Apr 30 21:37:55.014534 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-a72c87d1-f2cd-4719-89ac-206cfcfe93de tempest-VolumesListTestJSON-1600106481 None] Lock "b'cinder-ee9b895d-1576-4f63-bf0f-60cadaa52baa-delete_volume'" released by "delete_volume" :: held 3.696s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:37:56.335196 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-24e4b6d2-b7c1-455f-b6b1-de8bc8dc22fb tempest-GroupsV320Test-1967234360 None] Created reservations ['2fecd0f8-0ef2-413c-bd1c-c1e97874f94f'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:37:56.573250 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-24e4b6d2-b7c1-455f-b6b1-de8bc8dc22fb tempest-GroupsV320Test-1967234360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:56.627547 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-24e4b6d2-b7c1-455f-b6b1-de8bc8dc22fb tempest-GroupsV320Test-1967234360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:56.680722 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-24e4b6d2-b7c1-455f-b6b1-de8bc8dc22fb tempest-GroupsV320Test-1967234360 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:37:56.686437 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-24e4b6d2-b7c1-455f-b6b1-de8bc8dc22fb tempest-GroupsV320Test-1967234360 None] Delete group completed successfully. Apr 30 21:37:56.888967 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-5f2b30ac-7880-429b-89f0-1c0125eb9452 tempest-VolumesExtendTest-1772170466 None] Create snapshot completed successfully Apr 30 21:37:57.726280 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-19c8f007-2f8a-4d0f-b69b-97e6f094e950 tempest-VolumesExtendTest-1772170466 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:37:58.536329 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-19c8f007-2f8a-4d0f-b69b-97e6f094e950 tempest-VolumesExtendTest-1772170466 None] Extend volume from 1 GB to 2 GB. {{(pid=123855) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1875}} Apr 30 21:37:58.688928 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-19c8f007-2f8a-4d0f-b69b-97e6f094e950 tempest-VolumesExtendTest-1772170466 None] Extend volume completed successfully. Apr 30 21:37:59.207029 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-b2da3006-396f-4102-9249-995382e68525 tempest-VolumesExtendTest-1772170466 None] Lock "b'cinder-d0bf1a66-4729-435c-affa-1f65a2d3fbda-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.025s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:37:59.218444 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b2da3006-396f-4102-9249-995382e68525 tempest-VolumesExtendTest-1772170466 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:00.536784 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-88a3639d-1598-4526-937c-e81081a59369 tempest-VolumesSnapshotNegativeTestJSON-1858478793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:38:00.572581 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-88a3639d-1598-4526-937c-e81081a59369 tempest-VolumesSnapshotNegativeTestJSON-1858478793 None] Flow 'volume_create_manager' (4629bc3d-1d66-4e65-a341-c5697dc5263b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:38:00.581542 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-88a3639d-1598-4526-937c-e81081a59369 tempest-VolumesSnapshotNegativeTestJSON-1858478793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de5bca0e-e6a3-48ae-8503-492e3a5d7fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:00.621456 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-88a3639d-1598-4526-937c-e81081a59369 tempest-VolumesSnapshotNegativeTestJSON-1858478793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de5bca0e-e6a3-48ae-8503-492e3a5d7fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:38:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1077621241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=748f43fc-0a9b-4c33-a747-9fbbdd101bab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7901698b22e64b5a9d17ffdae95763bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:38:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:38:00Z,use_quota=True,user_id='7f383f91907a43ec8c02282cc3de6414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:00.636436 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-88a3639d-1598-4526-937c-e81081a59369 tempest-VolumesSnapshotNegativeTestJSON-1858478793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1698fc52-4b82-407c-8957-2e9b373e77a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:00.636436 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-88a3639d-1598-4526-937c-e81081a59369 tempest-VolumesSnapshotNegativeTestJSON-1858478793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1698fc52-4b82-407c-8957-2e9b373e77a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:00.639815 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-88a3639d-1598-4526-937c-e81081a59369 tempest-VolumesSnapshotNegativeTestJSON-1858478793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (742d3d5e-d11a-4431-9c24-19fa25c283a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:00.644880 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-88a3639d-1598-4526-937c-e81081a59369 tempest-VolumesSnapshotNegativeTestJSON-1858478793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (742d3d5e-d11a-4431-9c24-19fa25c283a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '748f43fc-0a9b-4c33-a747-9fbbdd101bab', 'volume_name': 'volume-748f43fc-0a9b-4c33-a747-9fbbdd101bab', 'volume_size': 2}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:00.650650 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-88a3639d-1598-4526-937c-e81081a59369 tempest-VolumesSnapshotNegativeTestJSON-1858478793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f54acd2-a99e-406d-bbce-637849dae943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:00.654802 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-88a3639d-1598-4526-937c-e81081a59369 tempest-VolumesSnapshotNegativeTestJSON-1858478793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f54acd2-a99e-406d-bbce-637849dae943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:00.660264 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-88a3639d-1598-4526-937c-e81081a59369 tempest-VolumesSnapshotNegativeTestJSON-1858478793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee5444fa-e903-40fd-b8bd-a12b0b4d4f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:00.662240 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-88a3639d-1598-4526-937c-e81081a59369 tempest-VolumesSnapshotNegativeTestJSON-1858478793 None] Volume 748f43fc-0a9b-4c33-a747-9fbbdd101bab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-748f43fc-0a9b-4c33-a747-9fbbdd101bab', 'volume_size': 2} Apr 30 21:38:00.662993 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-88a3639d-1598-4526-937c-e81081a59369 tempest-VolumesSnapshotNegativeTestJSON-1858478793 None] creating volume 'volume-748f43fc-0a9b-4c33-a747-9fbbdd101bab' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:38:00.664094 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-88a3639d-1598-4526-937c-e81081a59369 tempest-VolumesSnapshotNegativeTestJSON-1858478793 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:01.419767 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-b2da3006-396f-4102-9249-995382e68525 tempest-VolumesExtendTest-1772170466 None] Created reservations ['15f7feee-67c4-483a-b9a6-9f7450e2a5fa', '33437004-554c-4a2b-a785-bc0e6f0e6f13', '263ce979-af40-4d3d-9095-cfe70f4e7269', 'eb30635a-cc0c-4324-96e1-1066ee4bf46a'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:38:01.460471 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-88a3639d-1598-4526-937c-e81081a59369 tempest-VolumesSnapshotNegativeTestJSON-1858478793 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:38:01.462191 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-88a3639d-1598-4526-937c-e81081a59369 tempest-VolumesSnapshotNegativeTestJSON-1858478793 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:38:01.465165 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-88a3639d-1598-4526-937c-e81081a59369 tempest-VolumesSnapshotNegativeTestJSON-1858478793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee5444fa-e903-40fd-b8bd-a12b0b4d4f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-748f43fc-0a9b-4c33-a747-9fbbdd101bab', 'volume_size': 2}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:01.475371 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-88a3639d-1598-4526-937c-e81081a59369 tempest-VolumesSnapshotNegativeTestJSON-1858478793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bca5648-e643-4e9b-b0b4-d384b7336b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:01.548363 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-88a3639d-1598-4526-937c-e81081a59369 tempest-VolumesSnapshotNegativeTestJSON-1858478793 None] Volume volume-748f43fc-0a9b-4c33-a747-9fbbdd101bab (748f43fc-0a9b-4c33-a747-9fbbdd101bab): created successfully Apr 30 21:38:01.552049 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-88a3639d-1598-4526-937c-e81081a59369 tempest-VolumesSnapshotNegativeTestJSON-1858478793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bca5648-e643-4e9b-b0b4-d384b7336b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:01.557600 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-88a3639d-1598-4526-937c-e81081a59369 tempest-VolumesSnapshotNegativeTestJSON-1858478793 None] Flow 'volume_create_manager' (4629bc3d-1d66-4e65-a341-c5697dc5263b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:38:01.662155 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-88a3639d-1598-4526-937c-e81081a59369 tempest-VolumesSnapshotNegativeTestJSON-1858478793 None] Created volume successfully. Apr 30 21:38:01.665444 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-b2da3006-396f-4102-9249-995382e68525 tempest-VolumesExtendTest-1772170466 None] Delete snapshot completed successfully. Apr 30 21:38:01.674025 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-b2da3006-396f-4102-9249-995382e68525 tempest-VolumesExtendTest-1772170466 None] Lock "b'cinder-d0bf1a66-4729-435c-affa-1f65a2d3fbda-delete_snapshot'" released by "delete_snapshot" :: held 2.479s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:38:02.708878 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-b977e0fb-d0ba-4eb6-8abb-c84ba0c50be7 tempest-VolumesExtendTest-1772170466 None] Lock "b'cinder-63eed675-d58c-4194-ac38-ee3f4262e072-delete_volume'" acquired by "delete_volume" :: waited 0.027s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:38:02.862089 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b977e0fb-d0ba-4eb6-8abb-c84ba0c50be7 tempest-VolumesExtendTest-1772170466 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:02.991772 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b977e0fb-d0ba-4eb6-8abb-c84ba0c50be7 tempest-VolumesExtendTest-1772170466 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:38:02.992207 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b977e0fb-d0ba-4eb6-8abb-c84ba0c50be7 tempest-VolumesExtendTest-1772170466 None] Volume volume-63eed675-d58c-4194-ac38-ee3f4262e072 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:38:03.086827 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b977e0fb-d0ba-4eb6-8abb-c84ba0c50be7 tempest-VolumesExtendTest-1772170466 None] deleting rbd volume volume-63eed675-d58c-4194-ac38-ee3f4262e072 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:38:03.237904 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8e307e17-c657-4b81-b4f3-6466b1cac2d6 tempest-VolumesSnapshotNegativeTestJSON-1858478793 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:06.561110 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-8e307e17-c657-4b81-b4f3-6466b1cac2d6 tempest-VolumesSnapshotNegativeTestJSON-1858478793 None] Create snapshot completed successfully Apr 30 21:38:06.797939 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-b977e0fb-d0ba-4eb6-8abb-c84ba0c50be7 tempest-VolumesExtendTest-1772170466 None] Created reservations ['dcad5342-767a-4048-bdde-06b64a5b9608', 'd454f802-b4a7-47fc-8772-abe408cec4ed', '2b63e06c-b1f0-49d1-a064-0310dc48cc07', '00a52f3d-47fb-4108-aa24-78e6cc82691e'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:38:07.072549 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b977e0fb-d0ba-4eb6-8abb-c84ba0c50be7 tempest-VolumesExtendTest-1772170466 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:07.105387 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b977e0fb-d0ba-4eb6-8abb-c84ba0c50be7 tempest-VolumesExtendTest-1772170466 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:07.244461 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-b977e0fb-d0ba-4eb6-8abb-c84ba0c50be7 tempest-VolumesExtendTest-1772170466 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:38:07.248902 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-b977e0fb-d0ba-4eb6-8abb-c84ba0c50be7 tempest-VolumesExtendTest-1772170466 None] Deleted volume successfully. Apr 30 21:38:07.310265 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-032b331e-4e6e-44ac-80d3-09f383fe93ad tempest-VolumesExtendTest-1772170466 None] Lock "b'cinder-1a334699-fd38-469c-9756-198b1eb6912e-delete_volume'" acquired by "delete_volume" :: waited 0.036s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:38:07.384883 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-b977e0fb-d0ba-4eb6-8abb-c84ba0c50be7 tempest-VolumesExtendTest-1772170466 None] Lock "b'cinder-63eed675-d58c-4194-ac38-ee3f4262e072-delete_volume'" released by "delete_volume" :: held 4.677s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:38:07.459851 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-032b331e-4e6e-44ac-80d3-09f383fe93ad tempest-VolumesExtendTest-1772170466 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:07.597282 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-032b331e-4e6e-44ac-80d3-09f383fe93ad tempest-VolumesExtendTest-1772170466 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:38:07.661638 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-032b331e-4e6e-44ac-80d3-09f383fe93ad tempest-VolumesExtendTest-1772170466 None] deleting rbd volume volume-1a334699-fd38-469c-9756-198b1eb6912e {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:38:07.666573 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-4fe050b7-572c-45f3-aae4-33f10e3f3c9a tempest-VolumesSnapshotNegativeTestJSON-1858478793 None] Lock "b'cinder-674df2cd-1736-4e35-9a32-b8d7f9e8a928-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.222s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:38:07.668762 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-4fe050b7-572c-45f3-aae4-33f10e3f3c9a tempest-VolumesSnapshotNegativeTestJSON-1858478793 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:11.146414 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-4fe050b7-572c-45f3-aae4-33f10e3f3c9a tempest-VolumesSnapshotNegativeTestJSON-1858478793 None] Created reservations ['66dd05e4-ef6b-44b5-a58d-a79df63213a3', 'f899d2a8-e6cc-4e36-b8af-347afc861072', 'cf68bd6b-1a19-4ad3-ad93-fce6ff5b55f3', '58c4571c-f827-498c-a2e2-a6c42b73821b'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:38:11.232960 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-032b331e-4e6e-44ac-80d3-09f383fe93ad tempest-VolumesExtendTest-1772170466 None] volume is a clone so cleaning references {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} Apr 30 21:38:11.409352 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-032b331e-4e6e-44ac-80d3-09f383fe93ad tempest-VolumesExtendTest-1772170466 None] deleting parent snapshot volume-1a334699-fd38-469c-9756-198b1eb6912e.clone_snap {{(pid=123855) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} Apr 30 21:38:12.973059 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-fd0921ab-8bb7-4acb-ad5b-02cff676ed35 tempest-VolumesSnapshotNegativeTestJSON-1858478793 None] Lock "b'cinder-748f43fc-0a9b-4c33-a747-9fbbdd101bab-delete_volume'" acquired by "delete_volume" :: waited 0.093s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:38:13.028010 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-4fe050b7-572c-45f3-aae4-33f10e3f3c9a tempest-VolumesSnapshotNegativeTestJSON-1858478793 None] Delete snapshot completed successfully. Apr 30 21:38:13.037007 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-4fe050b7-572c-45f3-aae4-33f10e3f3c9a tempest-VolumesSnapshotNegativeTestJSON-1858478793 None] Lock "b'cinder-674df2cd-1736-4e35-9a32-b8d7f9e8a928-delete_snapshot'" released by "delete_snapshot" :: held 5.370s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:38:13.121799 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-fd0921ab-8bb7-4acb-ad5b-02cff676ed35 tempest-VolumesSnapshotNegativeTestJSON-1858478793 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:13.254717 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-fd0921ab-8bb7-4acb-ad5b-02cff676ed35 tempest-VolumesSnapshotNegativeTestJSON-1858478793 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:38:13.256186 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-fd0921ab-8bb7-4acb-ad5b-02cff676ed35 tempest-VolumesSnapshotNegativeTestJSON-1858478793 None] Volume volume-748f43fc-0a9b-4c33-a747-9fbbdd101bab is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:38:13.398162 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-fd0921ab-8bb7-4acb-ad5b-02cff676ed35 tempest-VolumesSnapshotNegativeTestJSON-1858478793 None] deleting rbd volume volume-748f43fc-0a9b-4c33-a747-9fbbdd101bab {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:38:13.400623 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-032b331e-4e6e-44ac-80d3-09f383fe93ad tempest-VolumesExtendTest-1772170466 None] Created reservations ['40e497a1-9df6-461e-97fd-e955e8139157', '0a017eb8-fb07-47b7-8eba-82940f662930', 'e8a6b5a6-8cfc-48fc-bedf-1b4b8daea5f9', '8194c239-bf88-4366-831b-ec113b7d1223'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:38:13.598539 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-032b331e-4e6e-44ac-80d3-09f383fe93ad tempest-VolumesExtendTest-1772170466 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:13.743833 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-032b331e-4e6e-44ac-80d3-09f383fe93ad tempest-VolumesExtendTest-1772170466 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:14.031522 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-032b331e-4e6e-44ac-80d3-09f383fe93ad tempest-VolumesExtendTest-1772170466 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:38:14.042526 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-032b331e-4e6e-44ac-80d3-09f383fe93ad tempest-VolumesExtendTest-1772170466 None] Deleted volume successfully. Apr 30 21:38:14.194604 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-032b331e-4e6e-44ac-80d3-09f383fe93ad tempest-VolumesExtendTest-1772170466 None] Lock "b'cinder-1a334699-fd38-469c-9756-198b1eb6912e-delete_volume'" released by "delete_volume" :: held 6.892s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:38:15.240942 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-97eeac00-2402-4ed7-81f5-2a73e9650f78 tempest-AbsoluteLimitsTests-660482739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:38:15.289964 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-97eeac00-2402-4ed7-81f5-2a73e9650f78 tempest-AbsoluteLimitsTests-660482739 None] Flow 'volume_create_manager' (5583ec8f-cdca-49d3-9731-7ab514695a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:38:15.297577 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-97eeac00-2402-4ed7-81f5-2a73e9650f78 tempest-AbsoluteLimitsTests-660482739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a057e248-06d0-4a43-8813-5dda0469e4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:15.316084 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-97eeac00-2402-4ed7-81f5-2a73e9650f78 tempest-AbsoluteLimitsTests-660482739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a057e248-06d0-4a43-8813-5dda0469e4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2027692103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9a75998c-c008-4bfb-9628-1c21dee472e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e77c0845b9d41c596a91632b64a98e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:38:15Z,use_quota=True,user_id='46a491d663814ab28aee4f5331924220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:15.321563 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-97eeac00-2402-4ed7-81f5-2a73e9650f78 tempest-AbsoluteLimitsTests-660482739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb148cd2-9084-4541-98ec-09c370b4d8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:15.325749 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-97eeac00-2402-4ed7-81f5-2a73e9650f78 tempest-AbsoluteLimitsTests-660482739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb148cd2-9084-4541-98ec-09c370b4d8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:15.331685 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-97eeac00-2402-4ed7-81f5-2a73e9650f78 tempest-AbsoluteLimitsTests-660482739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19bb02d5-fbc0-4a06-ae3b-2642d3d370bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:15.335945 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-97eeac00-2402-4ed7-81f5-2a73e9650f78 tempest-AbsoluteLimitsTests-660482739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19bb02d5-fbc0-4a06-ae3b-2642d3d370bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a75998c-c008-4bfb-9628-1c21dee472e8', 'volume_name': 'volume-9a75998c-c008-4bfb-9628-1c21dee472e8', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:15.341003 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-97eeac00-2402-4ed7-81f5-2a73e9650f78 tempest-AbsoluteLimitsTests-660482739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54ce5394-9f5f-4022-aa70-2312c1ce3464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:15.345027 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-97eeac00-2402-4ed7-81f5-2a73e9650f78 tempest-AbsoluteLimitsTests-660482739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54ce5394-9f5f-4022-aa70-2312c1ce3464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:15.349772 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-97eeac00-2402-4ed7-81f5-2a73e9650f78 tempest-AbsoluteLimitsTests-660482739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (801816ec-67a0-4ac7-b101-0a2c03645733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:15.350887 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-97eeac00-2402-4ed7-81f5-2a73e9650f78 tempest-AbsoluteLimitsTests-660482739 None] Volume 9a75998c-c008-4bfb-9628-1c21dee472e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a75998c-c008-4bfb-9628-1c21dee472e8', 'volume_size': 1} Apr 30 21:38:15.351288 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-97eeac00-2402-4ed7-81f5-2a73e9650f78 tempest-AbsoluteLimitsTests-660482739 None] creating volume 'volume-9a75998c-c008-4bfb-9628-1c21dee472e8' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:38:15.352071 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-97eeac00-2402-4ed7-81f5-2a73e9650f78 tempest-AbsoluteLimitsTests-660482739 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:15.932450 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-97eeac00-2402-4ed7-81f5-2a73e9650f78 tempest-AbsoluteLimitsTests-660482739 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:38:15.933146 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-97eeac00-2402-4ed7-81f5-2a73e9650f78 tempest-AbsoluteLimitsTests-660482739 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:38:15.936926 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-97eeac00-2402-4ed7-81f5-2a73e9650f78 tempest-AbsoluteLimitsTests-660482739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (801816ec-67a0-4ac7-b101-0a2c03645733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a75998c-c008-4bfb-9628-1c21dee472e8', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:15.942443 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-97eeac00-2402-4ed7-81f5-2a73e9650f78 tempest-AbsoluteLimitsTests-660482739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc9d0d80-7cc8-42a5-9f23-1ee2047f5924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:16.038153 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-97eeac00-2402-4ed7-81f5-2a73e9650f78 tempest-AbsoluteLimitsTests-660482739 None] Volume volume-9a75998c-c008-4bfb-9628-1c21dee472e8 (9a75998c-c008-4bfb-9628-1c21dee472e8): created successfully Apr 30 21:38:16.041995 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-97eeac00-2402-4ed7-81f5-2a73e9650f78 tempest-AbsoluteLimitsTests-660482739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc9d0d80-7cc8-42a5-9f23-1ee2047f5924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:16.048359 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-97eeac00-2402-4ed7-81f5-2a73e9650f78 tempest-AbsoluteLimitsTests-660482739 None] Flow 'volume_create_manager' (5583ec8f-cdca-49d3-9731-7ab514695a82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:38:16.100582 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-97eeac00-2402-4ed7-81f5-2a73e9650f78 tempest-AbsoluteLimitsTests-660482739 None] Created volume successfully. Apr 30 21:38:16.500355 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-fd0921ab-8bb7-4acb-ad5b-02cff676ed35 tempest-VolumesSnapshotNegativeTestJSON-1858478793 None] Created reservations ['067ce000-5d66-4308-b260-f8c13547b263', 'f21caedb-4df0-4943-a945-55954fd500c8', '503039c8-d0e2-4d38-98ed-0bbd5cc80a5b', 'be128946-28cf-4606-b39c-3df70955e19d'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:38:16.666572 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-fd0921ab-8bb7-4acb-ad5b-02cff676ed35 tempest-VolumesSnapshotNegativeTestJSON-1858478793 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:16.689012 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-fd0921ab-8bb7-4acb-ad5b-02cff676ed35 tempest-VolumesSnapshotNegativeTestJSON-1858478793 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:16.712208 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-fd0921ab-8bb7-4acb-ad5b-02cff676ed35 tempest-VolumesSnapshotNegativeTestJSON-1858478793 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:38:16.716274 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-fd0921ab-8bb7-4acb-ad5b-02cff676ed35 tempest-VolumesSnapshotNegativeTestJSON-1858478793 None] Deleted volume successfully. Apr 30 21:38:16.795596 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-fd0921ab-8bb7-4acb-ad5b-02cff676ed35 tempest-VolumesSnapshotNegativeTestJSON-1858478793 None] Lock "b'cinder-748f43fc-0a9b-4c33-a747-9fbbdd101bab-delete_volume'" released by "delete_volume" :: held 3.823s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:38:17.147664 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-43a9412a-a7a8-4045-b36c-5179407ce8ad tempest-VolumesGetTest-1561898534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:38:17.167048 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-43a9412a-a7a8-4045-b36c-5179407ce8ad tempest-VolumesGetTest-1561898534 None] Flow 'volume_create_manager' (6e753dcf-ab09-4f09-b208-c3d9c8f24b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:38:17.174096 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-43a9412a-a7a8-4045-b36c-5179407ce8ad tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d64a8b2-b654-494b-9136-c6230aef9fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:17.192132 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-43a9412a-a7a8-4045-b36c-5179407ce8ad tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d64a8b2-b654-494b-9136-c6230aef9fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1752241952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=21588e74-83a5-4041-987a-c71477a0dbd1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='903ce8c98e7941809c3641af803b1030',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:38:17Z,use_quota=True,user_id='ee17009a1c3248b7adf0cdd17c918e0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:17.197505 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-43a9412a-a7a8-4045-b36c-5179407ce8ad tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (688fe342-53ad-4d25-a277-0f8cded3599f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:17.201715 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-43a9412a-a7a8-4045-b36c-5179407ce8ad tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (688fe342-53ad-4d25-a277-0f8cded3599f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:17.206920 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-43a9412a-a7a8-4045-b36c-5179407ce8ad tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (763329b0-0589-43a7-bafe-bc4a921bec55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:17.211002 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-43a9412a-a7a8-4045-b36c-5179407ce8ad tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (763329b0-0589-43a7-bafe-bc4a921bec55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21588e74-83a5-4041-987a-c71477a0dbd1', 'volume_name': 'volume-21588e74-83a5-4041-987a-c71477a0dbd1', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:17.215975 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-43a9412a-a7a8-4045-b36c-5179407ce8ad tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cac163b6-b0e6-4342-89af-d0f0c21f3c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:17.219961 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-43a9412a-a7a8-4045-b36c-5179407ce8ad tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cac163b6-b0e6-4342-89af-d0f0c21f3c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:17.224711 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-43a9412a-a7a8-4045-b36c-5179407ce8ad tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ee688f-31fa-4859-ba77-9333c27dd610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:17.225852 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-43a9412a-a7a8-4045-b36c-5179407ce8ad tempest-VolumesGetTest-1561898534 None] Volume 21588e74-83a5-4041-987a-c71477a0dbd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21588e74-83a5-4041-987a-c71477a0dbd1', 'volume_size': 1} Apr 30 21:38:17.226247 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-43a9412a-a7a8-4045-b36c-5179407ce8ad tempest-VolumesGetTest-1561898534 None] creating volume 'volume-21588e74-83a5-4041-987a-c71477a0dbd1' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:38:17.227014 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-43a9412a-a7a8-4045-b36c-5179407ce8ad tempest-VolumesGetTest-1561898534 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:17.442484 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-85e525d1-2121-46ac-b30d-f04befd9a841 tempest-AbsoluteLimitsTests-660482739 None] Lock "b'cinder-9a75998c-c008-4bfb-9628-1c21dee472e8-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:38:17.579845 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-85e525d1-2121-46ac-b30d-f04befd9a841 tempest-AbsoluteLimitsTests-660482739 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:17.694620 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-85e525d1-2121-46ac-b30d-f04befd9a841 tempest-AbsoluteLimitsTests-660482739 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:38:17.694620 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-85e525d1-2121-46ac-b30d-f04befd9a841 tempest-AbsoluteLimitsTests-660482739 None] Volume volume-9a75998c-c008-4bfb-9628-1c21dee472e8 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:38:17.854822 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-85e525d1-2121-46ac-b30d-f04befd9a841 tempest-AbsoluteLimitsTests-660482739 None] deleting rbd volume volume-9a75998c-c008-4bfb-9628-1c21dee472e8 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:38:17.926040 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-43a9412a-a7a8-4045-b36c-5179407ce8ad tempest-VolumesGetTest-1561898534 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:38:17.926683 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-43a9412a-a7a8-4045-b36c-5179407ce8ad tempest-VolumesGetTest-1561898534 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:38:17.930648 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-43a9412a-a7a8-4045-b36c-5179407ce8ad tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ee688f-31fa-4859-ba77-9333c27dd610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21588e74-83a5-4041-987a-c71477a0dbd1', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:17.935264 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-43a9412a-a7a8-4045-b36c-5179407ce8ad tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4343321e-5099-4699-b229-6e0067f0d623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:18.025663 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-43a9412a-a7a8-4045-b36c-5179407ce8ad tempest-VolumesGetTest-1561898534 None] Volume volume-21588e74-83a5-4041-987a-c71477a0dbd1 (21588e74-83a5-4041-987a-c71477a0dbd1): created successfully Apr 30 21:38:18.029407 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-43a9412a-a7a8-4045-b36c-5179407ce8ad tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4343321e-5099-4699-b229-6e0067f0d623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:18.035670 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-43a9412a-a7a8-4045-b36c-5179407ce8ad tempest-VolumesGetTest-1561898534 None] Flow 'volume_create_manager' (6e753dcf-ab09-4f09-b208-c3d9c8f24b9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:38:18.123079 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-43a9412a-a7a8-4045-b36c-5179407ce8ad tempest-VolumesGetTest-1561898534 None] Created volume successfully. Apr 30 21:38:20.150679 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-12113a18-0d7a-4abe-94ed-5aa9bbf5c4e2 tempest-VolumesGetTest-1561898534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:38:20.176432 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-12113a18-0d7a-4abe-94ed-5aa9bbf5c4e2 tempest-VolumesGetTest-1561898534 None] Flow 'volume_create_manager' (c965a2de-60b8-48b5-a98e-20ec91554587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:38:20.185244 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-12113a18-0d7a-4abe-94ed-5aa9bbf5c4e2 tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b794326f-c6ff-4380-ae43-f4366a26a13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:20.204049 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-12113a18-0d7a-4abe-94ed-5aa9bbf5c4e2 tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b794326f-c6ff-4380-ae43-f4366a26a13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:38:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1136284714',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=49997dce-a9ea-470a-a72e-5a09ef5681e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='903ce8c98e7941809c3641af803b1030',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:38:20Z,use_quota=True,user_id='ee17009a1c3248b7adf0cdd17c918e0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:20.214254 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-12113a18-0d7a-4abe-94ed-5aa9bbf5c4e2 tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17bf9af3-3fc8-496c-8cc4-16d3aaeb48c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:20.218750 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-12113a18-0d7a-4abe-94ed-5aa9bbf5c4e2 tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17bf9af3-3fc8-496c-8cc4-16d3aaeb48c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:20.223911 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-12113a18-0d7a-4abe-94ed-5aa9bbf5c4e2 tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fdda8ed-a9c6-4f64-94f0-31e4068c3122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:20.228328 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-12113a18-0d7a-4abe-94ed-5aa9bbf5c4e2 tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fdda8ed-a9c6-4f64-94f0-31e4068c3122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49997dce-a9ea-470a-a72e-5a09ef5681e2', 'volume_name': 'volume-49997dce-a9ea-470a-a72e-5a09ef5681e2', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:20.233321 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-12113a18-0d7a-4abe-94ed-5aa9bbf5c4e2 tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e86de173-3bfa-4f65-96cc-3d05b51e5228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:20.238358 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-12113a18-0d7a-4abe-94ed-5aa9bbf5c4e2 tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e86de173-3bfa-4f65-96cc-3d05b51e5228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:20.243445 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-12113a18-0d7a-4abe-94ed-5aa9bbf5c4e2 tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84fc5508-fb8f-4ed5-9fc0-2990165fae65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:20.244809 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-12113a18-0d7a-4abe-94ed-5aa9bbf5c4e2 tempest-VolumesGetTest-1561898534 None] Volume 49997dce-a9ea-470a-a72e-5a09ef5681e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49997dce-a9ea-470a-a72e-5a09ef5681e2', 'volume_size': 1} Apr 30 21:38:20.245374 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-12113a18-0d7a-4abe-94ed-5aa9bbf5c4e2 tempest-VolumesGetTest-1561898534 None] creating volume 'volume-49997dce-a9ea-470a-a72e-5a09ef5681e2' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:38:20.246271 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-12113a18-0d7a-4abe-94ed-5aa9bbf5c4e2 tempest-VolumesGetTest-1561898534 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:20.540652 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-85e525d1-2121-46ac-b30d-f04befd9a841 tempest-AbsoluteLimitsTests-660482739 None] Created reservations ['fa2e89e4-524b-467e-9d72-8ab4a17163a1', 'bea4f30e-1edb-4b19-8451-01ff3cb5825b', 'f90c6e4a-3916-46f2-9604-70aca8c7f9b7', '9d856ad2-863d-44e3-8878-9978b5188af4'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:38:20.779174 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-85e525d1-2121-46ac-b30d-f04befd9a841 tempest-AbsoluteLimitsTests-660482739 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:20.817881 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-85e525d1-2121-46ac-b30d-f04befd9a841 tempest-AbsoluteLimitsTests-660482739 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:20.842298 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-85e525d1-2121-46ac-b30d-f04befd9a841 tempest-AbsoluteLimitsTests-660482739 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:38:20.850369 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-12113a18-0d7a-4abe-94ed-5aa9bbf5c4e2 tempest-VolumesGetTest-1561898534 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:38:20.850768 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-12113a18-0d7a-4abe-94ed-5aa9bbf5c4e2 tempest-VolumesGetTest-1561898534 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:38:20.854596 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-12113a18-0d7a-4abe-94ed-5aa9bbf5c4e2 tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84fc5508-fb8f-4ed5-9fc0-2990165fae65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49997dce-a9ea-470a-a72e-5a09ef5681e2', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:20.859806 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-12113a18-0d7a-4abe-94ed-5aa9bbf5c4e2 tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a796c00-1f3b-43ce-98f2-92caa97250da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:20.866802 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-85e525d1-2121-46ac-b30d-f04befd9a841 tempest-AbsoluteLimitsTests-660482739 None] Deleted volume successfully. Apr 30 21:38:20.928467 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-12113a18-0d7a-4abe-94ed-5aa9bbf5c4e2 tempest-VolumesGetTest-1561898534 None] Volume volume-49997dce-a9ea-470a-a72e-5a09ef5681e2 (49997dce-a9ea-470a-a72e-5a09ef5681e2): created successfully Apr 30 21:38:20.932851 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-12113a18-0d7a-4abe-94ed-5aa9bbf5c4e2 tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a796c00-1f3b-43ce-98f2-92caa97250da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:20.940112 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-12113a18-0d7a-4abe-94ed-5aa9bbf5c4e2 tempest-VolumesGetTest-1561898534 None] Flow 'volume_create_manager' (c965a2de-60b8-48b5-a98e-20ec91554587) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:38:20.956118 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-85e525d1-2121-46ac-b30d-f04befd9a841 tempest-AbsoluteLimitsTests-660482739 None] Lock "b'cinder-9a75998c-c008-4bfb-9628-1c21dee472e8-delete_volume'" released by "delete_volume" :: held 3.513s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:38:21.019943 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-12113a18-0d7a-4abe-94ed-5aa9bbf5c4e2 tempest-VolumesGetTest-1561898534 None] Created volume successfully. Apr 30 21:38:21.333293 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-66c826d6-c00d-4e6c-a9bf-33dd9674617f tempest-VolumesGetTest-1561898534 None] Lock "b'cinder-49997dce-a9ea-470a-a72e-5a09ef5681e2-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:38:21.437891 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-66c826d6-c00d-4e6c-a9bf-33dd9674617f tempest-VolumesGetTest-1561898534 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:21.551441 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-66c826d6-c00d-4e6c-a9bf-33dd9674617f tempest-VolumesGetTest-1561898534 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:38:21.552134 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-66c826d6-c00d-4e6c-a9bf-33dd9674617f tempest-VolumesGetTest-1561898534 None] Volume volume-49997dce-a9ea-470a-a72e-5a09ef5681e2 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:38:21.637700 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-66c826d6-c00d-4e6c-a9bf-33dd9674617f tempest-VolumesGetTest-1561898534 None] deleting rbd volume volume-49997dce-a9ea-470a-a72e-5a09ef5681e2 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:38:23.889051 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-66c826d6-c00d-4e6c-a9bf-33dd9674617f tempest-VolumesGetTest-1561898534 None] Created reservations ['54ac7334-f9d3-4e3c-955b-841bd3a3f94c', 'cbb61b81-680e-43bd-9237-4644b39be6ae', 'eda06f50-bf93-43b5-960a-f4e45be1b5e8', '033f96ab-5fc3-4ef3-b22b-2b43165bf374'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:38:24.073188 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-66c826d6-c00d-4e6c-a9bf-33dd9674617f tempest-VolumesGetTest-1561898534 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:24.152883 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-66c826d6-c00d-4e6c-a9bf-33dd9674617f tempest-VolumesGetTest-1561898534 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:24.211068 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-66c826d6-c00d-4e6c-a9bf-33dd9674617f tempest-VolumesGetTest-1561898534 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:38:24.215640 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-66c826d6-c00d-4e6c-a9bf-33dd9674617f tempest-VolumesGetTest-1561898534 None] Deleted volume successfully. Apr 30 21:38:24.313398 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-66c826d6-c00d-4e6c-a9bf-33dd9674617f tempest-VolumesGetTest-1561898534 None] Lock "b'cinder-49997dce-a9ea-470a-a72e-5a09ef5681e2-delete_volume'" released by "delete_volume" :: held 2.979s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:38:24.734822 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-ea21e0e8-eee8-46c9-9a2f-b723abafda5f tempest-VolumesGetTest-1561898534 None] Lock "b'cinder-21588e74-83a5-4041-987a-c71477a0dbd1-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:38:24.852250 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ea21e0e8-eee8-46c9-9a2f-b723abafda5f tempest-VolumesGetTest-1561898534 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:25.105617 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ea21e0e8-eee8-46c9-9a2f-b723abafda5f tempest-VolumesGetTest-1561898534 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:38:25.106622 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ea21e0e8-eee8-46c9-9a2f-b723abafda5f tempest-VolumesGetTest-1561898534 None] Volume volume-21588e74-83a5-4041-987a-c71477a0dbd1 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:38:25.288837 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ea21e0e8-eee8-46c9-9a2f-b723abafda5f tempest-VolumesGetTest-1561898534 None] deleting rbd volume volume-21588e74-83a5-4041-987a-c71477a0dbd1 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:38:27.683046 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-ea21e0e8-eee8-46c9-9a2f-b723abafda5f tempest-VolumesGetTest-1561898534 None] Created reservations ['54dc71f7-5392-42d5-a82f-4ec84302bb0e', '8b8d064f-3480-48ba-a8de-01a051c12f8c', '8071f2bb-c937-4efd-86f9-b4d10113081f', '49813c18-671b-4950-bf4b-8b24794b694f'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:38:27.871899 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ea21e0e8-eee8-46c9-9a2f-b723abafda5f tempest-VolumesGetTest-1561898534 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:27.952289 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ea21e0e8-eee8-46c9-9a2f-b723abafda5f tempest-VolumesGetTest-1561898534 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:28.088320 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ea21e0e8-eee8-46c9-9a2f-b723abafda5f tempest-VolumesGetTest-1561898534 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:38:28.099574 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-ea21e0e8-eee8-46c9-9a2f-b723abafda5f tempest-VolumesGetTest-1561898534 None] Deleted volume successfully. Apr 30 21:38:28.196325 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-ea21e0e8-eee8-46c9-9a2f-b723abafda5f tempest-VolumesGetTest-1561898534 None] Lock "b'cinder-21588e74-83a5-4041-987a-c71477a0dbd1-delete_volume'" released by "delete_volume" :: held 3.461s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:38:29.337076 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-acd90c58-cc05-4e19-8c54-620ee53637ba tempest-VolumesGetTest-1561898534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:38:29.447058 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-acd90c58-cc05-4e19-8c54-620ee53637ba tempest-VolumesGetTest-1561898534 None] Flow 'volume_create_manager' (df6822a3-dd6f-4f78-a7ab-2bffa7afd6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:38:29.467308 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-acd90c58-cc05-4e19-8c54-620ee53637ba tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb042e35-2f9a-4986-b022-47dc3993e745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:29.491448 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-acd90c58-cc05-4e19-8c54-620ee53637ba tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb042e35-2f9a-4986-b022-47dc3993e745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1401760348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=30460b4c-b78e-4bda-b2c2-b5a7bcd59acd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='903ce8c98e7941809c3641af803b1030',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:38:29Z,use_quota=True,user_id='ee17009a1c3248b7adf0cdd17c918e0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:29.500011 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-acd90c58-cc05-4e19-8c54-620ee53637ba tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce349c48-0baa-4f7e-8ff5-27575b4cccbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:29.509815 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-acd90c58-cc05-4e19-8c54-620ee53637ba tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce349c48-0baa-4f7e-8ff5-27575b4cccbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:29.519668 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-acd90c58-cc05-4e19-8c54-620ee53637ba tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbc2e15f-764d-45f6-b600-851bc2ab002f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:29.524783 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-acd90c58-cc05-4e19-8c54-620ee53637ba tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbc2e15f-764d-45f6-b600-851bc2ab002f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30460b4c-b78e-4bda-b2c2-b5a7bcd59acd', 'volume_name': 'volume-30460b4c-b78e-4bda-b2c2-b5a7bcd59acd', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:29.535903 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-acd90c58-cc05-4e19-8c54-620ee53637ba tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf5719b1-d053-49f0-b730-1a70171971d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:29.540664 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-acd90c58-cc05-4e19-8c54-620ee53637ba tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf5719b1-d053-49f0-b730-1a70171971d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:29.560980 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-acd90c58-cc05-4e19-8c54-620ee53637ba tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2a36310-cd6d-45aa-a9e6-143e7ccf414d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:29.578013 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-acd90c58-cc05-4e19-8c54-620ee53637ba tempest-VolumesGetTest-1561898534 None] Volume 30460b4c-b78e-4bda-b2c2-b5a7bcd59acd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30460b4c-b78e-4bda-b2c2-b5a7bcd59acd', 'volume_size': 1} Apr 30 21:38:29.578408 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-acd90c58-cc05-4e19-8c54-620ee53637ba tempest-VolumesGetTest-1561898534 None] creating volume 'volume-30460b4c-b78e-4bda-b2c2-b5a7bcd59acd' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:38:29.579753 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-acd90c58-cc05-4e19-8c54-620ee53637ba tempest-VolumesGetTest-1561898534 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:30.064764 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-acd90c58-cc05-4e19-8c54-620ee53637ba tempest-VolumesGetTest-1561898534 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:38:30.066887 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-acd90c58-cc05-4e19-8c54-620ee53637ba tempest-VolumesGetTest-1561898534 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:38:30.081393 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-acd90c58-cc05-4e19-8c54-620ee53637ba tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2a36310-cd6d-45aa-a9e6-143e7ccf414d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30460b4c-b78e-4bda-b2c2-b5a7bcd59acd', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:30.087647 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-acd90c58-cc05-4e19-8c54-620ee53637ba tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21f748e9-2da4-452d-8c82-116fd6c9f4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:30.157913 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-acd90c58-cc05-4e19-8c54-620ee53637ba tempest-VolumesGetTest-1561898534 None] Volume volume-30460b4c-b78e-4bda-b2c2-b5a7bcd59acd (30460b4c-b78e-4bda-b2c2-b5a7bcd59acd): created successfully Apr 30 21:38:30.167797 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-acd90c58-cc05-4e19-8c54-620ee53637ba tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21f748e9-2da4-452d-8c82-116fd6c9f4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:30.180722 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-acd90c58-cc05-4e19-8c54-620ee53637ba tempest-VolumesGetTest-1561898534 None] Flow 'volume_create_manager' (df6822a3-dd6f-4f78-a7ab-2bffa7afd6fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:38:30.244310 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-acd90c58-cc05-4e19-8c54-620ee53637ba tempest-VolumesGetTest-1561898534 None] Created volume successfully. Apr 30 21:38:30.708204 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5030bcc-f1e9-471b-8d4d-02d5665cd169 tempest-VolumesNegativeTest-109917746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:38:30.732396 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b5030bcc-f1e9-471b-8d4d-02d5665cd169 tempest-VolumesNegativeTest-109917746 None] Flow 'volume_create_manager' (bd72aa0d-1e4b-49e6-90df-d07cddd78fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:38:30.741264 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b5030bcc-f1e9-471b-8d4d-02d5665cd169 tempest-VolumesNegativeTest-109917746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c099e086-67e7-4b4d-83b8-797a2ad167e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:30.776946 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b5030bcc-f1e9-471b-8d4d-02d5665cd169 tempest-VolumesNegativeTest-109917746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c099e086-67e7-4b4d-83b8-797a2ad167e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-201772952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8617593b-e417-4998-94b0-aae41a7b5b40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f19b8cfdb2ea490ebcb51f4f67262300',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:38:31Z,use_quota=True,user_id='d6185d1aa50a4dcd919fb3410d4f30df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:30.783930 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b5030bcc-f1e9-471b-8d4d-02d5665cd169 tempest-VolumesNegativeTest-109917746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f111649-ccc4-4d97-9e2d-35079e2ff394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:30.788265 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b5030bcc-f1e9-471b-8d4d-02d5665cd169 tempest-VolumesNegativeTest-109917746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f111649-ccc4-4d97-9e2d-35079e2ff394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:30.798699 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b5030bcc-f1e9-471b-8d4d-02d5665cd169 tempest-VolumesNegativeTest-109917746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddd42498-6986-4ac7-a9d0-856c039d1633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:30.802875 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b5030bcc-f1e9-471b-8d4d-02d5665cd169 tempest-VolumesNegativeTest-109917746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddd42498-6986-4ac7-a9d0-856c039d1633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8617593b-e417-4998-94b0-aae41a7b5b40', 'volume_name': 'volume-8617593b-e417-4998-94b0-aae41a7b5b40', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:30.811646 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b5030bcc-f1e9-471b-8d4d-02d5665cd169 tempest-VolumesNegativeTest-109917746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3afeddf-7268-4dd7-adda-e896b43f6d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:30.816192 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b5030bcc-f1e9-471b-8d4d-02d5665cd169 tempest-VolumesNegativeTest-109917746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3afeddf-7268-4dd7-adda-e896b43f6d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:30.822432 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b5030bcc-f1e9-471b-8d4d-02d5665cd169 tempest-VolumesNegativeTest-109917746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d226987-cd31-4dd0-acb1-c16dbd451d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:30.823923 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-b5030bcc-f1e9-471b-8d4d-02d5665cd169 tempest-VolumesNegativeTest-109917746 None] Volume 8617593b-e417-4998-94b0-aae41a7b5b40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8617593b-e417-4998-94b0-aae41a7b5b40', 'volume_size': 1} Apr 30 21:38:30.824416 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b5030bcc-f1e9-471b-8d4d-02d5665cd169 tempest-VolumesNegativeTest-109917746 None] creating volume 'volume-8617593b-e417-4998-94b0-aae41a7b5b40' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:38:30.825210 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b5030bcc-f1e9-471b-8d4d-02d5665cd169 tempest-VolumesNegativeTest-109917746 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:31.281093 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b5030bcc-f1e9-471b-8d4d-02d5665cd169 tempest-VolumesNegativeTest-109917746 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:38:31.281563 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b5030bcc-f1e9-471b-8d4d-02d5665cd169 tempest-VolumesNegativeTest-109917746 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:38:31.285480 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b5030bcc-f1e9-471b-8d4d-02d5665cd169 tempest-VolumesNegativeTest-109917746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d226987-cd31-4dd0-acb1-c16dbd451d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8617593b-e417-4998-94b0-aae41a7b5b40', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:31.290315 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b5030bcc-f1e9-471b-8d4d-02d5665cd169 tempest-VolumesNegativeTest-109917746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ba233ec-bbb1-4b84-aad1-fd1df0af85f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:31.328226 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:38:31.329180 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:31.364555 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:31.413961 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:38:31.418773 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-b5030bcc-f1e9-471b-8d4d-02d5665cd169 tempest-VolumesNegativeTest-109917746 None] Volume volume-8617593b-e417-4998-94b0-aae41a7b5b40 (8617593b-e417-4998-94b0-aae41a7b5b40): created successfully Apr 30 21:38:31.423413 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b5030bcc-f1e9-471b-8d4d-02d5665cd169 tempest-VolumesNegativeTest-109917746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ba233ec-bbb1-4b84-aad1-fd1df0af85f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:31.429634 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b5030bcc-f1e9-471b-8d4d-02d5665cd169 tempest-VolumesNegativeTest-109917746 None] Flow 'volume_create_manager' (bd72aa0d-1e4b-49e6-90df-d07cddd78fe7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:38:31.495274 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-b5030bcc-f1e9-471b-8d4d-02d5665cd169 tempest-VolumesNegativeTest-109917746 None] Created volume successfully. Apr 30 21:38:32.159399 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-e96f28fc-1f8a-4206-91e0-a583066bd09f tempest-VolumesGetTest-1561898534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:38:32.223315 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e96f28fc-1f8a-4206-91e0-a583066bd09f tempest-VolumesGetTest-1561898534 None] Flow 'volume_create_manager' (0a4cd587-8b6a-4196-9e72-dcf08ef3b9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:38:32.243700 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e96f28fc-1f8a-4206-91e0-a583066bd09f tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09d0386a-ab29-41e0-b056-679ee611641d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:32.290732 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e96f28fc-1f8a-4206-91e0-a583066bd09f tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09d0386a-ab29-41e0-b056-679ee611641d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1396343416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cd81c9ca-b302-41fc-886f-4a1d1ae692de,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='903ce8c98e7941809c3641af803b1030',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=30460b4c-b78e-4bda-b2c2-b5a7bcd59acd,status='creating',terminated_at=None,updated_at=2022-04-30T21:38:32Z,use_quota=True,user_id='ee17009a1c3248b7adf0cdd17c918e0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:32.306122 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e96f28fc-1f8a-4206-91e0-a583066bd09f tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4af3049d-c506-44b8-9ff3-56804f1de58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:32.318672 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e96f28fc-1f8a-4206-91e0-a583066bd09f tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4af3049d-c506-44b8-9ff3-56804f1de58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:32.338300 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e96f28fc-1f8a-4206-91e0-a583066bd09f tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1cf44da-00fa-480f-b7e8-60cad2aa0a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:32.365472 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e96f28fc-1f8a-4206-91e0-a583066bd09f tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1cf44da-00fa-480f-b7e8-60cad2aa0a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cd81c9ca-b302-41fc-886f-4a1d1ae692de', 'volume_name': 'volume-cd81c9ca-b302-41fc-886f-4a1d1ae692de', 'volume_size': 1, 'source_volid': '30460b4c-b78e-4bda-b2c2-b5a7bcd59acd', 'source_volstatus': 'available'}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:32.371924 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e96f28fc-1f8a-4206-91e0-a583066bd09f tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9fedbe5-3d06-4396-9f9c-ed80229a8f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:32.378291 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e96f28fc-1f8a-4206-91e0-a583066bd09f tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9fedbe5-3d06-4396-9f9c-ed80229a8f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:32.385126 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e96f28fc-1f8a-4206-91e0-a583066bd09f tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7823f0d-ccb2-4d31-bc39-e7ac3d364a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:32.386633 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-e96f28fc-1f8a-4206-91e0-a583066bd09f tempest-VolumesGetTest-1561898534 None] Volume cd81c9ca-b302-41fc-886f-4a1d1ae692de: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cd81c9ca-b302-41fc-886f-4a1d1ae692de', 'volume_size': 1, 'source_volid': '30460b4c-b78e-4bda-b2c2-b5a7bcd59acd', 'source_volstatus': 'available'} Apr 30 21:38:32.402881 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e96f28fc-1f8a-4206-91e0-a583066bd09f tempest-VolumesGetTest-1561898534 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:32.591362 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e96f28fc-1f8a-4206-91e0-a583066bd09f tempest-VolumesGetTest-1561898534 None] creating snapshot='volume-cd81c9ca-b302-41fc-886f-4a1d1ae692de.clone_snap' {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} Apr 30 21:38:34.637818 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e96f28fc-1f8a-4206-91e0-a583066bd09f tempest-VolumesGetTest-1561898534 None] cloning 'volume-30460b4c-b78e-4bda-b2c2-b5a7bcd59acd@volume-cd81c9ca-b302-41fc-886f-4a1d1ae692de.clone_snap' to 'volume-cd81c9ca-b302-41fc-886f-4a1d1ae692de' {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} Apr 30 21:38:35.383987 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e96f28fc-1f8a-4206-91e0-a583066bd09f tempest-VolumesGetTest-1561898534 None] Volume volume-30460b4c-b78e-4bda-b2c2-b5a7bcd59acd is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:38:35.384962 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e96f28fc-1f8a-4206-91e0-a583066bd09f tempest-VolumesGetTest-1561898534 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:38:35.385475 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e96f28fc-1f8a-4206-91e0-a583066bd09f tempest-VolumesGetTest-1561898534 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:38:35.568950 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e96f28fc-1f8a-4206-91e0-a583066bd09f tempest-VolumesGetTest-1561898534 None] clone created successfully {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} Apr 30 21:38:35.579635 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e96f28fc-1f8a-4206-91e0-a583066bd09f tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7823f0d-ccb2-4d31-bc39-e7ac3d364a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd81c9ca-b302-41fc-886f-4a1d1ae692de', 'volume_size': 1, 'source_volid': '30460b4c-b78e-4bda-b2c2-b5a7bcd59acd', 'source_volstatus': 'available'}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:35.588124 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e96f28fc-1f8a-4206-91e0-a583066bd09f tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f2bf815-be5b-4cf8-a8b5-fb6724070394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:35.655296 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-e96f28fc-1f8a-4206-91e0-a583066bd09f tempest-VolumesGetTest-1561898534 None] Volume volume-cd81c9ca-b302-41fc-886f-4a1d1ae692de (cd81c9ca-b302-41fc-886f-4a1d1ae692de): created successfully Apr 30 21:38:35.661479 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e96f28fc-1f8a-4206-91e0-a583066bd09f tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f2bf815-be5b-4cf8-a8b5-fb6724070394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:35.681735 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e96f28fc-1f8a-4206-91e0-a583066bd09f tempest-VolumesGetTest-1561898534 None] Flow 'volume_create_manager' (0a4cd587-8b6a-4196-9e72-dcf08ef3b9c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:38:35.735646 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-e96f28fc-1f8a-4206-91e0-a583066bd09f tempest-VolumesGetTest-1561898534 None] Created volume successfully. Apr 30 21:38:37.347325 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd961f04-a4ca-45aa-8e2e-214ecdda25a9 tempest-VolumesGetTest-1561898534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:38:37.370278 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bd961f04-a4ca-45aa-8e2e-214ecdda25a9 tempest-VolumesGetTest-1561898534 None] Flow 'volume_create_manager' (8cb53066-f345-4ae1-b3d7-6f2a8d4fee74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:38:37.377214 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bd961f04-a4ca-45aa-8e2e-214ecdda25a9 tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (893100b5-fe1a-4538-a2ed-f4cb736b8d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:37.393458 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bd961f04-a4ca-45aa-8e2e-214ecdda25a9 tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (893100b5-fe1a-4538-a2ed-f4cb736b8d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:38:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-850794667',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d4177997-f1c0-493d-84fc-f4987f15efa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='903ce8c98e7941809c3641af803b1030',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:38:37Z,use_quota=True,user_id='ee17009a1c3248b7adf0cdd17c918e0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:37.405414 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bd961f04-a4ca-45aa-8e2e-214ecdda25a9 tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a67669a-4be1-4e19-9b66-8bbaf07101e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:37.405414 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bd961f04-a4ca-45aa-8e2e-214ecdda25a9 tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a67669a-4be1-4e19-9b66-8bbaf07101e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:37.409681 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bd961f04-a4ca-45aa-8e2e-214ecdda25a9 tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ac6d72-8394-4f2c-86a7-241605bb65f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:37.414036 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bd961f04-a4ca-45aa-8e2e-214ecdda25a9 tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ac6d72-8394-4f2c-86a7-241605bb65f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4177997-f1c0-493d-84fc-f4987f15efa0', 'volume_name': 'volume-d4177997-f1c0-493d-84fc-f4987f15efa0', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:37.419023 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bd961f04-a4ca-45aa-8e2e-214ecdda25a9 tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b87d7f3-35ce-422b-82f9-90cf1e96b39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:37.422988 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bd961f04-a4ca-45aa-8e2e-214ecdda25a9 tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b87d7f3-35ce-422b-82f9-90cf1e96b39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:37.428096 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bd961f04-a4ca-45aa-8e2e-214ecdda25a9 tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc57e867-ed4b-4b90-82ad-494b42d14d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:37.429448 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-bd961f04-a4ca-45aa-8e2e-214ecdda25a9 tempest-VolumesGetTest-1561898534 None] Volume d4177997-f1c0-493d-84fc-f4987f15efa0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4177997-f1c0-493d-84fc-f4987f15efa0', 'volume_size': 1} Apr 30 21:38:37.429856 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bd961f04-a4ca-45aa-8e2e-214ecdda25a9 tempest-VolumesGetTest-1561898534 None] creating volume 'volume-d4177997-f1c0-493d-84fc-f4987f15efa0' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:38:37.430527 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bd961f04-a4ca-45aa-8e2e-214ecdda25a9 tempest-VolumesGetTest-1561898534 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:37.854058 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bd961f04-a4ca-45aa-8e2e-214ecdda25a9 tempest-VolumesGetTest-1561898534 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:38:37.854560 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bd961f04-a4ca-45aa-8e2e-214ecdda25a9 tempest-VolumesGetTest-1561898534 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:38:37.858680 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bd961f04-a4ca-45aa-8e2e-214ecdda25a9 tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc57e867-ed4b-4b90-82ad-494b42d14d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4177997-f1c0-493d-84fc-f4987f15efa0', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:37.863961 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bd961f04-a4ca-45aa-8e2e-214ecdda25a9 tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a62a1133-65aa-4521-b136-8331dfb445ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:37.956014 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-bd961f04-a4ca-45aa-8e2e-214ecdda25a9 tempest-VolumesGetTest-1561898534 None] Volume volume-d4177997-f1c0-493d-84fc-f4987f15efa0 (d4177997-f1c0-493d-84fc-f4987f15efa0): created successfully Apr 30 21:38:37.960302 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bd961f04-a4ca-45aa-8e2e-214ecdda25a9 tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a62a1133-65aa-4521-b136-8331dfb445ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:37.966219 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bd961f04-a4ca-45aa-8e2e-214ecdda25a9 tempest-VolumesGetTest-1561898534 None] Flow 'volume_create_manager' (8cb53066-f345-4ae1-b3d7-6f2a8d4fee74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:38:38.043428 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-bd961f04-a4ca-45aa-8e2e-214ecdda25a9 tempest-VolumesGetTest-1561898534 None] Created volume successfully. Apr 30 21:38:38.501256 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-f3cb327e-f96c-4bfc-9f8d-c3092f8df154 tempest-VolumesGetTest-1561898534 None] Lock "b'cinder-d4177997-f1c0-493d-84fc-f4987f15efa0-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:38:38.617433 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f3cb327e-f96c-4bfc-9f8d-c3092f8df154 tempest-VolumesGetTest-1561898534 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:38.779428 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f3cb327e-f96c-4bfc-9f8d-c3092f8df154 tempest-VolumesGetTest-1561898534 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:38:38.779977 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f3cb327e-f96c-4bfc-9f8d-c3092f8df154 tempest-VolumesGetTest-1561898534 None] Volume volume-d4177997-f1c0-493d-84fc-f4987f15efa0 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:38:38.861923 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f3cb327e-f96c-4bfc-9f8d-c3092f8df154 tempest-VolumesGetTest-1561898534 None] deleting rbd volume volume-d4177997-f1c0-493d-84fc-f4987f15efa0 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:38:41.431251 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-f3cb327e-f96c-4bfc-9f8d-c3092f8df154 tempest-VolumesGetTest-1561898534 None] Created reservations ['e3a89c3d-62b0-4951-8481-64a802234128', '7ad31897-3488-47c0-9b61-d6352398acc6', 'fd69eb21-1af9-4c29-a970-d73d057ea094', '54619cac-272e-43f6-be26-b5382ff68f5f'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:38:41.586075 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f3cb327e-f96c-4bfc-9f8d-c3092f8df154 tempest-VolumesGetTest-1561898534 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:41.639289 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f3cb327e-f96c-4bfc-9f8d-c3092f8df154 tempest-VolumesGetTest-1561898534 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:41.712836 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-f3cb327e-f96c-4bfc-9f8d-c3092f8df154 tempest-VolumesGetTest-1561898534 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:38:41.717866 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-f3cb327e-f96c-4bfc-9f8d-c3092f8df154 tempest-VolumesGetTest-1561898534 None] Deleted volume successfully. Apr 30 21:38:41.845239 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-f3cb327e-f96c-4bfc-9f8d-c3092f8df154 tempest-VolumesGetTest-1561898534 None] Lock "b'cinder-d4177997-f1c0-493d-84fc-f4987f15efa0-delete_volume'" released by "delete_volume" :: held 3.342s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:38:41.959914 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-cdcedc1a-e23e-4e0c-8315-57d93c6e555d tempest-VolumesGetTest-1561898534 None] Lock "b'cinder-cd81c9ca-b302-41fc-886f-4a1d1ae692de-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:38:42.055606 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-cdcedc1a-e23e-4e0c-8315-57d93c6e555d tempest-VolumesGetTest-1561898534 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:42.173462 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-cdcedc1a-e23e-4e0c-8315-57d93c6e555d tempest-VolumesGetTest-1561898534 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:38:42.227741 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-cdcedc1a-e23e-4e0c-8315-57d93c6e555d tempest-VolumesGetTest-1561898534 None] deleting rbd volume volume-cd81c9ca-b302-41fc-886f-4a1d1ae692de {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:38:44.907607 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-cdcedc1a-e23e-4e0c-8315-57d93c6e555d tempest-VolumesGetTest-1561898534 None] volume is a clone so cleaning references {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} Apr 30 21:38:44.998734 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-cdcedc1a-e23e-4e0c-8315-57d93c6e555d tempest-VolumesGetTest-1561898534 None] Volume volume-30460b4c-b78e-4bda-b2c2-b5a7bcd59acd is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:38:44.999606 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-cdcedc1a-e23e-4e0c-8315-57d93c6e555d tempest-VolumesGetTest-1561898534 None] deleting parent snapshot volume-cd81c9ca-b302-41fc-886f-4a1d1ae692de.clone_snap {{(pid=123855) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} Apr 30 21:38:46.710735 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-cdcedc1a-e23e-4e0c-8315-57d93c6e555d tempest-VolumesGetTest-1561898534 None] Created reservations ['a1831eab-d811-4848-9ca1-d87f3b418138', '3f33f857-89fc-442b-b073-4d0122e2298c', '3bb73a82-3986-4acd-a610-8922861d9095', '56637e20-fcc9-4262-a1be-c467ae88d949'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:38:46.871911 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-cdcedc1a-e23e-4e0c-8315-57d93c6e555d tempest-VolumesGetTest-1561898534 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:46.903757 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-cdcedc1a-e23e-4e0c-8315-57d93c6e555d tempest-VolumesGetTest-1561898534 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:47.002804 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-cdcedc1a-e23e-4e0c-8315-57d93c6e555d tempest-VolumesGetTest-1561898534 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:38:47.007603 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-cdcedc1a-e23e-4e0c-8315-57d93c6e555d tempest-VolumesGetTest-1561898534 None] Deleted volume successfully. Apr 30 21:38:47.089320 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-cdcedc1a-e23e-4e0c-8315-57d93c6e555d tempest-VolumesGetTest-1561898534 None] Lock "b'cinder-cd81c9ca-b302-41fc-886f-4a1d1ae692de-delete_volume'" released by "delete_volume" :: held 5.131s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:38:48.491372 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-658b27ae-bd42-43ab-89bb-6d1b7adcc8e1 tempest-VolumesGetTest-1561898534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:38:48.512608 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-658b27ae-bd42-43ab-89bb-6d1b7adcc8e1 tempest-VolumesGetTest-1561898534 None] Flow 'volume_create_manager' (c39b3dd8-91f4-4081-80c3-02f8b0b3b1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:38:48.519327 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-658b27ae-bd42-43ab-89bb-6d1b7adcc8e1 tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f0f0f0-8972-49d7-9a1c-48402aa1cc6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:48.542409 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-658b27ae-bd42-43ab-89bb-6d1b7adcc8e1 tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f0f0f0-8972-49d7-9a1c-48402aa1cc6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:38:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1367604290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=699b0388-ad61-4f85-b49b-8ed1a1580b8c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='903ce8c98e7941809c3641af803b1030',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:38:48Z,use_quota=True,user_id='ee17009a1c3248b7adf0cdd17c918e0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:48.548497 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-658b27ae-bd42-43ab-89bb-6d1b7adcc8e1 tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b0b04f8-8912-41fd-83a0-1f9e179c924c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:48.552632 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-658b27ae-bd42-43ab-89bb-6d1b7adcc8e1 tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b0b04f8-8912-41fd-83a0-1f9e179c924c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:48.557929 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-658b27ae-bd42-43ab-89bb-6d1b7adcc8e1 tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4333e8cd-9e80-4812-954e-939d336c13de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:48.664372 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-658b27ae-bd42-43ab-89bb-6d1b7adcc8e1 tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4333e8cd-9e80-4812-954e-939d336c13de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '699b0388-ad61-4f85-b49b-8ed1a1580b8c', 'volume_name': 'volume-699b0388-ad61-4f85-b49b-8ed1a1580b8c', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:48.669552 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-658b27ae-bd42-43ab-89bb-6d1b7adcc8e1 tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67da1f50-c357-4b36-94a9-0f26719d6575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:48.674293 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-658b27ae-bd42-43ab-89bb-6d1b7adcc8e1 tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67da1f50-c357-4b36-94a9-0f26719d6575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:48.679380 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-658b27ae-bd42-43ab-89bb-6d1b7adcc8e1 tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (513d30d9-2c29-49fa-b29c-c6ddfcc97964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:48.680707 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-658b27ae-bd42-43ab-89bb-6d1b7adcc8e1 tempest-VolumesGetTest-1561898534 None] Volume 699b0388-ad61-4f85-b49b-8ed1a1580b8c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-699b0388-ad61-4f85-b49b-8ed1a1580b8c', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 30 21:38:48.681382 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-658b27ae-bd42-43ab-89bb-6d1b7adcc8e1 tempest-VolumesGetTest-1561898534 None] Cloning 699b0388-ad61-4f85-b49b-8ed1a1580b8c from image a5b0850f-3b24-4bcb-b0a7-351c3216b27d at location (None, None). {{(pid=123855) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Apr 30 21:38:48.690597 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-658b27ae-bd42-43ab-89bb-6d1b7adcc8e1 tempest-VolumesGetTest-1561898534 None] Lock "b'cinder-a5b0850f-3b24-4bcb-b0a7-351c3216b27d'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:38:48.779574 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-658b27ae-bd42-43ab-89bb-6d1b7adcc8e1 tempest-VolumesGetTest-1561898534 None] Found image-volume cache entry: {'id': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'volume_id': '5772aef0-721f-450a-93ff-02cc6a41edcc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7), 'last_used': datetime.datetime(2022, 4, 30, 21, 38, 48, 694557)}. {{(pid=123855) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 30 21:38:48.780383 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-658b27ae-bd42-43ab-89bb-6d1b7adcc8e1 tempest-VolumesGetTest-1561898534 None] Image-volume cache entry image_update_at = 2022-04-30 21:01:07+00:00, requested image updated_at = 2022-04-30 21:01:07+00:00. {{(pid=123855) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 30 21:38:48.780789 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-658b27ae-bd42-43ab-89bb-6d1b7adcc8e1 tempest-VolumesGetTest-1561898534 None] Found cache entry for image = a5b0850f-3b24-4bcb-b0a7-351c3216b27d on host ncdv-master-1@ceph#ceph. {{(pid=123855) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Apr 30 21:38:48.788939 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-658b27ae-bd42-43ab-89bb-6d1b7adcc8e1 tempest-VolumesGetTest-1561898534 None] Lock "b'cinder-a5b0850f-3b24-4bcb-b0a7-351c3216b27d'" released by "_prepare_image_cache_entry" :: held 0.095s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:38:48.788939 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-658b27ae-bd42-43ab-89bb-6d1b7adcc8e1 tempest-VolumesGetTest-1561898534 None] Attempting to retrieve cache entry for image = a5b0850f-3b24-4bcb-b0a7-351c3216b27d on host ncdv-master-1@ceph#ceph. {{(pid=123855) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Apr 30 21:38:48.792933 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-658b27ae-bd42-43ab-89bb-6d1b7adcc8e1 tempest-VolumesGetTest-1561898534 None] Found image-volume cache entry: {'id': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'volume_id': '5772aef0-721f-450a-93ff-02cc6a41edcc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7), 'last_used': datetime.datetime(2022, 4, 30, 21, 38, 48, 790435)}. {{(pid=123855) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 30 21:38:48.793598 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-658b27ae-bd42-43ab-89bb-6d1b7adcc8e1 tempest-VolumesGetTest-1561898534 None] Image-volume cache entry image_update_at = 2022-04-30 21:01:07+00:00, requested image updated_at = 2022-04-30 21:01:07+00:00. {{(pid=123855) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 30 21:38:48.794071 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-658b27ae-bd42-43ab-89bb-6d1b7adcc8e1 tempest-VolumesGetTest-1561898534 None] Creating from source image-volume 5772aef0-721f-450a-93ff-02cc6a41edcc {{(pid=123855) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Apr 30 21:38:48.807077 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-658b27ae-bd42-43ab-89bb-6d1b7adcc8e1 tempest-VolumesGetTest-1561898534 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:49.069869 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-658b27ae-bd42-43ab-89bb-6d1b7adcc8e1 tempest-VolumesGetTest-1561898534 None] creating snapshot='volume-699b0388-ad61-4f85-b49b-8ed1a1580b8c.clone_snap' {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} Apr 30 21:38:51.106163 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-658b27ae-bd42-43ab-89bb-6d1b7adcc8e1 tempest-VolumesGetTest-1561898534 None] cloning 'volume-5772aef0-721f-450a-93ff-02cc6a41edcc@volume-699b0388-ad61-4f85-b49b-8ed1a1580b8c.clone_snap' to 'volume-699b0388-ad61-4f85-b49b-8ed1a1580b8c' {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} Apr 30 21:38:52.001653 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-658b27ae-bd42-43ab-89bb-6d1b7adcc8e1 tempest-VolumesGetTest-1561898534 None] Volume volume-632a7810-1a6f-420a-a6fd-57675408a8f7.deleted is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:38:52.002743 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-658b27ae-bd42-43ab-89bb-6d1b7adcc8e1 tempest-VolumesGetTest-1561898534 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:38:52.003140 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-658b27ae-bd42-43ab-89bb-6d1b7adcc8e1 tempest-VolumesGetTest-1561898534 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:38:52.446515 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-658b27ae-bd42-43ab-89bb-6d1b7adcc8e1 tempest-VolumesGetTest-1561898534 None] clone created successfully {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} Apr 30 21:38:52.448311 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.volume_utils [None req-658b27ae-bd42-43ab-89bb-6d1b7adcc8e1 tempest-VolumesGetTest-1561898534 None] Marking volume 699b0388-ad61-4f85-b49b-8ed1a1580b8c as bootable. {{(pid=123855) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Apr 30 21:38:52.510682 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-658b27ae-bd42-43ab-89bb-6d1b7adcc8e1 tempest-VolumesGetTest-1561898534 None] Copying metadata from image a5b0850f-3b24-4bcb-b0a7-351c3216b27d to 699b0388-ad61-4f85-b49b-8ed1a1580b8c. {{(pid=123855) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Apr 30 21:38:52.511208 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-658b27ae-bd42-43ab-89bb-6d1b7adcc8e1 tempest-VolumesGetTest-1561898534 None] Creating volume glance metadata for volume 699b0388-ad61-4f85-b49b-8ed1a1580b8c backed by image a5b0850f-3b24-4bcb-b0a7-351c3216b27d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123855) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Apr 30 21:38:52.651947 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-658b27ae-bd42-43ab-89bb-6d1b7adcc8e1 tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (513d30d9-2c29-49fa-b29c-c6ddfcc97964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-699b0388-ad61-4f85-b49b-8ed1a1580b8c', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:52.656995 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-658b27ae-bd42-43ab-89bb-6d1b7adcc8e1 tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d149092-9f65-4542-ac28-cb939bf27ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:52.716119 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-658b27ae-bd42-43ab-89bb-6d1b7adcc8e1 tempest-VolumesGetTest-1561898534 None] Volume volume-699b0388-ad61-4f85-b49b-8ed1a1580b8c (699b0388-ad61-4f85-b49b-8ed1a1580b8c): created successfully Apr 30 21:38:52.720015 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-658b27ae-bd42-43ab-89bb-6d1b7adcc8e1 tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d149092-9f65-4542-ac28-cb939bf27ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:52.725784 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-658b27ae-bd42-43ab-89bb-6d1b7adcc8e1 tempest-VolumesGetTest-1561898534 None] Flow 'volume_create_manager' (c39b3dd8-91f4-4081-80c3-02f8b0b3b1eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:38:52.884156 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-658b27ae-bd42-43ab-89bb-6d1b7adcc8e1 tempest-VolumesGetTest-1561898534 None] Created volume successfully. Apr 30 21:38:54.426999 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-828f45d8-4e38-4fd3-9850-2ccd45c90f8d tempest-VolumesGetTest-1561898534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:38:54.448658 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-828f45d8-4e38-4fd3-9850-2ccd45c90f8d tempest-VolumesGetTest-1561898534 None] Flow 'volume_create_manager' (df129fb9-8457-411d-933f-7978785ce137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:38:54.455857 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-828f45d8-4e38-4fd3-9850-2ccd45c90f8d tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11c06d94-771b-4e06-b52d-862098eb5b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:54.472840 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-828f45d8-4e38-4fd3-9850-2ccd45c90f8d tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11c06d94-771b-4e06-b52d-862098eb5b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:38:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1053062501',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f4360008-47f1-4801-852d-bd359a9ffa3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='903ce8c98e7941809c3641af803b1030',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:38:54Z,use_quota=True,user_id='ee17009a1c3248b7adf0cdd17c918e0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:54.478412 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-828f45d8-4e38-4fd3-9850-2ccd45c90f8d tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83f7c2ea-a268-4b9c-aa18-f814cdcdb1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:54.482663 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-828f45d8-4e38-4fd3-9850-2ccd45c90f8d tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83f7c2ea-a268-4b9c-aa18-f814cdcdb1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:54.487947 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-828f45d8-4e38-4fd3-9850-2ccd45c90f8d tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ae0f87d-cca8-4a85-90ca-7b43c6e007a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:54.492128 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-828f45d8-4e38-4fd3-9850-2ccd45c90f8d tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ae0f87d-cca8-4a85-90ca-7b43c6e007a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4360008-47f1-4801-852d-bd359a9ffa3b', 'volume_name': 'volume-f4360008-47f1-4801-852d-bd359a9ffa3b', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:54.497106 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-828f45d8-4e38-4fd3-9850-2ccd45c90f8d tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36cb8ebe-bd77-43b2-abe1-c116e3f8da15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:54.501120 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-828f45d8-4e38-4fd3-9850-2ccd45c90f8d tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36cb8ebe-bd77-43b2-abe1-c116e3f8da15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:54.505941 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-828f45d8-4e38-4fd3-9850-2ccd45c90f8d tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (417a8e3e-8d89-4afb-9e54-f60180a0eba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:54.507070 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-828f45d8-4e38-4fd3-9850-2ccd45c90f8d tempest-VolumesGetTest-1561898534 None] Volume f4360008-47f1-4801-852d-bd359a9ffa3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4360008-47f1-4801-852d-bd359a9ffa3b', 'volume_size': 1} Apr 30 21:38:54.507459 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-828f45d8-4e38-4fd3-9850-2ccd45c90f8d tempest-VolumesGetTest-1561898534 None] creating volume 'volume-f4360008-47f1-4801-852d-bd359a9ffa3b' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:38:54.508286 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-828f45d8-4e38-4fd3-9850-2ccd45c90f8d tempest-VolumesGetTest-1561898534 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:55.056601 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-828f45d8-4e38-4fd3-9850-2ccd45c90f8d tempest-VolumesGetTest-1561898534 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:38:55.057104 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-828f45d8-4e38-4fd3-9850-2ccd45c90f8d tempest-VolumesGetTest-1561898534 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:38:55.060918 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-828f45d8-4e38-4fd3-9850-2ccd45c90f8d tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (417a8e3e-8d89-4afb-9e54-f60180a0eba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4360008-47f1-4801-852d-bd359a9ffa3b', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:55.066266 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-828f45d8-4e38-4fd3-9850-2ccd45c90f8d tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0407dd0-f6d1-4453-ade0-5813024d7302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:38:55.111026 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-828f45d8-4e38-4fd3-9850-2ccd45c90f8d tempest-VolumesGetTest-1561898534 None] Volume volume-f4360008-47f1-4801-852d-bd359a9ffa3b (f4360008-47f1-4801-852d-bd359a9ffa3b): created successfully Apr 30 21:38:55.115227 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-828f45d8-4e38-4fd3-9850-2ccd45c90f8d tempest-VolumesGetTest-1561898534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0407dd0-f6d1-4453-ade0-5813024d7302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:38:55.120916 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-828f45d8-4e38-4fd3-9850-2ccd45c90f8d tempest-VolumesGetTest-1561898534 None] Flow 'volume_create_manager' (df129fb9-8457-411d-933f-7978785ce137) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:38:55.174385 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-828f45d8-4e38-4fd3-9850-2ccd45c90f8d tempest-VolumesGetTest-1561898534 None] Created volume successfully. Apr 30 21:38:55.574842 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-5c012306-cf46-4645-a413-8f0ce3c1bd46 tempest-VolumesGetTest-1561898534 None] Lock "b'cinder-f4360008-47f1-4801-852d-bd359a9ffa3b-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:38:55.680963 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-5c012306-cf46-4645-a413-8f0ce3c1bd46 tempest-VolumesGetTest-1561898534 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:55.895250 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-5c012306-cf46-4645-a413-8f0ce3c1bd46 tempest-VolumesGetTest-1561898534 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:38:55.896149 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-5c012306-cf46-4645-a413-8f0ce3c1bd46 tempest-VolumesGetTest-1561898534 None] Volume volume-f4360008-47f1-4801-852d-bd359a9ffa3b is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:38:56.057732 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-5c012306-cf46-4645-a413-8f0ce3c1bd46 tempest-VolumesGetTest-1561898534 None] deleting rbd volume volume-f4360008-47f1-4801-852d-bd359a9ffa3b {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:38:57.559664 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-bac71dbe-bcc9-4f15-92ce-04618c4b8f72 tempest-VolumesNegativeTest-109917746 None] Lock "b'cinder-8617593b-e417-4998-94b0-aae41a7b5b40-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:38:57.665922 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bac71dbe-bcc9-4f15-92ce-04618c4b8f72 tempest-VolumesNegativeTest-109917746 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:38:57.899018 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bac71dbe-bcc9-4f15-92ce-04618c4b8f72 tempest-VolumesNegativeTest-109917746 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:38:57.899517 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bac71dbe-bcc9-4f15-92ce-04618c4b8f72 tempest-VolumesNegativeTest-109917746 None] Volume volume-8617593b-e417-4998-94b0-aae41a7b5b40 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:38:58.071339 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bac71dbe-bcc9-4f15-92ce-04618c4b8f72 tempest-VolumesNegativeTest-109917746 None] deleting rbd volume volume-8617593b-e417-4998-94b0-aae41a7b5b40 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:39:00.720706 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-5c012306-cf46-4645-a413-8f0ce3c1bd46 tempest-VolumesGetTest-1561898534 None] Created reservations ['62fc556c-618d-41eb-9daa-391691d180b4', '582fbc02-6033-472f-a5a9-5093a4d223a0', 'a8acc202-0004-4a36-8ce5-4050b4511745', 'eb0aa86e-4910-41ef-ab8c-3a0c4253b89e'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:39:00.877123 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-5c012306-cf46-4645-a413-8f0ce3c1bd46 tempest-VolumesGetTest-1561898534 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:39:00.918068 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-5c012306-cf46-4645-a413-8f0ce3c1bd46 tempest-VolumesGetTest-1561898534 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:39:00.950300 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-5c012306-cf46-4645-a413-8f0ce3c1bd46 tempest-VolumesGetTest-1561898534 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:39:00.955287 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-5c012306-cf46-4645-a413-8f0ce3c1bd46 tempest-VolumesGetTest-1561898534 None] Deleted volume successfully. Apr 30 21:39:01.051451 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-5c012306-cf46-4645-a413-8f0ce3c1bd46 tempest-VolumesGetTest-1561898534 None] Lock "b'cinder-f4360008-47f1-4801-852d-bd359a9ffa3b-delete_volume'" released by "delete_volume" :: held 5.477s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:39:01.137979 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-395ddab7-a876-43e9-a456-e194dd4eeede tempest-VolumesGetTest-1561898534 None] Lock "b'cinder-699b0388-ad61-4f85-b49b-8ed1a1580b8c-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:39:01.291681 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-395ddab7-a876-43e9-a456-e194dd4eeede tempest-VolumesGetTest-1561898534 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:39:01.503891 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-395ddab7-a876-43e9-a456-e194dd4eeede tempest-VolumesGetTest-1561898534 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:39:01.717732 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-395ddab7-a876-43e9-a456-e194dd4eeede tempest-VolumesGetTest-1561898534 None] deleting rbd volume volume-699b0388-ad61-4f85-b49b-8ed1a1580b8c {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:39:02.938615 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-bac71dbe-bcc9-4f15-92ce-04618c4b8f72 tempest-VolumesNegativeTest-109917746 None] Created reservations ['659be694-3a2b-4c7e-9cf0-eccc49b16bc9', '3e9fa4d0-b2f6-454f-809f-986f5256a8e2', '0424daf1-d01e-4ad9-8794-e27834822f55', 'b214046e-323e-4556-a77b-ea7d9908d769'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:39:03.122798 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bac71dbe-bcc9-4f15-92ce-04618c4b8f72 tempest-VolumesNegativeTest-109917746 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:39:03.151493 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bac71dbe-bcc9-4f15-92ce-04618c4b8f72 tempest-VolumesNegativeTest-109917746 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:39:03.179188 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-bac71dbe-bcc9-4f15-92ce-04618c4b8f72 tempest-VolumesNegativeTest-109917746 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:39:03.184156 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-bac71dbe-bcc9-4f15-92ce-04618c4b8f72 tempest-VolumesNegativeTest-109917746 None] Deleted volume successfully. Apr 30 21:39:03.282799 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-bac71dbe-bcc9-4f15-92ce-04618c4b8f72 tempest-VolumesNegativeTest-109917746 None] Lock "b'cinder-8617593b-e417-4998-94b0-aae41a7b5b40-delete_volume'" released by "delete_volume" :: held 5.723s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:39:05.346679 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-395ddab7-a876-43e9-a456-e194dd4eeede tempest-VolumesGetTest-1561898534 None] volume is a clone so cleaning references {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} Apr 30 21:39:05.477785 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-395ddab7-a876-43e9-a456-e194dd4eeede tempest-VolumesGetTest-1561898534 None] deleting parent snapshot volume-699b0388-ad61-4f85-b49b-8ed1a1580b8c.clone_snap {{(pid=123855) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} Apr 30 21:39:07.242956 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1d43e5d-4ad1-4976-b7f5-dab1a6b0285f tempest-VolumesSnapshotListTestJSON-350491497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:39:07.261935 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b1d43e5d-4ad1-4976-b7f5-dab1a6b0285f tempest-VolumesSnapshotListTestJSON-350491497 None] Flow 'volume_create_manager' (60271c8a-be8f-4039-ba79-be202ced408d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:39:07.268801 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b1d43e5d-4ad1-4976-b7f5-dab1a6b0285f tempest-VolumesSnapshotListTestJSON-350491497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b97331de-6c23-4392-9fc8-004ea6815bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:39:07.286742 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b1d43e5d-4ad1-4976-b7f5-dab1a6b0285f tempest-VolumesSnapshotListTestJSON-350491497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b97331de-6c23-4392-9fc8-004ea6815bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-444350930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ea2f5477-f949-4349-bf34-002b7eabddee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd10ab5932b44002aa3eea64dad5bf3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:39:07Z,use_quota=True,user_id='507a432b8dbe44eeaed56750b9ec5112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:39:07.292222 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b1d43e5d-4ad1-4976-b7f5-dab1a6b0285f tempest-VolumesSnapshotListTestJSON-350491497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c889df01-ad79-4ce3-a799-57957f14d71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:39:07.296385 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b1d43e5d-4ad1-4976-b7f5-dab1a6b0285f tempest-VolumesSnapshotListTestJSON-350491497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c889df01-ad79-4ce3-a799-57957f14d71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:39:07.301537 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b1d43e5d-4ad1-4976-b7f5-dab1a6b0285f tempest-VolumesSnapshotListTestJSON-350491497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a1de326-53f7-4291-8ea0-ab8c632a683c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:39:07.305821 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b1d43e5d-4ad1-4976-b7f5-dab1a6b0285f tempest-VolumesSnapshotListTestJSON-350491497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a1de326-53f7-4291-8ea0-ab8c632a683c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea2f5477-f949-4349-bf34-002b7eabddee', 'volume_name': 'volume-ea2f5477-f949-4349-bf34-002b7eabddee', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:39:07.311209 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b1d43e5d-4ad1-4976-b7f5-dab1a6b0285f tempest-VolumesSnapshotListTestJSON-350491497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0622acf-6fb3-465d-a603-47d449c36712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:39:07.315198 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b1d43e5d-4ad1-4976-b7f5-dab1a6b0285f tempest-VolumesSnapshotListTestJSON-350491497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0622acf-6fb3-465d-a603-47d449c36712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:39:07.319877 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b1d43e5d-4ad1-4976-b7f5-dab1a6b0285f tempest-VolumesSnapshotListTestJSON-350491497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c724367-e849-4a39-ac38-09853798f393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:39:07.320944 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-b1d43e5d-4ad1-4976-b7f5-dab1a6b0285f tempest-VolumesSnapshotListTestJSON-350491497 None] Volume ea2f5477-f949-4349-bf34-002b7eabddee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea2f5477-f949-4349-bf34-002b7eabddee', 'volume_size': 1} Apr 30 21:39:07.321327 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b1d43e5d-4ad1-4976-b7f5-dab1a6b0285f tempest-VolumesSnapshotListTestJSON-350491497 None] creating volume 'volume-ea2f5477-f949-4349-bf34-002b7eabddee' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:39:07.322352 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b1d43e5d-4ad1-4976-b7f5-dab1a6b0285f tempest-VolumesSnapshotListTestJSON-350491497 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:39:07.342617 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-395ddab7-a876-43e9-a456-e194dd4eeede tempest-VolumesGetTest-1561898534 None] Created reservations ['91957118-278c-4716-ae66-5b0a2bb8db0c', '614bd408-dc4e-464e-a3e1-cac331799894', '743588b5-75d0-47c8-9909-ce9118ac63a4', 'a48c85e7-e8da-4f1b-b2f7-719e4a444599'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:39:07.534022 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-395ddab7-a876-43e9-a456-e194dd4eeede tempest-VolumesGetTest-1561898534 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:39:07.631363 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-395ddab7-a876-43e9-a456-e194dd4eeede tempest-VolumesGetTest-1561898534 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:39:07.654022 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-395ddab7-a876-43e9-a456-e194dd4eeede tempest-VolumesGetTest-1561898534 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:39:07.657933 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-395ddab7-a876-43e9-a456-e194dd4eeede tempest-VolumesGetTest-1561898534 None] Deleted volume successfully. Apr 30 21:39:07.727517 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-e7db8b4a-b710-4ef3-bf6c-acbe47f4f822 tempest-VolumesGetTest-1561898534 None] Lock "b'cinder-30460b4c-b78e-4bda-b2c2-b5a7bcd59acd-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:39:07.743374 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-395ddab7-a876-43e9-a456-e194dd4eeede tempest-VolumesGetTest-1561898534 None] Lock "b'cinder-699b0388-ad61-4f85-b49b-8ed1a1580b8c-delete_volume'" released by "delete_volume" :: held 6.605s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:39:07.832007 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e7db8b4a-b710-4ef3-bf6c-acbe47f4f822 tempest-VolumesGetTest-1561898534 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:39:08.002188 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e7db8b4a-b710-4ef3-bf6c-acbe47f4f822 tempest-VolumesGetTest-1561898534 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:39:08.003082 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e7db8b4a-b710-4ef3-bf6c-acbe47f4f822 tempest-VolumesGetTest-1561898534 None] Volume volume-30460b4c-b78e-4bda-b2c2-b5a7bcd59acd is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:39:08.076852 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e7db8b4a-b710-4ef3-bf6c-acbe47f4f822 tempest-VolumesGetTest-1561898534 None] deleting rbd volume volume-30460b4c-b78e-4bda-b2c2-b5a7bcd59acd {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:39:08.081275 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b1d43e5d-4ad1-4976-b7f5-dab1a6b0285f tempest-VolumesSnapshotListTestJSON-350491497 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:39:08.081646 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b1d43e5d-4ad1-4976-b7f5-dab1a6b0285f tempest-VolumesSnapshotListTestJSON-350491497 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:39:08.085490 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b1d43e5d-4ad1-4976-b7f5-dab1a6b0285f tempest-VolumesSnapshotListTestJSON-350491497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c724367-e849-4a39-ac38-09853798f393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea2f5477-f949-4349-bf34-002b7eabddee', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:39:08.091576 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b1d43e5d-4ad1-4976-b7f5-dab1a6b0285f tempest-VolumesSnapshotListTestJSON-350491497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f010b40-23e8-4d4e-a497-ccf9e5d564b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:39:08.139663 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-b1d43e5d-4ad1-4976-b7f5-dab1a6b0285f tempest-VolumesSnapshotListTestJSON-350491497 None] Volume volume-ea2f5477-f949-4349-bf34-002b7eabddee (ea2f5477-f949-4349-bf34-002b7eabddee): created successfully Apr 30 21:39:08.143368 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b1d43e5d-4ad1-4976-b7f5-dab1a6b0285f tempest-VolumesSnapshotListTestJSON-350491497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f010b40-23e8-4d4e-a497-ccf9e5d564b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:39:08.149105 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b1d43e5d-4ad1-4976-b7f5-dab1a6b0285f tempest-VolumesSnapshotListTestJSON-350491497 None] Flow 'volume_create_manager' (60271c8a-be8f-4039-ba79-be202ced408d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:39:08.224536 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-b1d43e5d-4ad1-4976-b7f5-dab1a6b0285f tempest-VolumesSnapshotListTestJSON-350491497 None] Created volume successfully. Apr 30 21:39:09.151627 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-531b5160-af10-4116-a642-ffda2868b108 tempest-VolumesSnapshotListTestJSON-350491497 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:39:12.355837 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-e7db8b4a-b710-4ef3-bf6c-acbe47f4f822 tempest-VolumesGetTest-1561898534 None] Created reservations ['97dc6a43-e9e2-4f91-99ab-a3238becaedb', '5e17570d-7917-45ca-b40f-45dbbfc1d50d', '4e36d639-32ea-4e86-bcf3-9094639d850a', 'eb936ae7-7eef-475c-98d8-d31d594208f8'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:39:12.546037 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e7db8b4a-b710-4ef3-bf6c-acbe47f4f822 tempest-VolumesGetTest-1561898534 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:39:12.568556 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e7db8b4a-b710-4ef3-bf6c-acbe47f4f822 tempest-VolumesGetTest-1561898534 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:39:12.591159 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-e7db8b4a-b710-4ef3-bf6c-acbe47f4f822 tempest-VolumesGetTest-1561898534 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:39:12.595086 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-e7db8b4a-b710-4ef3-bf6c-acbe47f4f822 tempest-VolumesGetTest-1561898534 None] Deleted volume successfully. Apr 30 21:39:12.625302 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-531b5160-af10-4116-a642-ffda2868b108 tempest-VolumesSnapshotListTestJSON-350491497 None] Create snapshot completed successfully Apr 30 21:39:12.657941 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-e7db8b4a-b710-4ef3-bf6c-acbe47f4f822 tempest-VolumesGetTest-1561898534 None] Lock "b'cinder-30460b4c-b78e-4bda-b2c2-b5a7bcd59acd-delete_volume'" released by "delete_volume" :: held 4.930s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:39:13.625429 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-7bac38af-aac1-4f59-9645-893d176bee4b tempest-VolumesSnapshotListTestJSON-350491497 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:39:15.506001 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-7bac38af-aac1-4f59-9645-893d176bee4b tempest-VolumesSnapshotListTestJSON-350491497 None] Create snapshot completed successfully Apr 30 21:39:17.038144 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9e89187c-faad-4d8b-aded-384167ca0912 tempest-VolumesSnapshotListTestJSON-350491497 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:39:19.059333 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-9e89187c-faad-4d8b-aded-384167ca0912 tempest-VolumesSnapshotListTestJSON-350491497 None] Create snapshot completed successfully Apr 30 21:39:21.074039 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-0cdf3163-e88f-4bb1-8290-6440eb22e5de tempest-VolumesSnapshotListTestJSON-350491497 None] Lock "b'cinder-8f0c72ea-c937-4efc-b87c-426971163b0e-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:39:21.075916 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-0cdf3163-e88f-4bb1-8290-6440eb22e5de tempest-VolumesSnapshotListTestJSON-350491497 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:39:23.472209 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-0cdf3163-e88f-4bb1-8290-6440eb22e5de tempest-VolumesSnapshotListTestJSON-350491497 None] Created reservations ['fca56be4-b36e-461d-8ec2-6d4bb2e097d5', '4470558f-3b49-467a-badf-d9385cef47bf', 'de229fec-0f4d-4559-ba23-16bdf04c4109', '407438ae-6a2b-4449-975a-5b29ed390870'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:39:23.742317 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-0cdf3163-e88f-4bb1-8290-6440eb22e5de tempest-VolumesSnapshotListTestJSON-350491497 None] Delete snapshot completed successfully. Apr 30 21:39:23.751490 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-0cdf3163-e88f-4bb1-8290-6440eb22e5de tempest-VolumesSnapshotListTestJSON-350491497 None] Lock "b'cinder-8f0c72ea-c937-4efc-b87c-426971163b0e-delete_snapshot'" released by "delete_snapshot" :: held 2.676s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:39:24.365229 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-ffc2b1b6-ed7e-404f-b563-cba087e537ef tempest-VolumesSnapshotListTestJSON-350491497 None] Lock "b'cinder-742d6638-ffd6-41bc-90a8-d239fb09fb45-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.033s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:39:24.377103 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ffc2b1b6-ed7e-404f-b563-cba087e537ef tempest-VolumesSnapshotListTestJSON-350491497 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:39:26.963649 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-ffc2b1b6-ed7e-404f-b563-cba087e537ef tempest-VolumesSnapshotListTestJSON-350491497 None] Created reservations ['7a70e68a-ca8e-414d-acdb-2551138f4804', 'c3ce5f3e-4dc1-4aef-9b1a-6439daccd68b', '4a63819d-8b95-4631-91e6-c149883a3fd4', 'ac371ea6-f279-484e-bdb3-5dcb88c6a11a'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:39:27.203752 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-ffc2b1b6-ed7e-404f-b563-cba087e537ef tempest-VolumesSnapshotListTestJSON-350491497 None] Delete snapshot completed successfully. Apr 30 21:39:27.208647 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-ffc2b1b6-ed7e-404f-b563-cba087e537ef tempest-VolumesSnapshotListTestJSON-350491497 None] Lock "b'cinder-742d6638-ffd6-41bc-90a8-d239fb09fb45-delete_snapshot'" released by "delete_snapshot" :: held 2.843s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:39:27.626695 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-57a2faf3-4947-4776-92e7-a5c53b4b8770 tempest-VolumesSnapshotListTestJSON-350491497 None] Lock "b'cinder-9f33b8b1-af21-420d-ab0a-0aae9299fae7-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:39:27.629053 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-57a2faf3-4947-4776-92e7-a5c53b4b8770 tempest-VolumesSnapshotListTestJSON-350491497 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:39:30.788997 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-57a2faf3-4947-4776-92e7-a5c53b4b8770 tempest-VolumesSnapshotListTestJSON-350491497 None] Created reservations ['0e27bd74-e993-4952-9ed8-6444fd4c049c', '9c13f374-4dd7-47c2-97db-b13939f168ee', '8b1219e7-98da-4a95-84d1-a8ec0afb8d7c', '81d1ff2b-c24e-477a-b480-f635b4a060c3'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:39:31.013633 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-57a2faf3-4947-4776-92e7-a5c53b4b8770 tempest-VolumesSnapshotListTestJSON-350491497 None] Delete snapshot completed successfully. Apr 30 21:39:31.022891 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-57a2faf3-4947-4776-92e7-a5c53b4b8770 tempest-VolumesSnapshotListTestJSON-350491497 None] Lock "b'cinder-9f33b8b1-af21-420d-ab0a-0aae9299fae7-delete_snapshot'" released by "delete_snapshot" :: held 3.396s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:39:31.325334 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:39:31.332420 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:39:31.408508 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:39:31.473727 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:39:32.080920 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-8cdf1f4e-3ec0-453a-b82c-e5244659756a tempest-VolumesSnapshotListTestJSON-350491497 None] Lock "b'cinder-ea2f5477-f949-4349-bf34-002b7eabddee-delete_volume'" acquired by "delete_volume" :: waited 0.030s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:39:32.235587 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8cdf1f4e-3ec0-453a-b82c-e5244659756a tempest-VolumesSnapshotListTestJSON-350491497 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:39:32.397291 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8cdf1f4e-3ec0-453a-b82c-e5244659756a tempest-VolumesSnapshotListTestJSON-350491497 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:39:32.397717 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8cdf1f4e-3ec0-453a-b82c-e5244659756a tempest-VolumesSnapshotListTestJSON-350491497 None] Volume volume-ea2f5477-f949-4349-bf34-002b7eabddee is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:39:32.494846 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8cdf1f4e-3ec0-453a-b82c-e5244659756a tempest-VolumesSnapshotListTestJSON-350491497 None] deleting rbd volume volume-ea2f5477-f949-4349-bf34-002b7eabddee {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:39:32.600885 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-038502d5-15e5-49ea-aa10-0348426f204e tempest-AttachVolumeTestJSON-628843456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:39:32.628056 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-038502d5-15e5-49ea-aa10-0348426f204e tempest-AttachVolumeTestJSON-628843456 None] Flow 'volume_create_manager' (2656cc4b-c847-48e9-ac71-659fa0ba857c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:39:32.636613 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-038502d5-15e5-49ea-aa10-0348426f204e tempest-AttachVolumeTestJSON-628843456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0784a2c4-db28-47cb-bafc-e486838b6596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:39:32.655259 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-038502d5-15e5-49ea-aa10-0348426f204e tempest-AttachVolumeTestJSON-628843456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0784a2c4-db28-47cb-bafc-e486838b6596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1790930646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c899b854-e3f9-4a55-a1a7-2d557b80cc44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b74e36d3bb384eeb92da16d1b201fc9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:39:32Z,use_quota=True,user_id='e9fa67fb4ad4472183b95067597f043e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:39:32.662890 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-038502d5-15e5-49ea-aa10-0348426f204e tempest-AttachVolumeTestJSON-628843456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69606d83-c8be-411f-b004-d266a2a8470e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:39:32.667151 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-038502d5-15e5-49ea-aa10-0348426f204e tempest-AttachVolumeTestJSON-628843456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69606d83-c8be-411f-b004-d266a2a8470e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:39:32.672354 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-038502d5-15e5-49ea-aa10-0348426f204e tempest-AttachVolumeTestJSON-628843456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43199114-413c-45cf-82dc-7db17a70ed8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:39:32.677184 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-038502d5-15e5-49ea-aa10-0348426f204e tempest-AttachVolumeTestJSON-628843456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43199114-413c-45cf-82dc-7db17a70ed8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c899b854-e3f9-4a55-a1a7-2d557b80cc44', 'volume_name': 'volume-c899b854-e3f9-4a55-a1a7-2d557b80cc44', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:39:32.682440 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-038502d5-15e5-49ea-aa10-0348426f204e tempest-AttachVolumeTestJSON-628843456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df44d57b-e597-4ebc-9ecd-316d24f787e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:39:32.686542 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-038502d5-15e5-49ea-aa10-0348426f204e tempest-AttachVolumeTestJSON-628843456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df44d57b-e597-4ebc-9ecd-316d24f787e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:39:32.691244 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-038502d5-15e5-49ea-aa10-0348426f204e tempest-AttachVolumeTestJSON-628843456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4abffa61-116d-42a5-a8db-691e6a2226ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:39:32.693355 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-038502d5-15e5-49ea-aa10-0348426f204e tempest-AttachVolumeTestJSON-628843456 None] Volume c899b854-e3f9-4a55-a1a7-2d557b80cc44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c899b854-e3f9-4a55-a1a7-2d557b80cc44', 'volume_size': 1} Apr 30 21:39:32.693745 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-038502d5-15e5-49ea-aa10-0348426f204e tempest-AttachVolumeTestJSON-628843456 None] creating volume 'volume-c899b854-e3f9-4a55-a1a7-2d557b80cc44' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:39:32.694763 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-038502d5-15e5-49ea-aa10-0348426f204e tempest-AttachVolumeTestJSON-628843456 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:39:33.627174 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-038502d5-15e5-49ea-aa10-0348426f204e tempest-AttachVolumeTestJSON-628843456 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:39:33.627824 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-038502d5-15e5-49ea-aa10-0348426f204e tempest-AttachVolumeTestJSON-628843456 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:39:33.633049 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-038502d5-15e5-49ea-aa10-0348426f204e tempest-AttachVolumeTestJSON-628843456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4abffa61-116d-42a5-a8db-691e6a2226ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c899b854-e3f9-4a55-a1a7-2d557b80cc44', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:39:33.637126 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-038502d5-15e5-49ea-aa10-0348426f204e tempest-AttachVolumeTestJSON-628843456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5d0f34f-a01e-431d-8a4e-2ada4539b7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:39:33.710841 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-038502d5-15e5-49ea-aa10-0348426f204e tempest-AttachVolumeTestJSON-628843456 None] Volume volume-c899b854-e3f9-4a55-a1a7-2d557b80cc44 (c899b854-e3f9-4a55-a1a7-2d557b80cc44): created successfully Apr 30 21:39:33.717025 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-038502d5-15e5-49ea-aa10-0348426f204e tempest-AttachVolumeTestJSON-628843456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5d0f34f-a01e-431d-8a4e-2ada4539b7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:39:33.732725 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-038502d5-15e5-49ea-aa10-0348426f204e tempest-AttachVolumeTestJSON-628843456 None] Flow 'volume_create_manager' (2656cc4b-c847-48e9-ac71-659fa0ba857c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:39:33.803593 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-038502d5-15e5-49ea-aa10-0348426f204e tempest-AttachVolumeTestJSON-628843456 None] Created volume successfully. Apr 30 21:39:36.191208 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-aad4097f-dc85-4578-9b6e-fa97c07ba1ea req-f756ffd0-32b3-412c-bbf6-83d5948ca7c5 tempest-AttachVolumeTestJSON-628843456 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:39:36.943511 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-8cdf1f4e-3ec0-453a-b82c-e5244659756a tempest-VolumesSnapshotListTestJSON-350491497 None] Created reservations ['4b3660f8-78c5-4e5f-93af-9236652e14d5', 'c54206c7-00ae-476f-b1b7-0ee8a0bec1b8', 'e9832858-10f4-45f9-a173-d8ff10a7598e', '9a6d3f53-2297-4df6-936b-d7ae0f82df5b'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:39:37.190206 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8cdf1f4e-3ec0-453a-b82c-e5244659756a tempest-VolumesSnapshotListTestJSON-350491497 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:39:37.250436 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8cdf1f4e-3ec0-453a-b82c-e5244659756a tempest-VolumesSnapshotListTestJSON-350491497 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:39:37.329630 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-8cdf1f4e-3ec0-453a-b82c-e5244659756a tempest-VolumesSnapshotListTestJSON-350491497 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:39:37.336262 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-8cdf1f4e-3ec0-453a-b82c-e5244659756a tempest-VolumesSnapshotListTestJSON-350491497 None] Deleted volume successfully. Apr 30 21:39:37.383610 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-8cdf1f4e-3ec0-453a-b82c-e5244659756a tempest-VolumesSnapshotListTestJSON-350491497 None] Lock "b'cinder-ea2f5477-f949-4349-bf34-002b7eabddee-delete_volume'" released by "delete_volume" :: held 5.303s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:39:37.500264 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-aad4097f-dc85-4578-9b6e-fa97c07ba1ea req-f756ffd0-32b3-412c-bbf6-83d5948ca7c5 tempest-AttachVolumeTestJSON-628843456 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.309s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:39:37.501053 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-aad4097f-dc85-4578-9b6e-fa97c07ba1ea req-f756ffd0-32b3-412c-bbf6-83d5948ca7c5 tempest-AttachVolumeTestJSON-628843456 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c899b854-e3f9-4a55-a1a7-2d557b80cc44', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': 'c899b854-e3f9-4a55-a1a7-2d557b80cc44', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:39:37.598112 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-aad4097f-dc85-4578-9b6e-fa97c07ba1ea req-f756ffd0-32b3-412c-bbf6-83d5948ca7c5 tempest-AttachVolumeTestJSON-628843456 None] Connection info returned from driver {'name': 'volumes/volume-c899b854-e3f9-4a55-a1a7-2d557b80cc44', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c899b854-e3f9-4a55-a1a7-2d557b80cc44', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '870e9bb4-1636-461a-8e3d-bae4be32cfa7'} {{(pid=123855) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Apr 30 21:39:37.772452 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-aad4097f-dc85-4578-9b6e-fa97c07ba1ea req-f756ffd0-32b3-412c-bbf6-83d5948ca7c5 tempest-AttachVolumeTestJSON-628843456 None] attachment_update completed successfully. Apr 30 21:39:41.756241 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ed02f5c-d26a-4b91-9247-35678c1ee7f5 tempest-AttachVolumeTestJSON-628843456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:39:41.783901 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9ed02f5c-d26a-4b91-9247-35678c1ee7f5 tempest-AttachVolumeTestJSON-628843456 None] Flow 'volume_create_manager' (4cc0c4ec-721c-49d0-b005-7061fbd6d37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:39:41.791446 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9ed02f5c-d26a-4b91-9247-35678c1ee7f5 tempest-AttachVolumeTestJSON-628843456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f8b21fe-049e-4630-9f9c-aed497fdb4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:39:41.807156 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9ed02f5c-d26a-4b91-9247-35678c1ee7f5 tempest-AttachVolumeTestJSON-628843456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f8b21fe-049e-4630-9f9c-aed497fdb4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-672283550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a7defae2-9b5f-4f22-bbe5-a7f93f245557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b74e36d3bb384eeb92da16d1b201fc9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:39:42Z,use_quota=True,user_id='e9fa67fb4ad4472183b95067597f043e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:39:41.813517 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9ed02f5c-d26a-4b91-9247-35678c1ee7f5 tempest-AttachVolumeTestJSON-628843456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9cc98b4-56b4-472b-8e55-1b1f034882ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:39:41.821731 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9ed02f5c-d26a-4b91-9247-35678c1ee7f5 tempest-AttachVolumeTestJSON-628843456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9cc98b4-56b4-472b-8e55-1b1f034882ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:39:41.824250 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9ed02f5c-d26a-4b91-9247-35678c1ee7f5 tempest-AttachVolumeTestJSON-628843456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a3744e-4de9-4506-94a1-1ddefa0112a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:39:41.828940 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9ed02f5c-d26a-4b91-9247-35678c1ee7f5 tempest-AttachVolumeTestJSON-628843456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a3744e-4de9-4506-94a1-1ddefa0112a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7defae2-9b5f-4f22-bbe5-a7f93f245557', 'volume_name': 'volume-a7defae2-9b5f-4f22-bbe5-a7f93f245557', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:39:41.834932 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9ed02f5c-d26a-4b91-9247-35678c1ee7f5 tempest-AttachVolumeTestJSON-628843456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08031df4-79e8-41f5-9ee0-ef29a1af98a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:39:41.839420 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9ed02f5c-d26a-4b91-9247-35678c1ee7f5 tempest-AttachVolumeTestJSON-628843456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08031df4-79e8-41f5-9ee0-ef29a1af98a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:39:41.845496 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9ed02f5c-d26a-4b91-9247-35678c1ee7f5 tempest-AttachVolumeTestJSON-628843456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c20fc86b-94aa-4ba8-9b66-dec9e446f45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:39:41.847082 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-9ed02f5c-d26a-4b91-9247-35678c1ee7f5 tempest-AttachVolumeTestJSON-628843456 None] Volume a7defae2-9b5f-4f22-bbe5-a7f93f245557: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7defae2-9b5f-4f22-bbe5-a7f93f245557', 'volume_size': 1} Apr 30 21:39:41.847746 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9ed02f5c-d26a-4b91-9247-35678c1ee7f5 tempest-AttachVolumeTestJSON-628843456 None] creating volume 'volume-a7defae2-9b5f-4f22-bbe5-a7f93f245557' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:39:41.849433 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9ed02f5c-d26a-4b91-9247-35678c1ee7f5 tempest-AttachVolumeTestJSON-628843456 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:39:42.620719 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9ed02f5c-d26a-4b91-9247-35678c1ee7f5 tempest-AttachVolumeTestJSON-628843456 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:39:42.622334 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9ed02f5c-d26a-4b91-9247-35678c1ee7f5 tempest-AttachVolumeTestJSON-628843456 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:39:42.630894 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9ed02f5c-d26a-4b91-9247-35678c1ee7f5 tempest-AttachVolumeTestJSON-628843456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c20fc86b-94aa-4ba8-9b66-dec9e446f45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7defae2-9b5f-4f22-bbe5-a7f93f245557', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:39:42.637289 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9ed02f5c-d26a-4b91-9247-35678c1ee7f5 tempest-AttachVolumeTestJSON-628843456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8c9fb5-5732-4763-be5c-3a7c01e14c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:39:42.792076 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-9ed02f5c-d26a-4b91-9247-35678c1ee7f5 tempest-AttachVolumeTestJSON-628843456 None] Volume volume-a7defae2-9b5f-4f22-bbe5-a7f93f245557 (a7defae2-9b5f-4f22-bbe5-a7f93f245557): created successfully Apr 30 21:39:42.798707 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9ed02f5c-d26a-4b91-9247-35678c1ee7f5 tempest-AttachVolumeTestJSON-628843456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8c9fb5-5732-4763-be5c-3a7c01e14c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:39:42.808849 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-9ed02f5c-d26a-4b91-9247-35678c1ee7f5 tempest-AttachVolumeTestJSON-628843456 None] Flow 'volume_create_manager' (4cc0c4ec-721c-49d0-b005-7061fbd6d37b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:39:42.906581 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-9ed02f5c-d26a-4b91-9247-35678c1ee7f5 tempest-AttachVolumeTestJSON-628843456 None] Created volume successfully. Apr 30 21:39:44.891378 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-fb7c739b-a5e5-42b4-9411-768c5b32f40f req-539ac6f1-de5f-4963-abc8-f3b721519300 tempest-AttachVolumeTestJSON-628843456 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:39:45.723366 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-fb7c739b-a5e5-42b4-9411-768c5b32f40f req-539ac6f1-de5f-4963-abc8-f3b721519300 tempest-AttachVolumeTestJSON-628843456 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.831s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:39:45.724581 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-fb7c739b-a5e5-42b4-9411-768c5b32f40f req-539ac6f1-de5f-4963-abc8-f3b721519300 tempest-AttachVolumeTestJSON-628843456 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a7defae2-9b5f-4f22-bbe5-a7f93f245557', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': 'a7defae2-9b5f-4f22-bbe5-a7f93f245557', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:39:45.866602 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-fb7c739b-a5e5-42b4-9411-768c5b32f40f req-539ac6f1-de5f-4963-abc8-f3b721519300 tempest-AttachVolumeTestJSON-628843456 None] Connection info returned from driver {'name': 'volumes/volume-a7defae2-9b5f-4f22-bbe5-a7f93f245557', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a7defae2-9b5f-4f22-bbe5-a7f93f245557', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4cac8205-94b2-47f4-b5d9-fbfe268866af'} {{(pid=123855) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Apr 30 21:39:45.981799 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-fb7c739b-a5e5-42b4-9411-768c5b32f40f req-539ac6f1-de5f-4963-abc8-f3b721519300 tempest-AttachVolumeTestJSON-628843456 None] attachment_update completed successfully. Apr 30 21:39:51.802807 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-fee69417-9096-42a6-95fb-a2b4f9187586 req-dd18bc59-8d07-48e9-a3ca-44c2dff06593 tempest-AttachVolumeTestJSON-628843456 None] Terminate volume connection completed successfully. Apr 30 21:39:51.805428 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-fee69417-9096-42a6-95fb-a2b4f9187586 req-dd18bc59-8d07-48e9-a3ca-44c2dff06593 tempest-AttachVolumeTestJSON-628843456 None] Deleting attachment 870e9bb4-1636-461a-8e3d-bae4be32cfa7. {{(pid=123855) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} Apr 30 21:39:54.385398 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-5d29590f-16e5-456c-ad88-cf9b6ce03871 req-7cf8a502-3706-489b-b5b2-cfe577e1b4e1 tempest-AttachVolumeTestJSON-628843456 None] Terminate volume connection completed successfully. Apr 30 21:39:54.386684 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-5d29590f-16e5-456c-ad88-cf9b6ce03871 req-7cf8a502-3706-489b-b5b2-cfe577e1b4e1 tempest-AttachVolumeTestJSON-628843456 None] Deleting attachment 4cac8205-94b2-47f4-b5d9-fbfe268866af. {{(pid=123855) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} Apr 30 21:40:03.289609 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-32c978da-3471-4911-bb01-952d85ca2c7a tempest-AttachVolumeTestJSON-628843456 None] Lock "b'cinder-a7defae2-9b5f-4f22-bbe5-a7f93f245557-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:40:03.428767 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-32c978da-3471-4911-bb01-952d85ca2c7a tempest-AttachVolumeTestJSON-628843456 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:40:03.655092 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-32c978da-3471-4911-bb01-952d85ca2c7a tempest-AttachVolumeTestJSON-628843456 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:40:03.655594 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-32c978da-3471-4911-bb01-952d85ca2c7a tempest-AttachVolumeTestJSON-628843456 None] Volume volume-a7defae2-9b5f-4f22-bbe5-a7f93f245557 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:40:03.729750 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-32c978da-3471-4911-bb01-952d85ca2c7a tempest-AttachVolumeTestJSON-628843456 None] deleting rbd volume volume-a7defae2-9b5f-4f22-bbe5-a7f93f245557 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:40:07.740078 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-32c978da-3471-4911-bb01-952d85ca2c7a tempest-AttachVolumeTestJSON-628843456 None] Created reservations ['42c1b861-aa7e-413e-b9e8-15a4c41c3dbf', 'f6f06113-6a4a-4f33-a171-dd3e09f0e34e', '171d96c2-2259-43f4-a596-628a5557d91e', '4ee008c3-f3ff-45e8-9e00-e8ac2cc56ece'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:40:07.988725 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-32c978da-3471-4911-bb01-952d85ca2c7a tempest-AttachVolumeTestJSON-628843456 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:40:08.107334 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-32c978da-3471-4911-bb01-952d85ca2c7a tempest-AttachVolumeTestJSON-628843456 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:40:08.261350 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-32c978da-3471-4911-bb01-952d85ca2c7a tempest-AttachVolumeTestJSON-628843456 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:40:08.266557 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-32c978da-3471-4911-bb01-952d85ca2c7a tempest-AttachVolumeTestJSON-628843456 None] Deleted volume successfully. Apr 30 21:40:08.348153 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-32c978da-3471-4911-bb01-952d85ca2c7a tempest-AttachVolumeTestJSON-628843456 None] Lock "b'cinder-a7defae2-9b5f-4f22-bbe5-a7f93f245557-delete_volume'" released by "delete_volume" :: held 5.060s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:40:08.907462 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-d81c7d59-8666-4c9c-a01c-85627c6697b6 tempest-AttachVolumeTestJSON-628843456 None] Lock "b'cinder-c899b854-e3f9-4a55-a1a7-2d557b80cc44-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:40:09.007038 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-d81c7d59-8666-4c9c-a01c-85627c6697b6 tempest-AttachVolumeTestJSON-628843456 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:40:09.230017 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-d81c7d59-8666-4c9c-a01c-85627c6697b6 tempest-AttachVolumeTestJSON-628843456 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:40:09.230017 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-d81c7d59-8666-4c9c-a01c-85627c6697b6 tempest-AttachVolumeTestJSON-628843456 None] Volume volume-c899b854-e3f9-4a55-a1a7-2d557b80cc44 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:40:09.370568 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-d81c7d59-8666-4c9c-a01c-85627c6697b6 tempest-AttachVolumeTestJSON-628843456 None] deleting rbd volume volume-c899b854-e3f9-4a55-a1a7-2d557b80cc44 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:40:12.935740 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-d81c7d59-8666-4c9c-a01c-85627c6697b6 tempest-AttachVolumeTestJSON-628843456 None] Created reservations ['8b43900d-ec8f-4f9b-b5bb-4939af362658', 'eca5ba69-364d-45db-b965-81cc6db23366', 'ac259364-43d3-4c11-b621-d7e981eae750', '2bcf0226-5967-4554-84a2-39414e943ac6'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:40:13.142057 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-d81c7d59-8666-4c9c-a01c-85627c6697b6 tempest-AttachVolumeTestJSON-628843456 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:40:13.190365 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-d81c7d59-8666-4c9c-a01c-85627c6697b6 tempest-AttachVolumeTestJSON-628843456 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:40:13.250922 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-d81c7d59-8666-4c9c-a01c-85627c6697b6 tempest-AttachVolumeTestJSON-628843456 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:40:13.261332 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-d81c7d59-8666-4c9c-a01c-85627c6697b6 tempest-AttachVolumeTestJSON-628843456 None] Deleted volume successfully. Apr 30 21:40:13.341624 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-d81c7d59-8666-4c9c-a01c-85627c6697b6 tempest-AttachVolumeTestJSON-628843456 None] Lock "b'cinder-c899b854-e3f9-4a55-a1a7-2d557b80cc44-delete_volume'" released by "delete_volume" :: held 4.431s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:40:13.556795 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-eb87c78c-1e1f-4b9c-9882-b1dd42eadc23 tempest-AttachVolumeTestJSON-628843456 None] Lock "b'cinder-1f48d4d5-94cc-4387-97f6-69de0a01a3d8-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:40:13.682230 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-eb87c78c-1e1f-4b9c-9882-b1dd42eadc23 tempest-AttachVolumeTestJSON-628843456 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:40:13.838682 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-eb87c78c-1e1f-4b9c-9882-b1dd42eadc23 tempest-AttachVolumeTestJSON-628843456 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:40:13.839106 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-eb87c78c-1e1f-4b9c-9882-b1dd42eadc23 tempest-AttachVolumeTestJSON-628843456 None] Volume volume-1f48d4d5-94cc-4387-97f6-69de0a01a3d8 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:40:14.003710 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-eb87c78c-1e1f-4b9c-9882-b1dd42eadc23 tempest-AttachVolumeTestJSON-628843456 None] deleting rbd volume volume-1f48d4d5-94cc-4387-97f6-69de0a01a3d8 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:40:17.690278 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-eb87c78c-1e1f-4b9c-9882-b1dd42eadc23 tempest-AttachVolumeTestJSON-628843456 None] Created reservations ['8b355b11-57ca-40e6-930b-333115f7f3fb', 'c95feed5-53c7-484c-a353-571d591b93b5', '4da5139c-9302-4e45-8d3d-839cc984eade', 'ff0ab284-4a2b-4389-9014-2d7f78cba40b'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:40:17.901055 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-eb87c78c-1e1f-4b9c-9882-b1dd42eadc23 tempest-AttachVolumeTestJSON-628843456 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:40:17.946838 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-eb87c78c-1e1f-4b9c-9882-b1dd42eadc23 tempest-AttachVolumeTestJSON-628843456 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:40:17.977893 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-eb87c78c-1e1f-4b9c-9882-b1dd42eadc23 tempest-AttachVolumeTestJSON-628843456 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:40:17.984574 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-eb87c78c-1e1f-4b9c-9882-b1dd42eadc23 tempest-AttachVolumeTestJSON-628843456 None] Deleted volume successfully. Apr 30 21:40:18.085405 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-eb87c78c-1e1f-4b9c-9882-b1dd42eadc23 tempest-AttachVolumeTestJSON-628843456 None] Lock "b'cinder-1f48d4d5-94cc-4387-97f6-69de0a01a3d8-delete_volume'" released by "delete_volume" :: held 4.529s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:40:26.024249 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [req-d9b1580f-2865-489b-9da7-9393fc82fe70 req-26963844-8576-46b0-bb2a-81d3d51944ff tempest-VolumesSnapshotsTestJSON-1027907309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:40:26.044878 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-d9b1580f-2865-489b-9da7-9393fc82fe70 req-26963844-8576-46b0-bb2a-81d3d51944ff tempest-VolumesSnapshotsTestJSON-1027907309 None] Flow 'volume_create_manager' (ad9c2b1e-351c-4deb-9de4-11cba84d6594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:40:26.051533 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-d9b1580f-2865-489b-9da7-9393fc82fe70 req-26963844-8576-46b0-bb2a-81d3d51944ff tempest-VolumesSnapshotsTestJSON-1027907309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26371366-1e4e-43dd-9535-095ee2b6d052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:40:26.067039 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-d9b1580f-2865-489b-9da7-9393fc82fe70 req-26963844-8576-46b0-bb2a-81d3d51944ff tempest-VolumesSnapshotsTestJSON-1027907309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26371366-1e4e-43dd-9535-095ee2b6d052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-374081725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=313784e9-788a-46d4-8756-1a84b8db72b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee1c8ed9fb14ac58f354be83ac3458d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:40:26Z,use_quota=True,user_id='2be61fa42b864a0dbf3d2ad342334368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:40:26.072564 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-d9b1580f-2865-489b-9da7-9393fc82fe70 req-26963844-8576-46b0-bb2a-81d3d51944ff tempest-VolumesSnapshotsTestJSON-1027907309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11c84d3f-9925-4a50-b84a-f731df9a6599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:40:26.076708 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-d9b1580f-2865-489b-9da7-9393fc82fe70 req-26963844-8576-46b0-bb2a-81d3d51944ff tempest-VolumesSnapshotsTestJSON-1027907309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11c84d3f-9925-4a50-b84a-f731df9a6599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:40:26.081851 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-d9b1580f-2865-489b-9da7-9393fc82fe70 req-26963844-8576-46b0-bb2a-81d3d51944ff tempest-VolumesSnapshotsTestJSON-1027907309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1625ff73-71f8-4cdc-9381-06c50fc808ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:40:26.086615 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-d9b1580f-2865-489b-9da7-9393fc82fe70 req-26963844-8576-46b0-bb2a-81d3d51944ff tempest-VolumesSnapshotsTestJSON-1027907309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1625ff73-71f8-4cdc-9381-06c50fc808ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '313784e9-788a-46d4-8756-1a84b8db72b2', 'volume_name': 'volume-313784e9-788a-46d4-8756-1a84b8db72b2', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:40:26.091404 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-d9b1580f-2865-489b-9da7-9393fc82fe70 req-26963844-8576-46b0-bb2a-81d3d51944ff tempest-VolumesSnapshotsTestJSON-1027907309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62a6cd1c-912f-45e3-875f-2ff4801131cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:40:26.095362 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-d9b1580f-2865-489b-9da7-9393fc82fe70 req-26963844-8576-46b0-bb2a-81d3d51944ff tempest-VolumesSnapshotsTestJSON-1027907309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62a6cd1c-912f-45e3-875f-2ff4801131cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:40:26.100770 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-d9b1580f-2865-489b-9da7-9393fc82fe70 req-26963844-8576-46b0-bb2a-81d3d51944ff tempest-VolumesSnapshotsTestJSON-1027907309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e634c64a-d36a-4bc6-84b3-3fd2c7596401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:40:26.101984 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [req-d9b1580f-2865-489b-9da7-9393fc82fe70 req-26963844-8576-46b0-bb2a-81d3d51944ff tempest-VolumesSnapshotsTestJSON-1027907309 None] Volume 313784e9-788a-46d4-8756-1a84b8db72b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-313784e9-788a-46d4-8756-1a84b8db72b2', 'volume_size': 1} Apr 30 21:40:26.102377 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-d9b1580f-2865-489b-9da7-9393fc82fe70 req-26963844-8576-46b0-bb2a-81d3d51944ff tempest-VolumesSnapshotsTestJSON-1027907309 None] creating volume 'volume-313784e9-788a-46d4-8756-1a84b8db72b2' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:40:26.103176 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-d9b1580f-2865-489b-9da7-9393fc82fe70 req-26963844-8576-46b0-bb2a-81d3d51944ff tempest-VolumesSnapshotsTestJSON-1027907309 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:40:26.517740 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-d9b1580f-2865-489b-9da7-9393fc82fe70 req-26963844-8576-46b0-bb2a-81d3d51944ff tempest-VolumesSnapshotsTestJSON-1027907309 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:40:26.518156 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-d9b1580f-2865-489b-9da7-9393fc82fe70 req-26963844-8576-46b0-bb2a-81d3d51944ff tempest-VolumesSnapshotsTestJSON-1027907309 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:40:26.521930 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-d9b1580f-2865-489b-9da7-9393fc82fe70 req-26963844-8576-46b0-bb2a-81d3d51944ff tempest-VolumesSnapshotsTestJSON-1027907309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e634c64a-d36a-4bc6-84b3-3fd2c7596401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-313784e9-788a-46d4-8756-1a84b8db72b2', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:40:26.527740 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-d9b1580f-2865-489b-9da7-9393fc82fe70 req-26963844-8576-46b0-bb2a-81d3d51944ff tempest-VolumesSnapshotsTestJSON-1027907309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aef98ca-f035-4e56-bed8-e134a3b0eea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:40:26.593227 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [req-d9b1580f-2865-489b-9da7-9393fc82fe70 req-26963844-8576-46b0-bb2a-81d3d51944ff tempest-VolumesSnapshotsTestJSON-1027907309 None] Volume volume-313784e9-788a-46d4-8756-1a84b8db72b2 (313784e9-788a-46d4-8756-1a84b8db72b2): created successfully Apr 30 21:40:26.597175 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-d9b1580f-2865-489b-9da7-9393fc82fe70 req-26963844-8576-46b0-bb2a-81d3d51944ff tempest-VolumesSnapshotsTestJSON-1027907309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aef98ca-f035-4e56-bed8-e134a3b0eea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:40:26.604780 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-d9b1580f-2865-489b-9da7-9393fc82fe70 req-26963844-8576-46b0-bb2a-81d3d51944ff tempest-VolumesSnapshotsTestJSON-1027907309 None] Flow 'volume_create_manager' (ad9c2b1e-351c-4deb-9de4-11cba84d6594) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:40:26.684818 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-d9b1580f-2865-489b-9da7-9393fc82fe70 req-26963844-8576-46b0-bb2a-81d3d51944ff tempest-VolumesSnapshotsTestJSON-1027907309 None] Created volume successfully. Apr 30 21:40:27.593544 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-2a90dea5-4945-4718-8a16-d9c28c91e426 req-e84087e4-e4a8-4a48-8efe-4f106d8fcf23 tempest-VolumesSnapshotsTestJSON-1027907309 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:40:29.106338 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-2a90dea5-4945-4718-8a16-d9c28c91e426 req-e84087e4-e4a8-4a48-8efe-4f106d8fcf23 tempest-VolumesSnapshotsTestJSON-1027907309 None] Create snapshot completed successfully Apr 30 21:40:29.769162 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [req-6489d396-56ff-4294-82aa-97938ddb9c8a req-77e9449b-da6f-481a-99c4-f470157193f6 tempest-VolumesSnapshotsTestJSON-1027907309 None] Lock "b'cinder-648512f7-cd57-4892-a374-42885b0b9c06-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.018s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:40:29.771240 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-6489d396-56ff-4294-82aa-97938ddb9c8a req-77e9449b-da6f-481a-99c4-f470157193f6 tempest-VolumesSnapshotsTestJSON-1027907309 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:40:31.328716 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:40:31.329424 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:40:31.361473 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:40:31.385381 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:40:32.780694 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [req-6489d396-56ff-4294-82aa-97938ddb9c8a req-77e9449b-da6f-481a-99c4-f470157193f6 tempest-VolumesSnapshotsTestJSON-1027907309 None] Created reservations ['01606780-709c-4717-ae24-e8856b428955', 'b70eccb9-7e1a-4ded-993f-068a8713fce6', 'a5e8bf6c-73a8-475d-b242-8508a4d3b40d', '6c7aeac7-ac48-495b-abff-4efe28eeaef4'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:40:32.935976 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-6489d396-56ff-4294-82aa-97938ddb9c8a req-77e9449b-da6f-481a-99c4-f470157193f6 tempest-VolumesSnapshotsTestJSON-1027907309 None] Delete snapshot completed successfully. Apr 30 21:40:32.940425 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [req-6489d396-56ff-4294-82aa-97938ddb9c8a req-77e9449b-da6f-481a-99c4-f470157193f6 tempest-VolumesSnapshotsTestJSON-1027907309 None] Lock "b'cinder-648512f7-cd57-4892-a374-42885b0b9c06-delete_snapshot'" released by "delete_snapshot" :: held 3.171s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:40:33.282569 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [req-5ad4d926-d3fa-4587-b189-770c4cfffad8 req-47b3e33c-36b1-484c-ac9d-b4b56853c5d4 tempest-VolumesSnapshotsTestJSON-1027907309 None] Lock "b'cinder-313784e9-788a-46d4-8756-1a84b8db72b2-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:40:33.396816 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-5ad4d926-d3fa-4587-b189-770c4cfffad8 req-47b3e33c-36b1-484c-ac9d-b4b56853c5d4 tempest-VolumesSnapshotsTestJSON-1027907309 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:40:33.535910 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-5ad4d926-d3fa-4587-b189-770c4cfffad8 req-47b3e33c-36b1-484c-ac9d-b4b56853c5d4 tempest-VolumesSnapshotsTestJSON-1027907309 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:40:33.536272 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-5ad4d926-d3fa-4587-b189-770c4cfffad8 req-47b3e33c-36b1-484c-ac9d-b4b56853c5d4 tempest-VolumesSnapshotsTestJSON-1027907309 None] Volume volume-313784e9-788a-46d4-8756-1a84b8db72b2 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:40:33.663067 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-5ad4d926-d3fa-4587-b189-770c4cfffad8 req-47b3e33c-36b1-484c-ac9d-b4b56853c5d4 tempest-VolumesSnapshotsTestJSON-1027907309 None] deleting rbd volume volume-313784e9-788a-46d4-8756-1a84b8db72b2 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:40:37.393535 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [req-5ad4d926-d3fa-4587-b189-770c4cfffad8 req-47b3e33c-36b1-484c-ac9d-b4b56853c5d4 tempest-VolumesSnapshotsTestJSON-1027907309 None] Created reservations ['fc6de4d5-f1bf-49a8-9033-48c8b0aa592e', '61e8ec9e-f63b-4639-8771-846cbf775248', '1fa6e5e2-c661-484b-8165-252914e710bc', 'e4921edc-ef27-4ead-af32-2cd25f0eb157'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:40:37.577743 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-5ad4d926-d3fa-4587-b189-770c4cfffad8 req-47b3e33c-36b1-484c-ac9d-b4b56853c5d4 tempest-VolumesSnapshotsTestJSON-1027907309 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:40:37.624030 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-5ad4d926-d3fa-4587-b189-770c4cfffad8 req-47b3e33c-36b1-484c-ac9d-b4b56853c5d4 tempest-VolumesSnapshotsTestJSON-1027907309 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:40:37.684861 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [req-5ad4d926-d3fa-4587-b189-770c4cfffad8 req-47b3e33c-36b1-484c-ac9d-b4b56853c5d4 tempest-VolumesSnapshotsTestJSON-1027907309 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:40:37.689148 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-5ad4d926-d3fa-4587-b189-770c4cfffad8 req-47b3e33c-36b1-484c-ac9d-b4b56853c5d4 tempest-VolumesSnapshotsTestJSON-1027907309 None] Deleted volume successfully. Apr 30 21:40:37.756908 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [req-5ad4d926-d3fa-4587-b189-770c4cfffad8 req-47b3e33c-36b1-484c-ac9d-b4b56853c5d4 tempest-VolumesSnapshotsTestJSON-1027907309 None] Lock "b'cinder-313784e9-788a-46d4-8756-1a84b8db72b2-delete_volume'" released by "delete_volume" :: held 4.474s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:41:31.330471 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:41:31.331403 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:41:31.356874 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:41:31.400912 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:41:57.342526 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-2d9eff88-b365-4b9c-9e92-f1b512a08cec tempest-BackendsCapabilitiesAdminTestsJSON-1837938953 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:3248ecd5-4483-4276-a2b9-de5137f4f872:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=123855) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4733}} Apr 30 21:41:57.375463 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d65be4af-2c2d-4518-9f7f-5a1214c33ff0 tempest-BackendsCapabilitiesAdminTestsJSON-1837938953 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:3248ecd5-4483-4276-a2b9-de5137f4f872:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=123855) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4733}} Apr 30 21:42:18.637170 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-0113014b-fbda-4537-867c-146720e74c0c tempest-SnapshotsActionsTest-1409062856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:42:18.658481 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0113014b-fbda-4537-867c-146720e74c0c tempest-SnapshotsActionsTest-1409062856 None] Flow 'volume_create_manager' (c2857e1c-3fbc-4cba-96b1-f10b4c27da4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:42:18.667544 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0113014b-fbda-4537-867c-146720e74c0c tempest-SnapshotsActionsTest-1409062856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b63ffa4f-0327-48df-8dd9-16b15acb436d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:42:18.683522 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0113014b-fbda-4537-867c-146720e74c0c tempest-SnapshotsActionsTest-1409062856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b63ffa4f-0327-48df-8dd9-16b15acb436d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1778158119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9ed32f59-e86d-446e-b73b-479816d1541f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50cc8aa73054488585bff076ca15cd47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:42:18Z,use_quota=True,user_id='5f3844e94a3349f4910da1ab405fa87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:42:18.689190 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0113014b-fbda-4537-867c-146720e74c0c tempest-SnapshotsActionsTest-1409062856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39c3527a-1b7e-4c35-9e49-0d99e692a4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:42:18.694269 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0113014b-fbda-4537-867c-146720e74c0c tempest-SnapshotsActionsTest-1409062856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39c3527a-1b7e-4c35-9e49-0d99e692a4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:42:18.699455 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0113014b-fbda-4537-867c-146720e74c0c tempest-SnapshotsActionsTest-1409062856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e07d8999-7158-439c-ba3a-9ec462f3e8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:42:18.703543 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0113014b-fbda-4537-867c-146720e74c0c tempest-SnapshotsActionsTest-1409062856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e07d8999-7158-439c-ba3a-9ec462f3e8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ed32f59-e86d-446e-b73b-479816d1541f', 'volume_name': 'volume-9ed32f59-e86d-446e-b73b-479816d1541f', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:42:18.708448 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0113014b-fbda-4537-867c-146720e74c0c tempest-SnapshotsActionsTest-1409062856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c622347-74a4-463d-be67-1e20e59dcc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:42:18.713427 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0113014b-fbda-4537-867c-146720e74c0c tempest-SnapshotsActionsTest-1409062856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c622347-74a4-463d-be67-1e20e59dcc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:42:18.718417 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0113014b-fbda-4537-867c-146720e74c0c tempest-SnapshotsActionsTest-1409062856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea108d86-a072-4ef9-b0c2-e27d6b2ee592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:42:18.719656 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-0113014b-fbda-4537-867c-146720e74c0c tempest-SnapshotsActionsTest-1409062856 None] Volume 9ed32f59-e86d-446e-b73b-479816d1541f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ed32f59-e86d-446e-b73b-479816d1541f', 'volume_size': 1} Apr 30 21:42:18.725053 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-0113014b-fbda-4537-867c-146720e74c0c tempest-SnapshotsActionsTest-1409062856 None] creating volume 'volume-9ed32f59-e86d-446e-b73b-479816d1541f' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:42:18.725053 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-0113014b-fbda-4537-867c-146720e74c0c tempest-SnapshotsActionsTest-1409062856 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:42:19.242489 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-0113014b-fbda-4537-867c-146720e74c0c tempest-SnapshotsActionsTest-1409062856 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:42:19.242923 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-0113014b-fbda-4537-867c-146720e74c0c tempest-SnapshotsActionsTest-1409062856 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:42:19.246817 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0113014b-fbda-4537-867c-146720e74c0c tempest-SnapshotsActionsTest-1409062856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea108d86-a072-4ef9-b0c2-e27d6b2ee592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ed32f59-e86d-446e-b73b-479816d1541f', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:42:19.251469 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0113014b-fbda-4537-867c-146720e74c0c tempest-SnapshotsActionsTest-1409062856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92b96c51-9218-4137-a7a4-09acc09acf89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:42:19.338613 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-0113014b-fbda-4537-867c-146720e74c0c tempest-SnapshotsActionsTest-1409062856 None] Volume volume-9ed32f59-e86d-446e-b73b-479816d1541f (9ed32f59-e86d-446e-b73b-479816d1541f): created successfully Apr 30 21:42:19.342438 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0113014b-fbda-4537-867c-146720e74c0c tempest-SnapshotsActionsTest-1409062856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92b96c51-9218-4137-a7a4-09acc09acf89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:42:19.347892 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-0113014b-fbda-4537-867c-146720e74c0c tempest-SnapshotsActionsTest-1409062856 None] Flow 'volume_create_manager' (c2857e1c-3fbc-4cba-96b1-f10b4c27da4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:42:19.424276 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-0113014b-fbda-4537-867c-146720e74c0c tempest-SnapshotsActionsTest-1409062856 None] Created volume successfully. Apr 30 21:42:20.036020 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-39112fea-caba-443d-82fb-950ae678fddd tempest-SnapshotsActionsTest-1409062856 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:42:23.051042 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-39112fea-caba-443d-82fb-950ae678fddd tempest-SnapshotsActionsTest-1409062856 None] Create snapshot completed successfully Apr 30 21:42:25.073131 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-86c979bc-d9f9-4fa8-b28c-295186a20e0b tempest-SnapshotsActionsTest-1409062856 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:42:26.715571 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-86c979bc-d9f9-4fa8-b28c-295186a20e0b tempest-SnapshotsActionsTest-1409062856 None] Create snapshot completed successfully Apr 30 21:42:27.290374 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-b2f74885-9bef-496d-9383-d07a7349f551 tempest-SnapshotsActionsTest-378899039 None] Lock "b'cinder-227a4014-a3c5-41ce-93e2-514689bd96bd-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.017s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:42:27.292285 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b2f74885-9bef-496d-9383-d07a7349f551 tempest-SnapshotsActionsTest-378899039 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:42:29.247517 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-b2f74885-9bef-496d-9383-d07a7349f551 tempest-SnapshotsActionsTest-378899039 None] Created reservations ['31fb52a7-62c9-4005-8d93-94c2c9519994', '6727068a-c46d-4321-a053-f982bf82ed37', '94ef21b4-b33d-495d-8a30-e73f28720b0e', 'ee29e8dd-be18-403e-bed6-9b59de634bc0'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:42:29.393638 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-b2f74885-9bef-496d-9383-d07a7349f551 tempest-SnapshotsActionsTest-378899039 None] Delete snapshot completed successfully. Apr 30 21:42:29.402777 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-b2f74885-9bef-496d-9383-d07a7349f551 tempest-SnapshotsActionsTest-378899039 None] Lock "b'cinder-227a4014-a3c5-41ce-93e2-514689bd96bd-delete_snapshot'" released by "delete_snapshot" :: held 2.108s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:42:30.016928 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b95ec74c-017b-4697-b232-7f3957efe900 tempest-SnapshotsActionsTest-1409062856 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:42:31.328693 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:42:31.329405 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:42:31.354877 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:42:31.378258 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:42:32.127267 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-b95ec74c-017b-4697-b232-7f3957efe900 tempest-SnapshotsActionsTest-1409062856 None] Create snapshot completed successfully Apr 30 21:42:33.221326 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-bbc93d66-4d2c-4ed6-bd6f-9d4d941ae7c2 tempest-SnapshotsActionsTest-378899039 None] Lock "b'cinder-7b36850c-b286-433d-a23b-0d5aff077b0f-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:42:33.222963 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bbc93d66-4d2c-4ed6-bd6f-9d4d941ae7c2 tempest-SnapshotsActionsTest-378899039 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:42:36.228565 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-bbc93d66-4d2c-4ed6-bd6f-9d4d941ae7c2 tempest-SnapshotsActionsTest-378899039 None] Created reservations ['f81f95db-1a58-4eab-82db-8953d7fbee1e', '3e6b965c-df3e-46bf-a74a-5db4b87beef0', '0fb86d75-512e-4c02-a47b-7f9c57268aed', '5b9a1f10-db8c-40b5-932c-95960a4d21d8'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:42:36.417042 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-bbc93d66-4d2c-4ed6-bd6f-9d4d941ae7c2 tempest-SnapshotsActionsTest-378899039 None] Delete snapshot completed successfully. Apr 30 21:42:36.422084 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-bbc93d66-4d2c-4ed6-bd6f-9d4d941ae7c2 tempest-SnapshotsActionsTest-378899039 None] Lock "b'cinder-7b36850c-b286-433d-a23b-0d5aff077b0f-delete_snapshot'" released by "delete_snapshot" :: held 3.201s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:42:38.042026 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a8208d00-9b0c-4d04-82c3-5895f1feea6b tempest-SnapshotsActionsTest-1409062856 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:42:39.813333 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-a8208d00-9b0c-4d04-82c3-5895f1feea6b tempest-SnapshotsActionsTest-1409062856 None] Create snapshot completed successfully Apr 30 21:42:40.229737 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-9dee0540-0b31-4ad8-b2fc-5ca4b5fcffce tempest-SnapshotsActionsTest-378899039 None] Lock "b'cinder-e094a6f8-8c50-4160-a603-766c04792bfd-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:42:40.229737 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9dee0540-0b31-4ad8-b2fc-5ca4b5fcffce tempest-SnapshotsActionsTest-378899039 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:42:43.527568 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-9dee0540-0b31-4ad8-b2fc-5ca4b5fcffce tempest-SnapshotsActionsTest-378899039 None] Created reservations ['3c939ee8-ca5e-41c2-8e91-67389658c8ad', 'd3416699-095c-4a55-b0c0-2fc8f7847539', 'be8027e4-76b6-4a62-8f5a-291af50af5ec', 'd16deaa0-298b-43df-b5bd-717e09152b85'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:42:43.807743 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-9dee0540-0b31-4ad8-b2fc-5ca4b5fcffce tempest-SnapshotsActionsTest-378899039 None] Delete snapshot completed successfully. Apr 30 21:42:43.813974 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-9dee0540-0b31-4ad8-b2fc-5ca4b5fcffce tempest-SnapshotsActionsTest-378899039 None] Lock "b'cinder-e094a6f8-8c50-4160-a603-766c04792bfd-delete_snapshot'" released by "delete_snapshot" :: held 3.586s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:42:45.074148 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9a07ba58-6631-4722-976a-e6db9611fd5b tempest-SnapshotsActionsTest-1409062856 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:42:47.162072 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-9a07ba58-6631-4722-976a-e6db9611fd5b tempest-SnapshotsActionsTest-1409062856 None] Create snapshot completed successfully Apr 30 21:42:48.383315 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-81a9c870-2b08-42fa-b41c-278983679cb8 tempest-SnapshotsActionsTest-378899039 None] Lock "b'cinder-0c3cb58f-396e-4ce4-8a5e-bc798b274224-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:42:48.385712 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-81a9c870-2b08-42fa-b41c-278983679cb8 tempest-SnapshotsActionsTest-378899039 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:42:51.006480 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-81a9c870-2b08-42fa-b41c-278983679cb8 tempest-SnapshotsActionsTest-378899039 None] Created reservations ['739b7b6d-f357-4b6c-8872-8741f5cab968', '55ae8fd6-97cf-4347-9c98-ef97465d90a6', 'fb9abcbb-61fc-49e4-b75b-f8208e2db57b', '29dddd21-6fc1-4280-ac2c-2c571a217584'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:42:51.179387 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-81a9c870-2b08-42fa-b41c-278983679cb8 tempest-SnapshotsActionsTest-378899039 None] Delete snapshot completed successfully. Apr 30 21:42:51.185346 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-81a9c870-2b08-42fa-b41c-278983679cb8 tempest-SnapshotsActionsTest-378899039 None] Lock "b'cinder-0c3cb58f-396e-4ce4-8a5e-bc798b274224-delete_snapshot'" released by "delete_snapshot" :: held 2.802s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:42:52.409257 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-ad5ec0e1-6083-486c-992d-5bbe398737da tempest-SnapshotsActionsTest-1409062856 None] Lock "b'cinder-cfa98645-28e0-4b6d-a619-60703a275503-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:42:52.414735 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ad5ec0e1-6083-486c-992d-5bbe398737da tempest-SnapshotsActionsTest-1409062856 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:42:54.803888 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-ad5ec0e1-6083-486c-992d-5bbe398737da tempest-SnapshotsActionsTest-1409062856 None] Created reservations ['3bf3468a-878c-4df0-87cf-2c81e176dcaf', '98690286-ccb0-4923-82fe-17ada764def7', '8da5d861-e363-4249-8f55-0435003a0803', 'c869167c-90ef-4f55-83a0-3134188c6508'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:42:54.983429 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-ad5ec0e1-6083-486c-992d-5bbe398737da tempest-SnapshotsActionsTest-1409062856 None] Delete snapshot completed successfully. Apr 30 21:42:54.989198 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-ad5ec0e1-6083-486c-992d-5bbe398737da tempest-SnapshotsActionsTest-1409062856 None] Lock "b'cinder-cfa98645-28e0-4b6d-a619-60703a275503-delete_snapshot'" released by "delete_snapshot" :: held 2.580s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:42:55.792507 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-9c5c2581-4c06-4c0d-8f54-75152a9f3a17 tempest-SnapshotsActionsTest-1409062856 None] Lock "b'cinder-9ed32f59-e86d-446e-b73b-479816d1541f-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:42:55.946954 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9c5c2581-4c06-4c0d-8f54-75152a9f3a17 tempest-SnapshotsActionsTest-1409062856 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:42:56.156544 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9c5c2581-4c06-4c0d-8f54-75152a9f3a17 tempest-SnapshotsActionsTest-1409062856 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:42:56.157259 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9c5c2581-4c06-4c0d-8f54-75152a9f3a17 tempest-SnapshotsActionsTest-1409062856 None] Volume volume-9ed32f59-e86d-446e-b73b-479816d1541f is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:42:56.401436 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9c5c2581-4c06-4c0d-8f54-75152a9f3a17 tempest-SnapshotsActionsTest-1409062856 None] deleting rbd volume volume-9ed32f59-e86d-446e-b73b-479816d1541f {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:43:00.216865 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-9c5c2581-4c06-4c0d-8f54-75152a9f3a17 tempest-SnapshotsActionsTest-1409062856 None] Created reservations ['c8926ed7-4329-43a7-825b-53b40c8f178a', '603e9c3a-bbee-4a25-b814-9f7bcb8b9171', '580e9ebd-c1cc-4720-8c85-cf4d332e0a15', 'dded76be-c0dc-43af-ad28-907896f0969a'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:43:00.437173 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9c5c2581-4c06-4c0d-8f54-75152a9f3a17 tempest-SnapshotsActionsTest-1409062856 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:43:00.473130 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9c5c2581-4c06-4c0d-8f54-75152a9f3a17 tempest-SnapshotsActionsTest-1409062856 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:43:00.504670 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-9c5c2581-4c06-4c0d-8f54-75152a9f3a17 tempest-SnapshotsActionsTest-1409062856 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:43:00.511007 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-9c5c2581-4c06-4c0d-8f54-75152a9f3a17 tempest-SnapshotsActionsTest-1409062856 None] Deleted volume successfully. Apr 30 21:43:00.590701 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-9c5c2581-4c06-4c0d-8f54-75152a9f3a17 tempest-SnapshotsActionsTest-1409062856 None] Lock "b'cinder-9ed32f59-e86d-446e-b73b-479816d1541f-delete_volume'" released by "delete_volume" :: held 4.794s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:43:06.381189 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ad704d8-7933-4c91-9022-4f0e6215e0f4 tempest-VolumeTypesTest-803262472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:43:06.411849 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5ad704d8-7933-4c91-9022-4f0e6215e0f4 tempest-VolumeTypesTest-803262472 None] Flow 'volume_create_manager' (0aa5b0a7-041a-49f7-9b34-d890c3cf7382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:43:06.420417 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5ad704d8-7933-4c91-9022-4f0e6215e0f4 tempest-VolumeTypesTest-803262472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81e095e1-442f-4e88-ad76-41272178c359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:43:06.435880 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5ad704d8-7933-4c91-9022-4f0e6215e0f4 tempest-VolumeTypesTest-803262472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81e095e1-442f-4e88-ad76-41272178c359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-959894012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=03095289-a86f-407a-b995-3ffaf61c460e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1bce6a0d61d43199f4e4e2dd0bb96b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:43:06Z,use_quota=True,user_id='be9f074146594ea6a20c1a0de97e6330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f39bee2e-8393-494a-a6aa-c93eab033920),volume_type_id=f39bee2e-8393-494a-a6aa-c93eab033920)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:43:06.441385 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5ad704d8-7933-4c91-9022-4f0e6215e0f4 tempest-VolumeTypesTest-803262472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84e8d294-797b-46b2-8a32-8f5c76fdbb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:43:06.445740 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5ad704d8-7933-4c91-9022-4f0e6215e0f4 tempest-VolumeTypesTest-803262472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84e8d294-797b-46b2-8a32-8f5c76fdbb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:43:06.451160 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5ad704d8-7933-4c91-9022-4f0e6215e0f4 tempest-VolumeTypesTest-803262472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a98a56e-cbee-4c1a-87b2-1df9861c25c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:43:06.456403 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5ad704d8-7933-4c91-9022-4f0e6215e0f4 tempest-VolumeTypesTest-803262472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a98a56e-cbee-4c1a-87b2-1df9861c25c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03095289-a86f-407a-b995-3ffaf61c460e', 'volume_name': 'volume-03095289-a86f-407a-b995-3ffaf61c460e', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:43:06.462245 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5ad704d8-7933-4c91-9022-4f0e6215e0f4 tempest-VolumeTypesTest-803262472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (646085da-f824-4544-8853-8d38af94f352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:43:06.466302 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5ad704d8-7933-4c91-9022-4f0e6215e0f4 tempest-VolumeTypesTest-803262472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (646085da-f824-4544-8853-8d38af94f352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:43:06.471091 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5ad704d8-7933-4c91-9022-4f0e6215e0f4 tempest-VolumeTypesTest-803262472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eba86e15-fe9f-4d14-acb0-2f72f9b4dcdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:43:06.472219 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-5ad704d8-7933-4c91-9022-4f0e6215e0f4 tempest-VolumeTypesTest-803262472 None] Volume 03095289-a86f-407a-b995-3ffaf61c460e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03095289-a86f-407a-b995-3ffaf61c460e', 'volume_size': 1} Apr 30 21:43:06.472612 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-5ad704d8-7933-4c91-9022-4f0e6215e0f4 tempest-VolumeTypesTest-803262472 None] creating volume 'volume-03095289-a86f-407a-b995-3ffaf61c460e' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:43:06.473416 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-5ad704d8-7933-4c91-9022-4f0e6215e0f4 tempest-VolumeTypesTest-803262472 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:43:07.067011 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-5ad704d8-7933-4c91-9022-4f0e6215e0f4 tempest-VolumeTypesTest-803262472 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:43:07.068770 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-5ad704d8-7933-4c91-9022-4f0e6215e0f4 tempest-VolumeTypesTest-803262472 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:43:07.074592 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5ad704d8-7933-4c91-9022-4f0e6215e0f4 tempest-VolumeTypesTest-803262472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eba86e15-fe9f-4d14-acb0-2f72f9b4dcdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03095289-a86f-407a-b995-3ffaf61c460e', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:43:07.082265 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5ad704d8-7933-4c91-9022-4f0e6215e0f4 tempest-VolumeTypesTest-803262472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04ea18e1-2401-4bfb-98f9-38cfb520a0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:43:07.151085 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-5ad704d8-7933-4c91-9022-4f0e6215e0f4 tempest-VolumeTypesTest-803262472 None] Volume volume-03095289-a86f-407a-b995-3ffaf61c460e (03095289-a86f-407a-b995-3ffaf61c460e): created successfully Apr 30 21:43:07.159484 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5ad704d8-7933-4c91-9022-4f0e6215e0f4 tempest-VolumeTypesTest-803262472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04ea18e1-2401-4bfb-98f9-38cfb520a0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:43:07.160535 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-5ad704d8-7933-4c91-9022-4f0e6215e0f4 tempest-VolumeTypesTest-803262472 None] Flow 'volume_create_manager' (0aa5b0a7-041a-49f7-9b34-d890c3cf7382) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:43:07.242142 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-5ad704d8-7933-4c91-9022-4f0e6215e0f4 tempest-VolumeTypesTest-803262472 None] Created volume successfully. Apr 30 21:43:08.880844 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f4e5cabd-d00b-4227-8be2-3bb46394decc tempest-VolumeTypesTest-803262472 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:43:08.911301 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f4e5cabd-d00b-4227-8be2-3bb46394decc tempest-VolumeTypesTest-803262472 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:43:08.940859 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-f4e5cabd-d00b-4227-8be2-3bb46394decc tempest-VolumeTypesTest-803262472 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:43:08.947015 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-f4e5cabd-d00b-4227-8be2-3bb46394decc tempest-VolumeTypesTest-803262472 None] Retype volume completed successfully. Apr 30 21:43:11.728299 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-d5d1c7df-b23b-4470-a5b5-51210fd13a66 tempest-VolumeTypesTest-803262472 None] Lock "b'cinder-03095289-a86f-407a-b995-3ffaf61c460e-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:43:11.843648 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-d5d1c7df-b23b-4470-a5b5-51210fd13a66 tempest-VolumeTypesTest-803262472 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:43:12.001986 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-d5d1c7df-b23b-4470-a5b5-51210fd13a66 tempest-VolumeTypesTest-803262472 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:43:12.002488 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-d5d1c7df-b23b-4470-a5b5-51210fd13a66 tempest-VolumeTypesTest-803262472 None] Volume volume-03095289-a86f-407a-b995-3ffaf61c460e is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:43:12.131386 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-d5d1c7df-b23b-4470-a5b5-51210fd13a66 tempest-VolumeTypesTest-803262472 None] deleting rbd volume volume-03095289-a86f-407a-b995-3ffaf61c460e {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:43:15.666896 ncdv-master-1 cinder-volume[123855]: WARNING cinder.quota [None req-d5d1c7df-b23b-4470-a5b5-51210fd13a66 tempest-VolumeTypesTest-803262472 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesTest-volume-type-1365418559 is set by the default quota flag: quota_volumes_tempest-VolumeTypesTest-volume-type-1365418559, it is now deprecated. Please use the default quota class for default quota. Apr 30 21:43:15.668356 ncdv-master-1 cinder-volume[123855]: WARNING cinder.quota [None req-d5d1c7df-b23b-4470-a5b5-51210fd13a66 tempest-VolumeTypesTest-803262472 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesTest-volume-type-1365418559 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesTest-volume-type-1365418559, it is now deprecated. Please use the default quota class for default quota. Apr 30 21:43:15.774435 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-d5d1c7df-b23b-4470-a5b5-51210fd13a66 tempest-VolumeTypesTest-803262472 None] Created reservations ['0e4ff69a-1669-4ea0-bbd6-cf814331d10b', 'e35ad212-6f2c-41ff-b578-09860eeb6687', '67aedfd0-d89f-47ac-94aa-8cbb2103d710', 'f9538cf7-2dec-4c46-8584-fd5edb8219df'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:43:15.972369 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-d5d1c7df-b23b-4470-a5b5-51210fd13a66 tempest-VolumeTypesTest-803262472 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:43:16.024319 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-d5d1c7df-b23b-4470-a5b5-51210fd13a66 tempest-VolumeTypesTest-803262472 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:43:16.050663 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-d5d1c7df-b23b-4470-a5b5-51210fd13a66 tempest-VolumeTypesTest-803262472 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:43:16.056042 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-d5d1c7df-b23b-4470-a5b5-51210fd13a66 tempest-VolumeTypesTest-803262472 None] Deleted volume successfully. Apr 30 21:43:16.169878 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-d5d1c7df-b23b-4470-a5b5-51210fd13a66 tempest-VolumeTypesTest-803262472 None] Lock "b'cinder-03095289-a86f-407a-b995-3ffaf61c460e-delete_volume'" released by "delete_volume" :: held 4.442s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:43:30.569915 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-b54dae72-0979-46cf-aa33-4f86dcd58e2f tempest-VolumesTransfersV355Test-1916059063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:43:30.590642 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b54dae72-0979-46cf-aa33-4f86dcd58e2f tempest-VolumesTransfersV355Test-1916059063 None] Flow 'volume_create_manager' (c5ebe9c2-5c53-4229-a5b5-c67e1718c1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:43:30.597170 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b54dae72-0979-46cf-aa33-4f86dcd58e2f tempest-VolumesTransfersV355Test-1916059063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (693b9fe3-27f6-45e1-9338-0bccb1c78235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:43:30.613167 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b54dae72-0979-46cf-aa33-4f86dcd58e2f tempest-VolumesTransfersV355Test-1916059063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (693b9fe3-27f6-45e1-9338-0bccb1c78235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-942220388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5a53684e-2dcf-4df6-bb67-1f40ea2a15b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='786a3b8d82e44b2ca6ff802cf02c28c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:43:30Z,use_quota=True,user_id='d25e8bbbe40f40d689a1e4ab5c9c452e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:43:30.619316 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b54dae72-0979-46cf-aa33-4f86dcd58e2f tempest-VolumesTransfersV355Test-1916059063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94f648e8-eec0-4893-820c-06b72b36aefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:43:30.623528 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b54dae72-0979-46cf-aa33-4f86dcd58e2f tempest-VolumesTransfersV355Test-1916059063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94f648e8-eec0-4893-820c-06b72b36aefc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:43:30.628719 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b54dae72-0979-46cf-aa33-4f86dcd58e2f tempest-VolumesTransfersV355Test-1916059063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a82a988-fcab-4889-88c1-f266d8d24185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:43:30.632881 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b54dae72-0979-46cf-aa33-4f86dcd58e2f tempest-VolumesTransfersV355Test-1916059063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a82a988-fcab-4889-88c1-f266d8d24185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a53684e-2dcf-4df6-bb67-1f40ea2a15b5', 'volume_name': 'volume-5a53684e-2dcf-4df6-bb67-1f40ea2a15b5', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:43:30.637998 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b54dae72-0979-46cf-aa33-4f86dcd58e2f tempest-VolumesTransfersV355Test-1916059063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa6f861-e8f2-49d9-b300-56de3808eabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:43:30.642013 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b54dae72-0979-46cf-aa33-4f86dcd58e2f tempest-VolumesTransfersV355Test-1916059063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa6f861-e8f2-49d9-b300-56de3808eabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:43:30.646946 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b54dae72-0979-46cf-aa33-4f86dcd58e2f tempest-VolumesTransfersV355Test-1916059063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8012b7cd-2868-4278-8882-b89ffc992dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:43:30.647939 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-b54dae72-0979-46cf-aa33-4f86dcd58e2f tempest-VolumesTransfersV355Test-1916059063 None] Volume 5a53684e-2dcf-4df6-bb67-1f40ea2a15b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a53684e-2dcf-4df6-bb67-1f40ea2a15b5', 'volume_size': 1} Apr 30 21:43:30.648336 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b54dae72-0979-46cf-aa33-4f86dcd58e2f tempest-VolumesTransfersV355Test-1916059063 None] creating volume 'volume-5a53684e-2dcf-4df6-bb67-1f40ea2a15b5' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:43:30.649233 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b54dae72-0979-46cf-aa33-4f86dcd58e2f tempest-VolumesTransfersV355Test-1916059063 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:43:31.334230 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:43:31.335094 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:43:31.378436 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:43:31.439266 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:43:31.453672 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b54dae72-0979-46cf-aa33-4f86dcd58e2f tempest-VolumesTransfersV355Test-1916059063 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:43:31.454394 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b54dae72-0979-46cf-aa33-4f86dcd58e2f tempest-VolumesTransfersV355Test-1916059063 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:43:31.459446 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b54dae72-0979-46cf-aa33-4f86dcd58e2f tempest-VolumesTransfersV355Test-1916059063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8012b7cd-2868-4278-8882-b89ffc992dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a53684e-2dcf-4df6-bb67-1f40ea2a15b5', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:43:31.466861 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b54dae72-0979-46cf-aa33-4f86dcd58e2f tempest-VolumesTransfersV355Test-1916059063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7836f6c-08aa-4906-990b-6cd7aa7ca9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:43:31.562525 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-b54dae72-0979-46cf-aa33-4f86dcd58e2f tempest-VolumesTransfersV355Test-1916059063 None] Volume volume-5a53684e-2dcf-4df6-bb67-1f40ea2a15b5 (5a53684e-2dcf-4df6-bb67-1f40ea2a15b5): created successfully Apr 30 21:43:31.566383 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b54dae72-0979-46cf-aa33-4f86dcd58e2f tempest-VolumesTransfersV355Test-1916059063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7836f6c-08aa-4906-990b-6cd7aa7ca9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:43:31.572664 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-b54dae72-0979-46cf-aa33-4f86dcd58e2f tempest-VolumesTransfersV355Test-1916059063 None] Flow 'volume_create_manager' (c5ebe9c2-5c53-4229-a5b5-c67e1718c1d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:43:31.648217 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-b54dae72-0979-46cf-aa33-4f86dcd58e2f tempest-VolumesTransfersV355Test-1916059063 None] Created volume successfully. Apr 30 21:43:33.796476 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-82b37ceb-cc88-4ee4-82db-2e81e1c82478 tempest-VolumesTransfersV355Test-739862212 None] Transfer volume completed successfully. Apr 30 21:43:35.204742 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-2a41f98f-3380-4764-805d-87195db2fc64 tempest-VolumesTransfersV355Test-362893825 None] Lock "b'cinder-5a53684e-2dcf-4df6-bb67-1f40ea2a15b5-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:43:35.298190 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-2a41f98f-3380-4764-805d-87195db2fc64 tempest-VolumesTransfersV355Test-362893825 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:43:35.454397 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-2a41f98f-3380-4764-805d-87195db2fc64 tempest-VolumesTransfersV355Test-362893825 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:43:35.455213 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-2a41f98f-3380-4764-805d-87195db2fc64 tempest-VolumesTransfersV355Test-362893825 None] Volume volume-5a53684e-2dcf-4df6-bb67-1f40ea2a15b5 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:43:35.563341 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-2a41f98f-3380-4764-805d-87195db2fc64 tempest-VolumesTransfersV355Test-362893825 None] deleting rbd volume volume-5a53684e-2dcf-4df6-bb67-1f40ea2a15b5 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:43:39.503674 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-453c4672-f9a6-4628-ba24-e03f501b0921 tempest-GroupSnapshotsV319Test-434388681 None] Group tempest-GroupSnapshotsV319Test-Group-22590928: creating Apr 30 21:43:39.515193 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-2a41f98f-3380-4764-805d-87195db2fc64 tempest-VolumesTransfersV355Test-362893825 None] Created reservations ['a1460156-1a3e-4440-8acb-29966160e415', '5070a222-a100-45ff-a3fa-8e518c89ec46', 'b1249a5e-e779-4635-9a8b-f2b7de0cf4da', '3b47949f-b94f-43ba-9025-ce626849a8a5'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:43:39.613323 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-453c4672-f9a6-4628-ba24-e03f501b0921 tempest-GroupSnapshotsV319Test-434388681 None] Group tempest-GroupSnapshotsV319Test-Group-22590928: created successfully Apr 30 21:43:39.625915 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-453c4672-f9a6-4628-ba24-e03f501b0921 tempest-GroupSnapshotsV319Test-434388681 None] Create group completed successfully. Apr 30 21:43:39.741828 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-2a41f98f-3380-4764-805d-87195db2fc64 tempest-VolumesTransfersV355Test-362893825 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:43:39.782195 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-2a41f98f-3380-4764-805d-87195db2fc64 tempest-VolumesTransfersV355Test-362893825 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:43:39.820186 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-2a41f98f-3380-4764-805d-87195db2fc64 tempest-VolumesTransfersV355Test-362893825 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:43:39.825539 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-2a41f98f-3380-4764-805d-87195db2fc64 tempest-VolumesTransfersV355Test-362893825 None] Deleted volume successfully. Apr 30 21:43:39.944764 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-2a41f98f-3380-4764-805d-87195db2fc64 tempest-VolumesTransfersV355Test-362893825 None] Lock "b'cinder-5a53684e-2dcf-4df6-bb67-1f40ea2a15b5-delete_volume'" released by "delete_volume" :: held 4.757s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:43:40.769571 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab4e8f4e-80f0-46d8-8586-78947535d657 tempest-TestVolumeBackupRestore-1350104366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:43:40.790986 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-ab4e8f4e-80f0-46d8-8586-78947535d657 tempest-TestVolumeBackupRestore-1350104366 None] Flow 'volume_create_manager' (1265d8a3-26cf-4a58-ae83-274af0a56c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:43:40.798850 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-ab4e8f4e-80f0-46d8-8586-78947535d657 tempest-TestVolumeBackupRestore-1350104366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c3d509b-1a19-4205-844f-327d6c9b42ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:43:40.814955 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-ab4e8f4e-80f0-46d8-8586-78947535d657 tempest-TestVolumeBackupRestore-1350104366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c3d509b-1a19-4205-844f-327d6c9b42ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-139276487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a8eacc0e-0c7c-485f-9f60-94d4c5437298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abef47ea98c94b53836ceb8e201788f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:43:41Z,use_quota=True,user_id='34a160f829dd4dc6af9f2254653dc0b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:43:40.830534 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-ab4e8f4e-80f0-46d8-8586-78947535d657 tempest-TestVolumeBackupRestore-1350104366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be1f137b-55bf-4f11-8c9c-4ffa546cd99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:43:40.835594 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-ab4e8f4e-80f0-46d8-8586-78947535d657 tempest-TestVolumeBackupRestore-1350104366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be1f137b-55bf-4f11-8c9c-4ffa546cd99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:43:40.841893 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-ab4e8f4e-80f0-46d8-8586-78947535d657 tempest-TestVolumeBackupRestore-1350104366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5439c391-dd1f-41e3-acbe-198ea4c25797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:43:40.923777 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-ab4e8f4e-80f0-46d8-8586-78947535d657 tempest-TestVolumeBackupRestore-1350104366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5439c391-dd1f-41e3-acbe-198ea4c25797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a8eacc0e-0c7c-485f-9f60-94d4c5437298', 'volume_name': 'volume-a8eacc0e-0c7c-485f-9f60-94d4c5437298', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:43:40.930034 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-ab4e8f4e-80f0-46d8-8586-78947535d657 tempest-TestVolumeBackupRestore-1350104366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (399736f6-c72b-42dd-a2a3-430031cfc97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:43:40.934412 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-ab4e8f4e-80f0-46d8-8586-78947535d657 tempest-TestVolumeBackupRestore-1350104366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (399736f6-c72b-42dd-a2a3-430031cfc97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:43:40.939426 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-ab4e8f4e-80f0-46d8-8586-78947535d657 tempest-TestVolumeBackupRestore-1350104366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ff98cc-4ffd-4188-929e-b9421f1dc9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:43:40.940518 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-ab4e8f4e-80f0-46d8-8586-78947535d657 tempest-TestVolumeBackupRestore-1350104366 None] Volume a8eacc0e-0c7c-485f-9f60-94d4c5437298: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a8eacc0e-0c7c-485f-9f60-94d4c5437298', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 30 21:43:40.941102 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab4e8f4e-80f0-46d8-8586-78947535d657 tempest-TestVolumeBackupRestore-1350104366 None] Cloning a8eacc0e-0c7c-485f-9f60-94d4c5437298 from image a5b0850f-3b24-4bcb-b0a7-351c3216b27d at location (None, None). {{(pid=123855) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Apr 30 21:43:40.959440 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-ab4e8f4e-80f0-46d8-8586-78947535d657 tempest-TestVolumeBackupRestore-1350104366 None] Lock "b'cinder-a5b0850f-3b24-4bcb-b0a7-351c3216b27d'" acquired by "_prepare_image_cache_entry" :: waited 0.017s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:43:41.057364 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-ab4e8f4e-80f0-46d8-8586-78947535d657 tempest-TestVolumeBackupRestore-1350104366 None] Found image-volume cache entry: {'id': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'volume_id': '5772aef0-721f-450a-93ff-02cc6a41edcc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7), 'last_used': datetime.datetime(2022, 4, 30, 21, 43, 40, 964596)}. {{(pid=123855) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 30 21:43:41.057830 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-ab4e8f4e-80f0-46d8-8586-78947535d657 tempest-TestVolumeBackupRestore-1350104366 None] Image-volume cache entry image_update_at = 2022-04-30 21:01:07+00:00, requested image updated_at = 2022-04-30 21:01:07+00:00. {{(pid=123855) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 30 21:43:41.058277 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab4e8f4e-80f0-46d8-8586-78947535d657 tempest-TestVolumeBackupRestore-1350104366 None] Found cache entry for image = a5b0850f-3b24-4bcb-b0a7-351c3216b27d on host ncdv-master-1@ceph#ceph. {{(pid=123855) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Apr 30 21:43:41.062748 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-ab4e8f4e-80f0-46d8-8586-78947535d657 tempest-TestVolumeBackupRestore-1350104366 None] Lock "b'cinder-a5b0850f-3b24-4bcb-b0a7-351c3216b27d'" released by "_prepare_image_cache_entry" :: held 0.104s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:43:41.063688 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab4e8f4e-80f0-46d8-8586-78947535d657 tempest-TestVolumeBackupRestore-1350104366 None] Attempting to retrieve cache entry for image = a5b0850f-3b24-4bcb-b0a7-351c3216b27d on host ncdv-master-1@ceph#ceph. {{(pid=123855) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Apr 30 21:43:41.070271 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-ab4e8f4e-80f0-46d8-8586-78947535d657 tempest-TestVolumeBackupRestore-1350104366 None] Found image-volume cache entry: {'id': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'volume_id': '5772aef0-721f-450a-93ff-02cc6a41edcc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7), 'last_used': datetime.datetime(2022, 4, 30, 21, 43, 41, 67160)}. {{(pid=123855) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 30 21:43:41.070271 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-ab4e8f4e-80f0-46d8-8586-78947535d657 tempest-TestVolumeBackupRestore-1350104366 None] Image-volume cache entry image_update_at = 2022-04-30 21:01:07+00:00, requested image updated_at = 2022-04-30 21:01:07+00:00. {{(pid=123855) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 30 21:43:41.070271 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab4e8f4e-80f0-46d8-8586-78947535d657 tempest-TestVolumeBackupRestore-1350104366 None] Creating from source image-volume 5772aef0-721f-450a-93ff-02cc6a41edcc {{(pid=123855) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Apr 30 21:43:41.081998 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ab4e8f4e-80f0-46d8-8586-78947535d657 tempest-TestVolumeBackupRestore-1350104366 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:43:41.388236 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ab4e8f4e-80f0-46d8-8586-78947535d657 tempest-TestVolumeBackupRestore-1350104366 None] creating snapshot='volume-a8eacc0e-0c7c-485f-9f60-94d4c5437298.clone_snap' {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} Apr 30 21:43:43.157580 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ab4e8f4e-80f0-46d8-8586-78947535d657 tempest-TestVolumeBackupRestore-1350104366 None] cloning 'volume-5772aef0-721f-450a-93ff-02cc6a41edcc@volume-a8eacc0e-0c7c-485f-9f60-94d4c5437298.clone_snap' to 'volume-a8eacc0e-0c7c-485f-9f60-94d4c5437298' {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} Apr 30 21:43:43.277050 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-efad32a5-b470-4905-8f6a-bad95980593d tempest-VolumesTransfersV355Test-1916059063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:43:43.296950 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-efad32a5-b470-4905-8f6a-bad95980593d tempest-VolumesTransfersV355Test-1916059063 None] Flow 'volume_create_manager' (63b5a95c-0204-4909-9b9c-e8e3c736912a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:43:43.303469 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-efad32a5-b470-4905-8f6a-bad95980593d tempest-VolumesTransfersV355Test-1916059063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51ae2616-6371-4835-b3b3-22438e7782e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:43:43.311927 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-73dcb519-1352-44ee-b31d-d52abc6a8a77 tempest-GroupSnapshotsV319Test-434388681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:43:43.331361 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-73dcb519-1352-44ee-b31d-d52abc6a8a77 tempest-GroupSnapshotsV319Test-434388681 None] Flow 'volume_create_manager' (c76d3e6a-b7c2-4ad3-8bc8-87c179af9721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:43:43.338014 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-73dcb519-1352-44ee-b31d-d52abc6a8a77 tempest-GroupSnapshotsV319Test-434388681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd08fc4c-a342-432a-aca7-9161c2f8abb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:43:43.353461 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-efad32a5-b470-4905-8f6a-bad95980593d tempest-VolumesTransfersV355Test-1916059063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51ae2616-6371-4835-b3b3-22438e7782e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1734630770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=664511c5-1ae1-4e4d-8560-ac1fc3e2f426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='786a3b8d82e44b2ca6ff802cf02c28c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:43:41Z,use_quota=True,user_id='d25e8bbbe40f40d689a1e4ab5c9c452e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:43:43.358949 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-efad32a5-b470-4905-8f6a-bad95980593d tempest-VolumesTransfersV355Test-1916059063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a85c5e1-d44f-44ac-8d4c-4a24e5a687bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:43:43.363164 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-efad32a5-b470-4905-8f6a-bad95980593d tempest-VolumesTransfersV355Test-1916059063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a85c5e1-d44f-44ac-8d4c-4a24e5a687bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:43:43.369031 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-efad32a5-b470-4905-8f6a-bad95980593d tempest-VolumesTransfersV355Test-1916059063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ff78b8c-426e-494a-9c72-44a4b9cc078a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:43:43.373172 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-efad32a5-b470-4905-8f6a-bad95980593d tempest-VolumesTransfersV355Test-1916059063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ff78b8c-426e-494a-9c72-44a4b9cc078a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '664511c5-1ae1-4e4d-8560-ac1fc3e2f426', 'volume_name': 'volume-664511c5-1ae1-4e4d-8560-ac1fc3e2f426', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:43:43.378079 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-efad32a5-b470-4905-8f6a-bad95980593d tempest-VolumesTransfersV355Test-1916059063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d6e187b-3017-42f2-855f-4970fb3dd226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:43:43.382003 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-efad32a5-b470-4905-8f6a-bad95980593d tempest-VolumesTransfersV355Test-1916059063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d6e187b-3017-42f2-855f-4970fb3dd226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:43:43.386749 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-efad32a5-b470-4905-8f6a-bad95980593d tempest-VolumesTransfersV355Test-1916059063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca9282d9-01a1-458d-ae81-4e268f2ab3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:43:43.387855 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-efad32a5-b470-4905-8f6a-bad95980593d tempest-VolumesTransfersV355Test-1916059063 None] Volume 664511c5-1ae1-4e4d-8560-ac1fc3e2f426: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-664511c5-1ae1-4e4d-8560-ac1fc3e2f426', 'volume_size': 1} Apr 30 21:43:43.388289 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-efad32a5-b470-4905-8f6a-bad95980593d tempest-VolumesTransfersV355Test-1916059063 None] creating volume 'volume-664511c5-1ae1-4e4d-8560-ac1fc3e2f426' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:43:43.389295 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-efad32a5-b470-4905-8f6a-bad95980593d tempest-VolumesTransfersV355Test-1916059063 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:43:43.433599 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-73dcb519-1352-44ee-b31d-d52abc6a8a77 tempest-GroupSnapshotsV319Test-434388681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd08fc4c-a342-432a-aca7-9161c2f8abb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsV319Test-Volume-1757349259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=977f2a30-357c-493d-a24c-930aab89030f,host='ncdv-master-1@ceph#ceph',id=7034067d-b14d-4ee2-8c2d-071d0bc1f251,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d059f828e0d4a2fbfed837f74f3ecdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:43:41Z,use_quota=True,user_id='bf629beb150b45d2a0075c053261c7f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6881f8a-2bd9-4337-86d9-63fc8db0959c),volume_type_id=b6881f8a-2bd9-4337-86d9-63fc8db0959c)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:43:43.439610 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-73dcb519-1352-44ee-b31d-d52abc6a8a77 tempest-GroupSnapshotsV319Test-434388681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9963e8fc-3dac-4fba-8c14-8dca329fc2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:43:43.443731 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-73dcb519-1352-44ee-b31d-d52abc6a8a77 tempest-GroupSnapshotsV319Test-434388681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9963e8fc-3dac-4fba-8c14-8dca329fc2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:43:43.449080 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-73dcb519-1352-44ee-b31d-d52abc6a8a77 tempest-GroupSnapshotsV319Test-434388681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c43d04-f681-43db-a530-c45e922c2ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:43:43.457981 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-73dcb519-1352-44ee-b31d-d52abc6a8a77 tempest-GroupSnapshotsV319Test-434388681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c43d04-f681-43db-a530-c45e922c2ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7034067d-b14d-4ee2-8c2d-071d0bc1f251', 'volume_name': 'volume-7034067d-b14d-4ee2-8c2d-071d0bc1f251', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:43:43.463323 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-73dcb519-1352-44ee-b31d-d52abc6a8a77 tempest-GroupSnapshotsV319Test-434388681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (807c5586-3d88-4501-a813-92defb3cad2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:43:43.467647 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-73dcb519-1352-44ee-b31d-d52abc6a8a77 tempest-GroupSnapshotsV319Test-434388681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (807c5586-3d88-4501-a813-92defb3cad2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:43:43.472684 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-73dcb519-1352-44ee-b31d-d52abc6a8a77 tempest-GroupSnapshotsV319Test-434388681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c637e43-d420-454d-8270-0927f3148e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:43:43.473850 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-73dcb519-1352-44ee-b31d-d52abc6a8a77 tempest-GroupSnapshotsV319Test-434388681 None] Volume 7034067d-b14d-4ee2-8c2d-071d0bc1f251: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7034067d-b14d-4ee2-8c2d-071d0bc1f251', 'volume_size': 1} Apr 30 21:43:43.474250 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-73dcb519-1352-44ee-b31d-d52abc6a8a77 tempest-GroupSnapshotsV319Test-434388681 None] creating volume 'volume-7034067d-b14d-4ee2-8c2d-071d0bc1f251' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:43:43.474919 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-73dcb519-1352-44ee-b31d-d52abc6a8a77 tempest-GroupSnapshotsV319Test-434388681 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:43:44.364819 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-efad32a5-b470-4905-8f6a-bad95980593d tempest-VolumesTransfersV355Test-1916059063 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:43:44.365440 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-efad32a5-b470-4905-8f6a-bad95980593d tempest-VolumesTransfersV355Test-1916059063 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:43:44.368926 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-efad32a5-b470-4905-8f6a-bad95980593d tempest-VolumesTransfersV355Test-1916059063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca9282d9-01a1-458d-ae81-4e268f2ab3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-664511c5-1ae1-4e4d-8560-ac1fc3e2f426', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:43:44.373474 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-efad32a5-b470-4905-8f6a-bad95980593d tempest-VolumesTransfersV355Test-1916059063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (594d1b9c-4f96-4442-ac4e-64d931d39b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:43:44.440047 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-efad32a5-b470-4905-8f6a-bad95980593d tempest-VolumesTransfersV355Test-1916059063 None] Volume volume-664511c5-1ae1-4e4d-8560-ac1fc3e2f426 (664511c5-1ae1-4e4d-8560-ac1fc3e2f426): created successfully Apr 30 21:43:44.444609 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-efad32a5-b470-4905-8f6a-bad95980593d tempest-VolumesTransfersV355Test-1916059063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (594d1b9c-4f96-4442-ac4e-64d931d39b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:43:44.451104 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-efad32a5-b470-4905-8f6a-bad95980593d tempest-VolumesTransfersV355Test-1916059063 None] Flow 'volume_create_manager' (63b5a95c-0204-4909-9b9c-e8e3c736912a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:43:44.531354 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-efad32a5-b470-4905-8f6a-bad95980593d tempest-VolumesTransfersV355Test-1916059063 None] Created volume successfully. Apr 30 21:43:44.585497 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-73dcb519-1352-44ee-b31d-d52abc6a8a77 tempest-GroupSnapshotsV319Test-434388681 None] extra_specs: {} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:43:44.585933 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-73dcb519-1352-44ee-b31d-d52abc6a8a77 tempest-GroupSnapshotsV319Test-434388681 None] extra_specs: {} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:43:44.589798 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-73dcb519-1352-44ee-b31d-d52abc6a8a77 tempest-GroupSnapshotsV319Test-434388681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c637e43-d420-454d-8270-0927f3148e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7034067d-b14d-4ee2-8c2d-071d0bc1f251', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:43:44.594501 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-73dcb519-1352-44ee-b31d-d52abc6a8a77 tempest-GroupSnapshotsV319Test-434388681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75fccd51-19f5-407b-8ab4-8f9286215e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:43:44.685974 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-73dcb519-1352-44ee-b31d-d52abc6a8a77 tempest-GroupSnapshotsV319Test-434388681 None] Volume volume-7034067d-b14d-4ee2-8c2d-071d0bc1f251 (7034067d-b14d-4ee2-8c2d-071d0bc1f251): created successfully Apr 30 21:43:44.689808 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-73dcb519-1352-44ee-b31d-d52abc6a8a77 tempest-GroupSnapshotsV319Test-434388681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75fccd51-19f5-407b-8ab4-8f9286215e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:43:44.698127 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-73dcb519-1352-44ee-b31d-d52abc6a8a77 tempest-GroupSnapshotsV319Test-434388681 None] Flow 'volume_create_manager' (c76d3e6a-b7c2-4ad3-8bc8-87c179af9721) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:43:44.794946 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-73dcb519-1352-44ee-b31d-d52abc6a8a77 tempest-GroupSnapshotsV319Test-434388681 None] Created volume successfully. Apr 30 21:43:44.946816 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ab4e8f4e-80f0-46d8-8586-78947535d657 tempest-TestVolumeBackupRestore-1350104366 None] Volume volume-632a7810-1a6f-420a-a6fd-57675408a8f7.deleted is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:43:44.948112 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ab4e8f4e-80f0-46d8-8586-78947535d657 tempest-TestVolumeBackupRestore-1350104366 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:43:44.948514 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ab4e8f4e-80f0-46d8-8586-78947535d657 tempest-TestVolumeBackupRestore-1350104366 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:43:45.320955 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ab4e8f4e-80f0-46d8-8586-78947535d657 tempest-TestVolumeBackupRestore-1350104366 None] clone created successfully {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} Apr 30 21:43:45.321583 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.volume_utils [None req-ab4e8f4e-80f0-46d8-8586-78947535d657 tempest-TestVolumeBackupRestore-1350104366 None] Marking volume a8eacc0e-0c7c-485f-9f60-94d4c5437298 as bootable. {{(pid=123855) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Apr 30 21:43:45.411223 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab4e8f4e-80f0-46d8-8586-78947535d657 tempest-TestVolumeBackupRestore-1350104366 None] Copying metadata from image a5b0850f-3b24-4bcb-b0a7-351c3216b27d to a8eacc0e-0c7c-485f-9f60-94d4c5437298. {{(pid=123855) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Apr 30 21:43:45.411859 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab4e8f4e-80f0-46d8-8586-78947535d657 tempest-TestVolumeBackupRestore-1350104366 None] Creating volume glance metadata for volume a8eacc0e-0c7c-485f-9f60-94d4c5437298 backed by image a5b0850f-3b24-4bcb-b0a7-351c3216b27d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123855) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Apr 30 21:43:45.531523 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-ab4e8f4e-80f0-46d8-8586-78947535d657 tempest-TestVolumeBackupRestore-1350104366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ff98cc-4ffd-4188-929e-b9421f1dc9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8eacc0e-0c7c-485f-9f60-94d4c5437298', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:43:45.536146 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-ab4e8f4e-80f0-46d8-8586-78947535d657 tempest-TestVolumeBackupRestore-1350104366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (810fe28d-8a48-450b-822f-ff63b05e2116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:43:45.605853 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-ab4e8f4e-80f0-46d8-8586-78947535d657 tempest-TestVolumeBackupRestore-1350104366 None] Volume volume-a8eacc0e-0c7c-485f-9f60-94d4c5437298 (a8eacc0e-0c7c-485f-9f60-94d4c5437298): created successfully Apr 30 21:43:45.609561 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-ab4e8f4e-80f0-46d8-8586-78947535d657 tempest-TestVolumeBackupRestore-1350104366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (810fe28d-8a48-450b-822f-ff63b05e2116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:43:45.615481 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-ab4e8f4e-80f0-46d8-8586-78947535d657 tempest-TestVolumeBackupRestore-1350104366 None] Flow 'volume_create_manager' (1265d8a3-26cf-4a58-ae83-274af0a56c65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:43:45.682785 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-ab4e8f4e-80f0-46d8-8586-78947535d657 tempest-TestVolumeBackupRestore-1350104366 None] Created volume successfully. Apr 30 21:43:46.069396 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-3d38cec1-9177-4c0c-af47-1751a3d8cc0b tempest-GroupSnapshotsV319Test-434388681 None] GroupSnapshot f66eaae8-7dd4-450c-bfed-e524baad2d0d: creating. Apr 30 21:43:46.091149 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-3d38cec1-9177-4c0c-af47-1751a3d8cc0b tempest-GroupSnapshotsV319Test-434388681 None] Group snapshot f66eaae8-7dd4-450c-bfed-e524baad2d0d: creating. {{(pid=123855) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} Apr 30 21:43:46.107270 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-3d38cec1-9177-4c0c-af47-1751a3d8cc0b tempest-GroupSnapshotsV319Test-434388681 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:43:46.435659 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-fb9b3bd3-02dc-402e-a85a-ba198ce7f0ff tempest-VolumesTransfersV355Test-362893825 None] Lock "b'cinder-664511c5-1ae1-4e4d-8560-ac1fc3e2f426-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:43:46.557254 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-fb9b3bd3-02dc-402e-a85a-ba198ce7f0ff tempest-VolumesTransfersV355Test-362893825 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:43:46.736874 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-fb9b3bd3-02dc-402e-a85a-ba198ce7f0ff tempest-VolumesTransfersV355Test-362893825 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:43:46.737377 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-fb9b3bd3-02dc-402e-a85a-ba198ce7f0ff tempest-VolumesTransfersV355Test-362893825 None] Volume volume-664511c5-1ae1-4e4d-8560-ac1fc3e2f426 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:43:46.828539 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-fb9b3bd3-02dc-402e-a85a-ba198ce7f0ff tempest-VolumesTransfersV355Test-362893825 None] deleting rbd volume volume-664511c5-1ae1-4e4d-8560-ac1fc3e2f426 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:43:46.903152 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-24051de4-bb31-4a83-8768-86456186002b tempest-TestVolumeBackupRestore-1350104366 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-04-30T21:43:46Z,data_timestamp=2022-04-30T21:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name=None,encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=285112b3-871b-47e2-8f33-c2eb524ef9c8,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='abef47ea98c94b53836ceb8e201788f7',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='34a160f829dd4dc6af9f2254653dc0b8',volume_id=a8eacc0e-0c7c-485f-9f60-94d4c5437298) Apr 30 21:43:46.903810 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.backup.rpcapi [None req-24051de4-bb31-4a83-8768-86456186002b tempest-TestVolumeBackupRestore-1350104366 None] continue_backup in rpcapi backup_id 285112b3-871b-47e2-8f33-c2eb524ef9c8 {{(pid=123855) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Apr 30 21:43:47.008733 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [None req-24051de4-bb31-4a83-8768-86456186002b tempest-TestVolumeBackupRestore-1350104366 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:43:47.630581 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [None req-24051de4-bb31-4a83-8768-86456186002b tempest-TestVolumeBackupRestore-1350104366 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.621s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:43:47.631624 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-24051de4-bb31-4a83-8768-86456186002b tempest-TestVolumeBackupRestore-1350104366 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a8eacc0e-0c7c-485f-9f60-94d4c5437298', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': 'a8eacc0e-0c7c-485f-9f60-94d4c5437298', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:43:47.646670 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-24051de4-bb31-4a83-8768-86456186002b tempest-TestVolumeBackupRestore-1350104366 None] Initialize volume connection completed successfully. Apr 30 21:43:50.120625 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-3d38cec1-9177-4c0c-af47-1751a3d8cc0b tempest-GroupSnapshotsV319Test-434388681 None] group_snapshot f66eaae8-7dd4-450c-bfed-e524baad2d0d: created successfully Apr 30 21:43:50.990986 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-75bb829a-d197-4b44-8491-59741a12797a tempest-GroupSnapshotsV319Test-434388681 None] group_snapshot f66eaae8-7dd4-450c-bfed-e524baad2d0d: deleting Apr 30 21:43:51.007660 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-75bb829a-d197-4b44-8491-59741a12797a tempest-GroupSnapshotsV319Test-434388681 None] group_snapshot f66eaae8-7dd4-450c-bfed-e524baad2d0d: deleting {{(pid=123855) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} Apr 30 21:43:51.024077 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-75bb829a-d197-4b44-8491-59741a12797a tempest-GroupSnapshotsV319Test-434388681 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:43:52.206131 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-fb9b3bd3-02dc-402e-a85a-ba198ce7f0ff tempest-VolumesTransfersV355Test-362893825 None] Created reservations ['1886dfab-dd44-46ba-9072-7e09737aef27', 'f59cc37d-3397-4864-96b1-256a00c8bc31', 'b5006db9-d12c-46ee-bf08-af5742899549', '65bb4b8e-96d4-46f7-ac60-a0d32d1bb3c9'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:43:52.423342 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-fb9b3bd3-02dc-402e-a85a-ba198ce7f0ff tempest-VolumesTransfersV355Test-362893825 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:43:52.444009 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-fb9b3bd3-02dc-402e-a85a-ba198ce7f0ff tempest-VolumesTransfersV355Test-362893825 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:43:52.467388 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-fb9b3bd3-02dc-402e-a85a-ba198ce7f0ff tempest-VolumesTransfersV355Test-362893825 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:43:52.471543 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-fb9b3bd3-02dc-402e-a85a-ba198ce7f0ff tempest-VolumesTransfersV355Test-362893825 None] Deleted volume successfully. Apr 30 21:43:52.528507 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-fb9b3bd3-02dc-402e-a85a-ba198ce7f0ff tempest-VolumesTransfersV355Test-362893825 None] Lock "b'cinder-664511c5-1ae1-4e4d-8560-ac1fc3e2f426-delete_volume'" released by "delete_volume" :: held 6.093s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:43:56.399262 ncdv-master-1 cinder-volume[123855]: WARNING cinder.quota [None req-75bb829a-d197-4b44-8491-59741a12797a tempest-GroupSnapshotsV319Test-434388681 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-220582173 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-220582173, it is now deprecated. Please use the default quota class for default quota. Apr 30 21:43:56.400061 ncdv-master-1 cinder-volume[123855]: WARNING cinder.quota [None req-75bb829a-d197-4b44-8491-59741a12797a tempest-GroupSnapshotsV319Test-434388681 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-220582173 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-220582173, it is now deprecated. Please use the default quota class for default quota. Apr 30 21:43:56.522930 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-75bb829a-d197-4b44-8491-59741a12797a tempest-GroupSnapshotsV319Test-434388681 None] Created reservations ['ed6b5b38-4f48-46da-9029-633a1f4e615c', '792cda98-60e3-4dce-b8cc-94ca30a3465f', '78bb15b1-a4c1-4e2e-ae7b-6f747bcd082b', 'a1b829c6-765d-4462-bd87-478c9205dac8'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:43:56.805530 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-75bb829a-d197-4b44-8491-59741a12797a tempest-GroupSnapshotsV319Test-434388681 None] group_snapshot f66eaae8-7dd4-450c-bfed-e524baad2d0d: deleted successfully Apr 30 21:43:57.711270 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-3a9e725e-bcf6-4d89-b60e-37cd85490f9c tempest-GroupSnapshotsV319Test-434388681 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:43:58.031851 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-3a9e725e-bcf6-4d89-b60e-37cd85490f9c tempest-GroupSnapshotsV319Test-434388681 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:43:58.032360 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-3a9e725e-bcf6-4d89-b60e-37cd85490f9c tempest-GroupSnapshotsV319Test-434388681 None] Volume volume-7034067d-b14d-4ee2-8c2d-071d0bc1f251 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:43:58.366599 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-3a9e725e-bcf6-4d89-b60e-37cd85490f9c tempest-GroupSnapshotsV319Test-434388681 None] deleting rbd volume volume-7034067d-b14d-4ee2-8c2d-071d0bc1f251 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:43:59.707478 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-756e747a-ca3e-4879-9398-a968b9294356 tempest-VolumesSnapshotTestJSON-954528396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:43:59.726594 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-756e747a-ca3e-4879-9398-a968b9294356 tempest-VolumesSnapshotTestJSON-954528396 None] Flow 'volume_create_manager' (62becf92-6179-4a8c-9b82-56808ebe4ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:43:59.733021 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-756e747a-ca3e-4879-9398-a968b9294356 tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49ad8f00-607b-4388-abb2-7977186d3158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:43:59.749881 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-756e747a-ca3e-4879-9398-a968b9294356 tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49ad8f00-607b-4388-abb2-7977186d3158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2084297836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9ef7b859-1b98-4726-ad7b-39ae6a4c5bcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1febcefe29f461ea37667520a278022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:44:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:44:00Z,use_quota=True,user_id='0ed9fb1a529f4247acd72a6de21ceb4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:43:59.755217 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-756e747a-ca3e-4879-9398-a968b9294356 tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ae01548-cac2-4328-b3d5-237e52f1f1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:43:59.759336 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-756e747a-ca3e-4879-9398-a968b9294356 tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ae01548-cac2-4328-b3d5-237e52f1f1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:43:59.765067 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-756e747a-ca3e-4879-9398-a968b9294356 tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf491ee-a16c-4e40-9698-2e583c205f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:43:59.769120 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-756e747a-ca3e-4879-9398-a968b9294356 tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf491ee-a16c-4e40-9698-2e583c205f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ef7b859-1b98-4726-ad7b-39ae6a4c5bcb', 'volume_name': 'volume-9ef7b859-1b98-4726-ad7b-39ae6a4c5bcb', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:43:59.774002 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-756e747a-ca3e-4879-9398-a968b9294356 tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d775f7bd-cf30-437d-97cd-a9c365c94ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:43:59.778164 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-756e747a-ca3e-4879-9398-a968b9294356 tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d775f7bd-cf30-437d-97cd-a9c365c94ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:43:59.782846 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-756e747a-ca3e-4879-9398-a968b9294356 tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b78d62bc-57a2-4465-931a-5874cab5f9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:43:59.786619 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-756e747a-ca3e-4879-9398-a968b9294356 tempest-VolumesSnapshotTestJSON-954528396 None] Volume 9ef7b859-1b98-4726-ad7b-39ae6a4c5bcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ef7b859-1b98-4726-ad7b-39ae6a4c5bcb', 'volume_size': 1} Apr 30 21:43:59.786619 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-756e747a-ca3e-4879-9398-a968b9294356 tempest-VolumesSnapshotTestJSON-954528396 None] creating volume 'volume-9ef7b859-1b98-4726-ad7b-39ae6a4c5bcb' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:43:59.786619 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-756e747a-ca3e-4879-9398-a968b9294356 tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:44:00.971393 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-756e747a-ca3e-4879-9398-a968b9294356 tempest-VolumesSnapshotTestJSON-954528396 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:44:00.971997 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-756e747a-ca3e-4879-9398-a968b9294356 tempest-VolumesSnapshotTestJSON-954528396 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:44:00.975497 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-756e747a-ca3e-4879-9398-a968b9294356 tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b78d62bc-57a2-4465-931a-5874cab5f9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ef7b859-1b98-4726-ad7b-39ae6a4c5bcb', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:44:00.980782 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-756e747a-ca3e-4879-9398-a968b9294356 tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00d4251a-11c5-4f88-b2fb-eb1b040b20b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:44:01.065678 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-756e747a-ca3e-4879-9398-a968b9294356 tempest-VolumesSnapshotTestJSON-954528396 None] Volume volume-9ef7b859-1b98-4726-ad7b-39ae6a4c5bcb (9ef7b859-1b98-4726-ad7b-39ae6a4c5bcb): created successfully Apr 30 21:44:01.069371 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-756e747a-ca3e-4879-9398-a968b9294356 tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00d4251a-11c5-4f88-b2fb-eb1b040b20b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:44:01.075746 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-756e747a-ca3e-4879-9398-a968b9294356 tempest-VolumesSnapshotTestJSON-954528396 None] Flow 'volume_create_manager' (62becf92-6179-4a8c-9b82-56808ebe4ffa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:44:01.145810 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-756e747a-ca3e-4879-9398-a968b9294356 tempest-VolumesSnapshotTestJSON-954528396 None] Created volume successfully. Apr 30 21:44:02.137020 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-14da374a-c8d9-4e69-8f7b-b6281670af83 tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:44:08.348558 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-14da374a-c8d9-4e69-8f7b-b6281670af83 tempest-VolumesSnapshotTestJSON-954528396 None] Create snapshot completed successfully Apr 30 21:44:10.030922 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.driver [None req-43c73ba4-e234-4cae-a59c-f6b506e433e0 tempest-VolumesSnapshotTestJSON-954528396 None] Creating a new backup for volume volume-9ef7b859-1b98-4726-ad7b-39ae6a4c5bcb. {{(pid=123855) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1213}} Apr 30 21:44:10.121820 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-43c73ba4-e234-4cae-a59c-f6b506e433e0 tempest-VolumesSnapshotTestJSON-954528396 None] cloning volumes/volume-9ef7b859-1b98-4726-ad7b-39ae6a4c5bcb@snapshot-ec2413ff-cb82-413a-a348-da9cd71a0085 to volume-2ed44434-d716-48bc-b6b2-f86e55fec9d5 {{(pid=123855) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1091}} Apr 30 21:44:10.121820 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-43c73ba4-e234-4cae-a59c-f6b506e433e0 tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:44:10.486383 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-43c73ba4-e234-4cae-a59c-f6b506e433e0 tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:44:11.771604 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-3a9e725e-bcf6-4d89-b60e-37cd85490f9c tempest-GroupSnapshotsV319Test-434388681 None] Created reservations ['97a2fdb9-49b1-4bb7-ad5e-fa40a861ec31'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:44:11.789711 ncdv-master-1 cinder-volume[123855]: WARNING cinder.quota [None req-3a9e725e-bcf6-4d89-b60e-37cd85490f9c tempest-GroupSnapshotsV319Test-434388681 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-220582173 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-220582173, it is now deprecated. Please use the default quota class for default quota. Apr 30 21:44:11.877282 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-3a9e725e-bcf6-4d89-b60e-37cd85490f9c tempest-GroupSnapshotsV319Test-434388681 None] Created reservations ['c5afe901-bb26-4194-8926-8564cb43dae0', '52f672a1-e257-48b8-b7b0-671cf008710c', '6c63adb4-a229-4e6e-936a-9853a7eb8266', '52ec86d2-4f69-4501-9d7b-b420ec677887'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:44:12.270064 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-3a9e725e-bcf6-4d89-b60e-37cd85490f9c tempest-GroupSnapshotsV319Test-434388681 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:44:12.293666 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-3a9e725e-bcf6-4d89-b60e-37cd85490f9c tempest-GroupSnapshotsV319Test-434388681 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:44:12.317013 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-3a9e725e-bcf6-4d89-b60e-37cd85490f9c tempest-GroupSnapshotsV319Test-434388681 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:44:12.321138 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-3a9e725e-bcf6-4d89-b60e-37cd85490f9c tempest-GroupSnapshotsV319Test-434388681 None] Delete group completed successfully. Apr 30 21:44:13.370812 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-43c73ba4-e234-4cae-a59c-f6b506e433e0 tempest-VolumesSnapshotTestJSON-954528396 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:44:13.371626 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-43c73ba4-e234-4cae-a59c-f6b506e433e0 tempest-VolumesSnapshotTestJSON-954528396 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:44:13.557907 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-43c73ba4-e234-4cae-a59c-f6b506e433e0 tempest-VolumesSnapshotTestJSON-954528396 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-04-30T21:44:09Z,data_timestamp=2022-04-30T21:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Backup-1248633956',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=8548cec6-f453-475a-8e75-d8111ebf086a,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='d1febcefe29f461ea37667520a278022',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id='ec2413ff-cb82-413a-a348-da9cd71a0085',status='creating',temp_snapshot_id=None,temp_volume_id='2ed44434-d716-48bc-b6b2-f86e55fec9d5',updated_at=None,user_id='0ed9fb1a529f4247acd72a6de21ceb4c',volume_id=9ef7b859-1b98-4726-ad7b-39ae6a4c5bcb) Apr 30 21:44:13.559171 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.backup.rpcapi [None req-43c73ba4-e234-4cae-a59c-f6b506e433e0 tempest-VolumesSnapshotTestJSON-954528396 None] continue_backup in rpcapi backup_id 8548cec6-f453-475a-8e75-d8111ebf086a {{(pid=123855) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Apr 30 21:44:13.698095 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [None req-43c73ba4-e234-4cae-a59c-f6b506e433e0 tempest-VolumesSnapshotTestJSON-954528396 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:44:14.394273 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [None req-43c73ba4-e234-4cae-a59c-f6b506e433e0 tempest-VolumesSnapshotTestJSON-954528396 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.696s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:44:14.395453 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-43c73ba4-e234-4cae-a59c-f6b506e433e0 tempest-VolumesSnapshotTestJSON-954528396 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2ed44434-d716-48bc-b6b2-f86e55fec9d5', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': '2ed44434-d716-48bc-b6b2-f86e55fec9d5', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:44:14.410901 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-43c73ba4-e234-4cae-a59c-f6b506e433e0 tempest-VolumesSnapshotTestJSON-954528396 None] Initialize volume connection completed successfully. Apr 30 21:44:19.008084 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-eca57414-d346-4b92-898b-ae07db519d5d tempest-VolumeTypesAccessTest-1462643246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:44:19.029194 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-eca57414-d346-4b92-898b-ae07db519d5d tempest-VolumeTypesAccessTest-1462643246 None] Flow 'volume_create_manager' (c4edc122-ce57-4d12-af31-99573faf6afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:44:19.035744 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-eca57414-d346-4b92-898b-ae07db519d5d tempest-VolumeTypesAccessTest-1462643246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dd46ae5-740f-4579-a743-5af2d5118548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:44:19.051263 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-eca57414-d346-4b92-898b-ae07db519d5d tempest-VolumeTypesAccessTest-1462643246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dd46ae5-740f-4579-a743-5af2d5118548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-423937371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b5c37436-7cb7-4239-877d-b8156d76976a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a08f7eeff594200b8cf2a49affb2b70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:44:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:44:19Z,use_quota=True,user_id='e78f0279911c43fea0076117836fa82d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cbcc578-396f-42ab-92f2-793c0520156b),volume_type_id=0cbcc578-396f-42ab-92f2-793c0520156b)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:44:19.056569 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-eca57414-d346-4b92-898b-ae07db519d5d tempest-VolumeTypesAccessTest-1462643246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f9164d9-8341-49a9-839e-0b7d9afc90fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:44:19.060657 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-eca57414-d346-4b92-898b-ae07db519d5d tempest-VolumeTypesAccessTest-1462643246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f9164d9-8341-49a9-839e-0b7d9afc90fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:44:19.066228 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-eca57414-d346-4b92-898b-ae07db519d5d tempest-VolumeTypesAccessTest-1462643246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ebbdb20-f184-4812-9144-7b257a3882a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:44:19.070228 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-eca57414-d346-4b92-898b-ae07db519d5d tempest-VolumeTypesAccessTest-1462643246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ebbdb20-f184-4812-9144-7b257a3882a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5c37436-7cb7-4239-877d-b8156d76976a', 'volume_name': 'volume-b5c37436-7cb7-4239-877d-b8156d76976a', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:44:19.075068 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-eca57414-d346-4b92-898b-ae07db519d5d tempest-VolumeTypesAccessTest-1462643246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10d165a5-047f-407f-b966-0c8d67363f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:44:19.079765 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-eca57414-d346-4b92-898b-ae07db519d5d tempest-VolumeTypesAccessTest-1462643246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10d165a5-047f-407f-b966-0c8d67363f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:44:19.084491 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-eca57414-d346-4b92-898b-ae07db519d5d tempest-VolumeTypesAccessTest-1462643246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2df24fc0-f872-4a16-80c9-8d956bc41319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:44:19.085552 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-eca57414-d346-4b92-898b-ae07db519d5d tempest-VolumeTypesAccessTest-1462643246 None] Volume b5c37436-7cb7-4239-877d-b8156d76976a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5c37436-7cb7-4239-877d-b8156d76976a', 'volume_size': 1} Apr 30 21:44:19.085997 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-eca57414-d346-4b92-898b-ae07db519d5d tempest-VolumeTypesAccessTest-1462643246 None] creating volume 'volume-b5c37436-7cb7-4239-877d-b8156d76976a' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:44:19.093745 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-eca57414-d346-4b92-898b-ae07db519d5d tempest-VolumeTypesAccessTest-1462643246 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:44:22.088567 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-eca57414-d346-4b92-898b-ae07db519d5d tempest-VolumeTypesAccessTest-1462643246 None] extra_specs: {} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:44:22.089283 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-eca57414-d346-4b92-898b-ae07db519d5d tempest-VolumeTypesAccessTest-1462643246 None] extra_specs: {} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:44:22.092847 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-eca57414-d346-4b92-898b-ae07db519d5d tempest-VolumeTypesAccessTest-1462643246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2df24fc0-f872-4a16-80c9-8d956bc41319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5c37436-7cb7-4239-877d-b8156d76976a', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:44:22.097572 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-eca57414-d346-4b92-898b-ae07db519d5d tempest-VolumeTypesAccessTest-1462643246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d2da4d7-11ba-42ae-b333-8cdc3196ec9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:44:22.303387 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-eca57414-d346-4b92-898b-ae07db519d5d tempest-VolumeTypesAccessTest-1462643246 None] Volume volume-b5c37436-7cb7-4239-877d-b8156d76976a (b5c37436-7cb7-4239-877d-b8156d76976a): created successfully Apr 30 21:44:22.307169 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-eca57414-d346-4b92-898b-ae07db519d5d tempest-VolumeTypesAccessTest-1462643246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d2da4d7-11ba-42ae-b333-8cdc3196ec9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:44:22.313487 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-eca57414-d346-4b92-898b-ae07db519d5d tempest-VolumeTypesAccessTest-1462643246 None] Flow 'volume_create_manager' (c4edc122-ce57-4d12-af31-99573faf6afb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:44:22.386721 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-eca57414-d346-4b92-898b-ae07db519d5d tempest-VolumeTypesAccessTest-1462643246 None] Created volume successfully. Apr 30 21:44:24.012019 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-bea06ae4-c98f-4433-a3d2-e87d6d77fa71 tempest-VolumeTypesAccessTest-1462643246 None] Lock "b'cinder-b5c37436-7cb7-4239-877d-b8156d76976a-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:44:24.189467 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bea06ae4-c98f-4433-a3d2-e87d6d77fa71 tempest-VolumeTypesAccessTest-1462643246 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:44:25.171890 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bea06ae4-c98f-4433-a3d2-e87d6d77fa71 tempest-VolumeTypesAccessTest-1462643246 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:44:25.172472 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bea06ae4-c98f-4433-a3d2-e87d6d77fa71 tempest-VolumeTypesAccessTest-1462643246 None] Volume volume-b5c37436-7cb7-4239-877d-b8156d76976a is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:44:25.617687 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bea06ae4-c98f-4433-a3d2-e87d6d77fa71 tempest-VolumeTypesAccessTest-1462643246 None] deleting rbd volume volume-b5c37436-7cb7-4239-877d-b8156d76976a {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:44:31.337111 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:44:31.337927 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:44:31.360254 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:44:31.386014 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:44:43.281037 ncdv-master-1 cinder-volume[123855]: WARNING cinder.quota [None req-bea06ae4-c98f-4433-a3d2-e87d6d77fa71 tempest-VolumeTypesAccessTest-1462643246 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1419831615 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1419831615, it is now deprecated. Please use the default quota class for default quota. Apr 30 21:44:43.288644 ncdv-master-1 cinder-volume[123855]: WARNING cinder.quota [None req-bea06ae4-c98f-4433-a3d2-e87d6d77fa71 tempest-VolumeTypesAccessTest-1462643246 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1419831615 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1419831615, it is now deprecated. Please use the default quota class for default quota. Apr 30 21:44:43.351791 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-bea06ae4-c98f-4433-a3d2-e87d6d77fa71 tempest-VolumeTypesAccessTest-1462643246 None] Created reservations ['adc7a93b-a6c9-42fb-9423-6bd18047ffa7', 'cdf9d3c1-c0fc-4c32-917c-87f24449c023', 'b5382777-bfb7-4065-abe4-92bc6a68c0c0', 'd89b3c6b-065d-4e23-b055-06f21af43333'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:44:43.538228 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bea06ae4-c98f-4433-a3d2-e87d6d77fa71 tempest-VolumeTypesAccessTest-1462643246 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:44:43.570232 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bea06ae4-c98f-4433-a3d2-e87d6d77fa71 tempest-VolumeTypesAccessTest-1462643246 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:44:43.592935 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-bea06ae4-c98f-4433-a3d2-e87d6d77fa71 tempest-VolumeTypesAccessTest-1462643246 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:44:43.597394 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-bea06ae4-c98f-4433-a3d2-e87d6d77fa71 tempest-VolumeTypesAccessTest-1462643246 None] Deleted volume successfully. Apr 30 21:44:43.684048 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-bea06ae4-c98f-4433-a3d2-e87d6d77fa71 tempest-VolumeTypesAccessTest-1462643246 None] Lock "b'cinder-b5c37436-7cb7-4239-877d-b8156d76976a-delete_volume'" released by "delete_volume" :: held 19.672s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:44:54.547179 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-24051de4-bb31-4a83-8768-86456186002b tempest-TestVolumeBackupRestore-1350104366 None] Terminate volume connection completed successfully. Apr 30 21:44:54.563793 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-24051de4-bb31-4a83-8768-86456186002b tempest-TestVolumeBackupRestore-1350104366 None] Remove volume export completed successfully. Apr 30 21:44:55.504484 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4d17a18-f1d4-410a-b95e-f944aae690cc tempest-VolumesBackupsAdminTest-338210881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:44:55.523598 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c4d17a18-f1d4-410a-b95e-f944aae690cc tempest-VolumesBackupsAdminTest-338210881 None] Flow 'volume_create_manager' (dba318fb-53ff-4935-8bfe-7b6491a65069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:44:55.530295 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c4d17a18-f1d4-410a-b95e-f944aae690cc tempest-VolumesBackupsAdminTest-338210881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbf2a3d7-6f11-49c5-9289-581e6ce068fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:44:55.545718 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c4d17a18-f1d4-410a-b95e-f944aae690cc tempest-VolumesBackupsAdminTest-338210881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbf2a3d7-6f11-49c5-9289-581e6ce068fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:44:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-1954862019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2810f5d9-385b-4e01-91b4-33dcb61d9c2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0cfe2796f7949e0a521d95f29f0d9a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:44:55Z,use_quota=True,user_id='022bb44621924aa0bab1e519cf502a00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:44:55.551072 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c4d17a18-f1d4-410a-b95e-f944aae690cc tempest-VolumesBackupsAdminTest-338210881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbb0021f-c742-4e15-94ac-846ef6671dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:44:55.555791 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c4d17a18-f1d4-410a-b95e-f944aae690cc tempest-VolumesBackupsAdminTest-338210881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbb0021f-c742-4e15-94ac-846ef6671dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:44:55.561114 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c4d17a18-f1d4-410a-b95e-f944aae690cc tempest-VolumesBackupsAdminTest-338210881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cade43bb-b955-45a0-b78f-4141bb5bb60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:44:55.565113 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c4d17a18-f1d4-410a-b95e-f944aae690cc tempest-VolumesBackupsAdminTest-338210881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cade43bb-b955-45a0-b78f-4141bb5bb60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2810f5d9-385b-4e01-91b4-33dcb61d9c2c', 'volume_name': 'volume-2810f5d9-385b-4e01-91b4-33dcb61d9c2c', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:44:55.570013 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c4d17a18-f1d4-410a-b95e-f944aae690cc tempest-VolumesBackupsAdminTest-338210881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bca9250-962f-45d0-bcb0-76c3010b1df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:44:55.573853 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c4d17a18-f1d4-410a-b95e-f944aae690cc tempest-VolumesBackupsAdminTest-338210881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bca9250-962f-45d0-bcb0-76c3010b1df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:44:55.578522 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c4d17a18-f1d4-410a-b95e-f944aae690cc tempest-VolumesBackupsAdminTest-338210881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aa1a097-f68d-4549-94c3-42693a449928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:44:55.579583 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-c4d17a18-f1d4-410a-b95e-f944aae690cc tempest-VolumesBackupsAdminTest-338210881 None] Volume 2810f5d9-385b-4e01-91b4-33dcb61d9c2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2810f5d9-385b-4e01-91b4-33dcb61d9c2c', 'volume_size': 1} Apr 30 21:44:55.579965 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c4d17a18-f1d4-410a-b95e-f944aae690cc tempest-VolumesBackupsAdminTest-338210881 None] creating volume 'volume-2810f5d9-385b-4e01-91b4-33dcb61d9c2c' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:44:55.580750 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c4d17a18-f1d4-410a-b95e-f944aae690cc tempest-VolumesBackupsAdminTest-338210881 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:44:56.347769 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-73a13bd6-3515-49b1-aeae-dc81497a0ccc tempest-TestVolumeBackupRestore-1350104366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:44:56.366599 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-73a13bd6-3515-49b1-aeae-dc81497a0ccc tempest-TestVolumeBackupRestore-1350104366 None] Flow 'volume_create_manager' (bb0941e4-c0da-4f1c-af00-01e6cbaf8865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:44:56.372881 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-73a13bd6-3515-49b1-aeae-dc81497a0ccc tempest-TestVolumeBackupRestore-1350104366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18ad19bb-72fb-432e-acb6-157ace9e89b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:44:56.390054 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-73a13bd6-3515-49b1-aeae-dc81497a0ccc tempest-TestVolumeBackupRestore-1350104366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18ad19bb-72fb-432e-acb6-157ace9e89b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:44:56Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_285112b3-871b-47e2-8f33-c2eb524ef9c8',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=223065cf-14f3-4066-9159-1b9f16888528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abef47ea98c94b53836ceb8e201788f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:44:56Z,use_quota=True,user_id='34a160f829dd4dc6af9f2254653dc0b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:44:56.395307 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-73a13bd6-3515-49b1-aeae-dc81497a0ccc tempest-TestVolumeBackupRestore-1350104366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76ac3b9b-6323-4837-a1d2-b42202fef313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:44:56.400003 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-73a13bd6-3515-49b1-aeae-dc81497a0ccc tempest-TestVolumeBackupRestore-1350104366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76ac3b9b-6323-4837-a1d2-b42202fef313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:44:56.405256 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-73a13bd6-3515-49b1-aeae-dc81497a0ccc tempest-TestVolumeBackupRestore-1350104366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0711a648-f322-46b1-955a-0157e9ad4611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:44:56.409267 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-73a13bd6-3515-49b1-aeae-dc81497a0ccc tempest-TestVolumeBackupRestore-1350104366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0711a648-f322-46b1-955a-0157e9ad4611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '223065cf-14f3-4066-9159-1b9f16888528', 'volume_name': 'volume-223065cf-14f3-4066-9159-1b9f16888528', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:44:56.414141 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-73a13bd6-3515-49b1-aeae-dc81497a0ccc tempest-TestVolumeBackupRestore-1350104366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c606063-feee-44bd-9cc6-e6ff184459f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:44:56.417960 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-73a13bd6-3515-49b1-aeae-dc81497a0ccc tempest-TestVolumeBackupRestore-1350104366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c606063-feee-44bd-9cc6-e6ff184459f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:44:56.422556 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-73a13bd6-3515-49b1-aeae-dc81497a0ccc tempest-TestVolumeBackupRestore-1350104366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85189f55-f820-4b8b-b2ba-f1b8691af602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:44:56.423634 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-73a13bd6-3515-49b1-aeae-dc81497a0ccc tempest-TestVolumeBackupRestore-1350104366 None] Volume 223065cf-14f3-4066-9159-1b9f16888528: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-223065cf-14f3-4066-9159-1b9f16888528', 'volume_size': 1} Apr 30 21:44:56.424015 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-73a13bd6-3515-49b1-aeae-dc81497a0ccc tempest-TestVolumeBackupRestore-1350104366 None] creating volume 'volume-223065cf-14f3-4066-9159-1b9f16888528' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:44:56.424657 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-73a13bd6-3515-49b1-aeae-dc81497a0ccc tempest-TestVolumeBackupRestore-1350104366 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:44:57.623152 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c4d17a18-f1d4-410a-b95e-f944aae690cc tempest-VolumesBackupsAdminTest-338210881 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:44:57.623811 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c4d17a18-f1d4-410a-b95e-f944aae690cc tempest-VolumesBackupsAdminTest-338210881 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:44:57.627133 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c4d17a18-f1d4-410a-b95e-f944aae690cc tempest-VolumesBackupsAdminTest-338210881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aa1a097-f68d-4549-94c3-42693a449928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2810f5d9-385b-4e01-91b4-33dcb61d9c2c', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:44:57.631977 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c4d17a18-f1d4-410a-b95e-f944aae690cc tempest-VolumesBackupsAdminTest-338210881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (271be239-f0eb-46ec-ade3-4fb007b682e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:44:57.737195 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-c4d17a18-f1d4-410a-b95e-f944aae690cc tempest-VolumesBackupsAdminTest-338210881 None] Volume volume-2810f5d9-385b-4e01-91b4-33dcb61d9c2c (2810f5d9-385b-4e01-91b4-33dcb61d9c2c): created successfully Apr 30 21:44:57.740844 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c4d17a18-f1d4-410a-b95e-f944aae690cc tempest-VolumesBackupsAdminTest-338210881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (271be239-f0eb-46ec-ade3-4fb007b682e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:44:57.746944 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c4d17a18-f1d4-410a-b95e-f944aae690cc tempest-VolumesBackupsAdminTest-338210881 None] Flow 'volume_create_manager' (dba318fb-53ff-4935-8bfe-7b6491a65069) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:44:57.843447 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-c4d17a18-f1d4-410a-b95e-f944aae690cc tempest-VolumesBackupsAdminTest-338210881 None] Created volume successfully. Apr 30 21:44:57.978289 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-73a13bd6-3515-49b1-aeae-dc81497a0ccc tempest-TestVolumeBackupRestore-1350104366 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:44:57.978669 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-73a13bd6-3515-49b1-aeae-dc81497a0ccc tempest-TestVolumeBackupRestore-1350104366 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:44:57.982631 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-73a13bd6-3515-49b1-aeae-dc81497a0ccc tempest-TestVolumeBackupRestore-1350104366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85189f55-f820-4b8b-b2ba-f1b8691af602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-223065cf-14f3-4066-9159-1b9f16888528', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:44:57.987315 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-73a13bd6-3515-49b1-aeae-dc81497a0ccc tempest-TestVolumeBackupRestore-1350104366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20785f78-6545-498d-a4dd-50dbad0b3947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:44:58.091921 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-73a13bd6-3515-49b1-aeae-dc81497a0ccc tempest-TestVolumeBackupRestore-1350104366 None] Volume volume-223065cf-14f3-4066-9159-1b9f16888528 (223065cf-14f3-4066-9159-1b9f16888528): created successfully Apr 30 21:44:58.095776 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-73a13bd6-3515-49b1-aeae-dc81497a0ccc tempest-TestVolumeBackupRestore-1350104366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20785f78-6545-498d-a4dd-50dbad0b3947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:44:58.101935 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-73a13bd6-3515-49b1-aeae-dc81497a0ccc tempest-TestVolumeBackupRestore-1350104366 None] Flow 'volume_create_manager' (bb0941e4-c0da-4f1c-af00-01e6cbaf8865) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:44:58.197862 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-73a13bd6-3515-49b1-aeae-dc81497a0ccc tempest-TestVolumeBackupRestore-1350104366 None] Created volume successfully. Apr 30 21:44:59.210249 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-6b2f434e-ee93-42b4-a5fb-e601aa86796e tempest-VolumesBackupsAdminTest-338210881 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-04-30T21:44:58Z,data_timestamp=2022-04-30T21:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-930250247',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=3e51e71e-2ffa-4828-a9fc-ac25a214ec93,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='e0cfe2796f7949e0a521d95f29f0d9a2',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='022bb44621924aa0bab1e519cf502a00',volume_id=2810f5d9-385b-4e01-91b4-33dcb61d9c2c) Apr 30 21:44:59.211034 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.backup.rpcapi [None req-6b2f434e-ee93-42b4-a5fb-e601aa86796e tempest-VolumesBackupsAdminTest-338210881 None] continue_backup in rpcapi backup_id 3e51e71e-2ffa-4828-a9fc-ac25a214ec93 {{(pid=123855) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Apr 30 21:44:59.402427 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [None req-6b2f434e-ee93-42b4-a5fb-e601aa86796e tempest-VolumesBackupsAdminTest-338210881 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:44:59.434678 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [None req-73a13bd6-3515-49b1-aeae-dc81497a0ccc tempest-TestVolumeBackupRestore-1350104366 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:45:00.083406 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [None req-6b2f434e-ee93-42b4-a5fb-e601aa86796e tempest-VolumesBackupsAdminTest-338210881 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.680s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:45:00.084715 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-6b2f434e-ee93-42b4-a5fb-e601aa86796e tempest-VolumesBackupsAdminTest-338210881 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2810f5d9-385b-4e01-91b4-33dcb61d9c2c', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': '2810f5d9-385b-4e01-91b4-33dcb61d9c2c', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:45:00.090163 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [None req-73a13bd6-3515-49b1-aeae-dc81497a0ccc tempest-TestVolumeBackupRestore-1350104366 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.656s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:45:00.090722 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-73a13bd6-3515-49b1-aeae-dc81497a0ccc tempest-TestVolumeBackupRestore-1350104366 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-223065cf-14f3-4066-9159-1b9f16888528', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': '223065cf-14f3-4066-9159-1b9f16888528', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:45:00.110384 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-6b2f434e-ee93-42b4-a5fb-e601aa86796e tempest-VolumesBackupsAdminTest-338210881 None] Initialize volume connection completed successfully. Apr 30 21:45:00.112666 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-73a13bd6-3515-49b1-aeae-dc81497a0ccc tempest-TestVolumeBackupRestore-1350104366 None] Initialize volume connection completed successfully. Apr 30 21:45:26.228151 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-6b2f434e-ee93-42b4-a5fb-e601aa86796e tempest-VolumesBackupsAdminTest-338210881 None] Terminate volume connection completed successfully. Apr 30 21:45:26.244472 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-6b2f434e-ee93-42b4-a5fb-e601aa86796e tempest-VolumesBackupsAdminTest-338210881 None] Remove volume export completed successfully. Apr 30 21:45:29.502751 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3cba406-06f4-44b2-a93b-b3c037c83c05 tempest-VolumesBackupsAdminTest-338210881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:45:29.522805 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f3cba406-06f4-44b2-a93b-b3c037c83c05 tempest-VolumesBackupsAdminTest-338210881 None] Flow 'volume_create_manager' (d0ab947a-ed1f-47d5-abac-4937e886bcbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:45:29.530185 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f3cba406-06f4-44b2-a93b-b3c037c83c05 tempest-VolumesBackupsAdminTest-338210881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ad4922a-51a5-4b13-8d9c-6e71046d0164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:45:29.546226 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f3cba406-06f4-44b2-a93b-b3c037c83c05 tempest-VolumesBackupsAdminTest-338210881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ad4922a-51a5-4b13-8d9c-6e71046d0164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:45:29Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_3e51e71e-2ffa-4828-a9fc-ac25a214ec93',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8a314b0a-d670-4639-9a0d-b59fa00c9098,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0cfe2796f7949e0a521d95f29f0d9a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:45:29Z,use_quota=True,user_id='022bb44621924aa0bab1e519cf502a00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:45:29.551612 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f3cba406-06f4-44b2-a93b-b3c037c83c05 tempest-VolumesBackupsAdminTest-338210881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32940475-05eb-4806-9256-128fda6fba14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:45:29.555731 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f3cba406-06f4-44b2-a93b-b3c037c83c05 tempest-VolumesBackupsAdminTest-338210881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32940475-05eb-4806-9256-128fda6fba14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:45:29.560853 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f3cba406-06f4-44b2-a93b-b3c037c83c05 tempest-VolumesBackupsAdminTest-338210881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c5ac28e-d324-446a-bf6c-3fddcc99a5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:45:29.565006 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f3cba406-06f4-44b2-a93b-b3c037c83c05 tempest-VolumesBackupsAdminTest-338210881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c5ac28e-d324-446a-bf6c-3fddcc99a5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a314b0a-d670-4639-9a0d-b59fa00c9098', 'volume_name': 'volume-8a314b0a-d670-4639-9a0d-b59fa00c9098', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:45:29.570116 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f3cba406-06f4-44b2-a93b-b3c037c83c05 tempest-VolumesBackupsAdminTest-338210881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3aaecb9-56bb-418c-9ac0-73a8b8b4ca98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:45:29.574297 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f3cba406-06f4-44b2-a93b-b3c037c83c05 tempest-VolumesBackupsAdminTest-338210881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3aaecb9-56bb-418c-9ac0-73a8b8b4ca98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:45:29.579116 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f3cba406-06f4-44b2-a93b-b3c037c83c05 tempest-VolumesBackupsAdminTest-338210881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b6b863d-3311-4959-8e66-508d1120e898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:45:29.580209 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-f3cba406-06f4-44b2-a93b-b3c037c83c05 tempest-VolumesBackupsAdminTest-338210881 None] Volume 8a314b0a-d670-4639-9a0d-b59fa00c9098: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a314b0a-d670-4639-9a0d-b59fa00c9098', 'volume_size': 1} Apr 30 21:45:29.580615 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f3cba406-06f4-44b2-a93b-b3c037c83c05 tempest-VolumesBackupsAdminTest-338210881 None] creating volume 'volume-8a314b0a-d670-4639-9a0d-b59fa00c9098' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:45:29.581830 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f3cba406-06f4-44b2-a93b-b3c037c83c05 tempest-VolumesBackupsAdminTest-338210881 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:45:31.340959 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:45:31.341716 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:45:31.365287 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:45:31.387550 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:45:31.826945 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f3cba406-06f4-44b2-a93b-b3c037c83c05 tempest-VolumesBackupsAdminTest-338210881 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:45:31.827319 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f3cba406-06f4-44b2-a93b-b3c037c83c05 tempest-VolumesBackupsAdminTest-338210881 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:45:31.831013 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f3cba406-06f4-44b2-a93b-b3c037c83c05 tempest-VolumesBackupsAdminTest-338210881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b6b863d-3311-4959-8e66-508d1120e898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a314b0a-d670-4639-9a0d-b59fa00c9098', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:45:31.835583 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f3cba406-06f4-44b2-a93b-b3c037c83c05 tempest-VolumesBackupsAdminTest-338210881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b215ce37-9b9d-469d-8868-b2b645966e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:45:31.960023 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-f3cba406-06f4-44b2-a93b-b3c037c83c05 tempest-VolumesBackupsAdminTest-338210881 None] Volume volume-8a314b0a-d670-4639-9a0d-b59fa00c9098 (8a314b0a-d670-4639-9a0d-b59fa00c9098): created successfully Apr 30 21:45:31.963747 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f3cba406-06f4-44b2-a93b-b3c037c83c05 tempest-VolumesBackupsAdminTest-338210881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b215ce37-9b9d-469d-8868-b2b645966e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:45:31.969683 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f3cba406-06f4-44b2-a93b-b3c037c83c05 tempest-VolumesBackupsAdminTest-338210881 None] Flow 'volume_create_manager' (d0ab947a-ed1f-47d5-abac-4937e886bcbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:45:32.072301 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-f3cba406-06f4-44b2-a93b-b3c037c83c05 tempest-VolumesBackupsAdminTest-338210881 None] Created volume successfully. Apr 30 21:45:32.495993 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [None req-f3cba406-06f4-44b2-a93b-b3c037c83c05 tempest-VolumesBackupsAdminTest-338210881 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:45:33.249938 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [None req-f3cba406-06f4-44b2-a93b-b3c037c83c05 tempest-VolumesBackupsAdminTest-338210881 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.754s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:45:33.250697 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f3cba406-06f4-44b2-a93b-b3c037c83c05 tempest-VolumesBackupsAdminTest-338210881 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8a314b0a-d670-4639-9a0d-b59fa00c9098', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': '8a314b0a-d670-4639-9a0d-b59fa00c9098', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:45:33.263839 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-f3cba406-06f4-44b2-a93b-b3c037c83c05 tempest-VolumesBackupsAdminTest-338210881 None] Initialize volume connection completed successfully. Apr 30 21:45:48.686807 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-f3cba406-06f4-44b2-a93b-b3c037c83c05 tempest-VolumesBackupsAdminTest-338210881 None] Terminate volume connection completed successfully. Apr 30 21:45:48.703945 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-f3cba406-06f4-44b2-a93b-b3c037c83c05 tempest-VolumesBackupsAdminTest-338210881 None] Remove volume export completed successfully. Apr 30 21:45:50.131194 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-857d1750-872a-46b7-9441-640dee11df20 tempest-VolumesBackupsAdminTest-338210881 None] Lock "b'cinder-8a314b0a-d670-4639-9a0d-b59fa00c9098-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:45:50.295475 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-857d1750-872a-46b7-9441-640dee11df20 tempest-VolumesBackupsAdminTest-338210881 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:46:01.713316 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-857d1750-872a-46b7-9441-640dee11df20 tempest-VolumesBackupsAdminTest-338210881 None] Volume volume-8a314b0a-d670-4639-9a0d-b59fa00c9098 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:46:02.842309 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-857d1750-872a-46b7-9441-640dee11df20 tempest-VolumesBackupsAdminTest-338210881 None] deleting rbd volume volume-8a314b0a-d670-4639-9a0d-b59fa00c9098 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:46:21.851902 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-857d1750-872a-46b7-9441-640dee11df20 tempest-VolumesBackupsAdminTest-338210881 None] Created reservations ['3f534cc4-bd3e-4192-a6e7-1c1af149426c', '438a3ed7-3142-482a-bccf-260ca1f035c2', 'caade6d1-ab37-458f-a3de-00e3fb131d72', '343d6b9a-ee69-4150-9548-8005207d27e1'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:46:22.041144 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-857d1750-872a-46b7-9441-640dee11df20 tempest-VolumesBackupsAdminTest-338210881 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:46:22.063080 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-857d1750-872a-46b7-9441-640dee11df20 tempest-VolumesBackupsAdminTest-338210881 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:46:22.183611 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-857d1750-872a-46b7-9441-640dee11df20 tempest-VolumesBackupsAdminTest-338210881 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:46:22.188442 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-857d1750-872a-46b7-9441-640dee11df20 tempest-VolumesBackupsAdminTest-338210881 None] Deleted volume successfully. Apr 30 21:46:22.285444 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-857d1750-872a-46b7-9441-640dee11df20 tempest-VolumesBackupsAdminTest-338210881 None] Lock "b'cinder-8a314b0a-d670-4639-9a0d-b59fa00c9098-delete_volume'" released by "delete_volume" :: held 32.154s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:46:23.116787 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8261810-97fb-44de-8e3a-17acf8046bcc tempest-VolumesBackupsAdminTest-338210881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:46:23.136368 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d8261810-97fb-44de-8e3a-17acf8046bcc tempest-VolumesBackupsAdminTest-338210881 None] Flow 'volume_create_manager' (f5bc1607-a307-4539-ac83-a2c41628ebe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:46:23.142873 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d8261810-97fb-44de-8e3a-17acf8046bcc tempest-VolumesBackupsAdminTest-338210881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ad32f9-0174-4b88-9dd0-8b25ecda511e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:46:23.158234 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d8261810-97fb-44de-8e3a-17acf8046bcc tempest-VolumesBackupsAdminTest-338210881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ad32f9-0174-4b88-9dd0-8b25ecda511e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-1687051580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=db1274cb-b9ba-493c-9342-5b8562f70c92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0cfe2796f7949e0a521d95f29f0d9a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:46:23Z,use_quota=True,user_id='022bb44621924aa0bab1e519cf502a00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:46:23.164078 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d8261810-97fb-44de-8e3a-17acf8046bcc tempest-VolumesBackupsAdminTest-338210881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef0f03a2-7ab4-426b-aae0-fc4d4499bcf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:46:23.168166 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d8261810-97fb-44de-8e3a-17acf8046bcc tempest-VolumesBackupsAdminTest-338210881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef0f03a2-7ab4-426b-aae0-fc4d4499bcf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:46:23.173245 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d8261810-97fb-44de-8e3a-17acf8046bcc tempest-VolumesBackupsAdminTest-338210881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab4b9d5c-6798-4779-bb69-4cf51d77fc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:46:23.177973 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d8261810-97fb-44de-8e3a-17acf8046bcc tempest-VolumesBackupsAdminTest-338210881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab4b9d5c-6798-4779-bb69-4cf51d77fc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db1274cb-b9ba-493c-9342-5b8562f70c92', 'volume_name': 'volume-db1274cb-b9ba-493c-9342-5b8562f70c92', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:46:23.182841 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d8261810-97fb-44de-8e3a-17acf8046bcc tempest-VolumesBackupsAdminTest-338210881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (260dd5f1-2737-4700-b906-3dc0f5195ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:46:23.189471 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d8261810-97fb-44de-8e3a-17acf8046bcc tempest-VolumesBackupsAdminTest-338210881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (260dd5f1-2737-4700-b906-3dc0f5195ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:46:23.191424 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d8261810-97fb-44de-8e3a-17acf8046bcc tempest-VolumesBackupsAdminTest-338210881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47cb31f5-5e5a-4df2-82b1-6f19b80e91ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:46:23.192483 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-d8261810-97fb-44de-8e3a-17acf8046bcc tempest-VolumesBackupsAdminTest-338210881 None] Volume db1274cb-b9ba-493c-9342-5b8562f70c92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db1274cb-b9ba-493c-9342-5b8562f70c92', 'volume_size': 1} Apr 30 21:46:23.192868 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-d8261810-97fb-44de-8e3a-17acf8046bcc tempest-VolumesBackupsAdminTest-338210881 None] creating volume 'volume-db1274cb-b9ba-493c-9342-5b8562f70c92' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:46:23.193647 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-d8261810-97fb-44de-8e3a-17acf8046bcc tempest-VolumesBackupsAdminTest-338210881 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:46:26.096322 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-d8261810-97fb-44de-8e3a-17acf8046bcc tempest-VolumesBackupsAdminTest-338210881 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:46:26.097008 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-d8261810-97fb-44de-8e3a-17acf8046bcc tempest-VolumesBackupsAdminTest-338210881 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:46:26.101241 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d8261810-97fb-44de-8e3a-17acf8046bcc tempest-VolumesBackupsAdminTest-338210881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47cb31f5-5e5a-4df2-82b1-6f19b80e91ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db1274cb-b9ba-493c-9342-5b8562f70c92', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:46:26.105872 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d8261810-97fb-44de-8e3a-17acf8046bcc tempest-VolumesBackupsAdminTest-338210881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0c60812-4f0c-4030-841d-a1d80569263a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:46:26.188838 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-d8261810-97fb-44de-8e3a-17acf8046bcc tempest-VolumesBackupsAdminTest-338210881 None] Volume volume-db1274cb-b9ba-493c-9342-5b8562f70c92 (db1274cb-b9ba-493c-9342-5b8562f70c92): created successfully Apr 30 21:46:26.192697 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d8261810-97fb-44de-8e3a-17acf8046bcc tempest-VolumesBackupsAdminTest-338210881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0c60812-4f0c-4030-841d-a1d80569263a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:46:26.198148 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-d8261810-97fb-44de-8e3a-17acf8046bcc tempest-VolumesBackupsAdminTest-338210881 None] Flow 'volume_create_manager' (f5bc1607-a307-4539-ac83-a2c41628ebe6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:46:26.303795 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-d8261810-97fb-44de-8e3a-17acf8046bcc tempest-VolumesBackupsAdminTest-338210881 None] Created volume successfully. Apr 30 21:46:27.111166 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-73a13bd6-3515-49b1-aeae-dc81497a0ccc tempest-TestVolumeBackupRestore-1350104366 None] Terminate volume connection completed successfully. Apr 30 21:46:27.126677 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-73a13bd6-3515-49b1-aeae-dc81497a0ccc tempest-TestVolumeBackupRestore-1350104366 None] Remove volume export completed successfully. Apr 30 21:46:27.825048 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-cded7222-e04d-45af-9e7f-4f27017cf42a tempest-VolumesBackupsAdminTest-338210881 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-04-30T21:46:27Z,data_timestamp=2022-04-30T21:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-437325136',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=c4f6cb23-fcdc-4160-8a51-28765dd48d43,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='e0cfe2796f7949e0a521d95f29f0d9a2',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='022bb44621924aa0bab1e519cf502a00',volume_id=db1274cb-b9ba-493c-9342-5b8562f70c92) Apr 30 21:46:27.825812 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.backup.rpcapi [None req-cded7222-e04d-45af-9e7f-4f27017cf42a tempest-VolumesBackupsAdminTest-338210881 None] continue_backup in rpcapi backup_id c4f6cb23-fcdc-4160-8a51-28765dd48d43 {{(pid=123855) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Apr 30 21:46:27.956816 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [None req-cded7222-e04d-45af-9e7f-4f27017cf42a tempest-VolumesBackupsAdminTest-338210881 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:46:28.679052 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [None req-cded7222-e04d-45af-9e7f-4f27017cf42a tempest-VolumesBackupsAdminTest-338210881 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.722s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:46:28.680071 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-cded7222-e04d-45af-9e7f-4f27017cf42a tempest-VolumesBackupsAdminTest-338210881 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-db1274cb-b9ba-493c-9342-5b8562f70c92', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': 'db1274cb-b9ba-493c-9342-5b8562f70c92', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:46:28.695886 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-cded7222-e04d-45af-9e7f-4f27017cf42a tempest-VolumesBackupsAdminTest-338210881 None] Initialize volume connection completed successfully. Apr 30 21:46:31.344105 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:46:31.346186 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:46:32.534190 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:46:32.562726 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:46:32.969128 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-43c73ba4-e234-4cae-a59c-f6b506e433e0 tempest-VolumesSnapshotTestJSON-954528396 None] Terminate volume connection completed successfully. Apr 30 21:46:32.985159 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-43c73ba4-e234-4cae-a59c-f6b506e433e0 tempest-VolumesSnapshotTestJSON-954528396 None] Remove volume export completed successfully. Apr 30 21:46:33.032134 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-43c73ba4-e234-4cae-a59c-f6b506e433e0 tempest-VolumesSnapshotTestJSON-954528396 None] Lock "b'cinder-2ed44434-d716-48bc-b6b2-f86e55fec9d5-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:46:33.045745 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-43c73ba4-e234-4cae-a59c-f6b506e433e0 tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:46:33.346776 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-43c73ba4-e234-4cae-a59c-f6b506e433e0 tempest-VolumesSnapshotTestJSON-954528396 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:46:33.615254 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-43c73ba4-e234-4cae-a59c-f6b506e433e0 tempest-VolumesSnapshotTestJSON-954528396 None] deleting rbd volume volume-2ed44434-d716-48bc-b6b2-f86e55fec9d5 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:46:34.810296 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-59166801-7a1a-40eb-946d-17ba88adada7 req-04b819b4-f6bc-464b-aa1e-98e5119f4b5a tempest-TestVolumeBackupRestore-1350104366 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:46:35.461743 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-59166801-7a1a-40eb-946d-17ba88adada7 req-04b819b4-f6bc-464b-aa1e-98e5119f4b5a tempest-TestVolumeBackupRestore-1350104366 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.651s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:46:35.462772 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-59166801-7a1a-40eb-946d-17ba88adada7 req-04b819b4-f6bc-464b-aa1e-98e5119f4b5a tempest-TestVolumeBackupRestore-1350104366 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-223065cf-14f3-4066-9159-1b9f16888528', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': '223065cf-14f3-4066-9159-1b9f16888528', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:46:35.581948 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-59166801-7a1a-40eb-946d-17ba88adada7 req-04b819b4-f6bc-464b-aa1e-98e5119f4b5a tempest-TestVolumeBackupRestore-1350104366 None] Connection info returned from driver {'name': 'volumes/volume-223065cf-14f3-4066-9159-1b9f16888528', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '223065cf-14f3-4066-9159-1b9f16888528', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '953e1bc2-b909-4d3a-95af-26b8c469b6c3'} {{(pid=123855) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Apr 30 21:46:35.692014 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-59166801-7a1a-40eb-946d-17ba88adada7 req-04b819b4-f6bc-464b-aa1e-98e5119f4b5a tempest-TestVolumeBackupRestore-1350104366 None] attachment_update completed successfully. Apr 30 21:46:38.906739 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-cded7222-e04d-45af-9e7f-4f27017cf42a tempest-VolumesBackupsAdminTest-338210881 None] Terminate volume connection completed successfully. Apr 30 21:46:38.925201 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-cded7222-e04d-45af-9e7f-4f27017cf42a tempest-VolumesBackupsAdminTest-338210881 None] Remove volume export completed successfully. Apr 30 21:46:41.141161 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-43c73ba4-e234-4cae-a59c-f6b506e433e0 tempest-VolumesSnapshotTestJSON-954528396 None] Deleted volume successfully. Apr 30 21:46:41.145327 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-43c73ba4-e234-4cae-a59c-f6b506e433e0 tempest-VolumesSnapshotTestJSON-954528396 None] Lock "b'cinder-2ed44434-d716-48bc-b6b2-f86e55fec9d5-delete_volume'" released by "delete_volume" :: held 8.113s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:46:51.813224 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-7c040cdb-dcaa-4894-90cc-4f3a2a348cd2 tempest-VolumesBackupsAdminTest-338210881 None] Lock "b'cinder-db1274cb-b9ba-493c-9342-5b8562f70c92-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:46:51.941046 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-7c040cdb-dcaa-4894-90cc-4f3a2a348cd2 tempest-VolumesBackupsAdminTest-338210881 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:46:54.021170 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-7c040cdb-dcaa-4894-90cc-4f3a2a348cd2 tempest-VolumesBackupsAdminTest-338210881 None] Volume volume-db1274cb-b9ba-493c-9342-5b8562f70c92 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:46:54.366264 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-7c040cdb-dcaa-4894-90cc-4f3a2a348cd2 tempest-VolumesBackupsAdminTest-338210881 None] deleting rbd volume volume-db1274cb-b9ba-493c-9342-5b8562f70c92 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:46:57.645877 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-7c040cdb-dcaa-4894-90cc-4f3a2a348cd2 tempest-VolumesBackupsAdminTest-338210881 None] Created reservations ['530d5064-52b7-46f6-ba4f-96d124dcffb3', '3e4ba4c4-1d7f-4098-9d4b-dcae22b6bd5d', 'e5d4d604-54a3-4635-b758-d2f833ec23c5', '05901dc1-6c73-4e2e-a0b7-558a85e324ac'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:46:57.844946 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-7c040cdb-dcaa-4894-90cc-4f3a2a348cd2 tempest-VolumesBackupsAdminTest-338210881 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:46:57.876191 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-7c040cdb-dcaa-4894-90cc-4f3a2a348cd2 tempest-VolumesBackupsAdminTest-338210881 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:46:57.899277 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-7c040cdb-dcaa-4894-90cc-4f3a2a348cd2 tempest-VolumesBackupsAdminTest-338210881 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:46:57.903780 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-7c040cdb-dcaa-4894-90cc-4f3a2a348cd2 tempest-VolumesBackupsAdminTest-338210881 None] Deleted volume successfully. Apr 30 21:46:57.990829 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-7c040cdb-dcaa-4894-90cc-4f3a2a348cd2 tempest-VolumesBackupsAdminTest-338210881 None] Lock "b'cinder-db1274cb-b9ba-493c-9342-5b8562f70c92-delete_volume'" released by "delete_volume" :: held 6.178s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:46:58.358614 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-a4bee257-4e24-492c-a0b2-27c3659ea4c8 tempest-VolumesBackupsAdminTest-338210881 None] Lock "b'cinder-2810f5d9-385b-4e01-91b4-33dcb61d9c2c-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:46:58.457690 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a4bee257-4e24-492c-a0b2-27c3659ea4c8 tempest-VolumesBackupsAdminTest-338210881 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:47:00.906394 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a4bee257-4e24-492c-a0b2-27c3659ea4c8 tempest-VolumesBackupsAdminTest-338210881 None] Volume volume-2810f5d9-385b-4e01-91b4-33dcb61d9c2c is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:47:01.195263 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a4bee257-4e24-492c-a0b2-27c3659ea4c8 tempest-VolumesBackupsAdminTest-338210881 None] deleting rbd volume volume-2810f5d9-385b-4e01-91b4-33dcb61d9c2c {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:47:01.891201 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-e88fae22-4496-4c25-8733-aa8081180a2e tempest-VolumesSnapshotTestJSON-954528396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:47:01.912474 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e88fae22-4496-4c25-8733-aa8081180a2e tempest-VolumesSnapshotTestJSON-954528396 None] Flow 'volume_create_manager' (40d0f3ea-9ea8-48c5-b453-32a179511bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:47:01.919229 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e88fae22-4496-4c25-8733-aa8081180a2e tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b2fdd35-fe5b-47ff-886d-828f61288df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:47:01.934407 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e88fae22-4496-4c25-8733-aa8081180a2e tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b2fdd35-fe5b-47ff-886d-828f61288df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-535649119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cef2a6ba-722a-421e-a3d7-963730a1eb11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1febcefe29f461ea37667520a278022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:47:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:47:02Z,use_quota=True,user_id='0ed9fb1a529f4247acd72a6de21ceb4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:47:01.940387 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e88fae22-4496-4c25-8733-aa8081180a2e tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aca50990-86b8-42a2-b195-6d104cda79bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:47:01.944515 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e88fae22-4496-4c25-8733-aa8081180a2e tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aca50990-86b8-42a2-b195-6d104cda79bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:47:01.949632 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e88fae22-4496-4c25-8733-aa8081180a2e tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (731f375d-80ae-42f8-aa60-471495406d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:47:02.029161 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e88fae22-4496-4c25-8733-aa8081180a2e tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (731f375d-80ae-42f8-aa60-471495406d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cef2a6ba-722a-421e-a3d7-963730a1eb11', 'volume_name': 'volume-cef2a6ba-722a-421e-a3d7-963730a1eb11', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:47:02.034263 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e88fae22-4496-4c25-8733-aa8081180a2e tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3474bbc-8b83-4cf4-b59e-b5cd7ff5a9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:47:02.038157 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e88fae22-4496-4c25-8733-aa8081180a2e tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3474bbc-8b83-4cf4-b59e-b5cd7ff5a9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:47:02.042802 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e88fae22-4496-4c25-8733-aa8081180a2e tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6aca4ea-e7b9-456b-9fef-23ccabf6332a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:47:02.047370 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-e88fae22-4496-4c25-8733-aa8081180a2e tempest-VolumesSnapshotTestJSON-954528396 None] Volume cef2a6ba-722a-421e-a3d7-963730a1eb11: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cef2a6ba-722a-421e-a3d7-963730a1eb11', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 30 21:47:02.047370 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-e88fae22-4496-4c25-8733-aa8081180a2e tempest-VolumesSnapshotTestJSON-954528396 None] Cloning cef2a6ba-722a-421e-a3d7-963730a1eb11 from image a5b0850f-3b24-4bcb-b0a7-351c3216b27d at location (None, None). {{(pid=123855) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Apr 30 21:47:02.052365 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-e88fae22-4496-4c25-8733-aa8081180a2e tempest-VolumesSnapshotTestJSON-954528396 None] Lock "b'cinder-a5b0850f-3b24-4bcb-b0a7-351c3216b27d'" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:47:02.112280 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-e88fae22-4496-4c25-8733-aa8081180a2e tempest-VolumesSnapshotTestJSON-954528396 None] Found image-volume cache entry: {'id': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'volume_id': '5772aef0-721f-450a-93ff-02cc6a41edcc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7), 'last_used': datetime.datetime(2022, 4, 30, 21, 47, 2, 56259)}. {{(pid=123855) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 30 21:47:02.112643 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-e88fae22-4496-4c25-8733-aa8081180a2e tempest-VolumesSnapshotTestJSON-954528396 None] Image-volume cache entry image_update_at = 2022-04-30 21:01:07+00:00, requested image updated_at = 2022-04-30 21:01:07+00:00. {{(pid=123855) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 30 21:47:02.113055 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-e88fae22-4496-4c25-8733-aa8081180a2e tempest-VolumesSnapshotTestJSON-954528396 None] Found cache entry for image = a5b0850f-3b24-4bcb-b0a7-351c3216b27d on host ncdv-master-1@ceph#ceph. {{(pid=123855) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Apr 30 21:47:02.117213 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-e88fae22-4496-4c25-8733-aa8081180a2e tempest-VolumesSnapshotTestJSON-954528396 None] Lock "b'cinder-a5b0850f-3b24-4bcb-b0a7-351c3216b27d'" released by "_prepare_image_cache_entry" :: held 0.065s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:47:02.118154 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-e88fae22-4496-4c25-8733-aa8081180a2e tempest-VolumesSnapshotTestJSON-954528396 None] Attempting to retrieve cache entry for image = a5b0850f-3b24-4bcb-b0a7-351c3216b27d on host ncdv-master-1@ceph#ceph. {{(pid=123855) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Apr 30 21:47:02.124150 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-e88fae22-4496-4c25-8733-aa8081180a2e tempest-VolumesSnapshotTestJSON-954528396 None] Found image-volume cache entry: {'id': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'volume_id': '5772aef0-721f-450a-93ff-02cc6a41edcc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7), 'last_used': datetime.datetime(2022, 4, 30, 21, 47, 2, 121942)}. {{(pid=123855) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 30 21:47:02.124556 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-e88fae22-4496-4c25-8733-aa8081180a2e tempest-VolumesSnapshotTestJSON-954528396 None] Image-volume cache entry image_update_at = 2022-04-30 21:01:07+00:00, requested image updated_at = 2022-04-30 21:01:07+00:00. {{(pid=123855) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 30 21:47:02.124941 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-e88fae22-4496-4c25-8733-aa8081180a2e tempest-VolumesSnapshotTestJSON-954528396 None] Creating from source image-volume 5772aef0-721f-450a-93ff-02cc6a41edcc {{(pid=123855) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Apr 30 21:47:02.136538 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e88fae22-4496-4c25-8733-aa8081180a2e tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:47:02.485879 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e88fae22-4496-4c25-8733-aa8081180a2e tempest-VolumesSnapshotTestJSON-954528396 None] creating snapshot='volume-cef2a6ba-722a-421e-a3d7-963730a1eb11.clone_snap' {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} Apr 30 21:47:04.772353 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e88fae22-4496-4c25-8733-aa8081180a2e tempest-VolumesSnapshotTestJSON-954528396 None] cloning 'volume-5772aef0-721f-450a-93ff-02cc6a41edcc@volume-cef2a6ba-722a-421e-a3d7-963730a1eb11.clone_snap' to 'volume-cef2a6ba-722a-421e-a3d7-963730a1eb11' {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} Apr 30 21:47:05.375609 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-a4bee257-4e24-492c-a0b2-27c3659ea4c8 tempest-VolumesBackupsAdminTest-338210881 None] Created reservations ['a4756697-e0ed-4f30-9812-12a247cdff75', '18459733-fa6b-41c0-b22f-94687bc35ef9', '2ff4cc3a-fc18-4200-87fc-57cd15776927', 'f0325793-8479-4c5c-80aa-27d5cdc1fe29'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:47:05.564858 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a4bee257-4e24-492c-a0b2-27c3659ea4c8 tempest-VolumesBackupsAdminTest-338210881 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:47:05.586936 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a4bee257-4e24-492c-a0b2-27c3659ea4c8 tempest-VolumesBackupsAdminTest-338210881 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:47:05.608976 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-a4bee257-4e24-492c-a0b2-27c3659ea4c8 tempest-VolumesBackupsAdminTest-338210881 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:47:05.613747 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-a4bee257-4e24-492c-a0b2-27c3659ea4c8 tempest-VolumesBackupsAdminTest-338210881 None] Deleted volume successfully. Apr 30 21:47:05.676554 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-a4bee257-4e24-492c-a0b2-27c3659ea4c8 tempest-VolumesBackupsAdminTest-338210881 None] Lock "b'cinder-2810f5d9-385b-4e01-91b4-33dcb61d9c2c-delete_volume'" released by "delete_volume" :: held 7.318s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:47:06.124861 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e88fae22-4496-4c25-8733-aa8081180a2e tempest-VolumesSnapshotTestJSON-954528396 None] Volume volume-632a7810-1a6f-420a-a6fd-57675408a8f7.deleted is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:47:06.126844 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e88fae22-4496-4c25-8733-aa8081180a2e tempest-VolumesSnapshotTestJSON-954528396 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:47:06.127322 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e88fae22-4496-4c25-8733-aa8081180a2e tempest-VolumesSnapshotTestJSON-954528396 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:47:06.507045 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e88fae22-4496-4c25-8733-aa8081180a2e tempest-VolumesSnapshotTestJSON-954528396 None] clone created successfully {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} Apr 30 21:47:06.507782 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.volume_utils [None req-e88fae22-4496-4c25-8733-aa8081180a2e tempest-VolumesSnapshotTestJSON-954528396 None] Marking volume cef2a6ba-722a-421e-a3d7-963730a1eb11 as bootable. {{(pid=123855) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Apr 30 21:47:06.611691 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-e88fae22-4496-4c25-8733-aa8081180a2e tempest-VolumesSnapshotTestJSON-954528396 None] Copying metadata from image a5b0850f-3b24-4bcb-b0a7-351c3216b27d to cef2a6ba-722a-421e-a3d7-963730a1eb11. {{(pid=123855) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Apr 30 21:47:06.612166 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-e88fae22-4496-4c25-8733-aa8081180a2e tempest-VolumesSnapshotTestJSON-954528396 None] Creating volume glance metadata for volume cef2a6ba-722a-421e-a3d7-963730a1eb11 backed by image a5b0850f-3b24-4bcb-b0a7-351c3216b27d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123855) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Apr 30 21:47:06.833183 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e88fae22-4496-4c25-8733-aa8081180a2e tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6aca4ea-e7b9-456b-9fef-23ccabf6332a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cef2a6ba-722a-421e-a3d7-963730a1eb11', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:47:06.838117 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e88fae22-4496-4c25-8733-aa8081180a2e tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb007c3e-e797-41d1-80e3-ddfd2ca0af58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:47:06.920375 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-e88fae22-4496-4c25-8733-aa8081180a2e tempest-VolumesSnapshotTestJSON-954528396 None] Volume volume-cef2a6ba-722a-421e-a3d7-963730a1eb11 (cef2a6ba-722a-421e-a3d7-963730a1eb11): created successfully Apr 30 21:47:06.924556 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e88fae22-4496-4c25-8733-aa8081180a2e tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb007c3e-e797-41d1-80e3-ddfd2ca0af58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:47:06.930314 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-e88fae22-4496-4c25-8733-aa8081180a2e tempest-VolumesSnapshotTestJSON-954528396 None] Flow 'volume_create_manager' (40d0f3ea-9ea8-48c5-b453-32a179511bdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:47:07.004030 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-e88fae22-4496-4c25-8733-aa8081180a2e tempest-VolumesSnapshotTestJSON-954528396 None] Created volume successfully. Apr 30 21:47:08.999311 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-6df2702f-aa61-4bdf-8568-dc1ef93b580a req-7794e6c6-627c-4d57-851f-e4e912394045 tempest-VolumesSnapshotTestJSON-954528396 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:47:09.657415 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-6df2702f-aa61-4bdf-8568-dc1ef93b580a req-7794e6c6-627c-4d57-851f-e4e912394045 tempest-VolumesSnapshotTestJSON-954528396 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.658s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:47:09.658839 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-6df2702f-aa61-4bdf-8568-dc1ef93b580a req-7794e6c6-627c-4d57-851f-e4e912394045 tempest-VolumesSnapshotTestJSON-954528396 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-cef2a6ba-722a-421e-a3d7-963730a1eb11', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': 'cef2a6ba-722a-421e-a3d7-963730a1eb11', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:47:09.737941 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-6df2702f-aa61-4bdf-8568-dc1ef93b580a req-7794e6c6-627c-4d57-851f-e4e912394045 tempest-VolumesSnapshotTestJSON-954528396 None] Connection info returned from driver {'name': 'volumes/volume-cef2a6ba-722a-421e-a3d7-963730a1eb11', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'cef2a6ba-722a-421e-a3d7-963730a1eb11', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8ebc08c8-50a4-48ef-bd69-d6d139bd4945'} {{(pid=123855) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Apr 30 21:47:09.822405 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-6df2702f-aa61-4bdf-8568-dc1ef93b580a req-7794e6c6-627c-4d57-851f-e4e912394045 tempest-VolumesSnapshotTestJSON-954528396 None] attachment_update completed successfully. Apr 30 21:47:10.051331 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc869639-35aa-4edb-b16d-030ffe23865e tempest-VolumesDeleteCascade-228592453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:47:10.070791 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bc869639-35aa-4edb-b16d-030ffe23865e tempest-VolumesDeleteCascade-228592453 None] Flow 'volume_create_manager' (eed7ebe5-57a4-4fdf-890e-4e4383470300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:47:10.077499 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bc869639-35aa-4edb-b16d-030ffe23865e tempest-VolumesDeleteCascade-228592453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (873c9017-9c64-46ff-a621-70be6308c343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:47:10.094195 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bc869639-35aa-4edb-b16d-030ffe23865e tempest-VolumesDeleteCascade-228592453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (873c9017-9c64-46ff-a621-70be6308c343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:47:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1068829473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f2da2a8e-5667-4b88-89df-c4b0a7fd5a9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b4f79742058492f8104e7a2b11f0e39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:47:10Z,use_quota=True,user_id='98aa9a3301214f75afea712de78a06fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:47:10.100227 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bc869639-35aa-4edb-b16d-030ffe23865e tempest-VolumesDeleteCascade-228592453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecd9ed7d-0aef-4da2-9c9a-753a63e9f914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:47:10.104594 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bc869639-35aa-4edb-b16d-030ffe23865e tempest-VolumesDeleteCascade-228592453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecd9ed7d-0aef-4da2-9c9a-753a63e9f914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:47:10.109879 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bc869639-35aa-4edb-b16d-030ffe23865e tempest-VolumesDeleteCascade-228592453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17674fc5-8507-4c52-83bf-479023a97a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:47:10.113964 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bc869639-35aa-4edb-b16d-030ffe23865e tempest-VolumesDeleteCascade-228592453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17674fc5-8507-4c52-83bf-479023a97a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2da2a8e-5667-4b88-89df-c4b0a7fd5a9f', 'volume_name': 'volume-f2da2a8e-5667-4b88-89df-c4b0a7fd5a9f', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:47:10.118927 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bc869639-35aa-4edb-b16d-030ffe23865e tempest-VolumesDeleteCascade-228592453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da287209-bf34-47e3-a3e7-5e0c63880835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:47:10.122860 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bc869639-35aa-4edb-b16d-030ffe23865e tempest-VolumesDeleteCascade-228592453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da287209-bf34-47e3-a3e7-5e0c63880835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:47:10.127506 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bc869639-35aa-4edb-b16d-030ffe23865e tempest-VolumesDeleteCascade-228592453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f7331da-22f8-4e1f-97eb-7d06c553216a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:47:10.128609 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-bc869639-35aa-4edb-b16d-030ffe23865e tempest-VolumesDeleteCascade-228592453 None] Volume f2da2a8e-5667-4b88-89df-c4b0a7fd5a9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2da2a8e-5667-4b88-89df-c4b0a7fd5a9f', 'volume_size': 1} Apr 30 21:47:10.129002 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bc869639-35aa-4edb-b16d-030ffe23865e tempest-VolumesDeleteCascade-228592453 None] creating volume 'volume-f2da2a8e-5667-4b88-89df-c4b0a7fd5a9f' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:47:10.130046 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bc869639-35aa-4edb-b16d-030ffe23865e tempest-VolumesDeleteCascade-228592453 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:47:11.024222 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bc869639-35aa-4edb-b16d-030ffe23865e tempest-VolumesDeleteCascade-228592453 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:47:11.024518 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-bc869639-35aa-4edb-b16d-030ffe23865e tempest-VolumesDeleteCascade-228592453 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:47:11.028455 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bc869639-35aa-4edb-b16d-030ffe23865e tempest-VolumesDeleteCascade-228592453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f7331da-22f8-4e1f-97eb-7d06c553216a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2da2a8e-5667-4b88-89df-c4b0a7fd5a9f', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:47:11.033144 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bc869639-35aa-4edb-b16d-030ffe23865e tempest-VolumesDeleteCascade-228592453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d347782-70f5-42f6-917f-c9d0ea230fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:47:11.147233 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-bc869639-35aa-4edb-b16d-030ffe23865e tempest-VolumesDeleteCascade-228592453 None] Volume volume-f2da2a8e-5667-4b88-89df-c4b0a7fd5a9f (f2da2a8e-5667-4b88-89df-c4b0a7fd5a9f): created successfully Apr 30 21:47:11.152490 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bc869639-35aa-4edb-b16d-030ffe23865e tempest-VolumesDeleteCascade-228592453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d347782-70f5-42f6-917f-c9d0ea230fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:47:11.162822 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-bc869639-35aa-4edb-b16d-030ffe23865e tempest-VolumesDeleteCascade-228592453 None] Flow 'volume_create_manager' (eed7ebe5-57a4-4fdf-890e-4e4383470300) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:47:11.240238 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-bc869639-35aa-4edb-b16d-030ffe23865e tempest-VolumesDeleteCascade-228592453 None] Created volume successfully. Apr 30 21:47:12.611842 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-2141e256-a3b9-4240-8e2f-c91fe7055073 tempest-VolumesDeleteCascade-228592453 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:47:12.875649 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-8b2d20dd-c045-4b08-bf67-2101cd0459b2 tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:47:15.444229 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-8b2d20dd-c045-4b08-bf67-2101cd0459b2 tempest-VolumesSnapshotTestJSON-954528396 None] Create snapshot completed successfully Apr 30 21:47:15.880263 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-2141e256-a3b9-4240-8e2f-c91fe7055073 tempest-VolumesDeleteCascade-228592453 None] Create snapshot completed successfully Apr 30 21:47:16.391756 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e78ba8ea-16ad-4d92-9165-32039cabf353 tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:47:17.077229 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9bbc7348-4967-48cc-a2cf-f0afa45fd668 tempest-VolumesDeleteCascade-228592453 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:47:19.388834 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-e78ba8ea-16ad-4d92-9165-32039cabf353 tempest-VolumesSnapshotTestJSON-954528396 None] Create snapshot completed successfully Apr 30 21:47:20.820003 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-5cd4c0cc-645a-42cf-af48-c1d5888b6f3a tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:47:21.370107 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-9bbc7348-4967-48cc-a2cf-f0afa45fd668 tempest-VolumesDeleteCascade-228592453 None] Create snapshot completed successfully Apr 30 21:47:22.495982 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-f9257ca7-e39a-4fae-b7a4-07222ad73bb5 tempest-VolumesDeleteCascade-228592453 None] Lock "b'cinder-f2da2a8e-5667-4b88-89df-c4b0a7fd5a9f-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:47:22.593991 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f9257ca7-e39a-4fae-b7a4-07222ad73bb5 tempest-VolumesDeleteCascade-228592453 None] Performing cascade delete. {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/manager.py:964}} Apr 30 21:47:22.616978 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-f9257ca7-e39a-4fae-b7a4-07222ad73bb5 tempest-VolumesDeleteCascade-228592453 None] Lock "b'cinder-241db963-7273-4c19-8c1d-3073618ee790-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:47:22.629381 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f9257ca7-e39a-4fae-b7a4-07222ad73bb5 tempest-VolumesDeleteCascade-228592453 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:47:23.878601 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-5cd4c0cc-645a-42cf-af48-c1d5888b6f3a tempest-VolumesSnapshotTestJSON-954528396 None] Create snapshot completed successfully Apr 30 21:47:24.941852 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-e4db4901-b4bb-42b0-8140-e1ea967901ab tempest-VolumesSnapshotTestJSON-954528396 None] Lock "b'cinder-8c291148-41d9-43b7-856e-2e55692354b8-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:47:24.944010 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e4db4901-b4bb-42b0-8140-e1ea967901ab tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:47:25.820989 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-f9257ca7-e39a-4fae-b7a4-07222ad73bb5 tempest-VolumesDeleteCascade-228592453 None] Created reservations ['2e22ba5d-966a-4123-a5ef-c20b6e1eae98', 'f91f5d39-7dd4-47c2-ba9d-fec7d43bc141', '80854be4-ddb6-4570-bd7f-abd5037750ba', 'cef8cbdf-fff7-40ff-9d7c-8c94ffed0b5e'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:47:26.011430 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-f9257ca7-e39a-4fae-b7a4-07222ad73bb5 tempest-VolumesDeleteCascade-228592453 None] Delete snapshot completed successfully. Apr 30 21:47:26.016255 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-f9257ca7-e39a-4fae-b7a4-07222ad73bb5 tempest-VolumesDeleteCascade-228592453 None] Lock "b'cinder-241db963-7273-4c19-8c1d-3073618ee790-delete_snapshot'" released by "delete_snapshot" :: held 3.399s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:47:26.024568 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-f9257ca7-e39a-4fae-b7a4-07222ad73bb5 tempest-VolumesDeleteCascade-228592453 None] Lock "b'cinder-d0d9ac7f-5a3a-4234-b3cc-b62bd580cdc4-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.007s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:47:26.037395 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f9257ca7-e39a-4fae-b7a4-07222ad73bb5 tempest-VolumesDeleteCascade-228592453 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:47:29.554732 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-f9257ca7-e39a-4fae-b7a4-07222ad73bb5 tempest-VolumesDeleteCascade-228592453 None] Created reservations ['1aecdd8d-ffdf-4664-ba72-d7b43aecec82', '808f1687-f716-4273-b834-65a6cd80c340', '83b3c7fd-a239-49a6-8fa8-cd6870099e54', '03024c4e-6098-4428-8528-d8e59f3bc53e'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:47:29.783153 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-f9257ca7-e39a-4fae-b7a4-07222ad73bb5 tempest-VolumesDeleteCascade-228592453 None] Delete snapshot completed successfully. Apr 30 21:47:29.787720 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-f9257ca7-e39a-4fae-b7a4-07222ad73bb5 tempest-VolumesDeleteCascade-228592453 None] Lock "b'cinder-d0d9ac7f-5a3a-4234-b3cc-b62bd580cdc4-delete_snapshot'" released by "delete_snapshot" :: held 3.763s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:47:29.788387 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f9257ca7-e39a-4fae-b7a4-07222ad73bb5 tempest-VolumesDeleteCascade-228592453 None] Snapshots deleted, issuing volume delete {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/manager.py:979}} Apr 30 21:47:29.789427 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f9257ca7-e39a-4fae-b7a4-07222ad73bb5 tempest-VolumesDeleteCascade-228592453 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:47:29.908389 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f9257ca7-e39a-4fae-b7a4-07222ad73bb5 tempest-VolumesDeleteCascade-228592453 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:47:29.908822 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f9257ca7-e39a-4fae-b7a4-07222ad73bb5 tempest-VolumesDeleteCascade-228592453 None] Volume volume-f2da2a8e-5667-4b88-89df-c4b0a7fd5a9f is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:47:30.086299 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f9257ca7-e39a-4fae-b7a4-07222ad73bb5 tempest-VolumesDeleteCascade-228592453 None] deleting rbd volume volume-f2da2a8e-5667-4b88-89df-c4b0a7fd5a9f {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:47:31.349058 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:47:31.350387 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:47:31.371437 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:47:31.394001 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:47:36.800444 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-f9257ca7-e39a-4fae-b7a4-07222ad73bb5 tempest-VolumesDeleteCascade-228592453 None] Created reservations ['19fc4547-bfeb-4fe3-913b-d1fb42995a95', 'f51244ef-0e45-4662-9abc-40940564cf75', '7342d31b-77b9-4789-a69a-6232f7f138b2', 'acf8bdda-6cdf-4ad8-afbc-51c8abecfb17'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:47:36.961252 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f9257ca7-e39a-4fae-b7a4-07222ad73bb5 tempest-VolumesDeleteCascade-228592453 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:47:36.982666 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f9257ca7-e39a-4fae-b7a4-07222ad73bb5 tempest-VolumesDeleteCascade-228592453 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:47:37.008749 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-f9257ca7-e39a-4fae-b7a4-07222ad73bb5 tempest-VolumesDeleteCascade-228592453 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:47:37.013103 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-f9257ca7-e39a-4fae-b7a4-07222ad73bb5 tempest-VolumesDeleteCascade-228592453 None] Deleted volume successfully. Apr 30 21:47:37.112777 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-f9257ca7-e39a-4fae-b7a4-07222ad73bb5 tempest-VolumesDeleteCascade-228592453 None] Lock "b'cinder-f2da2a8e-5667-4b88-89df-c4b0a7fd5a9f-delete_volume'" released by "delete_volume" :: held 14.617s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:47:56.565892 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-e4db4901-b4bb-42b0-8140-e1ea967901ab tempest-VolumesSnapshotTestJSON-954528396 None] Created reservations ['c7206f24-ba99-4910-8308-9d482945e837', '0f78a5c7-aac6-4331-994c-7576f52e57f7', '31a9fd1b-c93a-4946-923c-ba77fae21b0e', '134ae21c-36be-44d1-88fb-009ecaf567e7'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:47:56.902886 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-e4db4901-b4bb-42b0-8140-e1ea967901ab tempest-VolumesSnapshotTestJSON-954528396 None] Delete snapshot completed successfully. Apr 30 21:47:56.907999 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-e4db4901-b4bb-42b0-8140-e1ea967901ab tempest-VolumesSnapshotTestJSON-954528396 None] Lock "b'cinder-8c291148-41d9-43b7-856e-2e55692354b8-delete_snapshot'" released by "delete_snapshot" :: held 31.966s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:47:56.994029 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-c07bb237-4790-4ab4-9e09-432ce9b0133b tempest-VolumesSnapshotTestJSON-954528396 None] Lock "b'cinder-144319ed-cf8d-4238-910a-90958228ed03-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:47:56.995876 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c07bb237-4790-4ab4-9e09-432ce9b0133b tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:48:28.451438 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-c07bb237-4790-4ab4-9e09-432ce9b0133b tempest-VolumesSnapshotTestJSON-954528396 None] Created reservations ['8f82b3d8-6ebf-4dc7-9055-ecc80cf44311', '3448cdec-7d83-41b2-8f9a-8f8d83a3f13e', '5d2e2efa-67eb-4279-952e-8ac8530f7591', '8a797a7c-c25c-4891-b339-b1ed62ba7425'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:48:28.701320 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-c07bb237-4790-4ab4-9e09-432ce9b0133b tempest-VolumesSnapshotTestJSON-954528396 None] Delete snapshot completed successfully. Apr 30 21:48:28.709016 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-c07bb237-4790-4ab4-9e09-432ce9b0133b tempest-VolumesSnapshotTestJSON-954528396 None] Lock "b'cinder-144319ed-cf8d-4238-910a-90958228ed03-delete_snapshot'" released by "delete_snapshot" :: held 31.712s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:48:28.972189 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-7fcf4f11-d853-4bfa-ac10-20458decc260 tempest-VolumesSnapshotTestJSON-954528396 None] Lock "b'cinder-a6a2003b-ad55-403f-bd67-bc944fac9aa0-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:48:28.974242 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-7fcf4f11-d853-4bfa-ac10-20458decc260 tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:48:31.349809 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:48:31.350570 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:48:31.371568 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:48:31.392607 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:48:57.311995 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-d52e31af-fc64-43f5-9d3f-da732bd0b2e0 req-073b2f8a-7410-407a-816e-a6ff256cf930 tempest-TestVolumeBackupRestore-1350104366 None] Terminate volume connection completed successfully. Apr 30 21:48:57.312659 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-d52e31af-fc64-43f5-9d3f-da732bd0b2e0 req-073b2f8a-7410-407a-816e-a6ff256cf930 tempest-TestVolumeBackupRestore-1350104366 None] Deleting attachment 953e1bc2-b909-4d3a-95af-26b8c469b6c3. {{(pid=123855) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} Apr 30 21:48:59.804341 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-84cf4e47-f893-41af-8b45-6aa81567fe9e tempest-TestVolumeBackupRestore-1350104366 None] Lock "b'cinder-223065cf-14f3-4066-9159-1b9f16888528-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:48:59.901724 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-84cf4e47-f893-41af-8b45-6aa81567fe9e tempest-TestVolumeBackupRestore-1350104366 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:49:02.572773 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-84cf4e47-f893-41af-8b45-6aa81567fe9e tempest-TestVolumeBackupRestore-1350104366 None] Volume volume-223065cf-14f3-4066-9159-1b9f16888528 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:49:03.021357 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-84cf4e47-f893-41af-8b45-6aa81567fe9e tempest-TestVolumeBackupRestore-1350104366 None] deleting rbd volume volume-223065cf-14f3-4066-9159-1b9f16888528 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:49:03.035053 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-fd5ab2ca-89d7-4322-abd6-9f313a05c13e tempest-TestVolumeBackupRestore-1350104366 None] Lock "b'cinder-a8eacc0e-0c7c-485f-9f60-94d4c5437298-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:49:03.119159 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-fd5ab2ca-89d7-4322-abd6-9f313a05c13e tempest-TestVolumeBackupRestore-1350104366 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:49:06.007809 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-fd5ab2ca-89d7-4322-abd6-9f313a05c13e tempest-TestVolumeBackupRestore-1350104366 None] deleting rbd volume volume-a8eacc0e-0c7c-485f-9f60-94d4c5437298 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:49:06.228215 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-7fcf4f11-d853-4bfa-ac10-20458decc260 tempest-VolumesSnapshotTestJSON-954528396 None] Created reservations ['634a214d-0fb6-42e0-b469-7cd5ecca3e82', '24c35bff-5ad1-454c-b747-557041fac353', 'c14bc665-4969-4299-92d2-dc36e901b4a5', 'c4ea38dc-cc6c-48a8-ad1b-bdbdb5b31cf3'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:49:06.542514 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-7fcf4f11-d853-4bfa-ac10-20458decc260 tempest-VolumesSnapshotTestJSON-954528396 None] Delete snapshot completed successfully. Apr 30 21:49:06.547793 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-7fcf4f11-d853-4bfa-ac10-20458decc260 tempest-VolumesSnapshotTestJSON-954528396 None] Lock "b'cinder-a6a2003b-ad55-403f-bd67-bc944fac9aa0-delete_snapshot'" released by "delete_snapshot" :: held 37.575s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:49:08.263232 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-e289124f-3216-4bfb-a312-f8279ffca408 req-bef383dc-8e61-4d9c-a48b-a052fbe524d2 tempest-VolumesSnapshotTestJSON-954528396 None] Terminate volume connection completed successfully. Apr 30 21:49:08.263857 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-e289124f-3216-4bfb-a312-f8279ffca408 req-bef383dc-8e61-4d9c-a48b-a052fbe524d2 tempest-VolumesSnapshotTestJSON-954528396 None] Deleting attachment 8ebc08c8-50a4-48ef-bd69-d6d139bd4945. {{(pid=123855) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} Apr 30 21:49:12.914137 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-fd5ab2ca-89d7-4322-abd6-9f313a05c13e tempest-TestVolumeBackupRestore-1350104366 None] volume is a clone so cleaning references {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} Apr 30 21:49:13.279561 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-fd5ab2ca-89d7-4322-abd6-9f313a05c13e tempest-TestVolumeBackupRestore-1350104366 None] deleting parent snapshot volume-a8eacc0e-0c7c-485f-9f60-94d4c5437298.clone_snap {{(pid=123855) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} Apr 30 21:49:14.856238 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-3e05ba07-6ed8-4af9-b858-dee128303043 tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:49:15.116186 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-fd5ab2ca-89d7-4322-abd6-9f313a05c13e tempest-TestVolumeBackupRestore-1350104366 None] Created reservations ['1d359119-e74a-4039-8bc7-8576c53cd10c', '73fa0566-17fe-47a7-98f1-766865810d53', 'fffba6b5-7ec7-478e-92d7-fbcb0e72e770', '0fe4d5ac-e6f8-48ef-914f-0c2011611f0f'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:49:15.221993 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-84cf4e47-f893-41af-8b45-6aa81567fe9e tempest-TestVolumeBackupRestore-1350104366 None] Created reservations ['2033ce4a-c8e2-4a45-9e94-11102c7fbf31', '0ef446c6-708d-4971-9d9f-dc452ccbf9d3', '35d98343-01c8-4be9-93fe-c8acd6668cbf', 'd7304d5a-844c-4e6d-9f3f-d6390c8f31c2'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:49:15.328006 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-fd5ab2ca-89d7-4322-abd6-9f313a05c13e tempest-TestVolumeBackupRestore-1350104366 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:49:15.351037 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-fd5ab2ca-89d7-4322-abd6-9f313a05c13e tempest-TestVolumeBackupRestore-1350104366 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:49:15.373121 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-fd5ab2ca-89d7-4322-abd6-9f313a05c13e tempest-TestVolumeBackupRestore-1350104366 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:49:15.379356 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-fd5ab2ca-89d7-4322-abd6-9f313a05c13e tempest-TestVolumeBackupRestore-1350104366 None] Deleted volume successfully. Apr 30 21:49:15.437532 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-fd5ab2ca-89d7-4322-abd6-9f313a05c13e tempest-TestVolumeBackupRestore-1350104366 None] Lock "b'cinder-a8eacc0e-0c7c-485f-9f60-94d4c5437298-delete_volume'" released by "delete_volume" :: held 12.402s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:49:15.456290 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-84cf4e47-f893-41af-8b45-6aa81567fe9e tempest-TestVolumeBackupRestore-1350104366 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:49:15.477735 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-84cf4e47-f893-41af-8b45-6aa81567fe9e tempest-TestVolumeBackupRestore-1350104366 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:49:15.499155 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-84cf4e47-f893-41af-8b45-6aa81567fe9e tempest-TestVolumeBackupRestore-1350104366 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:49:15.505087 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-84cf4e47-f893-41af-8b45-6aa81567fe9e tempest-TestVolumeBackupRestore-1350104366 None] Deleted volume successfully. Apr 30 21:49:15.596594 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-84cf4e47-f893-41af-8b45-6aa81567fe9e tempest-TestVolumeBackupRestore-1350104366 None] Lock "b'cinder-223065cf-14f3-4066-9159-1b9f16888528-delete_volume'" released by "delete_volume" :: held 15.792s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:49:17.462408 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-3e05ba07-6ed8-4af9-b858-dee128303043 tempest-VolumesSnapshotTestJSON-954528396 None] Create snapshot completed successfully Apr 30 21:49:18.306798 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-41f0eeea-c3ca-4e58-b8d5-e85b902b62b3 tempest-VolumesSnapshotTestJSON-954528396 None] Lock "b'cinder-3850e177-3f4d-44e7-855d-8d7cbfe1c5d5-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:49:18.311282 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-41f0eeea-c3ca-4e58-b8d5-e85b902b62b3 tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:49:20.581252 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-41f0eeea-c3ca-4e58-b8d5-e85b902b62b3 tempest-VolumesSnapshotTestJSON-954528396 None] Created reservations ['0e6c2f10-714e-4649-91f8-44d0b454fe25', '28509a6b-4915-4e1c-91ce-6b57d6839e4d', '1d08abc1-0a1e-40e6-871c-a97a35fde226', '8cbe59fc-482d-4568-976c-e5469603a4cf'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:49:20.741722 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-41f0eeea-c3ca-4e58-b8d5-e85b902b62b3 tempest-VolumesSnapshotTestJSON-954528396 None] Delete snapshot completed successfully. Apr 30 21:49:20.746586 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-41f0eeea-c3ca-4e58-b8d5-e85b902b62b3 tempest-VolumesSnapshotTestJSON-954528396 None] Lock "b'cinder-3850e177-3f4d-44e7-855d-8d7cbfe1c5d5-delete_snapshot'" released by "delete_snapshot" :: held 2.440s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:49:21.883231 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b98b6751-3dee-4bde-a743-14660577936a tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:49:23.434512 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-b98b6751-3dee-4bde-a743-14660577936a tempest-VolumesSnapshotTestJSON-954528396 None] Create snapshot completed successfully Apr 30 21:49:31.347802 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:49:31.348591 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:49:31.394041 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:49:31.430325 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:49:39.981774 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-21367198-e2b7-451a-b133-b5dc2eb58dc1 req-8e616d05-40c5-41f1-b9a7-ce0e11fc73ab tempest-VolumesSnapshotTestJSON-954528396 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:49:40.638302 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-21367198-e2b7-451a-b133-b5dc2eb58dc1 req-8e616d05-40c5-41f1-b9a7-ce0e11fc73ab tempest-VolumesSnapshotTestJSON-954528396 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.656s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:49:40.639154 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-21367198-e2b7-451a-b133-b5dc2eb58dc1 req-8e616d05-40c5-41f1-b9a7-ce0e11fc73ab tempest-VolumesSnapshotTestJSON-954528396 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9ef7b859-1b98-4726-ad7b-39ae6a4c5bcb', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': '9ef7b859-1b98-4726-ad7b-39ae6a4c5bcb', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:49:40.731080 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-21367198-e2b7-451a-b133-b5dc2eb58dc1 req-8e616d05-40c5-41f1-b9a7-ce0e11fc73ab tempest-VolumesSnapshotTestJSON-954528396 None] Connection info returned from driver {'name': 'volumes/volume-9ef7b859-1b98-4726-ad7b-39ae6a4c5bcb', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '9ef7b859-1b98-4726-ad7b-39ae6a4c5bcb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd08923f3-70a4-42d6-85e8-1a91db64efae'} {{(pid=123855) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Apr 30 21:49:40.875740 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-21367198-e2b7-451a-b133-b5dc2eb58dc1 req-8e616d05-40c5-41f1-b9a7-ce0e11fc73ab tempest-VolumesSnapshotTestJSON-954528396 None] attachment_update completed successfully. Apr 30 21:49:43.576300 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-627a0e32-da02-46b7-8ea0-e62d5167c1f8 tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:49:44.901852 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-627a0e32-da02-46b7-8ea0-e62d5167c1f8 tempest-VolumesSnapshotTestJSON-954528396 None] Create snapshot completed successfully Apr 30 21:49:45.990239 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-dde5a995-d116-4d49-a5bd-26f364122139 tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:49:47.393566 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-dde5a995-d116-4d49-a5bd-26f364122139 tempest-VolumesSnapshotTestJSON-954528396 None] Create snapshot completed successfully Apr 30 21:49:48.053927 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-e4b23f3d-8e92-4c8d-9ddc-27d23b92741d tempest-VolumesSnapshotTestJSON-954528396 None] Lock "b'cinder-41cf1444-49a9-42c1-8a05-f80b0564e1ed-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.018s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:49:48.056784 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-e4b23f3d-8e92-4c8d-9ddc-27d23b92741d tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:50:18.913183 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-e4b23f3d-8e92-4c8d-9ddc-27d23b92741d tempest-VolumesSnapshotTestJSON-954528396 None] Created reservations ['7d4cfe1c-7950-4653-b2e1-9769cb6f5627', '031fc796-a0ba-42a7-8508-7face7d7ff3d', 'e979012b-14f8-4889-b282-b7248f801bb4', 'babb7681-5aee-4ec5-8d33-5bc990992399'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:50:19.073133 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-e4b23f3d-8e92-4c8d-9ddc-27d23b92741d tempest-VolumesSnapshotTestJSON-954528396 None] Delete snapshot completed successfully. Apr 30 21:50:19.077612 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-e4b23f3d-8e92-4c8d-9ddc-27d23b92741d tempest-VolumesSnapshotTestJSON-954528396 None] Lock "b'cinder-41cf1444-49a9-42c1-8a05-f80b0564e1ed-delete_snapshot'" released by "delete_snapshot" :: held 31.024s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:50:20.078862 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-b48fe227-8471-4e1b-9eb6-690f5b80159f tempest-VolumesSnapshotTestJSON-954528396 None] Lock "b'cinder-3f18b4cd-b864-4e8e-92e1-cb5a93f18f21-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:50:20.080807 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b48fe227-8471-4e1b-9eb6-690f5b80159f tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:50:31.351437 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:50:31.352377 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:50:31.377174 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:50:31.400049 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:50:50.890119 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-b48fe227-8471-4e1b-9eb6-690f5b80159f tempest-VolumesSnapshotTestJSON-954528396 None] Created reservations ['921d43e4-341f-4962-9e7c-186920055158', 'ddcd8051-564c-485b-aeca-a83c5d00f701', 'e771f430-e5e4-4bde-8a43-2b999814f575', 'f1f19cd7-c31e-4e6b-84f9-190645a67433'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:50:51.033432 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-b48fe227-8471-4e1b-9eb6-690f5b80159f tempest-VolumesSnapshotTestJSON-954528396 None] Delete snapshot completed successfully. Apr 30 21:50:51.039563 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-b48fe227-8471-4e1b-9eb6-690f5b80159f tempest-VolumesSnapshotTestJSON-954528396 None] Lock "b'cinder-3f18b4cd-b864-4e8e-92e1-cb5a93f18f21-delete_snapshot'" released by "delete_snapshot" :: held 30.960s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:50:52.047312 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-edc83db8-ce9c-4b7c-bc20-a47a7d64842c tempest-VolumesSnapshotTestJSON-954528396 None] Lock "b'cinder-ddac939f-bad9-4275-9883-9dc49ea55268-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:50:52.050367 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-edc83db8-ce9c-4b7c-bc20-a47a7d64842c tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:51:23.009817 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-edc83db8-ce9c-4b7c-bc20-a47a7d64842c tempest-VolumesSnapshotTestJSON-954528396 None] Created reservations ['3240dbe8-4010-4545-8498-a8deae379c1a', '41a515c1-9617-49bf-b1bd-431fb773444b', '4d722b82-9075-41bc-a2b9-9660ea929d63', '68e10698-0585-4e88-8b20-f95dc54d308e'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:51:23.141379 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-edc83db8-ce9c-4b7c-bc20-a47a7d64842c tempest-VolumesSnapshotTestJSON-954528396 None] Delete snapshot completed successfully. Apr 30 21:51:23.147619 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-edc83db8-ce9c-4b7c-bc20-a47a7d64842c tempest-VolumesSnapshotTestJSON-954528396 None] Lock "b'cinder-ddac939f-bad9-4275-9883-9dc49ea55268-delete_snapshot'" released by "delete_snapshot" :: held 31.100s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:51:24.959206 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-b46fd6a7-8f8c-49cf-9af0-9d3fb252ae88 req-27c0af78-3f96-4c5b-a07d-442e92f97dd2 tempest-VolumesSnapshotTestJSON-954528396 None] Terminate volume connection completed successfully. Apr 30 21:51:24.959826 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-b46fd6a7-8f8c-49cf-9af0-9d3fb252ae88 req-27c0af78-3f96-4c5b-a07d-442e92f97dd2 tempest-VolumesSnapshotTestJSON-954528396 None] Deleting attachment d08923f3-70a4-42d6-85e8-1a91db64efae. {{(pid=123855) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} Apr 30 21:51:29.852854 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-f074692f-a0de-4676-8ae7-3d504ce1c2fc tempest-VolumesSnapshotTestJSON-954528396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:51:29.880494 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f074692f-a0de-4676-8ae7-3d504ce1c2fc tempest-VolumesSnapshotTestJSON-954528396 None] Flow 'volume_create_manager' (9f0bc1e2-fed2-4cf3-a1ab-02148e258853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:51:29.889023 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f074692f-a0de-4676-8ae7-3d504ce1c2fc tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7f1f19f-328c-4935-8272-756502a0ba35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:51:29.908035 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f074692f-a0de-4676-8ae7-3d504ce1c2fc tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7f1f19f-328c-4935-8272-756502a0ba35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-634481954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=24cbb600-25d1-47e8-bc7c-fed2f51ec9f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1febcefe29f461ea37667520a278022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:51:30Z,use_quota=True,user_id='0ed9fb1a529f4247acd72a6de21ceb4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:51:29.913573 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f074692f-a0de-4676-8ae7-3d504ce1c2fc tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5060a7e4-3e4c-4b01-bec6-2d8977c4ae17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:51:29.918062 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f074692f-a0de-4676-8ae7-3d504ce1c2fc tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5060a7e4-3e4c-4b01-bec6-2d8977c4ae17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:51:29.923278 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f074692f-a0de-4676-8ae7-3d504ce1c2fc tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ea0038f-261f-4c40-91b0-9e3b7629f361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:51:29.927455 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f074692f-a0de-4676-8ae7-3d504ce1c2fc tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ea0038f-261f-4c40-91b0-9e3b7629f361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24cbb600-25d1-47e8-bc7c-fed2f51ec9f8', 'volume_name': 'volume-24cbb600-25d1-47e8-bc7c-fed2f51ec9f8', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:51:29.933229 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f074692f-a0de-4676-8ae7-3d504ce1c2fc tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5852b4c8-ba95-4749-ad3b-89196f8a5f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:51:29.937308 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f074692f-a0de-4676-8ae7-3d504ce1c2fc tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5852b4c8-ba95-4749-ad3b-89196f8a5f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:51:29.942243 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f074692f-a0de-4676-8ae7-3d504ce1c2fc tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f182a0e6-b699-4a56-b1cc-9242b4170c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:51:29.943366 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-f074692f-a0de-4676-8ae7-3d504ce1c2fc tempest-VolumesSnapshotTestJSON-954528396 None] Volume 24cbb600-25d1-47e8-bc7c-fed2f51ec9f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24cbb600-25d1-47e8-bc7c-fed2f51ec9f8', 'volume_size': 1} Apr 30 21:51:29.943772 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f074692f-a0de-4676-8ae7-3d504ce1c2fc tempest-VolumesSnapshotTestJSON-954528396 None] creating volume 'volume-24cbb600-25d1-47e8-bc7c-fed2f51ec9f8' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:51:29.944849 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f074692f-a0de-4676-8ae7-3d504ce1c2fc tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:51:30.447161 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f074692f-a0de-4676-8ae7-3d504ce1c2fc tempest-VolumesSnapshotTestJSON-954528396 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:51:30.447662 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f074692f-a0de-4676-8ae7-3d504ce1c2fc tempest-VolumesSnapshotTestJSON-954528396 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:51:30.452063 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f074692f-a0de-4676-8ae7-3d504ce1c2fc tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f182a0e6-b699-4a56-b1cc-9242b4170c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24cbb600-25d1-47e8-bc7c-fed2f51ec9f8', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:51:30.457517 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f074692f-a0de-4676-8ae7-3d504ce1c2fc tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (774a861f-52ba-4c72-b06c-2ec9959d9e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:51:30.512323 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-f074692f-a0de-4676-8ae7-3d504ce1c2fc tempest-VolumesSnapshotTestJSON-954528396 None] Volume volume-24cbb600-25d1-47e8-bc7c-fed2f51ec9f8 (24cbb600-25d1-47e8-bc7c-fed2f51ec9f8): created successfully Apr 30 21:51:30.516119 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f074692f-a0de-4676-8ae7-3d504ce1c2fc tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (774a861f-52ba-4c72-b06c-2ec9959d9e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:51:30.522504 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-f074692f-a0de-4676-8ae7-3d504ce1c2fc tempest-VolumesSnapshotTestJSON-954528396 None] Flow 'volume_create_manager' (9f0bc1e2-fed2-4cf3-a1ab-02148e258853) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:51:30.581111 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-f074692f-a0de-4676-8ae7-3d504ce1c2fc tempest-VolumesSnapshotTestJSON-954528396 None] Created volume successfully. Apr 30 21:51:31.263172 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c8d11173-0f09-4168-92f5-af1f4c30782a tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:51:31.456458 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:51:31.457806 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:51:31.539856 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:51:31.567919 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:51:33.535160 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-c8d11173-0f09-4168-92f5-af1f4c30782a tempest-VolumesSnapshotTestJSON-954528396 None] Create snapshot completed successfully Apr 30 21:51:35.023081 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d92b354-173d-4712-92eb-539a6cc762b9 tempest-VolumesSnapshotTestJSON-954528396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:51:35.055448 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4d92b354-173d-4712-92eb-539a6cc762b9 tempest-VolumesSnapshotTestJSON-954528396 None] Flow 'volume_create_manager' (9c3a96fd-2e14-4c19-8b3e-8bc066d3f141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:51:35.061907 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4d92b354-173d-4712-92eb-539a6cc762b9 tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3bdc24a-5638-49b0-9899-59e835aeb7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:51:35.079171 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4d92b354-173d-4712-92eb-539a6cc762b9 tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3bdc24a-5638-49b0-9899-59e835aeb7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:51:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1660230588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cd8e6656-7189-4225-b0f8-b22ce262438d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1febcefe29f461ea37667520a278022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:51:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=fea59f3f-40d4-4b59-b594-93fa979f1e0b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:51:35Z,use_quota=True,user_id='0ed9fb1a529f4247acd72a6de21ceb4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:51:35.086349 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4d92b354-173d-4712-92eb-539a6cc762b9 tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72a0f10f-3982-49fd-a2de-ae132fa39f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:51:35.089641 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4d92b354-173d-4712-92eb-539a6cc762b9 tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72a0f10f-3982-49fd-a2de-ae132fa39f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:51:35.094931 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4d92b354-173d-4712-92eb-539a6cc762b9 tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c2e0789-8eae-4179-aeab-a4f0412f09d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:51:35.099205 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4d92b354-173d-4712-92eb-539a6cc762b9 tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c2e0789-8eae-4179-aeab-a4f0412f09d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cd8e6656-7189-4225-b0f8-b22ce262438d', 'volume_name': 'volume-cd8e6656-7189-4225-b0f8-b22ce262438d', 'volume_size': 2, 'snapshot_id': 'fea59f3f-40d4-4b59-b594-93fa979f1e0b'}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:51:35.104623 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4d92b354-173d-4712-92eb-539a6cc762b9 tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c3ca41d-0aca-461b-b4dc-c98afed6711d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:51:35.108549 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4d92b354-173d-4712-92eb-539a6cc762b9 tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c3ca41d-0aca-461b-b4dc-c98afed6711d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:51:35.113222 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4d92b354-173d-4712-92eb-539a6cc762b9 tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58645cf9-6c8d-4744-a74f-18b5801a92ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:51:35.114331 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-4d92b354-173d-4712-92eb-539a6cc762b9 tempest-VolumesSnapshotTestJSON-954528396 None] Volume cd8e6656-7189-4225-b0f8-b22ce262438d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cd8e6656-7189-4225-b0f8-b22ce262438d', 'volume_size': 2, 'snapshot_id': 'fea59f3f-40d4-4b59-b594-93fa979f1e0b'} Apr 30 21:51:35.132255 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-4d92b354-173d-4712-92eb-539a6cc762b9 tempest-VolumesSnapshotTestJSON-954528396 None] cloning volumes/volume-24cbb600-25d1-47e8-bc7c-fed2f51ec9f8@snapshot-fea59f3f-40d4-4b59-b594-93fa979f1e0b to volume-cd8e6656-7189-4225-b0f8-b22ce262438d {{(pid=123855) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1091}} Apr 30 21:51:35.132922 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-4d92b354-173d-4712-92eb-539a6cc762b9 tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:51:35.197921 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-4d92b354-173d-4712-92eb-539a6cc762b9 tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:51:36.267636 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-4d92b354-173d-4712-92eb-539a6cc762b9 tempest-VolumesSnapshotTestJSON-954528396 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:51:36.269082 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-4d92b354-173d-4712-92eb-539a6cc762b9 tempest-VolumesSnapshotTestJSON-954528396 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:51:36.274658 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-4d92b354-173d-4712-92eb-539a6cc762b9 tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:51:37.415874 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4d92b354-173d-4712-92eb-539a6cc762b9 tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58645cf9-6c8d-4744-a74f-18b5801a92ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd8e6656-7189-4225-b0f8-b22ce262438d', 'volume_size': 2, 'snapshot_id': 'fea59f3f-40d4-4b59-b594-93fa979f1e0b'}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:51:37.422198 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4d92b354-173d-4712-92eb-539a6cc762b9 tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41813b0b-3ceb-4fcd-b92e-4980564163ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:51:37.478581 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-4d92b354-173d-4712-92eb-539a6cc762b9 tempest-VolumesSnapshotTestJSON-954528396 None] Volume volume-cd8e6656-7189-4225-b0f8-b22ce262438d (cd8e6656-7189-4225-b0f8-b22ce262438d): created successfully Apr 30 21:51:37.484280 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4d92b354-173d-4712-92eb-539a6cc762b9 tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41813b0b-3ceb-4fcd-b92e-4980564163ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:51:37.491647 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-4d92b354-173d-4712-92eb-539a6cc762b9 tempest-VolumesSnapshotTestJSON-954528396 None] Flow 'volume_create_manager' (9c3a96fd-2e14-4c19-8b3e-8bc066d3f141) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:51:37.547671 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-4d92b354-173d-4712-92eb-539a6cc762b9 tempest-VolumesSnapshotTestJSON-954528396 None] Created volume successfully. Apr 30 21:51:38.360018 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-f2b5d9de-4dbb-48b3-9947-d1506cccb2ff tempest-VolumesSnapshotTestJSON-954528396 None] Lock "b'cinder-cd8e6656-7189-4225-b0f8-b22ce262438d-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:51:38.482052 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f2b5d9de-4dbb-48b3-9947-d1506cccb2ff tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:51:38.700544 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f2b5d9de-4dbb-48b3-9947-d1506cccb2ff tempest-VolumesSnapshotTestJSON-954528396 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:51:38.833548 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f2b5d9de-4dbb-48b3-9947-d1506cccb2ff tempest-VolumesSnapshotTestJSON-954528396 None] deleting rbd volume volume-cd8e6656-7189-4225-b0f8-b22ce262438d {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:51:39.759472 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-916ded87-e97e-4943-8f2a-eb96ea8ad4b6 tempest-TestVolumeBootPattern-539025653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:51:39.780009 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-916ded87-e97e-4943-8f2a-eb96ea8ad4b6 tempest-TestVolumeBootPattern-539025653 None] Flow 'volume_create_manager' (e0258a02-8ab0-4d79-9f02-b29557fc8dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:51:39.786666 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-916ded87-e97e-4943-8f2a-eb96ea8ad4b6 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcc9bf42-9664-465e-8399-9fcb283b7eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:51:39.805531 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-916ded87-e97e-4943-8f2a-eb96ea8ad4b6 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcc9bf42-9664-465e-8399-9fcb283b7eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1971355935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1f0104e1-0316-4101-96fd-5f0f496e3800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='839ab2af4d6b40c3b957be9c7dc78b26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:51:40Z,use_quota=True,user_id='4d838be38c1941eba44ffcfc6c17f002',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:51:39.811339 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-916ded87-e97e-4943-8f2a-eb96ea8ad4b6 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e29610b-9040-49bd-8b11-55bc425e2055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:51:39.815591 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-916ded87-e97e-4943-8f2a-eb96ea8ad4b6 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e29610b-9040-49bd-8b11-55bc425e2055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:51:39.820763 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-916ded87-e97e-4943-8f2a-eb96ea8ad4b6 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf7cbce-d743-4dbd-a28c-a1cc727fd6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:51:39.906523 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-916ded87-e97e-4943-8f2a-eb96ea8ad4b6 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf7cbce-d743-4dbd-a28c-a1cc727fd6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1f0104e1-0316-4101-96fd-5f0f496e3800', 'volume_name': 'volume-1f0104e1-0316-4101-96fd-5f0f496e3800', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:51:39.911588 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-916ded87-e97e-4943-8f2a-eb96ea8ad4b6 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d3068d3-ae0e-46da-add6-54354cc6ca76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:51:39.915517 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-916ded87-e97e-4943-8f2a-eb96ea8ad4b6 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d3068d3-ae0e-46da-add6-54354cc6ca76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:51:39.920327 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-916ded87-e97e-4943-8f2a-eb96ea8ad4b6 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15baf9a3-1f68-4202-b092-870416b208f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:51:39.921461 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-916ded87-e97e-4943-8f2a-eb96ea8ad4b6 tempest-TestVolumeBootPattern-539025653 None] Volume 1f0104e1-0316-4101-96fd-5f0f496e3800: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1f0104e1-0316-4101-96fd-5f0f496e3800', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 30 21:51:39.922123 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-916ded87-e97e-4943-8f2a-eb96ea8ad4b6 tempest-TestVolumeBootPattern-539025653 None] Cloning 1f0104e1-0316-4101-96fd-5f0f496e3800 from image a5b0850f-3b24-4bcb-b0a7-351c3216b27d at location (None, None). {{(pid=123855) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Apr 30 21:51:39.933571 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-916ded87-e97e-4943-8f2a-eb96ea8ad4b6 tempest-TestVolumeBootPattern-539025653 None] Lock "b'cinder-a5b0850f-3b24-4bcb-b0a7-351c3216b27d'" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:51:40.003992 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-916ded87-e97e-4943-8f2a-eb96ea8ad4b6 tempest-TestVolumeBootPattern-539025653 None] Found image-volume cache entry: {'id': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'volume_id': '5772aef0-721f-450a-93ff-02cc6a41edcc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7), 'last_used': datetime.datetime(2022, 4, 30, 21, 51, 39, 934512)}. {{(pid=123855) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 30 21:51:40.004884 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-916ded87-e97e-4943-8f2a-eb96ea8ad4b6 tempest-TestVolumeBootPattern-539025653 None] Image-volume cache entry image_update_at = 2022-04-30 21:01:07+00:00, requested image updated_at = 2022-04-30 21:01:07+00:00. {{(pid=123855) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 30 21:51:40.005316 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-916ded87-e97e-4943-8f2a-eb96ea8ad4b6 tempest-TestVolumeBootPattern-539025653 None] Found cache entry for image = a5b0850f-3b24-4bcb-b0a7-351c3216b27d on host ncdv-master-1@ceph#ceph. {{(pid=123855) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Apr 30 21:51:40.010363 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-916ded87-e97e-4943-8f2a-eb96ea8ad4b6 tempest-TestVolumeBootPattern-539025653 None] Lock "b'cinder-a5b0850f-3b24-4bcb-b0a7-351c3216b27d'" released by "_prepare_image_cache_entry" :: held 0.079s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:51:40.011343 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-916ded87-e97e-4943-8f2a-eb96ea8ad4b6 tempest-TestVolumeBootPattern-539025653 None] Attempting to retrieve cache entry for image = a5b0850f-3b24-4bcb-b0a7-351c3216b27d on host ncdv-master-1@ceph#ceph. {{(pid=123855) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Apr 30 21:51:40.017192 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-916ded87-e97e-4943-8f2a-eb96ea8ad4b6 tempest-TestVolumeBootPattern-539025653 None] Found image-volume cache entry: {'id': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'volume_id': '5772aef0-721f-450a-93ff-02cc6a41edcc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7), 'last_used': datetime.datetime(2022, 4, 30, 21, 51, 40, 14788)}. {{(pid=123855) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 30 21:51:40.017617 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-916ded87-e97e-4943-8f2a-eb96ea8ad4b6 tempest-TestVolumeBootPattern-539025653 None] Image-volume cache entry image_update_at = 2022-04-30 21:01:07+00:00, requested image updated_at = 2022-04-30 21:01:07+00:00. {{(pid=123855) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 30 21:51:40.018033 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-916ded87-e97e-4943-8f2a-eb96ea8ad4b6 tempest-TestVolumeBootPattern-539025653 None] Creating from source image-volume 5772aef0-721f-450a-93ff-02cc6a41edcc {{(pid=123855) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Apr 30 21:51:40.030348 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-916ded87-e97e-4943-8f2a-eb96ea8ad4b6 tempest-TestVolumeBootPattern-539025653 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:51:40.363370 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-916ded87-e97e-4943-8f2a-eb96ea8ad4b6 tempest-TestVolumeBootPattern-539025653 None] creating snapshot='volume-1f0104e1-0316-4101-96fd-5f0f496e3800.clone_snap' {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} Apr 30 21:51:42.541848 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-916ded87-e97e-4943-8f2a-eb96ea8ad4b6 tempest-TestVolumeBootPattern-539025653 None] cloning 'volume-5772aef0-721f-450a-93ff-02cc6a41edcc@volume-1f0104e1-0316-4101-96fd-5f0f496e3800.clone_snap' to 'volume-1f0104e1-0316-4101-96fd-5f0f496e3800' {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} Apr 30 21:51:42.627182 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-f2b5d9de-4dbb-48b3-9947-d1506cccb2ff tempest-VolumesSnapshotTestJSON-954528396 None] Created reservations ['b7374c24-7fe3-422d-ab43-992c6078d87d', 'c3d9bad6-ca48-4096-887c-fdaf544ae28d', '1945a05b-e197-4cba-880d-7a68ce09e4eb', 'b037f330-5c30-4bc7-a750-6d3dacd9f1e4'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:51:42.793143 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f2b5d9de-4dbb-48b3-9947-d1506cccb2ff tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:51:42.848715 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f2b5d9de-4dbb-48b3-9947-d1506cccb2ff tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:51:42.876332 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-f2b5d9de-4dbb-48b3-9947-d1506cccb2ff tempest-VolumesSnapshotTestJSON-954528396 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:51:42.880682 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-f2b5d9de-4dbb-48b3-9947-d1506cccb2ff tempest-VolumesSnapshotTestJSON-954528396 None] Deleted volume successfully. Apr 30 21:51:42.962821 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-f2b5d9de-4dbb-48b3-9947-d1506cccb2ff tempest-VolumesSnapshotTestJSON-954528396 None] Lock "b'cinder-cd8e6656-7189-4225-b0f8-b22ce262438d-delete_volume'" released by "delete_volume" :: held 4.602s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:51:43.543078 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-916ded87-e97e-4943-8f2a-eb96ea8ad4b6 tempest-TestVolumeBootPattern-539025653 None] Volume volume-632a7810-1a6f-420a-a6fd-57675408a8f7.deleted is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:51:43.544536 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-916ded87-e97e-4943-8f2a-eb96ea8ad4b6 tempest-TestVolumeBootPattern-539025653 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:51:43.544910 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-916ded87-e97e-4943-8f2a-eb96ea8ad4b6 tempest-TestVolumeBootPattern-539025653 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:51:43.763354 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-916ded87-e97e-4943-8f2a-eb96ea8ad4b6 tempest-TestVolumeBootPattern-539025653 None] clone created successfully {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} Apr 30 21:51:43.763984 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.volume_utils [None req-916ded87-e97e-4943-8f2a-eb96ea8ad4b6 tempest-TestVolumeBootPattern-539025653 None] Marking volume 1f0104e1-0316-4101-96fd-5f0f496e3800 as bootable. {{(pid=123855) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Apr 30 21:51:43.866547 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-916ded87-e97e-4943-8f2a-eb96ea8ad4b6 tempest-TestVolumeBootPattern-539025653 None] Copying metadata from image a5b0850f-3b24-4bcb-b0a7-351c3216b27d to 1f0104e1-0316-4101-96fd-5f0f496e3800. {{(pid=123855) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Apr 30 21:51:43.866976 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-916ded87-e97e-4943-8f2a-eb96ea8ad4b6 tempest-TestVolumeBootPattern-539025653 None] Creating volume glance metadata for volume 1f0104e1-0316-4101-96fd-5f0f496e3800 backed by image a5b0850f-3b24-4bcb-b0a7-351c3216b27d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123855) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Apr 30 21:51:43.978936 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-916ded87-e97e-4943-8f2a-eb96ea8ad4b6 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15baf9a3-1f68-4202-b092-870416b208f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f0104e1-0316-4101-96fd-5f0f496e3800', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:51:43.983938 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-916ded87-e97e-4943-8f2a-eb96ea8ad4b6 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c61c31-74d1-4fbf-9d1f-a68b3d9cf17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:51:44.066561 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-916ded87-e97e-4943-8f2a-eb96ea8ad4b6 tempest-TestVolumeBootPattern-539025653 None] Volume volume-1f0104e1-0316-4101-96fd-5f0f496e3800 (1f0104e1-0316-4101-96fd-5f0f496e3800): created successfully Apr 30 21:51:44.070275 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-916ded87-e97e-4943-8f2a-eb96ea8ad4b6 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c61c31-74d1-4fbf-9d1f-a68b3d9cf17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:51:44.076408 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-916ded87-e97e-4943-8f2a-eb96ea8ad4b6 tempest-TestVolumeBootPattern-539025653 None] Flow 'volume_create_manager' (e0258a02-8ab0-4d79-9f02-b29557fc8dcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:51:44.163482 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-916ded87-e97e-4943-8f2a-eb96ea8ad4b6 tempest-TestVolumeBootPattern-539025653 None] Created volume successfully. Apr 30 21:51:44.485109 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-68a4f8bf-b1db-4ddf-a0cb-bd5e6b3c363c tempest-VolumesSnapshotTestJSON-954528396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:51:44.503878 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-68a4f8bf-b1db-4ddf-a0cb-bd5e6b3c363c tempest-VolumesSnapshotTestJSON-954528396 None] Flow 'volume_create_manager' (46d6edb5-9124-4c6f-a53a-fe67c9b72ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:51:44.511834 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-68a4f8bf-b1db-4ddf-a0cb-bd5e6b3c363c tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aaa0952-f232-40d3-95d3-b34d19fc125b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:51:44.527131 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-68a4f8bf-b1db-4ddf-a0cb-bd5e6b3c363c tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aaa0952-f232-40d3-95d3-b34d19fc125b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1110771895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=09ac6e99-7da7-449b-9e69-53b5bbabdd06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1febcefe29f461ea37667520a278022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:51:44Z,use_quota=True,user_id='0ed9fb1a529f4247acd72a6de21ceb4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:51:44.532524 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-68a4f8bf-b1db-4ddf-a0cb-bd5e6b3c363c tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1562ef4-6344-414e-9b81-78b52d43d737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:51:44.536606 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-68a4f8bf-b1db-4ddf-a0cb-bd5e6b3c363c tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1562ef4-6344-414e-9b81-78b52d43d737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:51:44.541696 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-68a4f8bf-b1db-4ddf-a0cb-bd5e6b3c363c tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9e0b7b6-6bcb-4e8f-8334-cc50a152e4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:51:44.545746 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-68a4f8bf-b1db-4ddf-a0cb-bd5e6b3c363c tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9e0b7b6-6bcb-4e8f-8334-cc50a152e4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09ac6e99-7da7-449b-9e69-53b5bbabdd06', 'volume_name': 'volume-09ac6e99-7da7-449b-9e69-53b5bbabdd06', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:51:44.550619 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-68a4f8bf-b1db-4ddf-a0cb-bd5e6b3c363c tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0520be95-2ba7-429a-9650-67261153d2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:51:44.554500 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-68a4f8bf-b1db-4ddf-a0cb-bd5e6b3c363c tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0520be95-2ba7-429a-9650-67261153d2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:51:44.559188 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-68a4f8bf-b1db-4ddf-a0cb-bd5e6b3c363c tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4acb079b-ae47-48f4-ad65-1fd8cadde6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:51:44.560243 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-68a4f8bf-b1db-4ddf-a0cb-bd5e6b3c363c tempest-VolumesSnapshotTestJSON-954528396 None] Volume 09ac6e99-7da7-449b-9e69-53b5bbabdd06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09ac6e99-7da7-449b-9e69-53b5bbabdd06', 'volume_size': 1} Apr 30 21:51:44.560622 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-68a4f8bf-b1db-4ddf-a0cb-bd5e6b3c363c tempest-VolumesSnapshotTestJSON-954528396 None] creating volume 'volume-09ac6e99-7da7-449b-9e69-53b5bbabdd06' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 21:51:44.561372 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-68a4f8bf-b1db-4ddf-a0cb-bd5e6b3c363c tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:51:45.024507 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-68a4f8bf-b1db-4ddf-a0cb-bd5e6b3c363c tempest-VolumesSnapshotTestJSON-954528396 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:51:45.024879 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-68a4f8bf-b1db-4ddf-a0cb-bd5e6b3c363c tempest-VolumesSnapshotTestJSON-954528396 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:51:45.028617 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-68a4f8bf-b1db-4ddf-a0cb-bd5e6b3c363c tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4acb079b-ae47-48f4-ad65-1fd8cadde6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09ac6e99-7da7-449b-9e69-53b5bbabdd06', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:51:45.033313 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-68a4f8bf-b1db-4ddf-a0cb-bd5e6b3c363c tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (082db84c-16ba-4be3-a30f-f9eb39354061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:51:45.078121 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-68a4f8bf-b1db-4ddf-a0cb-bd5e6b3c363c tempest-VolumesSnapshotTestJSON-954528396 None] Volume volume-09ac6e99-7da7-449b-9e69-53b5bbabdd06 (09ac6e99-7da7-449b-9e69-53b5bbabdd06): created successfully Apr 30 21:51:45.081878 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-68a4f8bf-b1db-4ddf-a0cb-bd5e6b3c363c tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (082db84c-16ba-4be3-a30f-f9eb39354061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:51:45.087536 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-68a4f8bf-b1db-4ddf-a0cb-bd5e6b3c363c tempest-VolumesSnapshotTestJSON-954528396 None] Flow 'volume_create_manager' (46d6edb5-9124-4c6f-a53a-fe67c9b72ed9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:51:45.163695 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-68a4f8bf-b1db-4ddf-a0cb-bd5e6b3c363c tempest-VolumesSnapshotTestJSON-954528396 None] Created volume successfully. Apr 30 21:51:45.506465 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-b5d2802c-5ddf-4eba-aee6-8443e33304ce tempest-TestVolumeBootPattern-539025653 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:51:45.759632 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f8469c2d-39bc-4723-822f-7c365e5b01a5 tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:51:48.061490 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-f8469c2d-39bc-4723-822f-7c365e5b01a5 tempest-VolumesSnapshotTestJSON-954528396 None] Create snapshot completed successfully Apr 30 21:51:48.203442 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-b5d2802c-5ddf-4eba-aee6-8443e33304ce tempest-TestVolumeBootPattern-539025653 None] Create snapshot completed successfully Apr 30 21:51:49.480587 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-c72df419-c6d8-4795-89ca-0bf1cbd144f4 tempest-VolumesSnapshotTestJSON-954528396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:51:49.508688 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c72df419-c6d8-4795-89ca-0bf1cbd144f4 tempest-VolumesSnapshotTestJSON-954528396 None] Flow 'volume_create_manager' (242d711a-b198-47ce-9b5b-37139e3c2883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:51:49.515877 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c72df419-c6d8-4795-89ca-0bf1cbd144f4 tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (457358d4-f3c0-4022-a74e-fa76b9dc0a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:51:49.531734 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c72df419-c6d8-4795-89ca-0bf1cbd144f4 tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (457358d4-f3c0-4022-a74e-fa76b9dc0a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-213447707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8961c45a-7f22-4db3-a5ed-8f6f9a331cde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1febcefe29f461ea37667520a278022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=11623c52-92c7-4183-831e-eef8b06b352f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:51:49Z,use_quota=True,user_id='0ed9fb1a529f4247acd72a6de21ceb4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:51:49.537443 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c72df419-c6d8-4795-89ca-0bf1cbd144f4 tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fccd4b9-67d5-4037-bad3-9d202bcb04e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:51:49.541802 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c72df419-c6d8-4795-89ca-0bf1cbd144f4 tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fccd4b9-67d5-4037-bad3-9d202bcb04e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:51:49.546906 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c72df419-c6d8-4795-89ca-0bf1cbd144f4 tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dab3898f-8896-4854-92d1-3e302a2be9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:51:49.551058 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c72df419-c6d8-4795-89ca-0bf1cbd144f4 tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dab3898f-8896-4854-92d1-3e302a2be9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8961c45a-7f22-4db3-a5ed-8f6f9a331cde', 'volume_name': 'volume-8961c45a-7f22-4db3-a5ed-8f6f9a331cde', 'volume_size': 1, 'snapshot_id': '11623c52-92c7-4183-831e-eef8b06b352f'}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:51:49.556033 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c72df419-c6d8-4795-89ca-0bf1cbd144f4 tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e8bf4c9-56dd-41ff-9744-04d2e1846c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:51:49.560565 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c72df419-c6d8-4795-89ca-0bf1cbd144f4 tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e8bf4c9-56dd-41ff-9744-04d2e1846c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:51:49.565313 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c72df419-c6d8-4795-89ca-0bf1cbd144f4 tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2082e33-b95d-44d7-8828-275879a73222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:51:49.566468 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-c72df419-c6d8-4795-89ca-0bf1cbd144f4 tempest-VolumesSnapshotTestJSON-954528396 None] Volume 8961c45a-7f22-4db3-a5ed-8f6f9a331cde: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8961c45a-7f22-4db3-a5ed-8f6f9a331cde', 'volume_size': 1, 'snapshot_id': '11623c52-92c7-4183-831e-eef8b06b352f'} Apr 30 21:51:49.585722 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c72df419-c6d8-4795-89ca-0bf1cbd144f4 tempest-VolumesSnapshotTestJSON-954528396 None] cloning volumes/volume-09ac6e99-7da7-449b-9e69-53b5bbabdd06@snapshot-11623c52-92c7-4183-831e-eef8b06b352f to volume-8961c45a-7f22-4db3-a5ed-8f6f9a331cde {{(pid=123855) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1091}} Apr 30 21:51:49.586532 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c72df419-c6d8-4795-89ca-0bf1cbd144f4 tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:51:49.628424 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c72df419-c6d8-4795-89ca-0bf1cbd144f4 tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:51:50.443944 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c72df419-c6d8-4795-89ca-0bf1cbd144f4 tempest-VolumesSnapshotTestJSON-954528396 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:51:50.444329 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c72df419-c6d8-4795-89ca-0bf1cbd144f4 tempest-VolumesSnapshotTestJSON-954528396 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:51:50.464066 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c72df419-c6d8-4795-89ca-0bf1cbd144f4 tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2082e33-b95d-44d7-8828-275879a73222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8961c45a-7f22-4db3-a5ed-8f6f9a331cde', 'volume_size': 1, 'snapshot_id': '11623c52-92c7-4183-831e-eef8b06b352f'}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:51:50.468751 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c72df419-c6d8-4795-89ca-0bf1cbd144f4 tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (768b1fca-d55c-430f-a7d0-7827f2d2e0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:51:50.530013 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-c72df419-c6d8-4795-89ca-0bf1cbd144f4 tempest-VolumesSnapshotTestJSON-954528396 None] Volume volume-8961c45a-7f22-4db3-a5ed-8f6f9a331cde (8961c45a-7f22-4db3-a5ed-8f6f9a331cde): created successfully Apr 30 21:51:50.533505 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c72df419-c6d8-4795-89ca-0bf1cbd144f4 tempest-VolumesSnapshotTestJSON-954528396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (768b1fca-d55c-430f-a7d0-7827f2d2e0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:51:50.539062 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c72df419-c6d8-4795-89ca-0bf1cbd144f4 tempest-VolumesSnapshotTestJSON-954528396 None] Flow 'volume_create_manager' (242d711a-b198-47ce-9b5b-37139e3c2883) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:51:50.592259 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-c72df419-c6d8-4795-89ca-0bf1cbd144f4 tempest-VolumesSnapshotTestJSON-954528396 None] Created volume successfully. Apr 30 21:51:51.559221 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-a038270c-32c8-4876-a294-5dede9eab814 tempest-VolumesSnapshotTestJSON-954528396 None] Lock "b'cinder-8961c45a-7f22-4db3-a5ed-8f6f9a331cde-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:51:51.673032 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a038270c-32c8-4876-a294-5dede9eab814 tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:51:51.843976 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a038270c-32c8-4876-a294-5dede9eab814 tempest-VolumesSnapshotTestJSON-954528396 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:51:51.977368 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a038270c-32c8-4876-a294-5dede9eab814 tempest-VolumesSnapshotTestJSON-954528396 None] deleting rbd volume volume-8961c45a-7f22-4db3-a5ed-8f6f9a331cde {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:51:52.662103 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [req-58112c39-5cca-4db4-a3d7-0211cddd344f req-41af3f12-5b7c-4fa8-a781-613b98788b52 tempest-TestVolumeBootPattern-539025653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:51:52.691351 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-58112c39-5cca-4db4-a3d7-0211cddd344f req-41af3f12-5b7c-4fa8-a781-613b98788b52 tempest-TestVolumeBootPattern-539025653 None] Flow 'volume_create_manager' (4e4f8761-9d83-49c2-afe0-2a65c81e30f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:51:52.697810 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-58112c39-5cca-4db4-a3d7-0211cddd344f req-41af3f12-5b7c-4fa8-a781-613b98788b52 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (159ff31b-d496-4288-96b2-49c3a4189230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:51:52.714858 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-58112c39-5cca-4db4-a3d7-0211cddd344f req-41af3f12-5b7c-4fa8-a781-613b98788b52 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (159ff31b-d496-4288-96b2-49c3a4189230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:51:52Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2efe524c-9bc8-4297-adf2-325865ad46c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='839ab2af4d6b40c3b957be9c7dc78b26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1015f375-c3d8-41c8-9a88-5a3e99cf27c6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:51:53Z,use_quota=True,user_id='4d838be38c1941eba44ffcfc6c17f002',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:51:52.720399 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-58112c39-5cca-4db4-a3d7-0211cddd344f req-41af3f12-5b7c-4fa8-a781-613b98788b52 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88d43803-a4d1-417a-9d39-bf41b1b681f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:51:52.724598 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-58112c39-5cca-4db4-a3d7-0211cddd344f req-41af3f12-5b7c-4fa8-a781-613b98788b52 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88d43803-a4d1-417a-9d39-bf41b1b681f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:51:52.729732 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-58112c39-5cca-4db4-a3d7-0211cddd344f req-41af3f12-5b7c-4fa8-a781-613b98788b52 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad8456aa-b0b5-4f81-b30c-ee91071f17e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:51:52.734520 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-58112c39-5cca-4db4-a3d7-0211cddd344f req-41af3f12-5b7c-4fa8-a781-613b98788b52 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad8456aa-b0b5-4f81-b30c-ee91071f17e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2efe524c-9bc8-4297-adf2-325865ad46c9', 'volume_name': 'volume-2efe524c-9bc8-4297-adf2-325865ad46c9', 'volume_size': 1, 'snapshot_id': '1015f375-c3d8-41c8-9a88-5a3e99cf27c6'}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:51:52.739417 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-58112c39-5cca-4db4-a3d7-0211cddd344f req-41af3f12-5b7c-4fa8-a781-613b98788b52 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05093ea9-93df-4938-876b-091f330cb721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:51:52.743331 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-58112c39-5cca-4db4-a3d7-0211cddd344f req-41af3f12-5b7c-4fa8-a781-613b98788b52 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05093ea9-93df-4938-876b-091f330cb721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:51:52.748735 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-58112c39-5cca-4db4-a3d7-0211cddd344f req-41af3f12-5b7c-4fa8-a781-613b98788b52 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fbb164b-83c9-494e-b66c-9c5d98d27564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:51:52.749852 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [req-58112c39-5cca-4db4-a3d7-0211cddd344f req-41af3f12-5b7c-4fa8-a781-613b98788b52 tempest-TestVolumeBootPattern-539025653 None] Volume 2efe524c-9bc8-4297-adf2-325865ad46c9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2efe524c-9bc8-4297-adf2-325865ad46c9', 'volume_size': 1, 'snapshot_id': '1015f375-c3d8-41c8-9a88-5a3e99cf27c6'} Apr 30 21:51:52.768483 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-58112c39-5cca-4db4-a3d7-0211cddd344f req-41af3f12-5b7c-4fa8-a781-613b98788b52 tempest-TestVolumeBootPattern-539025653 None] cloning volumes/volume-1f0104e1-0316-4101-96fd-5f0f496e3800@snapshot-1015f375-c3d8-41c8-9a88-5a3e99cf27c6 to volume-2efe524c-9bc8-4297-adf2-325865ad46c9 {{(pid=123855) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1091}} Apr 30 21:51:52.769146 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-58112c39-5cca-4db4-a3d7-0211cddd344f req-41af3f12-5b7c-4fa8-a781-613b98788b52 tempest-TestVolumeBootPattern-539025653 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:51:52.834866 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-58112c39-5cca-4db4-a3d7-0211cddd344f req-41af3f12-5b7c-4fa8-a781-613b98788b52 tempest-TestVolumeBootPattern-539025653 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:51:54.603079 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-58112c39-5cca-4db4-a3d7-0211cddd344f req-41af3f12-5b7c-4fa8-a781-613b98788b52 tempest-TestVolumeBootPattern-539025653 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:51:54.603710 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-58112c39-5cca-4db4-a3d7-0211cddd344f req-41af3f12-5b7c-4fa8-a781-613b98788b52 tempest-TestVolumeBootPattern-539025653 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:51:54.618116 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.volume_utils [req-58112c39-5cca-4db4-a3d7-0211cddd344f req-41af3f12-5b7c-4fa8-a781-613b98788b52 tempest-TestVolumeBootPattern-539025653 None] Marking volume 2efe524c-9bc8-4297-adf2-325865ad46c9 as bootable. {{(pid=123855) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Apr 30 21:51:54.677913 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [req-58112c39-5cca-4db4-a3d7-0211cddd344f req-41af3f12-5b7c-4fa8-a781-613b98788b52 tempest-TestVolumeBootPattern-539025653 None] Copying metadata from snapshot 1015f375-c3d8-41c8-9a88-5a3e99cf27c6 to 2efe524c-9bc8-4297-adf2-325865ad46c9. {{(pid=123855) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:427}} Apr 30 21:51:54.750519 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-58112c39-5cca-4db4-a3d7-0211cddd344f req-41af3f12-5b7c-4fa8-a781-613b98788b52 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fbb164b-83c9-494e-b66c-9c5d98d27564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2efe524c-9bc8-4297-adf2-325865ad46c9', 'volume_size': 1, 'snapshot_id': '1015f375-c3d8-41c8-9a88-5a3e99cf27c6'}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:51:54.755243 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-58112c39-5cca-4db4-a3d7-0211cddd344f req-41af3f12-5b7c-4fa8-a781-613b98788b52 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f568ebee-4cad-417d-a91e-4750a223c5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:51:54.797742 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [req-58112c39-5cca-4db4-a3d7-0211cddd344f req-41af3f12-5b7c-4fa8-a781-613b98788b52 tempest-TestVolumeBootPattern-539025653 None] Volume volume-2efe524c-9bc8-4297-adf2-325865ad46c9 (2efe524c-9bc8-4297-adf2-325865ad46c9): created successfully Apr 30 21:51:54.801413 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-58112c39-5cca-4db4-a3d7-0211cddd344f req-41af3f12-5b7c-4fa8-a781-613b98788b52 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f568ebee-4cad-417d-a91e-4750a223c5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:51:54.807040 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-58112c39-5cca-4db4-a3d7-0211cddd344f req-41af3f12-5b7c-4fa8-a781-613b98788b52 tempest-TestVolumeBootPattern-539025653 None] Flow 'volume_create_manager' (4e4f8761-9d83-49c2-afe0-2a65c81e30f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:51:54.883804 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-58112c39-5cca-4db4-a3d7-0211cddd344f req-41af3f12-5b7c-4fa8-a781-613b98788b52 tempest-TestVolumeBootPattern-539025653 None] Created volume successfully. Apr 30 21:51:55.512713 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-a038270c-32c8-4876-a294-5dede9eab814 tempest-VolumesSnapshotTestJSON-954528396 None] Created reservations ['c8a32359-6d03-468a-9be1-217ae8ba23e1', '2cb6bc5e-7517-4d2d-bb58-05c44783c2c5', 'f44880bc-c000-4a00-8f2d-302e6ff6dc63', 'f3d65c85-0f28-4799-929e-8bce49500f43'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:51:55.672559 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a038270c-32c8-4876-a294-5dede9eab814 tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:51:55.697410 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a038270c-32c8-4876-a294-5dede9eab814 tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:51:55.719561 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-a038270c-32c8-4876-a294-5dede9eab814 tempest-VolumesSnapshotTestJSON-954528396 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:51:55.723741 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-a038270c-32c8-4876-a294-5dede9eab814 tempest-VolumesSnapshotTestJSON-954528396 None] Deleted volume successfully. Apr 30 21:51:55.780315 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-a038270c-32c8-4876-a294-5dede9eab814 tempest-VolumesSnapshotTestJSON-954528396 None] Lock "b'cinder-8961c45a-7f22-4db3-a5ed-8f6f9a331cde-delete_volume'" released by "delete_volume" :: held 4.220s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:51:55.907061 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-05ae2f4f-e544-4f46-b76f-860c10d38a69 tempest-VolumesSnapshotTestJSON-954528396 None] Lock "b'cinder-11623c52-92c7-4183-831e-eef8b06b352f-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:51:55.907725 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-05ae2f4f-e544-4f46-b76f-860c10d38a69 tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:51:56.088960 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-58112c39-5cca-4db4-a3d7-0211cddd344f req-01078007-9e2c-480a-a22a-44eaf66e7751 tempest-TestVolumeBootPattern-539025653 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:51:56.720331 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-58112c39-5cca-4db4-a3d7-0211cddd344f req-01078007-9e2c-480a-a22a-44eaf66e7751 tempest-TestVolumeBootPattern-539025653 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.631s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:51:56.721097 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-58112c39-5cca-4db4-a3d7-0211cddd344f req-01078007-9e2c-480a-a22a-44eaf66e7751 tempest-TestVolumeBootPattern-539025653 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2efe524c-9bc8-4297-adf2-325865ad46c9', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': '2efe524c-9bc8-4297-adf2-325865ad46c9', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:51:56.803929 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-58112c39-5cca-4db4-a3d7-0211cddd344f req-01078007-9e2c-480a-a22a-44eaf66e7751 tempest-TestVolumeBootPattern-539025653 None] Connection info returned from driver {'name': 'volumes/volume-2efe524c-9bc8-4297-adf2-325865ad46c9', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2efe524c-9bc8-4297-adf2-325865ad46c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f227a2e3-390f-48ee-9ae2-de0c3d6bfdc2'} {{(pid=123855) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Apr 30 21:51:56.925839 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-58112c39-5cca-4db4-a3d7-0211cddd344f req-01078007-9e2c-480a-a22a-44eaf66e7751 tempest-TestVolumeBootPattern-539025653 None] attachment_update completed successfully. Apr 30 21:51:57.969287 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-05ae2f4f-e544-4f46-b76f-860c10d38a69 tempest-VolumesSnapshotTestJSON-954528396 None] Created reservations ['f5508e25-53bf-40cd-9ad2-f8798a4126bc', 'ad58bb3b-afb8-47f6-ae45-42066f4030ca', '41bc25a0-bf4a-4276-87a2-96038baa1479', '91ef3f43-5d4c-42bd-85d2-ba206c568653'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:51:58.106165 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-05ae2f4f-e544-4f46-b76f-860c10d38a69 tempest-VolumesSnapshotTestJSON-954528396 None] Delete snapshot completed successfully. Apr 30 21:51:58.111531 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-05ae2f4f-e544-4f46-b76f-860c10d38a69 tempest-VolumesSnapshotTestJSON-954528396 None] Lock "b'cinder-11623c52-92c7-4183-831e-eef8b06b352f-delete_snapshot'" released by "delete_snapshot" :: held 2.206s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:51:59.161141 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-60ded99f-56f8-4399-9753-d25d61dc2197 tempest-VolumesSnapshotTestJSON-954528396 None] Lock "b'cinder-09ac6e99-7da7-449b-9e69-53b5bbabdd06-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:51:59.227316 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-60ded99f-56f8-4399-9753-d25d61dc2197 tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:51:59.358199 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-60ded99f-56f8-4399-9753-d25d61dc2197 tempest-VolumesSnapshotTestJSON-954528396 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:51:59.358646 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-60ded99f-56f8-4399-9753-d25d61dc2197 tempest-VolumesSnapshotTestJSON-954528396 None] Volume volume-09ac6e99-7da7-449b-9e69-53b5bbabdd06 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:51:59.466925 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-60ded99f-56f8-4399-9753-d25d61dc2197 tempest-VolumesSnapshotTestJSON-954528396 None] deleting rbd volume volume-09ac6e99-7da7-449b-9e69-53b5bbabdd06 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:52:02.331798 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-60ded99f-56f8-4399-9753-d25d61dc2197 tempest-VolumesSnapshotTestJSON-954528396 None] Created reservations ['c0573ef8-f2ce-40b0-a2c1-e62be65ab980', 'f41ea997-ace7-4ff1-bddb-d29cfd57de15', 'cb89f582-a3f5-418d-b7fd-e0d66e02f190', '4deb1e18-6d25-4f2c-83e7-054ca5ffdafc'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:52:02.506915 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-60ded99f-56f8-4399-9753-d25d61dc2197 tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:52:02.537974 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-60ded99f-56f8-4399-9753-d25d61dc2197 tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:52:02.564937 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-60ded99f-56f8-4399-9753-d25d61dc2197 tempest-VolumesSnapshotTestJSON-954528396 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:52:02.569520 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-60ded99f-56f8-4399-9753-d25d61dc2197 tempest-VolumesSnapshotTestJSON-954528396 None] Deleted volume successfully. Apr 30 21:52:02.629923 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-60ded99f-56f8-4399-9753-d25d61dc2197 tempest-VolumesSnapshotTestJSON-954528396 None] Lock "b'cinder-09ac6e99-7da7-449b-9e69-53b5bbabdd06-delete_volume'" released by "delete_volume" :: held 3.469s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:52:03.491426 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-839f919d-49f8-4c17-a36e-e84dbcffb06d tempest-VolumesSnapshotTestJSON-954528396 None] Lock "b'cinder-fea59f3f-40d4-4b59-b594-93fa979f1e0b-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:52:03.491426 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-839f919d-49f8-4c17-a36e-e84dbcffb06d tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:52:05.249515 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-839f919d-49f8-4c17-a36e-e84dbcffb06d tempest-VolumesSnapshotTestJSON-954528396 None] Created reservations ['f9cd1102-7032-4c7d-9f71-be5eab26c401', '99a7ebcf-2ef4-4797-bb35-aebe1176c9c6', '8d7ed43a-0a36-4cbc-87b3-aa3c556578c7', '3130b6ef-f462-4730-a0a9-68b4403469a5'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:52:05.420363 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-839f919d-49f8-4c17-a36e-e84dbcffb06d tempest-VolumesSnapshotTestJSON-954528396 None] Delete snapshot completed successfully. Apr 30 21:52:05.424739 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-839f919d-49f8-4c17-a36e-e84dbcffb06d tempest-VolumesSnapshotTestJSON-954528396 None] Lock "b'cinder-fea59f3f-40d4-4b59-b594-93fa979f1e0b-delete_snapshot'" released by "delete_snapshot" :: held 1.936s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:52:05.738115 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-9409afe9-0e99-4feb-b3cb-72ac67703125 tempest-VolumesSnapshotTestJSON-954528396 None] Lock "b'cinder-24cbb600-25d1-47e8-bc7c-fed2f51ec9f8-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:52:05.825523 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9409afe9-0e99-4feb-b3cb-72ac67703125 tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:52:05.923286 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9409afe9-0e99-4feb-b3cb-72ac67703125 tempest-VolumesSnapshotTestJSON-954528396 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:52:05.923710 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9409afe9-0e99-4feb-b3cb-72ac67703125 tempest-VolumesSnapshotTestJSON-954528396 None] Volume volume-24cbb600-25d1-47e8-bc7c-fed2f51ec9f8 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:52:06.015886 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9409afe9-0e99-4feb-b3cb-72ac67703125 tempest-VolumesSnapshotTestJSON-954528396 None] deleting rbd volume volume-24cbb600-25d1-47e8-bc7c-fed2f51ec9f8 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:52:08.735529 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-9409afe9-0e99-4feb-b3cb-72ac67703125 tempest-VolumesSnapshotTestJSON-954528396 None] Created reservations ['366142f8-c63a-4ee5-88c9-85e21d23a21c', '567936c0-b2f1-47e4-93ce-d1ada1195291', '872909d6-7d7b-4497-922e-083f8a1e06de', 'f5067236-6fc1-4295-90be-cfe67b4a0340'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:52:08.861448 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9409afe9-0e99-4feb-b3cb-72ac67703125 tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:52:08.889786 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-9409afe9-0e99-4feb-b3cb-72ac67703125 tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:52:08.923367 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-9409afe9-0e99-4feb-b3cb-72ac67703125 tempest-VolumesSnapshotTestJSON-954528396 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:52:08.927773 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-9409afe9-0e99-4feb-b3cb-72ac67703125 tempest-VolumesSnapshotTestJSON-954528396 None] Deleted volume successfully. Apr 30 21:52:09.007682 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-9409afe9-0e99-4feb-b3cb-72ac67703125 tempest-VolumesSnapshotTestJSON-954528396 None] Lock "b'cinder-24cbb600-25d1-47e8-bc7c-fed2f51ec9f8-delete_volume'" released by "delete_volume" :: held 3.270s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:52:09.179025 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-65d97821-6c01-4907-be1b-9836fbad7b69 tempest-VolumesSnapshotTestJSON-954528396 None] Lock "b'cinder-cef2a6ba-722a-421e-a3d7-963730a1eb11-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:52:09.255154 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-65d97821-6c01-4907-be1b-9836fbad7b69 tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:52:09.420510 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-65d97821-6c01-4907-be1b-9836fbad7b69 tempest-VolumesSnapshotTestJSON-954528396 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:52:09.513566 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-65d97821-6c01-4907-be1b-9836fbad7b69 tempest-VolumesSnapshotTestJSON-954528396 None] deleting rbd volume volume-cef2a6ba-722a-421e-a3d7-963730a1eb11 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:52:10.488528 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-78999374-1ef3-47b7-bc4b-42090636a06a req-6ab11299-50ea-42bb-b420-5b7e6f136e90 tempest-TestVolumeBootPattern-539025653 None] Terminate volume connection completed successfully. Apr 30 21:52:10.489162 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-78999374-1ef3-47b7-bc4b-42090636a06a req-6ab11299-50ea-42bb-b420-5b7e6f136e90 tempest-TestVolumeBootPattern-539025653 None] Deleting attachment f227a2e3-390f-48ee-9ae2-de0c3d6bfdc2. {{(pid=123855) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} Apr 30 21:52:10.930090 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [req-78999374-1ef3-47b7-bc4b-42090636a06a req-c9a26e1b-6675-4e57-b8d2-5881ba1b366a tempest-TestVolumeBootPattern-539025653 None] Lock "b'cinder-2efe524c-9bc8-4297-adf2-325865ad46c9-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:52:11.015313 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-78999374-1ef3-47b7-bc4b-42090636a06a req-c9a26e1b-6675-4e57-b8d2-5881ba1b366a tempest-TestVolumeBootPattern-539025653 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:52:11.254523 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-78999374-1ef3-47b7-bc4b-42090636a06a req-c9a26e1b-6675-4e57-b8d2-5881ba1b366a tempest-TestVolumeBootPattern-539025653 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:52:11.509083 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-78999374-1ef3-47b7-bc4b-42090636a06a req-c9a26e1b-6675-4e57-b8d2-5881ba1b366a tempest-TestVolumeBootPattern-539025653 None] deleting rbd volume volume-2efe524c-9bc8-4297-adf2-325865ad46c9 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:52:14.644383 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-65d97821-6c01-4907-be1b-9836fbad7b69 tempest-VolumesSnapshotTestJSON-954528396 None] volume is a clone so cleaning references {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} Apr 30 21:52:14.953052 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-65d97821-6c01-4907-be1b-9836fbad7b69 tempest-VolumesSnapshotTestJSON-954528396 None] deleting parent snapshot volume-cef2a6ba-722a-421e-a3d7-963730a1eb11.clone_snap {{(pid=123855) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} Apr 30 21:52:17.660705 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-65d97821-6c01-4907-be1b-9836fbad7b69 tempest-VolumesSnapshotTestJSON-954528396 None] Created reservations ['4c107e07-ac54-47a7-8c1c-058af96b8e85', 'c23eba96-fbd3-456d-b8ea-c50e6cd6da26', '7760caa6-4057-407f-892d-5ff3c01d6890', 'f90abb92-2049-4ce7-b96f-a6327c0e204d'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:52:17.851155 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-65d97821-6c01-4907-be1b-9836fbad7b69 tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:52:17.876535 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-65d97821-6c01-4907-be1b-9836fbad7b69 tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:52:17.908530 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-65d97821-6c01-4907-be1b-9836fbad7b69 tempest-VolumesSnapshotTestJSON-954528396 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:52:17.914722 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-65d97821-6c01-4907-be1b-9836fbad7b69 tempest-VolumesSnapshotTestJSON-954528396 None] Deleted volume successfully. Apr 30 21:52:18.002978 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [req-78999374-1ef3-47b7-bc4b-42090636a06a req-c9a26e1b-6675-4e57-b8d2-5881ba1b366a tempest-TestVolumeBootPattern-539025653 None] Created reservations ['c81c8f5a-e21a-45da-8542-52896fdc3f90', '1ccc9fef-77b0-4b4d-b294-34229a021145', '5d795e52-0c17-416a-b6c0-d3624476dee5', 'b463b53a-2b4a-4e71-9cb4-41ad8175ad32'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:52:18.021462 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-65d97821-6c01-4907-be1b-9836fbad7b69 tempest-VolumesSnapshotTestJSON-954528396 None] Lock "b'cinder-cef2a6ba-722a-421e-a3d7-963730a1eb11-delete_volume'" released by "delete_volume" :: held 8.843s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:52:18.180846 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-78999374-1ef3-47b7-bc4b-42090636a06a req-c9a26e1b-6675-4e57-b8d2-5881ba1b366a tempest-TestVolumeBootPattern-539025653 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:52:18.202592 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-78999374-1ef3-47b7-bc4b-42090636a06a req-c9a26e1b-6675-4e57-b8d2-5881ba1b366a tempest-TestVolumeBootPattern-539025653 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:52:18.224743 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [req-78999374-1ef3-47b7-bc4b-42090636a06a req-c9a26e1b-6675-4e57-b8d2-5881ba1b366a tempest-TestVolumeBootPattern-539025653 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:52:18.228491 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-78999374-1ef3-47b7-bc4b-42090636a06a req-c9a26e1b-6675-4e57-b8d2-5881ba1b366a tempest-TestVolumeBootPattern-539025653 None] Deleted volume successfully. Apr 30 21:52:18.327151 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [req-78999374-1ef3-47b7-bc4b-42090636a06a req-c9a26e1b-6675-4e57-b8d2-5881ba1b366a tempest-TestVolumeBootPattern-539025653 None] Lock "b'cinder-2efe524c-9bc8-4297-adf2-325865ad46c9-delete_volume'" released by "delete_volume" :: held 7.399s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:52:18.779927 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-281a532a-dd3c-4dbe-98ad-e5073891599c tempest-VolumesSnapshotTestJSON-954528396 None] Lock "b'cinder-ec2413ff-cb82-413a-a348-da9cd71a0085-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:52:18.781422 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-281a532a-dd3c-4dbe-98ad-e5073891599c tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:52:19.139398 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-c45ce8a6-8918-473b-bac9-3cbc602f86b5 tempest-TestVolumeBootPattern-539025653 None] Lock "b'cinder-1015f375-c3d8-41c8-9a88-5a3e99cf27c6-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.015s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:52:19.151012 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c45ce8a6-8918-473b-bac9-3cbc602f86b5 tempest-TestVolumeBootPattern-539025653 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:52:21.409374 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-281a532a-dd3c-4dbe-98ad-e5073891599c tempest-VolumesSnapshotTestJSON-954528396 None] Created reservations ['b0472d2f-7009-4aa0-a98e-4f2bf4055a7e', '7e76e064-23bb-4115-8cfc-5ebf07d25948', '7cf6333a-1e43-43a4-97c3-b7ab50e3b079', '6cb76033-db5c-4d5e-a02a-cf9f48bcfb84'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:52:21.540521 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-281a532a-dd3c-4dbe-98ad-e5073891599c tempest-VolumesSnapshotTestJSON-954528396 None] Delete snapshot completed successfully. Apr 30 21:52:21.544822 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-281a532a-dd3c-4dbe-98ad-e5073891599c tempest-VolumesSnapshotTestJSON-954528396 None] Lock "b'cinder-ec2413ff-cb82-413a-a348-da9cd71a0085-delete_snapshot'" released by "delete_snapshot" :: held 2.765s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:52:22.035980 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-5340caed-69c7-4c71-be55-206e6882b61f tempest-VolumesSnapshotTestJSON-954528396 None] Lock "b'cinder-9ef7b859-1b98-4726-ad7b-39ae6a4c5bcb-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:52:22.124607 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-5340caed-69c7-4c71-be55-206e6882b61f tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:52:22.300772 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-5340caed-69c7-4c71-be55-206e6882b61f tempest-VolumesSnapshotTestJSON-954528396 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:52:22.301201 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-5340caed-69c7-4c71-be55-206e6882b61f tempest-VolumesSnapshotTestJSON-954528396 None] Volume volume-9ef7b859-1b98-4726-ad7b-39ae6a4c5bcb is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:52:22.546697 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-5340caed-69c7-4c71-be55-206e6882b61f tempest-VolumesSnapshotTestJSON-954528396 None] deleting rbd volume volume-9ef7b859-1b98-4726-ad7b-39ae6a4c5bcb {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:52:22.751824 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-c45ce8a6-8918-473b-bac9-3cbc602f86b5 tempest-TestVolumeBootPattern-539025653 None] Created reservations ['b8e3d2b9-9ca0-402e-9a01-3a74d9bca634', 'b26513b7-dcd5-429d-b526-4c01a47e64f7', '06d3b69c-c152-4ce9-9406-0b0874baff40', 'ab7568ca-7fe4-4de3-9872-97c5a5241daa'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:52:23.014891 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-c45ce8a6-8918-473b-bac9-3cbc602f86b5 tempest-TestVolumeBootPattern-539025653 None] Delete snapshot completed successfully. Apr 30 21:52:23.019663 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-c45ce8a6-8918-473b-bac9-3cbc602f86b5 tempest-TestVolumeBootPattern-539025653 None] Lock "b'cinder-1015f375-c3d8-41c8-9a88-5a3e99cf27c6-delete_snapshot'" released by "delete_snapshot" :: held 3.880s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:52:23.430147 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-477a6225-2a2a-4742-9364-e4579451bdc3 tempest-TestVolumeBootPattern-539025653 None] Lock "b'cinder-1f0104e1-0316-4101-96fd-5f0f496e3800-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:52:23.511988 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-477a6225-2a2a-4742-9364-e4579451bdc3 tempest-TestVolumeBootPattern-539025653 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:52:23.716987 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-477a6225-2a2a-4742-9364-e4579451bdc3 tempest-TestVolumeBootPattern-539025653 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:52:23.861481 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-477a6225-2a2a-4742-9364-e4579451bdc3 tempest-TestVolumeBootPattern-539025653 None] deleting rbd volume volume-1f0104e1-0316-4101-96fd-5f0f496e3800 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:52:27.055157 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-5340caed-69c7-4c71-be55-206e6882b61f tempest-VolumesSnapshotTestJSON-954528396 None] Created reservations ['348675b3-8b5c-46dd-bab5-7a8672653ded', '72a6de44-3fa2-49c5-8d5d-80cfdfcde6dc', 'e495ee72-852b-4403-bfcc-d8d684012246', '1f955308-cae0-4dc4-8d01-7264469e732b'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:52:27.273587 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-5340caed-69c7-4c71-be55-206e6882b61f tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:52:27.305323 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-5340caed-69c7-4c71-be55-206e6882b61f tempest-VolumesSnapshotTestJSON-954528396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:52:27.331044 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-5340caed-69c7-4c71-be55-206e6882b61f tempest-VolumesSnapshotTestJSON-954528396 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:52:27.335448 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-5340caed-69c7-4c71-be55-206e6882b61f tempest-VolumesSnapshotTestJSON-954528396 None] Deleted volume successfully. Apr 30 21:52:27.423221 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-5340caed-69c7-4c71-be55-206e6882b61f tempest-VolumesSnapshotTestJSON-954528396 None] Lock "b'cinder-9ef7b859-1b98-4726-ad7b-39ae6a4c5bcb-delete_volume'" released by "delete_volume" :: held 5.387s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:52:28.621533 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-477a6225-2a2a-4742-9364-e4579451bdc3 tempest-TestVolumeBootPattern-539025653 None] volume is a clone so cleaning references {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} Apr 30 21:52:28.798635 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-477a6225-2a2a-4742-9364-e4579451bdc3 tempest-TestVolumeBootPattern-539025653 None] deleting parent snapshot volume-1f0104e1-0316-4101-96fd-5f0f496e3800.clone_snap {{(pid=123855) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} Apr 30 21:52:31.123129 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-477a6225-2a2a-4742-9364-e4579451bdc3 tempest-TestVolumeBootPattern-539025653 None] Created reservations ['1681ba1d-62c7-4ea0-8473-50f73a54d133', 'a4844982-34fe-433d-99b0-de712c52e0c2', '8b0f6c9b-3e2b-4812-bb12-e20fc41fc044', 'f75758ae-f893-4fbf-bf06-79db1b218f44'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:52:31.335251 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-477a6225-2a2a-4742-9364-e4579451bdc3 tempest-TestVolumeBootPattern-539025653 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:52:31.357186 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-477a6225-2a2a-4742-9364-e4579451bdc3 tempest-TestVolumeBootPattern-539025653 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:52:31.380705 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-477a6225-2a2a-4742-9364-e4579451bdc3 tempest-TestVolumeBootPattern-539025653 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:52:31.384498 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-477a6225-2a2a-4742-9364-e4579451bdc3 tempest-TestVolumeBootPattern-539025653 None] Deleted volume successfully. Apr 30 21:52:31.430745 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-477a6225-2a2a-4742-9364-e4579451bdc3 tempest-TestVolumeBootPattern-539025653 None] Lock "b'cinder-1f0104e1-0316-4101-96fd-5f0f496e3800-delete_volume'" released by "delete_volume" :: held 8.001s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:52:31.453597 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:52:31.454307 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:52:31.478021 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:52:31.502584 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:52:32.730910 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-00e02c09-8548-402b-ad24-de0f3d56dc24 tempest-TestVolumeBootPattern-539025653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:52:32.751182 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-00e02c09-8548-402b-ad24-de0f3d56dc24 tempest-TestVolumeBootPattern-539025653 None] Flow 'volume_create_manager' (7e815aba-c4eb-4202-b86a-64b05eeb9764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:52:32.758450 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-00e02c09-8548-402b-ad24-de0f3d56dc24 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb48feac-656c-4d44-8d8e-ce8f2cd673b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:52:32.780854 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-00e02c09-8548-402b-ad24-de0f3d56dc24 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb48feac-656c-4d44-8d8e-ce8f2cd673b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1705002052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f4402b35-971a-48cf-bc2d-3f5f5f47faa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='839ab2af4d6b40c3b957be9c7dc78b26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:52:33Z,use_quota=True,user_id='4d838be38c1941eba44ffcfc6c17f002',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:52:32.795258 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-00e02c09-8548-402b-ad24-de0f3d56dc24 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e5dcdda-fa80-465a-9b11-09ea07853219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:52:32.802355 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-00e02c09-8548-402b-ad24-de0f3d56dc24 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e5dcdda-fa80-465a-9b11-09ea07853219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:52:32.806929 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-00e02c09-8548-402b-ad24-de0f3d56dc24 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9a2ed87-42ab-405c-9169-1ab939d94fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:52:32.895320 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-00e02c09-8548-402b-ad24-de0f3d56dc24 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9a2ed87-42ab-405c-9169-1ab939d94fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f4402b35-971a-48cf-bc2d-3f5f5f47faa0', 'volume_name': 'volume-f4402b35-971a-48cf-bc2d-3f5f5f47faa0', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:52:32.900837 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-00e02c09-8548-402b-ad24-de0f3d56dc24 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f44da0b-faab-462a-939f-e99a8e77debc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:52:32.905004 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-00e02c09-8548-402b-ad24-de0f3d56dc24 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f44da0b-faab-462a-939f-e99a8e77debc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:52:32.909954 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-00e02c09-8548-402b-ad24-de0f3d56dc24 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5681c497-9df0-49f5-bd25-4fc8a16236f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:52:32.911211 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-00e02c09-8548-402b-ad24-de0f3d56dc24 tempest-TestVolumeBootPattern-539025653 None] Volume f4402b35-971a-48cf-bc2d-3f5f5f47faa0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f4402b35-971a-48cf-bc2d-3f5f5f47faa0', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 30 21:52:32.911790 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-00e02c09-8548-402b-ad24-de0f3d56dc24 tempest-TestVolumeBootPattern-539025653 None] Cloning f4402b35-971a-48cf-bc2d-3f5f5f47faa0 from image a5b0850f-3b24-4bcb-b0a7-351c3216b27d at location (None, None). {{(pid=123855) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Apr 30 21:52:32.919823 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-00e02c09-8548-402b-ad24-de0f3d56dc24 tempest-TestVolumeBootPattern-539025653 None] Lock "b'cinder-a5b0850f-3b24-4bcb-b0a7-351c3216b27d'" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:52:32.992150 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-00e02c09-8548-402b-ad24-de0f3d56dc24 tempest-TestVolumeBootPattern-539025653 None] Found image-volume cache entry: {'id': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'volume_id': '5772aef0-721f-450a-93ff-02cc6a41edcc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7), 'last_used': datetime.datetime(2022, 4, 30, 21, 52, 32, 923657)}. {{(pid=123855) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 30 21:52:32.992611 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-00e02c09-8548-402b-ad24-de0f3d56dc24 tempest-TestVolumeBootPattern-539025653 None] Image-volume cache entry image_update_at = 2022-04-30 21:01:07+00:00, requested image updated_at = 2022-04-30 21:01:07+00:00. {{(pid=123855) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 30 21:52:32.993014 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-00e02c09-8548-402b-ad24-de0f3d56dc24 tempest-TestVolumeBootPattern-539025653 None] Found cache entry for image = a5b0850f-3b24-4bcb-b0a7-351c3216b27d on host ncdv-master-1@ceph#ceph. {{(pid=123855) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Apr 30 21:52:32.997270 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-00e02c09-8548-402b-ad24-de0f3d56dc24 tempest-TestVolumeBootPattern-539025653 None] Lock "b'cinder-a5b0850f-3b24-4bcb-b0a7-351c3216b27d'" released by "_prepare_image_cache_entry" :: held 0.077s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:52:32.998215 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-00e02c09-8548-402b-ad24-de0f3d56dc24 tempest-TestVolumeBootPattern-539025653 None] Attempting to retrieve cache entry for image = a5b0850f-3b24-4bcb-b0a7-351c3216b27d on host ncdv-master-1@ceph#ceph. {{(pid=123855) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Apr 30 21:52:33.003953 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-00e02c09-8548-402b-ad24-de0f3d56dc24 tempest-TestVolumeBootPattern-539025653 None] Found image-volume cache entry: {'id': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'volume_id': '5772aef0-721f-450a-93ff-02cc6a41edcc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7), 'last_used': datetime.datetime(2022, 4, 30, 21, 52, 33, 1655)}. {{(pid=123855) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 30 21:52:33.004366 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-00e02c09-8548-402b-ad24-de0f3d56dc24 tempest-TestVolumeBootPattern-539025653 None] Image-volume cache entry image_update_at = 2022-04-30 21:01:07+00:00, requested image updated_at = 2022-04-30 21:01:07+00:00. {{(pid=123855) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 30 21:52:33.004748 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-00e02c09-8548-402b-ad24-de0f3d56dc24 tempest-TestVolumeBootPattern-539025653 None] Creating from source image-volume 5772aef0-721f-450a-93ff-02cc6a41edcc {{(pid=123855) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Apr 30 21:52:33.017953 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-00e02c09-8548-402b-ad24-de0f3d56dc24 tempest-TestVolumeBootPattern-539025653 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:52:33.209227 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-00e02c09-8548-402b-ad24-de0f3d56dc24 tempest-TestVolumeBootPattern-539025653 None] creating snapshot='volume-f4402b35-971a-48cf-bc2d-3f5f5f47faa0.clone_snap' {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} Apr 30 21:52:34.781353 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-00e02c09-8548-402b-ad24-de0f3d56dc24 tempest-TestVolumeBootPattern-539025653 None] cloning 'volume-5772aef0-721f-450a-93ff-02cc6a41edcc@volume-f4402b35-971a-48cf-bc2d-3f5f5f47faa0.clone_snap' to 'volume-f4402b35-971a-48cf-bc2d-3f5f5f47faa0' {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} Apr 30 21:52:35.680880 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-00e02c09-8548-402b-ad24-de0f3d56dc24 tempest-TestVolumeBootPattern-539025653 None] Volume volume-632a7810-1a6f-420a-a6fd-57675408a8f7.deleted is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:52:35.682535 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-00e02c09-8548-402b-ad24-de0f3d56dc24 tempest-TestVolumeBootPattern-539025653 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:52:35.683158 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-00e02c09-8548-402b-ad24-de0f3d56dc24 tempest-TestVolumeBootPattern-539025653 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:52:35.996461 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-00e02c09-8548-402b-ad24-de0f3d56dc24 tempest-TestVolumeBootPattern-539025653 None] clone created successfully {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} Apr 30 21:52:35.997780 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.volume_utils [None req-00e02c09-8548-402b-ad24-de0f3d56dc24 tempest-TestVolumeBootPattern-539025653 None] Marking volume f4402b35-971a-48cf-bc2d-3f5f5f47faa0 as bootable. {{(pid=123855) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Apr 30 21:52:36.066338 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-00e02c09-8548-402b-ad24-de0f3d56dc24 tempest-TestVolumeBootPattern-539025653 None] Copying metadata from image a5b0850f-3b24-4bcb-b0a7-351c3216b27d to f4402b35-971a-48cf-bc2d-3f5f5f47faa0. {{(pid=123855) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Apr 30 21:52:36.069706 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-00e02c09-8548-402b-ad24-de0f3d56dc24 tempest-TestVolumeBootPattern-539025653 None] Creating volume glance metadata for volume f4402b35-971a-48cf-bc2d-3f5f5f47faa0 backed by image a5b0850f-3b24-4bcb-b0a7-351c3216b27d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123855) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Apr 30 21:52:36.178773 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-00e02c09-8548-402b-ad24-de0f3d56dc24 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5681c497-9df0-49f5-bd25-4fc8a16236f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4402b35-971a-48cf-bc2d-3f5f5f47faa0', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:52:36.183864 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-00e02c09-8548-402b-ad24-de0f3d56dc24 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d72fef48-979e-4a0d-a286-0f60b5c01822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:52:36.260916 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-00e02c09-8548-402b-ad24-de0f3d56dc24 tempest-TestVolumeBootPattern-539025653 None] Volume volume-f4402b35-971a-48cf-bc2d-3f5f5f47faa0 (f4402b35-971a-48cf-bc2d-3f5f5f47faa0): created successfully Apr 30 21:52:36.264987 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-00e02c09-8548-402b-ad24-de0f3d56dc24 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d72fef48-979e-4a0d-a286-0f60b5c01822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:52:36.271535 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-00e02c09-8548-402b-ad24-de0f3d56dc24 tempest-TestVolumeBootPattern-539025653 None] Flow 'volume_create_manager' (7e815aba-c4eb-4202-b86a-64b05eeb9764) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:52:36.346119 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-00e02c09-8548-402b-ad24-de0f3d56dc24 tempest-TestVolumeBootPattern-539025653 None] Created volume successfully. Apr 30 21:52:41.132429 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-f60f6214-0f7b-4a0b-99b9-5922eab14ccb req-68b9d313-af7d-44c1-bae8-e3cbaf46a785 tempest-TestVolumeBootPattern-539025653 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:52:41.981639 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-f60f6214-0f7b-4a0b-99b9-5922eab14ccb req-68b9d313-af7d-44c1-bae8-e3cbaf46a785 tempest-TestVolumeBootPattern-539025653 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.849s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:52:41.982568 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-f60f6214-0f7b-4a0b-99b9-5922eab14ccb req-68b9d313-af7d-44c1-bae8-e3cbaf46a785 tempest-TestVolumeBootPattern-539025653 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f4402b35-971a-48cf-bc2d-3f5f5f47faa0', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': 'f4402b35-971a-48cf-bc2d-3f5f5f47faa0', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:52:42.057683 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-f60f6214-0f7b-4a0b-99b9-5922eab14ccb req-68b9d313-af7d-44c1-bae8-e3cbaf46a785 tempest-TestVolumeBootPattern-539025653 None] Connection info returned from driver {'name': 'volumes/volume-f4402b35-971a-48cf-bc2d-3f5f5f47faa0', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f4402b35-971a-48cf-bc2d-3f5f5f47faa0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '95632df6-59b2-4e6b-a8d7-8c200f3f1010'} {{(pid=123855) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Apr 30 21:52:42.198376 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-f60f6214-0f7b-4a0b-99b9-5922eab14ccb req-68b9d313-af7d-44c1-bae8-e3cbaf46a785 tempest-TestVolumeBootPattern-539025653 None] attachment_update completed successfully. Apr 30 21:52:54.177738 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-d6376fd7-ec36-41ca-a60c-2ac427d229f9 req-6962fe20-a4b1-404c-9f94-9c4f60b15fcd tempest-TestVolumeBootPattern-539025653 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:52:56.334771 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-d6376fd7-ec36-41ca-a60c-2ac427d229f9 req-6962fe20-a4b1-404c-9f94-9c4f60b15fcd tempest-TestVolumeBootPattern-539025653 None] Create snapshot completed successfully Apr 30 21:53:01.119373 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [req-390c242b-b531-4442-ab59-a456205de4f0 req-812f028b-5fff-41a4-8c5c-d9428af83d83 tempest-TestVolumeBootPattern-539025653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:53:01.151139 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-390c242b-b531-4442-ab59-a456205de4f0 req-812f028b-5fff-41a4-8c5c-d9428af83d83 tempest-TestVolumeBootPattern-539025653 None] Flow 'volume_create_manager' (b715c809-f1ae-49ed-bfdc-f631fe323957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:53:01.158520 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-390c242b-b531-4442-ab59-a456205de4f0 req-812f028b-5fff-41a4-8c5c-d9428af83d83 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eff352c2-1088-4998-a95e-364f344a9e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:53:01.177089 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-390c242b-b531-4442-ab59-a456205de4f0 req-812f028b-5fff-41a4-8c5c-d9428af83d83 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eff352c2-1088-4998-a95e-364f344a9e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:53:00Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=96fa57a5-6544-4e8e-9430-49ce1bc08e80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='839ab2af4d6b40c3b957be9c7dc78b26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=90f9ec0f-5dc4-4ae9-b383-af9018403276,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:53:01Z,use_quota=True,user_id='4d838be38c1941eba44ffcfc6c17f002',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:53:01.182835 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-390c242b-b531-4442-ab59-a456205de4f0 req-812f028b-5fff-41a4-8c5c-d9428af83d83 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1951257-d25f-429a-a581-3874ccc70072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:53:01.187057 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-390c242b-b531-4442-ab59-a456205de4f0 req-812f028b-5fff-41a4-8c5c-d9428af83d83 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1951257-d25f-429a-a581-3874ccc70072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:53:01.192787 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-390c242b-b531-4442-ab59-a456205de4f0 req-812f028b-5fff-41a4-8c5c-d9428af83d83 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b14baa9-0977-41db-be69-1acf8847f120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:53:01.198319 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-390c242b-b531-4442-ab59-a456205de4f0 req-812f028b-5fff-41a4-8c5c-d9428af83d83 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b14baa9-0977-41db-be69-1acf8847f120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '96fa57a5-6544-4e8e-9430-49ce1bc08e80', 'volume_name': 'volume-96fa57a5-6544-4e8e-9430-49ce1bc08e80', 'volume_size': 1, 'snapshot_id': '90f9ec0f-5dc4-4ae9-b383-af9018403276'}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:53:01.203537 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-390c242b-b531-4442-ab59-a456205de4f0 req-812f028b-5fff-41a4-8c5c-d9428af83d83 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6688d4b7-82be-490b-88a3-b2ece83a8a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:53:01.208085 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-390c242b-b531-4442-ab59-a456205de4f0 req-812f028b-5fff-41a4-8c5c-d9428af83d83 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6688d4b7-82be-490b-88a3-b2ece83a8a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:53:01.212929 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-390c242b-b531-4442-ab59-a456205de4f0 req-812f028b-5fff-41a4-8c5c-d9428af83d83 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de8aeb9a-ad2a-4e4d-a1f1-ca5e51c72637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:53:01.214122 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [req-390c242b-b531-4442-ab59-a456205de4f0 req-812f028b-5fff-41a4-8c5c-d9428af83d83 tempest-TestVolumeBootPattern-539025653 None] Volume 96fa57a5-6544-4e8e-9430-49ce1bc08e80: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-96fa57a5-6544-4e8e-9430-49ce1bc08e80', 'volume_size': 1, 'snapshot_id': '90f9ec0f-5dc4-4ae9-b383-af9018403276'} Apr 30 21:53:01.239185 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-390c242b-b531-4442-ab59-a456205de4f0 req-812f028b-5fff-41a4-8c5c-d9428af83d83 tempest-TestVolumeBootPattern-539025653 None] cloning volumes/volume-f4402b35-971a-48cf-bc2d-3f5f5f47faa0@snapshot-90f9ec0f-5dc4-4ae9-b383-af9018403276 to volume-96fa57a5-6544-4e8e-9430-49ce1bc08e80 {{(pid=123855) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1091}} Apr 30 21:53:01.239897 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-390c242b-b531-4442-ab59-a456205de4f0 req-812f028b-5fff-41a4-8c5c-d9428af83d83 tempest-TestVolumeBootPattern-539025653 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:53:01.306200 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-390c242b-b531-4442-ab59-a456205de4f0 req-812f028b-5fff-41a4-8c5c-d9428af83d83 tempest-TestVolumeBootPattern-539025653 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:53:02.237518 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-390c242b-b531-4442-ab59-a456205de4f0 req-812f028b-5fff-41a4-8c5c-d9428af83d83 tempest-TestVolumeBootPattern-539025653 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:53:02.239143 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-390c242b-b531-4442-ab59-a456205de4f0 req-812f028b-5fff-41a4-8c5c-d9428af83d83 tempest-TestVolumeBootPattern-539025653 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:53:02.258887 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.volume_utils [req-390c242b-b531-4442-ab59-a456205de4f0 req-812f028b-5fff-41a4-8c5c-d9428af83d83 tempest-TestVolumeBootPattern-539025653 None] Marking volume 96fa57a5-6544-4e8e-9430-49ce1bc08e80 as bootable. {{(pid=123855) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Apr 30 21:53:02.314355 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [req-390c242b-b531-4442-ab59-a456205de4f0 req-812f028b-5fff-41a4-8c5c-d9428af83d83 tempest-TestVolumeBootPattern-539025653 None] Copying metadata from snapshot 90f9ec0f-5dc4-4ae9-b383-af9018403276 to 96fa57a5-6544-4e8e-9430-49ce1bc08e80. {{(pid=123855) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:427}} Apr 30 21:53:02.418387 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-390c242b-b531-4442-ab59-a456205de4f0 req-812f028b-5fff-41a4-8c5c-d9428af83d83 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de8aeb9a-ad2a-4e4d-a1f1-ca5e51c72637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96fa57a5-6544-4e8e-9430-49ce1bc08e80', 'volume_size': 1, 'snapshot_id': '90f9ec0f-5dc4-4ae9-b383-af9018403276'}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:53:02.422974 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-390c242b-b531-4442-ab59-a456205de4f0 req-812f028b-5fff-41a4-8c5c-d9428af83d83 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8d67d69-8615-4a1a-bd93-05335c55a9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:53:02.489622 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [req-390c242b-b531-4442-ab59-a456205de4f0 req-812f028b-5fff-41a4-8c5c-d9428af83d83 tempest-TestVolumeBootPattern-539025653 None] Volume volume-96fa57a5-6544-4e8e-9430-49ce1bc08e80 (96fa57a5-6544-4e8e-9430-49ce1bc08e80): created successfully Apr 30 21:53:02.493593 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-390c242b-b531-4442-ab59-a456205de4f0 req-812f028b-5fff-41a4-8c5c-d9428af83d83 tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8d67d69-8615-4a1a-bd93-05335c55a9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:53:02.499325 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-390c242b-b531-4442-ab59-a456205de4f0 req-812f028b-5fff-41a4-8c5c-d9428af83d83 tempest-TestVolumeBootPattern-539025653 None] Flow 'volume_create_manager' (b715c809-f1ae-49ed-bfdc-f631fe323957) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:53:02.609130 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-390c242b-b531-4442-ab59-a456205de4f0 req-812f028b-5fff-41a4-8c5c-d9428af83d83 tempest-TestVolumeBootPattern-539025653 None] Created volume successfully. Apr 30 21:53:04.557167 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-390c242b-b531-4442-ab59-a456205de4f0 req-e680cd75-7133-4ffe-a293-0073f8c63930 tempest-TestVolumeBootPattern-539025653 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:53:05.192263 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-390c242b-b531-4442-ab59-a456205de4f0 req-e680cd75-7133-4ffe-a293-0073f8c63930 tempest-TestVolumeBootPattern-539025653 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.629s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:53:05.192263 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-390c242b-b531-4442-ab59-a456205de4f0 req-e680cd75-7133-4ffe-a293-0073f8c63930 tempest-TestVolumeBootPattern-539025653 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-96fa57a5-6544-4e8e-9430-49ce1bc08e80', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': '96fa57a5-6544-4e8e-9430-49ce1bc08e80', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:53:05.271893 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-390c242b-b531-4442-ab59-a456205de4f0 req-e680cd75-7133-4ffe-a293-0073f8c63930 tempest-TestVolumeBootPattern-539025653 None] Connection info returned from driver {'name': 'volumes/volume-96fa57a5-6544-4e8e-9430-49ce1bc08e80', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '96fa57a5-6544-4e8e-9430-49ce1bc08e80', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5a8b91e4-20e6-448b-99f2-b57546c410c4'} {{(pid=123855) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Apr 30 21:53:05.379933 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-390c242b-b531-4442-ab59-a456205de4f0 req-e680cd75-7133-4ffe-a293-0073f8c63930 tempest-TestVolumeBootPattern-539025653 None] attachment_update completed successfully. Apr 30 21:53:18.727701 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-a12d4456-3844-48b8-8eb6-e1e10eab5a8a req-2897dd07-1553-46db-a9c4-014e71c1c0f6 tempest-TestVolumeBootPattern-539025653 None] Terminate volume connection completed successfully. Apr 30 21:53:18.728374 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-a12d4456-3844-48b8-8eb6-e1e10eab5a8a req-2897dd07-1553-46db-a9c4-014e71c1c0f6 tempest-TestVolumeBootPattern-539025653 None] Deleting attachment 5a8b91e4-20e6-448b-99f2-b57546c410c4. {{(pid=123855) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} Apr 30 21:53:19.082074 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [req-a12d4456-3844-48b8-8eb6-e1e10eab5a8a req-f4c7b47d-8f31-4765-9ad5-2737d0a0241c tempest-TestVolumeBootPattern-539025653 None] Lock "b'cinder-96fa57a5-6544-4e8e-9430-49ce1bc08e80-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:53:19.163429 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-a12d4456-3844-48b8-8eb6-e1e10eab5a8a req-f4c7b47d-8f31-4765-9ad5-2737d0a0241c tempest-TestVolumeBootPattern-539025653 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:53:19.517231 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-a12d4456-3844-48b8-8eb6-e1e10eab5a8a req-f4c7b47d-8f31-4765-9ad5-2737d0a0241c tempest-TestVolumeBootPattern-539025653 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:53:19.697552 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-a12d4456-3844-48b8-8eb6-e1e10eab5a8a req-f4c7b47d-8f31-4765-9ad5-2737d0a0241c tempest-TestVolumeBootPattern-539025653 None] deleting rbd volume volume-96fa57a5-6544-4e8e-9430-49ce1bc08e80 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:53:26.009116 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [req-a12d4456-3844-48b8-8eb6-e1e10eab5a8a req-f4c7b47d-8f31-4765-9ad5-2737d0a0241c tempest-TestVolumeBootPattern-539025653 None] Created reservations ['08fbdc0f-0364-4d0c-a4dc-e8b0f5602932', '336ee41f-79ff-44ad-9e5a-cbeaa36859f0', '7a8fd25d-d30c-4cbf-ac8f-79afcdb068a0', '51a97136-a5be-4cb5-9dfd-b70902595b6e'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:53:26.198172 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-a12d4456-3844-48b8-8eb6-e1e10eab5a8a req-f4c7b47d-8f31-4765-9ad5-2737d0a0241c tempest-TestVolumeBootPattern-539025653 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:53:26.226213 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-a12d4456-3844-48b8-8eb6-e1e10eab5a8a req-f4c7b47d-8f31-4765-9ad5-2737d0a0241c tempest-TestVolumeBootPattern-539025653 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:53:26.307064 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [req-a12d4456-3844-48b8-8eb6-e1e10eab5a8a req-f4c7b47d-8f31-4765-9ad5-2737d0a0241c tempest-TestVolumeBootPattern-539025653 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:53:26.311969 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-a12d4456-3844-48b8-8eb6-e1e10eab5a8a req-f4c7b47d-8f31-4765-9ad5-2737d0a0241c tempest-TestVolumeBootPattern-539025653 None] Deleted volume successfully. Apr 30 21:53:26.394859 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [req-a12d4456-3844-48b8-8eb6-e1e10eab5a8a req-f4c7b47d-8f31-4765-9ad5-2737d0a0241c tempest-TestVolumeBootPattern-539025653 None] Lock "b'cinder-96fa57a5-6544-4e8e-9430-49ce1bc08e80-delete_volume'" released by "delete_volume" :: held 7.313s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:53:27.268907 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-f9b7d8a9-33af-4a20-8b15-6ec450fac5c1 tempest-TestVolumeBootPattern-539025653 None] Lock "b'cinder-90f9ec0f-5dc4-4ae9-b383-af9018403276-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:53:27.271395 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-f9b7d8a9-33af-4a20-8b15-6ec450fac5c1 tempest-TestVolumeBootPattern-539025653 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:53:31.458539 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:53:31.459236 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:53:31.485107 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:53:31.511931 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:53:58.876857 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-f9b7d8a9-33af-4a20-8b15-6ec450fac5c1 tempest-TestVolumeBootPattern-539025653 None] Created reservations ['0437a8f4-c249-4b61-8272-9fcd599cfbdf', '3cc506bf-caf3-4f07-be47-8c08831fa055', 'acf53793-074d-43f5-974a-30c82a9ac2bc', '1cf47644-3efd-41e8-9ed7-ad41ccba00d6'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:53:59.105368 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-f9b7d8a9-33af-4a20-8b15-6ec450fac5c1 tempest-TestVolumeBootPattern-539025653 None] Delete snapshot completed successfully. Apr 30 21:53:59.109915 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-f9b7d8a9-33af-4a20-8b15-6ec450fac5c1 tempest-TestVolumeBootPattern-539025653 None] Lock "b'cinder-90f9ec0f-5dc4-4ae9-b383-af9018403276-delete_snapshot'" released by "delete_snapshot" :: held 31.841s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:54:01.924659 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-2b46772b-5ec6-4422-afda-55c52f19531b req-272d527f-d701-4ee1-bfcf-7b616ab88ad7 tempest-TestVolumeBootPattern-539025653 None] Terminate volume connection completed successfully. Apr 30 21:54:01.925288 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-2b46772b-5ec6-4422-afda-55c52f19531b req-272d527f-d701-4ee1-bfcf-7b616ab88ad7 tempest-TestVolumeBootPattern-539025653 None] Deleting attachment 95632df6-59b2-4e6b-a8d7-8c200f3f1010. {{(pid=123855) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} Apr 30 21:54:02.258061 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [req-2b46772b-5ec6-4422-afda-55c52f19531b req-97b14a29-7d45-45c5-b8d3-7bd76209bebb tempest-TestVolumeBootPattern-539025653 None] Lock "b'cinder-f4402b35-971a-48cf-bc2d-3f5f5f47faa0-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:54:02.346680 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-2b46772b-5ec6-4422-afda-55c52f19531b req-97b14a29-7d45-45c5-b8d3-7bd76209bebb tempest-TestVolumeBootPattern-539025653 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:54:02.511077 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-2b46772b-5ec6-4422-afda-55c52f19531b req-97b14a29-7d45-45c5-b8d3-7bd76209bebb tempest-TestVolumeBootPattern-539025653 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:54:02.575429 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-2b46772b-5ec6-4422-afda-55c52f19531b req-97b14a29-7d45-45c5-b8d3-7bd76209bebb tempest-TestVolumeBootPattern-539025653 None] deleting rbd volume volume-f4402b35-971a-48cf-bc2d-3f5f5f47faa0 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:54:05.923901 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-2b46772b-5ec6-4422-afda-55c52f19531b req-97b14a29-7d45-45c5-b8d3-7bd76209bebb tempest-TestVolumeBootPattern-539025653 None] volume is a clone so cleaning references {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} Apr 30 21:54:06.037333 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-2b46772b-5ec6-4422-afda-55c52f19531b req-97b14a29-7d45-45c5-b8d3-7bd76209bebb tempest-TestVolumeBootPattern-539025653 None] deleting parent snapshot volume-f4402b35-971a-48cf-bc2d-3f5f5f47faa0.clone_snap {{(pid=123855) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} Apr 30 21:54:08.431103 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [req-2b46772b-5ec6-4422-afda-55c52f19531b req-97b14a29-7d45-45c5-b8d3-7bd76209bebb tempest-TestVolumeBootPattern-539025653 None] Created reservations ['3ef756eb-1f49-48d0-8292-c0803274e46b', '7925572e-c9f2-458d-a3e1-9b6528daab65', '1fad3b42-5560-482a-8c23-15555cfd605e', '457131f5-bc50-4f4a-a627-10f15333fdd3'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:54:08.585854 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-2b46772b-5ec6-4422-afda-55c52f19531b req-97b14a29-7d45-45c5-b8d3-7bd76209bebb tempest-TestVolumeBootPattern-539025653 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:54:08.608485 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-2b46772b-5ec6-4422-afda-55c52f19531b req-97b14a29-7d45-45c5-b8d3-7bd76209bebb tempest-TestVolumeBootPattern-539025653 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:54:08.631845 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [req-2b46772b-5ec6-4422-afda-55c52f19531b req-97b14a29-7d45-45c5-b8d3-7bd76209bebb tempest-TestVolumeBootPattern-539025653 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:54:08.636170 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-2b46772b-5ec6-4422-afda-55c52f19531b req-97b14a29-7d45-45c5-b8d3-7bd76209bebb tempest-TestVolumeBootPattern-539025653 None] Deleted volume successfully. Apr 30 21:54:08.680962 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [req-2b46772b-5ec6-4422-afda-55c52f19531b req-97b14a29-7d45-45c5-b8d3-7bd76209bebb tempest-TestVolumeBootPattern-539025653 None] Lock "b'cinder-f4402b35-971a-48cf-bc2d-3f5f5f47faa0-delete_volume'" released by "delete_volume" :: held 6.423s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:54:13.552933 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-a05b88e9-d195-4eac-9774-6a0e8649282a tempest-TestVolumeBootPattern-539025653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 21:54:13.572623 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a05b88e9-d195-4eac-9774-6a0e8649282a tempest-TestVolumeBootPattern-539025653 None] Flow 'volume_create_manager' (f5a74fef-7473-4247-9dc3-052ede60b891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:54:13.579178 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a05b88e9-d195-4eac-9774-6a0e8649282a tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c331e61-0d9e-4a20-9217-1cc2532ec4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:54:13.595857 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a05b88e9-d195-4eac-9774-6a0e8649282a tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c331e61-0d9e-4a20-9217-1cc2532ec4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T21:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1474544198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=73e426da-a6ca-4d21-b50f-30bf936473a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='839ab2af4d6b40c3b957be9c7dc78b26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T21:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T21:54:13Z,use_quota=True,user_id='4d838be38c1941eba44ffcfc6c17f002',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:54:13.599927 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a05b88e9-d195-4eac-9774-6a0e8649282a tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (752856b7-1ae7-4158-ada7-5a5c61d21c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:54:13.604086 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a05b88e9-d195-4eac-9774-6a0e8649282a tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (752856b7-1ae7-4158-ada7-5a5c61d21c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:54:13.609209 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a05b88e9-d195-4eac-9774-6a0e8649282a tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9a01661-27cf-43c7-b95e-bdd075d2f66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:54:13.687441 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a05b88e9-d195-4eac-9774-6a0e8649282a tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9a01661-27cf-43c7-b95e-bdd075d2f66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '73e426da-a6ca-4d21-b50f-30bf936473a1', 'volume_name': 'volume-73e426da-a6ca-4d21-b50f-30bf936473a1', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:54:13.692596 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a05b88e9-d195-4eac-9774-6a0e8649282a tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83d8dc25-f847-47b7-a743-d91a8e852dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:54:13.696601 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a05b88e9-d195-4eac-9774-6a0e8649282a tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83d8dc25-f847-47b7-a743-d91a8e852dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:54:13.701402 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a05b88e9-d195-4eac-9774-6a0e8649282a tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a39f021a-7bdc-4744-a3b2-d58ad2237e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:54:13.702554 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-a05b88e9-d195-4eac-9774-6a0e8649282a tempest-TestVolumeBootPattern-539025653 None] Volume 73e426da-a6ca-4d21-b50f-30bf936473a1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-73e426da-a6ca-4d21-b50f-30bf936473a1', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 30 21:54:13.703131 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-a05b88e9-d195-4eac-9774-6a0e8649282a tempest-TestVolumeBootPattern-539025653 None] Cloning 73e426da-a6ca-4d21-b50f-30bf936473a1 from image a5b0850f-3b24-4bcb-b0a7-351c3216b27d at location (None, None). {{(pid=123855) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Apr 30 21:54:13.713133 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-a05b88e9-d195-4eac-9774-6a0e8649282a tempest-TestVolumeBootPattern-539025653 None] Lock "b'cinder-a5b0850f-3b24-4bcb-b0a7-351c3216b27d'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:54:13.791598 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-a05b88e9-d195-4eac-9774-6a0e8649282a tempest-TestVolumeBootPattern-539025653 None] Found image-volume cache entry: {'id': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'volume_id': '5772aef0-721f-450a-93ff-02cc6a41edcc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7), 'last_used': datetime.datetime(2022, 4, 30, 21, 54, 13, 719185)}. {{(pid=123855) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 30 21:54:13.792037 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-a05b88e9-d195-4eac-9774-6a0e8649282a tempest-TestVolumeBootPattern-539025653 None] Image-volume cache entry image_update_at = 2022-04-30 21:01:07+00:00, requested image updated_at = 2022-04-30 21:01:07+00:00. {{(pid=123855) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 30 21:54:13.792439 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-a05b88e9-d195-4eac-9774-6a0e8649282a tempest-TestVolumeBootPattern-539025653 None] Found cache entry for image = a5b0850f-3b24-4bcb-b0a7-351c3216b27d on host ncdv-master-1@ceph#ceph. {{(pid=123855) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Apr 30 21:54:13.796773 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-a05b88e9-d195-4eac-9774-6a0e8649282a tempest-TestVolumeBootPattern-539025653 None] Lock "b'cinder-a5b0850f-3b24-4bcb-b0a7-351c3216b27d'" released by "_prepare_image_cache_entry" :: held 0.084s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:54:13.797689 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-a05b88e9-d195-4eac-9774-6a0e8649282a tempest-TestVolumeBootPattern-539025653 None] Attempting to retrieve cache entry for image = a5b0850f-3b24-4bcb-b0a7-351c3216b27d on host ncdv-master-1@ceph#ceph. {{(pid=123855) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Apr 30 21:54:13.803319 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-a05b88e9-d195-4eac-9774-6a0e8649282a tempest-TestVolumeBootPattern-539025653 None] Found image-volume cache entry: {'id': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'volume_id': '5772aef0-721f-450a-93ff-02cc6a41edcc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7), 'last_used': datetime.datetime(2022, 4, 30, 21, 54, 13, 801153)}. {{(pid=123855) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 30 21:54:13.803727 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-a05b88e9-d195-4eac-9774-6a0e8649282a tempest-TestVolumeBootPattern-539025653 None] Image-volume cache entry image_update_at = 2022-04-30 21:01:07+00:00, requested image updated_at = 2022-04-30 21:01:07+00:00. {{(pid=123855) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 30 21:54:13.804112 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-a05b88e9-d195-4eac-9774-6a0e8649282a tempest-TestVolumeBootPattern-539025653 None] Creating from source image-volume 5772aef0-721f-450a-93ff-02cc6a41edcc {{(pid=123855) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Apr 30 21:54:13.815335 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a05b88e9-d195-4eac-9774-6a0e8649282a tempest-TestVolumeBootPattern-539025653 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:54:14.128959 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a05b88e9-d195-4eac-9774-6a0e8649282a tempest-TestVolumeBootPattern-539025653 None] creating snapshot='volume-73e426da-a6ca-4d21-b50f-30bf936473a1.clone_snap' {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} Apr 30 21:54:15.551866 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a05b88e9-d195-4eac-9774-6a0e8649282a tempest-TestVolumeBootPattern-539025653 None] cloning 'volume-5772aef0-721f-450a-93ff-02cc6a41edcc@volume-73e426da-a6ca-4d21-b50f-30bf936473a1.clone_snap' to 'volume-73e426da-a6ca-4d21-b50f-30bf936473a1' {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} Apr 30 21:54:16.570212 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a05b88e9-d195-4eac-9774-6a0e8649282a tempest-TestVolumeBootPattern-539025653 None] Volume volume-632a7810-1a6f-420a-a6fd-57675408a8f7.deleted is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 21:54:16.571244 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a05b88e9-d195-4eac-9774-6a0e8649282a tempest-TestVolumeBootPattern-539025653 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 21:54:16.571628 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a05b88e9-d195-4eac-9774-6a0e8649282a tempest-TestVolumeBootPattern-539025653 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 21:54:16.847037 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-a05b88e9-d195-4eac-9774-6a0e8649282a tempest-TestVolumeBootPattern-539025653 None] clone created successfully {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} Apr 30 21:54:16.847591 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.volume_utils [None req-a05b88e9-d195-4eac-9774-6a0e8649282a tempest-TestVolumeBootPattern-539025653 None] Marking volume 73e426da-a6ca-4d21-b50f-30bf936473a1 as bootable. {{(pid=123855) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Apr 30 21:54:16.905271 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-a05b88e9-d195-4eac-9774-6a0e8649282a tempest-TestVolumeBootPattern-539025653 None] Copying metadata from image a5b0850f-3b24-4bcb-b0a7-351c3216b27d to 73e426da-a6ca-4d21-b50f-30bf936473a1. {{(pid=123855) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Apr 30 21:54:16.905712 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-a05b88e9-d195-4eac-9774-6a0e8649282a tempest-TestVolumeBootPattern-539025653 None] Creating volume glance metadata for volume 73e426da-a6ca-4d21-b50f-30bf936473a1 backed by image a5b0850f-3b24-4bcb-b0a7-351c3216b27d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123855) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Apr 30 21:54:17.012451 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a05b88e9-d195-4eac-9774-6a0e8649282a tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a39f021a-7bdc-4744-a3b2-d58ad2237e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73e426da-a6ca-4d21-b50f-30bf936473a1', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:54:17.017440 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a05b88e9-d195-4eac-9774-6a0e8649282a tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cef781d-5996-49de-b218-2e3ef6ce6bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 21:54:17.088336 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-a05b88e9-d195-4eac-9774-6a0e8649282a tempest-TestVolumeBootPattern-539025653 None] Volume volume-73e426da-a6ca-4d21-b50f-30bf936473a1 (73e426da-a6ca-4d21-b50f-30bf936473a1): created successfully Apr 30 21:54:17.092078 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a05b88e9-d195-4eac-9774-6a0e8649282a tempest-TestVolumeBootPattern-539025653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cef781d-5996-49de-b218-2e3ef6ce6bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 21:54:17.098235 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-a05b88e9-d195-4eac-9774-6a0e8649282a tempest-TestVolumeBootPattern-539025653 None] Flow 'volume_create_manager' (f5a74fef-7473-4247-9dc3-052ede60b891) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 21:54:17.156757 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-a05b88e9-d195-4eac-9774-6a0e8649282a tempest-TestVolumeBootPattern-539025653 None] Created volume successfully. Apr 30 21:54:20.476998 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-efbcd779-51c8-4322-b1c1-8bdca9ba5dcf req-d6b75f48-bdb2-4a5c-9d7f-9b90c6daf8fc tempest-TestVolumeBootPattern-539025653 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 21:54:21.124108 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-efbcd779-51c8-4322-b1c1-8bdca9ba5dcf req-d6b75f48-bdb2-4a5c-9d7f-9b90c6daf8fc tempest-TestVolumeBootPattern-539025653 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.647s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 21:54:21.124925 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-efbcd779-51c8-4322-b1c1-8bdca9ba5dcf req-d6b75f48-bdb2-4a5c-9d7f-9b90c6daf8fc tempest-TestVolumeBootPattern-539025653 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-73e426da-a6ca-4d21-b50f-30bf936473a1', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': '73e426da-a6ca-4d21-b50f-30bf936473a1', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 21:54:21.191984 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-efbcd779-51c8-4322-b1c1-8bdca9ba5dcf req-d6b75f48-bdb2-4a5c-9d7f-9b90c6daf8fc tempest-TestVolumeBootPattern-539025653 None] Connection info returned from driver {'name': 'volumes/volume-73e426da-a6ca-4d21-b50f-30bf936473a1', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '73e426da-a6ca-4d21-b50f-30bf936473a1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '22d7c93c-7b60-49ef-b8e8-d545b846ce62'} {{(pid=123855) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Apr 30 21:54:21.316319 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-efbcd779-51c8-4322-b1c1-8bdca9ba5dcf req-d6b75f48-bdb2-4a5c-9d7f-9b90c6daf8fc tempest-TestVolumeBootPattern-539025653 None] attachment_update completed successfully. Apr 30 21:54:31.458166 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:54:31.459653 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:54:31.485844 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:54:31.520284 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:55:31.456228 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:55:31.456918 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:55:31.478506 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:55:31.500855 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:56:31.455829 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:56:31.456572 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:56:31.478620 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:56:31.500579 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:57:31.456152 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:57:31.456992 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:57:31.478768 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:57:31.504122 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:57:57.248249 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-c24663b0-1a31-4639-9e77-ebc49adbb194 req-03853aaa-b367-4dfa-9764-019674d89a85 tempest-TestVolumeBootPattern-539025653 None] Terminate volume connection completed successfully. Apr 30 21:57:57.248912 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-c24663b0-1a31-4639-9e77-ebc49adbb194 req-03853aaa-b367-4dfa-9764-019674d89a85 tempest-TestVolumeBootPattern-539025653 None] Deleting attachment 22d7c93c-7b60-49ef-b8e8-d545b846ce62. {{(pid=123855) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} Apr 30 21:57:58.599366 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-591a40e1-1049-4a9b-8ef1-48bad1175616 tempest-TestVolumeBootPattern-539025653 None] Lock "b'cinder-73e426da-a6ca-4d21-b50f-30bf936473a1-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 21:57:58.702285 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-591a40e1-1049-4a9b-8ef1-48bad1175616 tempest-TestVolumeBootPattern-539025653 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:57:58.860777 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-591a40e1-1049-4a9b-8ef1-48bad1175616 tempest-TestVolumeBootPattern-539025653 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 21:57:58.999494 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-591a40e1-1049-4a9b-8ef1-48bad1175616 tempest-TestVolumeBootPattern-539025653 None] deleting rbd volume volume-73e426da-a6ca-4d21-b50f-30bf936473a1 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 21:58:02.933235 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-591a40e1-1049-4a9b-8ef1-48bad1175616 tempest-TestVolumeBootPattern-539025653 None] volume is a clone so cleaning references {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} Apr 30 21:58:03.056461 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-591a40e1-1049-4a9b-8ef1-48bad1175616 tempest-TestVolumeBootPattern-539025653 None] deleting parent snapshot volume-73e426da-a6ca-4d21-b50f-30bf936473a1.clone_snap {{(pid=123855) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} Apr 30 21:58:05.055316 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-591a40e1-1049-4a9b-8ef1-48bad1175616 tempest-TestVolumeBootPattern-539025653 None] Created reservations ['7bd90d74-0fb7-45a8-8dac-df90db5e441e', 'be5e6fe4-64d5-4859-a137-5dc25eae1256', '27cfeec4-dd37-4526-b702-d92cae172dd7', '35f0b075-5948-40f4-95f1-3a10aae66c2c'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 21:58:05.280136 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-591a40e1-1049-4a9b-8ef1-48bad1175616 tempest-TestVolumeBootPattern-539025653 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:58:05.341677 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-591a40e1-1049-4a9b-8ef1-48bad1175616 tempest-TestVolumeBootPattern-539025653 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:58:05.365255 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-591a40e1-1049-4a9b-8ef1-48bad1175616 tempest-TestVolumeBootPattern-539025653 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:58:05.370446 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-591a40e1-1049-4a9b-8ef1-48bad1175616 tempest-TestVolumeBootPattern-539025653 None] Deleted volume successfully. Apr 30 21:58:05.421608 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-591a40e1-1049-4a9b-8ef1-48bad1175616 tempest-TestVolumeBootPattern-539025653 None] Lock "b'cinder-73e426da-a6ca-4d21-b50f-30bf936473a1-delete_volume'" released by "delete_volume" :: held 6.822s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 21:58:31.460113 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:58:31.460836 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:58:31.486447 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:58:31.515964 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 21:59:31.460985 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 21:59:31.461651 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:59:31.485891 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 21:59:31.510299 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:00:31.467748 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:00:31.467748 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:00:31.490503 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:00:31.525028 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:01:31.464303 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:01:31.464997 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:01:31.486418 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:01:31.508129 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:02:31.462673 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:02:31.463585 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:02:31.492618 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:02:31.530035 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:03:31.465643 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:03:31.466315 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:03:31.509372 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:03:31.537283 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:04:31.463980 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:04:31.464708 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:04:31.507157 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:04:31.543119 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:05:31.473048 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:05:31.473048 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:05:31.500053 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:05:31.523994 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:06:52.618608 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a3c6bc6-773a-4e22-9f88-29e594200b3a tempest-ServerActionsTestJSON-1299757710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 22:06:52.639663 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-2a3c6bc6-773a-4e22-9f88-29e594200b3a tempest-ServerActionsTestJSON-1299757710 None] Flow 'volume_create_manager' (af2124b5-ee33-4117-b302-9b5b1d9d1037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 22:06:52.647072 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-2a3c6bc6-773a-4e22-9f88-29e594200b3a tempest-ServerActionsTestJSON-1299757710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7551e7e9-4864-4721-97da-275b5a81eb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 22:06:52.663651 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-2a3c6bc6-773a-4e22-9f88-29e594200b3a tempest-ServerActionsTestJSON-1299757710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7551e7e9-4864-4721-97da-275b5a81eb54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T22:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-818858246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=18f0c32d-3895-4b23-9fbb-d968e889b7c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fad6f6856db4b229be0837d3874a1f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T22:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T22:06:52Z,use_quota=True,user_id='303501939f1f44069213c3ef0166497d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 22:06:52.669239 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-2a3c6bc6-773a-4e22-9f88-29e594200b3a tempest-ServerActionsTestJSON-1299757710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b0e7025-ce66-43d5-b539-ea33dc85c854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 22:06:52.673486 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-2a3c6bc6-773a-4e22-9f88-29e594200b3a tempest-ServerActionsTestJSON-1299757710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b0e7025-ce66-43d5-b539-ea33dc85c854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 22:06:52.678729 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-2a3c6bc6-773a-4e22-9f88-29e594200b3a tempest-ServerActionsTestJSON-1299757710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (959a190e-dd14-41d4-8716-6cf5a8116835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 22:06:52.682909 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-2a3c6bc6-773a-4e22-9f88-29e594200b3a tempest-ServerActionsTestJSON-1299757710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (959a190e-dd14-41d4-8716-6cf5a8116835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18f0c32d-3895-4b23-9fbb-d968e889b7c0', 'volume_name': 'volume-18f0c32d-3895-4b23-9fbb-d968e889b7c0', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 22:06:52.687960 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-2a3c6bc6-773a-4e22-9f88-29e594200b3a tempest-ServerActionsTestJSON-1299757710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f995b65-2123-4fef-b63a-3b7f56d84d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 22:06:52.692577 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-2a3c6bc6-773a-4e22-9f88-29e594200b3a tempest-ServerActionsTestJSON-1299757710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f995b65-2123-4fef-b63a-3b7f56d84d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 22:06:52.697407 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-2a3c6bc6-773a-4e22-9f88-29e594200b3a tempest-ServerActionsTestJSON-1299757710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f51fb3e-3b5b-4eb3-8839-e5ff0fb3063d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 22:06:52.698701 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-2a3c6bc6-773a-4e22-9f88-29e594200b3a tempest-ServerActionsTestJSON-1299757710 None] Volume 18f0c32d-3895-4b23-9fbb-d968e889b7c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18f0c32d-3895-4b23-9fbb-d968e889b7c0', 'volume_size': 1} Apr 30 22:06:52.698965 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-2a3c6bc6-773a-4e22-9f88-29e594200b3a tempest-ServerActionsTestJSON-1299757710 None] creating volume 'volume-18f0c32d-3895-4b23-9fbb-d968e889b7c0' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 22:06:52.699715 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-2a3c6bc6-773a-4e22-9f88-29e594200b3a tempest-ServerActionsTestJSON-1299757710 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:06:53.196344 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-2a3c6bc6-773a-4e22-9f88-29e594200b3a tempest-ServerActionsTestJSON-1299757710 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 22:06:53.196722 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-2a3c6bc6-773a-4e22-9f88-29e594200b3a tempest-ServerActionsTestJSON-1299757710 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 22:06:53.200473 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-2a3c6bc6-773a-4e22-9f88-29e594200b3a tempest-ServerActionsTestJSON-1299757710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f51fb3e-3b5b-4eb3-8839-e5ff0fb3063d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18f0c32d-3895-4b23-9fbb-d968e889b7c0', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 22:06:53.205085 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-2a3c6bc6-773a-4e22-9f88-29e594200b3a tempest-ServerActionsTestJSON-1299757710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcc68c7c-ba6f-496a-b8b3-ae883b559fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 22:06:53.285378 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-2a3c6bc6-773a-4e22-9f88-29e594200b3a tempest-ServerActionsTestJSON-1299757710 None] Volume volume-18f0c32d-3895-4b23-9fbb-d968e889b7c0 (18f0c32d-3895-4b23-9fbb-d968e889b7c0): created successfully Apr 30 22:06:53.289238 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-2a3c6bc6-773a-4e22-9f88-29e594200b3a tempest-ServerActionsTestJSON-1299757710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcc68c7c-ba6f-496a-b8b3-ae883b559fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 22:06:53.295760 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-2a3c6bc6-773a-4e22-9f88-29e594200b3a tempest-ServerActionsTestJSON-1299757710 None] Flow 'volume_create_manager' (af2124b5-ee33-4117-b302-9b5b1d9d1037) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 22:06:53.359320 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-2a3c6bc6-773a-4e22-9f88-29e594200b3a tempest-ServerActionsTestJSON-1299757710 None] Created volume successfully. Apr 30 22:06:54.472295 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-6d05826a-26c3-4f5c-a311-e4d0f73affc7 req-9a6d4261-dd20-4060-84c4-fd632b7722e9 tempest-ServerActionsTestJSON-1299757710 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 22:06:55.096057 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-6d05826a-26c3-4f5c-a311-e4d0f73affc7 req-9a6d4261-dd20-4060-84c4-fd632b7722e9 tempest-ServerActionsTestJSON-1299757710 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.624s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 22:06:55.096846 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-6d05826a-26c3-4f5c-a311-e4d0f73affc7 req-9a6d4261-dd20-4060-84c4-fd632b7722e9 tempest-ServerActionsTestJSON-1299757710 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-18f0c32d-3895-4b23-9fbb-d968e889b7c0', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': '18f0c32d-3895-4b23-9fbb-d968e889b7c0', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 22:06:55.153333 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-6d05826a-26c3-4f5c-a311-e4d0f73affc7 req-9a6d4261-dd20-4060-84c4-fd632b7722e9 tempest-ServerActionsTestJSON-1299757710 None] Connection info returned from driver {'name': 'volumes/volume-18f0c32d-3895-4b23-9fbb-d968e889b7c0', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '18f0c32d-3895-4b23-9fbb-d968e889b7c0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '182c67b4-6a16-457a-869f-44905f12d4b1'} {{(pid=123855) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Apr 30 22:06:55.232605 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-6d05826a-26c3-4f5c-a311-e4d0f73affc7 req-9a6d4261-dd20-4060-84c4-fd632b7722e9 tempest-ServerActionsTestJSON-1299757710 None] attachment_update completed successfully. Apr 30 22:07:23.117481 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-9677865e-749f-475a-a3d9-e6e85cd4cb92 req-ea5eac7c-f62b-497f-b2b8-eea26cb0e181 tempest-ServerActionsTestJSON-1299757710 None] Terminate volume connection completed successfully. Apr 30 22:07:23.118215 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-9677865e-749f-475a-a3d9-e6e85cd4cb92 req-ea5eac7c-f62b-497f-b2b8-eea26cb0e181 tempest-ServerActionsTestJSON-1299757710 None] Deleting attachment 182c67b4-6a16-457a-869f-44905f12d4b1. {{(pid=123855) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} Apr 30 22:07:25.715080 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-9677865e-749f-475a-a3d9-e6e85cd4cb92 req-59f5ebb6-af04-4138-8fd1-61150d25eb7b tempest-ServerActionsTestJSON-1299757710 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 22:07:26.342628 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-9677865e-749f-475a-a3d9-e6e85cd4cb92 req-59f5ebb6-af04-4138-8fd1-61150d25eb7b tempest-ServerActionsTestJSON-1299757710 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.627s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 22:07:26.343519 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-9677865e-749f-475a-a3d9-e6e85cd4cb92 req-59f5ebb6-af04-4138-8fd1-61150d25eb7b tempest-ServerActionsTestJSON-1299757710 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-18f0c32d-3895-4b23-9fbb-d968e889b7c0', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': '18f0c32d-3895-4b23-9fbb-d968e889b7c0', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 22:07:26.438907 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-9677865e-749f-475a-a3d9-e6e85cd4cb92 req-59f5ebb6-af04-4138-8fd1-61150d25eb7b tempest-ServerActionsTestJSON-1299757710 None] Connection info returned from driver {'name': 'volumes/volume-18f0c32d-3895-4b23-9fbb-d968e889b7c0', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '18f0c32d-3895-4b23-9fbb-d968e889b7c0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '77455483-7507-4b34-ab8f-2a2ce4102a92'} {{(pid=123855) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Apr 30 22:07:26.525235 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-9677865e-749f-475a-a3d9-e6e85cd4cb92 req-59f5ebb6-af04-4138-8fd1-61150d25eb7b tempest-ServerActionsTestJSON-1299757710 None] attachment_update completed successfully. Apr 30 22:07:31.475376 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:07:31.484553 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:07:31.501318 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:07:31.523165 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:07:34.608618 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-8c75723c-a932-44ce-a2d6-e55c151a78e7 req-5505b544-617a-46aa-b017-3f820f72bf09 tempest-ServerActionsTestJSON-1299757710 None] Terminate volume connection completed successfully. Apr 30 22:07:34.609226 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-8c75723c-a932-44ce-a2d6-e55c151a78e7 req-5505b544-617a-46aa-b017-3f820f72bf09 tempest-ServerActionsTestJSON-1299757710 None] Deleting attachment 77455483-7507-4b34-ab8f-2a2ce4102a92. {{(pid=123855) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} Apr 30 22:07:37.409253 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-8c75723c-a932-44ce-a2d6-e55c151a78e7 req-5aebc4a5-8817-4a01-b123-3c87db7c25f2 tempest-ServerActionsTestJSON-1299757710 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 22:07:38.035597 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-8c75723c-a932-44ce-a2d6-e55c151a78e7 req-5aebc4a5-8817-4a01-b123-3c87db7c25f2 tempest-ServerActionsTestJSON-1299757710 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.626s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 22:07:38.036364 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-8c75723c-a932-44ce-a2d6-e55c151a78e7 req-5aebc4a5-8817-4a01-b123-3c87db7c25f2 tempest-ServerActionsTestJSON-1299757710 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-18f0c32d-3895-4b23-9fbb-d968e889b7c0', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': '18f0c32d-3895-4b23-9fbb-d968e889b7c0', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 22:07:38.147901 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-8c75723c-a932-44ce-a2d6-e55c151a78e7 req-5aebc4a5-8817-4a01-b123-3c87db7c25f2 tempest-ServerActionsTestJSON-1299757710 None] Connection info returned from driver {'name': 'volumes/volume-18f0c32d-3895-4b23-9fbb-d968e889b7c0', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '18f0c32d-3895-4b23-9fbb-d968e889b7c0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a1f2a99b-2cdb-4c64-aa40-94e803250de7'} {{(pid=123855) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Apr 30 22:07:38.243635 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-8c75723c-a932-44ce-a2d6-e55c151a78e7 req-5aebc4a5-8817-4a01-b123-3c87db7c25f2 tempest-ServerActionsTestJSON-1299757710 None] attachment_update completed successfully. Apr 30 22:07:46.206786 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-af6a9bd8-4f2a-4ea8-a492-9d7ecbaecf0b req-acaad555-ed39-43d9-a6a4-6e1a5d90331e tempest-ServerActionsTestJSON-1299757710 None] Terminate volume connection completed successfully. Apr 30 22:07:46.207556 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-af6a9bd8-4f2a-4ea8-a492-9d7ecbaecf0b req-acaad555-ed39-43d9-a6a4-6e1a5d90331e tempest-ServerActionsTestJSON-1299757710 None] Deleting attachment a1f2a99b-2cdb-4c64-aa40-94e803250de7. {{(pid=123855) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} Apr 30 22:07:48.398907 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-480f3edc-8355-4576-94ab-d2faacfc0fd8 tempest-ServerActionsTestJSON-1299757710 None] Lock "b'cinder-18f0c32d-3895-4b23-9fbb-d968e889b7c0-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 22:07:48.560076 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-480f3edc-8355-4576-94ab-d2faacfc0fd8 tempest-ServerActionsTestJSON-1299757710 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:07:48.764051 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-480f3edc-8355-4576-94ab-d2faacfc0fd8 tempest-ServerActionsTestJSON-1299757710 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 22:07:48.764494 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-480f3edc-8355-4576-94ab-d2faacfc0fd8 tempest-ServerActionsTestJSON-1299757710 None] Volume volume-18f0c32d-3895-4b23-9fbb-d968e889b7c0 is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 22:07:48.850527 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-480f3edc-8355-4576-94ab-d2faacfc0fd8 tempest-ServerActionsTestJSON-1299757710 None] deleting rbd volume volume-18f0c32d-3895-4b23-9fbb-d968e889b7c0 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 22:07:51.409734 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-480f3edc-8355-4576-94ab-d2faacfc0fd8 tempest-ServerActionsTestJSON-1299757710 None] Created reservations ['e3778b8b-2f3d-4b6c-99cb-948bf19bd16f', '81704274-1e45-415e-b63e-bae9d4e151e9', 'e3545195-5ffc-4c86-828f-1d624675383a', '12309ae9-bf7e-4e76-97e5-ccc72801be06'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 22:07:51.599513 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-480f3edc-8355-4576-94ab-d2faacfc0fd8 tempest-ServerActionsTestJSON-1299757710 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:07:51.633183 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-480f3edc-8355-4576-94ab-d2faacfc0fd8 tempest-ServerActionsTestJSON-1299757710 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:07:51.658986 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-480f3edc-8355-4576-94ab-d2faacfc0fd8 tempest-ServerActionsTestJSON-1299757710 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:07:51.664292 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-480f3edc-8355-4576-94ab-d2faacfc0fd8 tempest-ServerActionsTestJSON-1299757710 None] Deleted volume successfully. Apr 30 22:07:51.711981 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-480f3edc-8355-4576-94ab-d2faacfc0fd8 tempest-ServerActionsTestJSON-1299757710 None] Lock "b'cinder-18f0c32d-3895-4b23-9fbb-d968e889b7c0-delete_volume'" released by "delete_volume" :: held 3.313s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 22:08:31.478318 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:08:31.479014 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:08:31.513607 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:08:31.540426 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:09:31.477203 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:09:31.478041 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:09:31.512116 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:09:31.549358 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:09:44.478741 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-dce08a7c-eeac-41b2-a909-2987e45a18f8 tempest-TestMinimumBasicScenario-597789740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 22:09:44.498392 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-dce08a7c-eeac-41b2-a909-2987e45a18f8 tempest-TestMinimumBasicScenario-597789740 None] Flow 'volume_create_manager' (1f62ba7c-17a1-4c37-b5ad-b9392f2459cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 22:09:44.504864 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-dce08a7c-eeac-41b2-a909-2987e45a18f8 tempest-TestMinimumBasicScenario-597789740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f79ae2d-a186-4e01-85c8-975c847a3186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 22:09:44.520016 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-dce08a7c-eeac-41b2-a909-2987e45a18f8 tempest-TestMinimumBasicScenario-597789740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f79ae2d-a186-4e01-85c8-975c847a3186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T22:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-872854207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=51212ef3-353e-4630-969e-099dfb53b35d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29d93461dcdc458386181f7e31c7450b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T22:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T22:09:44Z,use_quota=True,user_id='722d6f7c30804cfda68ac3dc86a643c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 22:09:44.525894 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-dce08a7c-eeac-41b2-a909-2987e45a18f8 tempest-TestMinimumBasicScenario-597789740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1edeff73-1dfa-409c-8cf0-2bbc7f61c175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 22:09:44.535188 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-dce08a7c-eeac-41b2-a909-2987e45a18f8 tempest-TestMinimumBasicScenario-597789740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1edeff73-1dfa-409c-8cf0-2bbc7f61c175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 22:09:44.535188 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-dce08a7c-eeac-41b2-a909-2987e45a18f8 tempest-TestMinimumBasicScenario-597789740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a12a9cc-1afd-481d-8314-26d80b3fd872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 22:09:44.539171 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-dce08a7c-eeac-41b2-a909-2987e45a18f8 tempest-TestMinimumBasicScenario-597789740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a12a9cc-1afd-481d-8314-26d80b3fd872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51212ef3-353e-4630-969e-099dfb53b35d', 'volume_name': 'volume-51212ef3-353e-4630-969e-099dfb53b35d', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 22:09:44.544705 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-dce08a7c-eeac-41b2-a909-2987e45a18f8 tempest-TestMinimumBasicScenario-597789740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (667d7e33-752d-4350-a575-3bcc85d12ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 22:09:44.548631 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-dce08a7c-eeac-41b2-a909-2987e45a18f8 tempest-TestMinimumBasicScenario-597789740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (667d7e33-752d-4350-a575-3bcc85d12ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 22:09:44.553314 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-dce08a7c-eeac-41b2-a909-2987e45a18f8 tempest-TestMinimumBasicScenario-597789740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f525589-d746-4028-99e4-75f015b925b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 22:09:44.558087 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-dce08a7c-eeac-41b2-a909-2987e45a18f8 tempest-TestMinimumBasicScenario-597789740 None] Volume 51212ef3-353e-4630-969e-099dfb53b35d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51212ef3-353e-4630-969e-099dfb53b35d', 'volume_size': 1} Apr 30 22:09:44.558087 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-dce08a7c-eeac-41b2-a909-2987e45a18f8 tempest-TestMinimumBasicScenario-597789740 None] creating volume 'volume-51212ef3-353e-4630-969e-099dfb53b35d' {{(pid=123855) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} Apr 30 22:09:44.558087 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-dce08a7c-eeac-41b2-a909-2987e45a18f8 tempest-TestMinimumBasicScenario-597789740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:09:45.016714 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-dce08a7c-eeac-41b2-a909-2987e45a18f8 tempest-TestMinimumBasicScenario-597789740 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 22:09:45.017083 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-dce08a7c-eeac-41b2-a909-2987e45a18f8 tempest-TestMinimumBasicScenario-597789740 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 22:09:45.020785 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-dce08a7c-eeac-41b2-a909-2987e45a18f8 tempest-TestMinimumBasicScenario-597789740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f525589-d746-4028-99e4-75f015b925b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51212ef3-353e-4630-969e-099dfb53b35d', 'volume_size': 1}' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 22:09:45.026040 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-dce08a7c-eeac-41b2-a909-2987e45a18f8 tempest-TestMinimumBasicScenario-597789740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3553f6f-4751-4c02-9d76-625163932499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 22:09:45.116740 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-dce08a7c-eeac-41b2-a909-2987e45a18f8 tempest-TestMinimumBasicScenario-597789740 None] Volume volume-51212ef3-353e-4630-969e-099dfb53b35d (51212ef3-353e-4630-969e-099dfb53b35d): created successfully Apr 30 22:09:45.120880 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-dce08a7c-eeac-41b2-a909-2987e45a18f8 tempest-TestMinimumBasicScenario-597789740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3553f6f-4751-4c02-9d76-625163932499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 22:09:45.126338 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-dce08a7c-eeac-41b2-a909-2987e45a18f8 tempest-TestMinimumBasicScenario-597789740 None] Flow 'volume_create_manager' (1f62ba7c-17a1-4c37-b5ad-b9392f2459cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 22:09:45.197111 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-dce08a7c-eeac-41b2-a909-2987e45a18f8 tempest-TestMinimumBasicScenario-597789740 None] Created volume successfully. Apr 30 22:09:46.344445 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-ca02fe47-20ba-4a22-bb46-edc7e865efcc req-daa273e3-01c9-4b0f-bc2b-e8eadb25e3f4 tempest-TestMinimumBasicScenario-597789740 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 22:09:47.195679 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-ca02fe47-20ba-4a22-bb46-edc7e865efcc req-daa273e3-01c9-4b0f-bc2b-e8eadb25e3f4 tempest-TestMinimumBasicScenario-597789740 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.851s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 22:09:47.197021 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-ca02fe47-20ba-4a22-bb46-edc7e865efcc req-daa273e3-01c9-4b0f-bc2b-e8eadb25e3f4 tempest-TestMinimumBasicScenario-597789740 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-51212ef3-353e-4630-969e-099dfb53b35d', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': '51212ef3-353e-4630-969e-099dfb53b35d', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 22:09:47.260352 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-ca02fe47-20ba-4a22-bb46-edc7e865efcc req-daa273e3-01c9-4b0f-bc2b-e8eadb25e3f4 tempest-TestMinimumBasicScenario-597789740 None] Connection info returned from driver {'name': 'volumes/volume-51212ef3-353e-4630-969e-099dfb53b35d', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '51212ef3-353e-4630-969e-099dfb53b35d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ef588e8b-f37b-42a1-a428-791d68cd0722'} {{(pid=123855) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Apr 30 22:09:47.356109 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-ca02fe47-20ba-4a22-bb46-edc7e865efcc req-daa273e3-01c9-4b0f-bc2b-e8eadb25e3f4 tempest-TestMinimumBasicScenario-597789740 None] attachment_update completed successfully. Apr 30 22:10:31.474782 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:10:31.475706 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:10:31.500674 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:10:31.523122 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:11:06.570520 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-223cd35b-010e-420b-8322-85b2bcf9f0f9 req-65d754ef-5f93-4b9d-b0d1-c2776fd1ae98 tempest-TestMinimumBasicScenario-597789740 None] Terminate volume connection completed successfully. Apr 30 22:11:06.571280 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-223cd35b-010e-420b-8322-85b2bcf9f0f9 req-65d754ef-5f93-4b9d-b0d1-c2776fd1ae98 tempest-TestMinimumBasicScenario-597789740 None] Deleting attachment ef588e8b-f37b-42a1-a428-791d68cd0722. {{(pid=123855) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} Apr 30 22:11:07.237679 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-feb079cb-06b2-4a2a-902b-fb2a7b60b08f tempest-TestMinimumBasicScenario-597789740 None] Lock "b'cinder-51212ef3-353e-4630-969e-099dfb53b35d-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 22:11:07.333066 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-feb079cb-06b2-4a2a-902b-fb2a7b60b08f tempest-TestMinimumBasicScenario-597789740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:11:07.520854 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-feb079cb-06b2-4a2a-902b-fb2a7b60b08f tempest-TestMinimumBasicScenario-597789740 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 22:11:07.521208 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-feb079cb-06b2-4a2a-902b-fb2a7b60b08f tempest-TestMinimumBasicScenario-597789740 None] Volume volume-51212ef3-353e-4630-969e-099dfb53b35d is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 22:11:07.618465 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-feb079cb-06b2-4a2a-902b-fb2a7b60b08f tempest-TestMinimumBasicScenario-597789740 None] deleting rbd volume volume-51212ef3-353e-4630-969e-099dfb53b35d {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 22:11:10.548077 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [None req-feb079cb-06b2-4a2a-902b-fb2a7b60b08f tempest-TestMinimumBasicScenario-597789740 None] Created reservations ['656e8e3a-7d58-495f-9023-9ee8858d1979', '8e22a130-31f4-4996-ad72-674d4bb6bb9e', '1f22e093-f894-4113-91d6-c9093b9961df', '6412e0b1-3c4b-49d9-bd49-860d3fc5d305'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 22:11:10.739334 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-feb079cb-06b2-4a2a-902b-fb2a7b60b08f tempest-TestMinimumBasicScenario-597789740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:11:10.761890 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-feb079cb-06b2-4a2a-902b-fb2a7b60b08f tempest-TestMinimumBasicScenario-597789740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:11:10.785582 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-feb079cb-06b2-4a2a-902b-fb2a7b60b08f tempest-TestMinimumBasicScenario-597789740 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:11:10.789851 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-feb079cb-06b2-4a2a-902b-fb2a7b60b08f tempest-TestMinimumBasicScenario-597789740 None] Deleted volume successfully. Apr 30 22:11:10.867770 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-feb079cb-06b2-4a2a-902b-fb2a7b60b08f tempest-TestMinimumBasicScenario-597789740 None] Lock "b'cinder-51212ef3-353e-4630-969e-099dfb53b35d-delete_volume'" released by "delete_volume" :: held 3.630s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 22:11:31.478027 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:11:31.482034 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:11:31.500812 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:11:31.523392 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:12:31.478989 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:12:31.479700 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:12:31.508576 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:12:31.576001 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:13:31.484020 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:13:31.484730 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:13:31.506784 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:13:31.529713 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:14:31.484876 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:14:31.485568 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:14:31.521433 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:14:31.542828 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:15:31.488228 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:15:31.488881 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:15:31.511890 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:15:31.537868 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:16:31.493379 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:16:31.500152 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:16:31.535844 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:16:31.559041 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:17:31.494366 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:17:31.495051 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:17:31.517804 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:17:31.540759 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:18:31.495804 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:18:31.496507 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:18:31.522236 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:18:31.557777 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:19:31.493738 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:19:31.494449 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:19:31.517407 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:19:31.538819 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:20:31.493620 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:20:31.494338 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:20:31.516988 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:20:31.538377 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:21:31.493535 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:21:31.494518 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:21:31.516772 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:21:31.538705 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:22:31.493660 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:22:31.495064 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:22:31.518922 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:22:31.543525 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:23:31.490468 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:23:31.491158 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:23:31.512890 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:23:31.536198 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:24:25.845522 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6cd925c-246d-4a88-bedc-9c3d9636380f tempest-TestShelveInstance-184288386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123855) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 30 22:24:25.866021 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c6cd925c-246d-4a88-bedc-9c3d9636380f tempest-TestShelveInstance-184288386 None] Flow 'volume_create_manager' (dc6abccb-225f-4a5b-9268-96557999f118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 22:24:25.872836 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c6cd925c-246d-4a88-bedc-9c3d9636380f tempest-TestShelveInstance-184288386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f70ea45-8621-460a-8021-f0ecc14b6bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 22:24:25.887604 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c6cd925c-246d-4a88-bedc-9c3d9636380f tempest-TestShelveInstance-184288386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f70ea45-8621-460a-8021-f0ecc14b6bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-30T22:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1728309976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ba641aff-2e83-4e62-b722-0db065460767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a470c13c84849f28ff3b1d4bb55c4e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-30T22:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-30T22:24:26Z,use_quota=True,user_id='d303e4f4105348928c5697b11e69a3d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460ef46e-2bc4-423f-9bd9-e67dcd7221c3),volume_type_id=460ef46e-2bc4-423f-9bd9-e67dcd7221c3)' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 22:24:25.892941 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c6cd925c-246d-4a88-bedc-9c3d9636380f tempest-TestShelveInstance-184288386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (240cb7c8-645d-4691-9098-1b0b5638dd3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 22:24:25.897086 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c6cd925c-246d-4a88-bedc-9c3d9636380f tempest-TestShelveInstance-184288386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (240cb7c8-645d-4691-9098-1b0b5638dd3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 22:24:25.902248 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c6cd925c-246d-4a88-bedc-9c3d9636380f tempest-TestShelveInstance-184288386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e14a96e-6a4c-414e-b92a-24cc1c654281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 22:24:25.978411 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c6cd925c-246d-4a88-bedc-9c3d9636380f tempest-TestShelveInstance-184288386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e14a96e-6a4c-414e-b92a-24cc1c654281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ba641aff-2e83-4e62-b722-0db065460767', 'volume_name': 'volume-ba641aff-2e83-4e62-b722-0db065460767', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 22:24:25.983440 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c6cd925c-246d-4a88-bedc-9c3d9636380f tempest-TestShelveInstance-184288386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8fb48b-227f-474b-9fd2-cb9522e13581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 22:24:25.988015 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c6cd925c-246d-4a88-bedc-9c3d9636380f tempest-TestShelveInstance-184288386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8fb48b-227f-474b-9fd2-cb9522e13581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 22:24:25.992982 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c6cd925c-246d-4a88-bedc-9c3d9636380f tempest-TestShelveInstance-184288386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90a157e0-7b0c-44c8-ab56-2cf43b39e2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 22:24:25.994147 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-c6cd925c-246d-4a88-bedc-9c3d9636380f tempest-TestShelveInstance-184288386 None] Volume ba641aff-2e83-4e62-b722-0db065460767: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ba641aff-2e83-4e62-b722-0db065460767', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 30 22:24:25.994717 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6cd925c-246d-4a88-bedc-9c3d9636380f tempest-TestShelveInstance-184288386 None] Cloning ba641aff-2e83-4e62-b722-0db065460767 from image a5b0850f-3b24-4bcb-b0a7-351c3216b27d at location (None, None). {{(pid=123855) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Apr 30 22:24:26.002514 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-c6cd925c-246d-4a88-bedc-9c3d9636380f tempest-TestShelveInstance-184288386 None] Lock "b'cinder-a5b0850f-3b24-4bcb-b0a7-351c3216b27d'" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 22:24:26.072883 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-c6cd925c-246d-4a88-bedc-9c3d9636380f tempest-TestShelveInstance-184288386 None] Found image-volume cache entry: {'id': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'volume_id': '5772aef0-721f-450a-93ff-02cc6a41edcc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7), 'last_used': datetime.datetime(2022, 4, 30, 22, 24, 26, 6396)}. {{(pid=123855) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 30 22:24:26.073310 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-c6cd925c-246d-4a88-bedc-9c3d9636380f tempest-TestShelveInstance-184288386 None] Image-volume cache entry image_update_at = 2022-04-30 21:01:07+00:00, requested image updated_at = 2022-04-30 21:01:07+00:00. {{(pid=123855) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 30 22:24:26.073705 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6cd925c-246d-4a88-bedc-9c3d9636380f tempest-TestShelveInstance-184288386 None] Found cache entry for image = a5b0850f-3b24-4bcb-b0a7-351c3216b27d on host ncdv-master-1@ceph#ceph. {{(pid=123855) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Apr 30 22:24:26.078790 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [None req-c6cd925c-246d-4a88-bedc-9c3d9636380f tempest-TestShelveInstance-184288386 None] Lock "b'cinder-a5b0850f-3b24-4bcb-b0a7-351c3216b27d'" released by "_prepare_image_cache_entry" :: held 0.076s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 22:24:26.079699 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6cd925c-246d-4a88-bedc-9c3d9636380f tempest-TestShelveInstance-184288386 None] Attempting to retrieve cache entry for image = a5b0850f-3b24-4bcb-b0a7-351c3216b27d on host ncdv-master-1@ceph#ceph. {{(pid=123855) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Apr 30 22:24:26.085480 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-c6cd925c-246d-4a88-bedc-9c3d9636380f tempest-TestShelveInstance-184288386 None] Found image-volume cache entry: {'id': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'volume_id': '5772aef0-721f-450a-93ff-02cc6a41edcc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7), 'last_used': datetime.datetime(2022, 4, 30, 22, 24, 26, 83293)}. {{(pid=123855) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 30 22:24:26.085926 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.image.cache [None req-c6cd925c-246d-4a88-bedc-9c3d9636380f tempest-TestShelveInstance-184288386 None] Image-volume cache entry image_update_at = 2022-04-30 21:01:07+00:00, requested image updated_at = 2022-04-30 21:01:07+00:00. {{(pid=123855) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 30 22:24:26.086304 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6cd925c-246d-4a88-bedc-9c3d9636380f tempest-TestShelveInstance-184288386 None] Creating from source image-volume 5772aef0-721f-450a-93ff-02cc6a41edcc {{(pid=123855) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Apr 30 22:24:26.099817 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c6cd925c-246d-4a88-bedc-9c3d9636380f tempest-TestShelveInstance-184288386 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:24:26.410313 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c6cd925c-246d-4a88-bedc-9c3d9636380f tempest-TestShelveInstance-184288386 None] creating snapshot='volume-ba641aff-2e83-4e62-b722-0db065460767.clone_snap' {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} Apr 30 22:24:28.209521 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c6cd925c-246d-4a88-bedc-9c3d9636380f tempest-TestShelveInstance-184288386 None] cloning 'volume-5772aef0-721f-450a-93ff-02cc6a41edcc@volume-ba641aff-2e83-4e62-b722-0db065460767.clone_snap' to 'volume-ba641aff-2e83-4e62-b722-0db065460767' {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} Apr 30 22:24:29.143611 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c6cd925c-246d-4a88-bedc-9c3d9636380f tempest-TestShelveInstance-184288386 None] Volume volume-632a7810-1a6f-420a-a6fd-57675408a8f7.deleted is not a clone. {{(pid=123855) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} Apr 30 22:24:29.144709 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c6cd925c-246d-4a88-bedc-9c3d9636380f tempest-TestShelveInstance-184288386 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} Apr 30 22:24:29.145082 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c6cd925c-246d-4a88-bedc-9c3d9636380f tempest-TestShelveInstance-184288386 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123855) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} Apr 30 22:24:29.362503 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-c6cd925c-246d-4a88-bedc-9c3d9636380f tempest-TestShelveInstance-184288386 None] clone created successfully {{(pid=123855) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} Apr 30 22:24:29.363120 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.volume_utils [None req-c6cd925c-246d-4a88-bedc-9c3d9636380f tempest-TestShelveInstance-184288386 None] Marking volume ba641aff-2e83-4e62-b722-0db065460767 as bootable. {{(pid=123855) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Apr 30 22:24:29.443114 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6cd925c-246d-4a88-bedc-9c3d9636380f tempest-TestShelveInstance-184288386 None] Copying metadata from image a5b0850f-3b24-4bcb-b0a7-351c3216b27d to ba641aff-2e83-4e62-b722-0db065460767. {{(pid=123855) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Apr 30 22:24:29.443537 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6cd925c-246d-4a88-bedc-9c3d9636380f tempest-TestShelveInstance-184288386 None] Creating volume glance metadata for volume ba641aff-2e83-4e62-b722-0db065460767 backed by image a5b0850f-3b24-4bcb-b0a7-351c3216b27d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123855) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Apr 30 22:24:29.543709 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c6cd925c-246d-4a88-bedc-9c3d9636380f tempest-TestShelveInstance-184288386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90a157e0-7b0c-44c8-ab56-2cf43b39e2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba641aff-2e83-4e62-b722-0db065460767', 'volume_size': 1, 'image_id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '137d4e571f624bfe845b398839c48b74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'a5b0850f-3b24-4bcb-b0a7-351c3216b27d', 'created_at': datetime.datetime(2022, 4, 30, 21, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 30, 21, 1, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5b0850f-3b24-4bcb-b0a7-351c3216b27d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 22:24:29.548944 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c6cd925c-246d-4a88-bedc-9c3d9636380f tempest-TestShelveInstance-184288386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (313064a9-69c5-490f-a191-450732ba245f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 30 22:24:29.614556 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.flows.manager.create_volume [None req-c6cd925c-246d-4a88-bedc-9c3d9636380f tempest-TestShelveInstance-184288386 None] Volume volume-ba641aff-2e83-4e62-b722-0db065460767 (ba641aff-2e83-4e62-b722-0db065460767): created successfully Apr 30 22:24:29.618365 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c6cd925c-246d-4a88-bedc-9c3d9636380f tempest-TestShelveInstance-184288386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (313064a9-69c5-490f-a191-450732ba245f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123855) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 30 22:24:29.623967 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [None req-c6cd925c-246d-4a88-bedc-9c3d9636380f tempest-TestShelveInstance-184288386 None] Flow 'volume_create_manager' (dc6abccb-225f-4a5b-9268-96557999f118) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123855) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 30 22:24:29.695599 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [None req-c6cd925c-246d-4a88-bedc-9c3d9636380f tempest-TestShelveInstance-184288386 None] Created volume successfully. Apr 30 22:24:31.491412 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:24:31.492088 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:24:31.513428 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:24:31.534822 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:24:36.886416 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-d3ce055f-987b-4a40-95c2-4a3baa879d2a req-8d6c98eb-dfce-45ff-889a-0f356efa96bc tempest-TestShelveInstance-184288386 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 30 22:24:37.535357 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_concurrency.processutils [req-d3ce055f-987b-4a40-95c2-4a3baa879d2a req-8d6c98eb-dfce-45ff-889a-0f356efa96bc tempest-TestShelveInstance-184288386 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.648s {{(pid=123855) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 30 22:24:37.536802 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-d3ce055f-987b-4a40-95c2-4a3baa879d2a req-8d6c98eb-dfce-45ff-889a-0f356efa96bc tempest-TestShelveInstance-184288386 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ba641aff-2e83-4e62-b722-0db065460767', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9e39727c-6075-4d95-b487-e2c486f443b1', 'volume_id': 'ba641aff-2e83-4e62-b722-0db065460767', 'discard': True}} {{(pid=123855) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} Apr 30 22:24:37.649090 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-d3ce055f-987b-4a40-95c2-4a3baa879d2a req-8d6c98eb-dfce-45ff-889a-0f356efa96bc tempest-TestShelveInstance-184288386 None] Connection info returned from driver {'name': 'volumes/volume-ba641aff-2e83-4e62-b722-0db065460767', 'hosts': ['10.222.0.23'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ba641aff-2e83-4e62-b722-0db065460767', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '13466eb8-fc7e-46df-bbde-fe9d95b4907a'} {{(pid=123855) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Apr 30 22:24:37.758592 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-d3ce055f-987b-4a40-95c2-4a3baa879d2a req-8d6c98eb-dfce-45ff-889a-0f356efa96bc tempest-TestShelveInstance-184288386 None] attachment_update completed successfully. Apr 30 22:25:31.491074 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:25:31.492125 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:25:31.515543 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:25:31.538146 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:26:31.493021 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:26:31.493700 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:26:31.516137 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:26:31.545071 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:27:31.491376 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:27:31.492051 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:27:31.513998 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:27:31.548121 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:28:11.835618 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-6a57174a-96a2-4e99-939f-dbdd95c9e63f req-61466540-1356-4088-82cf-6479624786f8 tempest-TestShelveInstance-184288386 None] Terminate volume connection completed successfully. Apr 30 22:28:11.836236 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.manager [req-6a57174a-96a2-4e99-939f-dbdd95c9e63f req-61466540-1356-4088-82cf-6479624786f8 tempest-TestShelveInstance-184288386 None] Deleting attachment 13466eb8-fc7e-46df-bbde-fe9d95b4907a. {{(pid=123855) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} Apr 30 22:28:12.219630 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [req-6a57174a-96a2-4e99-939f-dbdd95c9e63f req-f0cf707b-d320-4739-96c0-a85d4207e5d8 tempest-TestShelveInstance-184288386 None] Lock "b'cinder-ba641aff-2e83-4e62-b722-0db065460767-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 30 22:28:12.320153 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-6a57174a-96a2-4e99-939f-dbdd95c9e63f req-f0cf707b-d320-4739-96c0-a85d4207e5d8 tempest-TestShelveInstance-184288386 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:28:12.513051 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-6a57174a-96a2-4e99-939f-dbdd95c9e63f req-f0cf707b-d320-4739-96c0-a85d4207e5d8 tempest-TestShelveInstance-184288386 None] volume has no backup snaps {{(pid=123855) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} Apr 30 22:28:12.597182 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-6a57174a-96a2-4e99-939f-dbdd95c9e63f req-f0cf707b-d320-4739-96c0-a85d4207e5d8 tempest-TestShelveInstance-184288386 None] deleting rbd volume volume-ba641aff-2e83-4e62-b722-0db065460767 {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} Apr 30 22:28:16.600745 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-6a57174a-96a2-4e99-939f-dbdd95c9e63f req-f0cf707b-d320-4739-96c0-a85d4207e5d8 tempest-TestShelveInstance-184288386 None] volume is a clone so cleaning references {{(pid=123855) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} Apr 30 22:28:16.701119 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-6a57174a-96a2-4e99-939f-dbdd95c9e63f req-f0cf707b-d320-4739-96c0-a85d4207e5d8 tempest-TestShelveInstance-184288386 None] deleting parent snapshot volume-ba641aff-2e83-4e62-b722-0db065460767.clone_snap {{(pid=123855) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} Apr 30 22:28:19.725858 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.quota [req-6a57174a-96a2-4e99-939f-dbdd95c9e63f req-f0cf707b-d320-4739-96c0-a85d4207e5d8 tempest-TestShelveInstance-184288386 None] Created reservations ['abb043e8-da73-41c5-86ff-09257d675c91', '34cebd0a-089b-421b-b559-f1323ff97487', '99b23247-9e9c-4062-b15c-a967db78e358', 'eca223b0-1cfa-4427-a185-8eb787907097'] {{(pid=123855) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 30 22:28:19.877320 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-6a57174a-96a2-4e99-939f-dbdd95c9e63f req-f0cf707b-d320-4739-96c0-a85d4207e5d8 tempest-TestShelveInstance-184288386 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:28:19.901613 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [req-6a57174a-96a2-4e99-939f-dbdd95c9e63f req-f0cf707b-d320-4739-96c0-a85d4207e5d8 tempest-TestShelveInstance-184288386 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:28:19.927639 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [req-6a57174a-96a2-4e99-939f-dbdd95c9e63f req-f0cf707b-d320-4739-96c0-a85d4207e5d8 tempest-TestShelveInstance-184288386 None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:28:19.932678 ncdv-master-1 cinder-volume[123855]: INFO cinder.volume.manager [req-6a57174a-96a2-4e99-939f-dbdd95c9e63f req-f0cf707b-d320-4739-96c0-a85d4207e5d8 tempest-TestShelveInstance-184288386 None] Deleted volume successfully. Apr 30 22:28:20.004020 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.coordination [req-6a57174a-96a2-4e99-939f-dbdd95c9e63f req-f0cf707b-d320-4739-96c0-a85d4207e5d8 tempest-TestShelveInstance-184288386 None] Lock "b'cinder-ba641aff-2e83-4e62-b722-0db065460767-delete_volume'" released by "delete_volume" :: held 7.784s {{(pid=123855) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 30 22:28:31.505821 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:28:31.505821 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:28:31.566723 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:28:31.691478 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:29:31.495941 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:29:31.496665 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:29:31.518866 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:29:31.544629 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:30:31.501242 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:30:31.501974 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:30:31.523310 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:30:31.544736 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:31:31.499389 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:31:31.500124 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:31:31.522857 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:31:31.544018 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:32:31.498968 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:32:31.499680 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:32:31.521153 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:32:31.543401 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:33:31.498824 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:33:31.499531 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:33:31.522381 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:33:31.549017 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:34:31.494902 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:34:31.495554 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:34:31.516989 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:34:31.537930 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:35:31.493636 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:35:31.494372 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:35:31.515574 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:35:31.537416 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:36:31.492768 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:36:31.493456 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:36:31.515769 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:36:31.537160 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:37:31.492110 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:37:31.492824 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:37:31.513820 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:37:31.535671 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:38:31.490831 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:38:31.491520 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:38:31.514581 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:38:31.536478 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:39:31.491380 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:39:31.492061 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:39:31.513441 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:39:31.535496 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:40:31.490469 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:40:31.491148 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:40:31.516731 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:40:31.539492 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 22:41:31.493924 ncdv-master-1 cinder-volume[123855]: DEBUG oslo_service.periodic_task [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123855) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 30 22:41:31.494593 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:41:31.519248 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.volume.drivers.rbd [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123855) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} Apr 30 22:41:31.541543 ncdv-master-1 cinder-volume[123855]: DEBUG cinder.manager [None req-ee2c33e6-2cc4-4a62-a993-9d82c95a4831 None None] Notifying Schedulers of capabilities ... {{(pid=123855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}