-- Logs begin at Sat 2022-03-12 20:01:16 UTC, end at Sat 2022-03-12 22:10:14 UTC. -- Mar 12 20:38:58.124954 ncdv-master-1 systemd[1]: Started Devstack devstack@c-vol.service. Mar 12 20:39:01.515174 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=129358) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 12 20:39:01.515772 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=129358) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 12 20:39:01.908395 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_db.sqlalchemy.engines [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 20:39:02.216661 ncdv-master-1 cinder-volume[129358]: INFO cinder.rpc [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Mar 12 20:39:02.222953 ncdv-master-1 cinder-volume[129358]: INFO cinder.rpc [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Mar 12 20:39:02.230320 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_db.sqlalchemy.engines [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 20:39:02.298274 ncdv-master-1 cinder-volume[129358]: INFO cinder.volume.manager [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] Determined volume DB was empty at startup. Mar 12 20:39:02.298889 ncdv-master-1 cinder-volume[129358]: DEBUG cinder.volume.manager [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=129358) __init__ /opt/stack/cinder/cinder/volume/manager.py:286}} Mar 12 20:39:02.307943 ncdv-master-1 cinder-volume[129358]: INFO cinder.volume.manager [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] Service not found for updating active_backend_id, assuming default for driver init. Mar 12 20:39:02.308985 ncdv-master-1 cinder-volume[129358]: WARNING stevedore.named [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 20:39:02.309677 ncdv-master-1 cinder-volume[129358]: WARNING castellan.key_manager [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 20:39:02.311235 ncdv-master-1 cinder-volume[129358]: WARNING cinder.keymgr.conf_key_mgr [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 20:39:02.327614 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_db.sqlalchemy.engines [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 20:39:02.335108 ncdv-master-1 cinder-volume[129358]: INFO cinder.rpc [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Mar 12 20:39:02.339036 ncdv-master-1 cinder-volume[129358]: INFO cinder.rpc [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] Automatically selected cinder-volume RPC version 3.18 as minimum service version. Mar 12 20:39:02.339728 ncdv-master-1 cinder-volume[129358]: WARNING stevedore.named [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 20:39:02.340135 ncdv-master-1 cinder-volume[129358]: WARNING castellan.key_manager [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 20:39:02.341912 ncdv-master-1 cinder-volume[129358]: INFO cinder.volume.manager [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] Image-volume cache enabled for host ncdv-master-1@ceph. Mar 12 20:39:02.347388 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_db.sqlalchemy.engines [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 20:39:02.366436 ncdv-master-1 cinder-volume[129358]: INFO oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] Starting 1 workers Mar 12 20:39:02.372118 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] Started child 129531 {{(pid=129358) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Mar 12 20:39:02.373736 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] Full set of CONF: {{(pid=129358) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Mar 12 20:39:02.374776 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ******************************************************************************** {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 12 20:39:02.375148 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] Configuration options gathered from: {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 12 20:39:02.375776 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 12 20:39:02.376639 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 12 20:39:02.377137 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ================================================================================ {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 12 20:39:02.378066 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] allow_availability_zone_fallback = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.378714 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] allow_compression_on_image_upload = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.379113 ncdv-master-1 cinder-volume[129531]: INFO cinder.service [-] Starting cinder-volume node (version 19.1.0) Mar 12 20:39:02.380795 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] allowed_direct_url_schemes = [] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.380795 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] api_rate_limit = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.381481 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] auth_strategy = keystone {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.382123 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] az_cache_duration = 3600 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.382736 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_availability_zone = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.383498 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_host = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.384305 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_name = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.384960 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_stats_polling_interval = 60 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.386194 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backup_api_class = cinder.backup.api.API {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.386819 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.387444 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backup_name_template = backup-%s {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.388085 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backup_use_same_host = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.388838 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backup_use_temp_snapshot = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.389464 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] chap_password = **** {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.390098 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] chap_username = {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.390706 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.391408 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] cinder_internal_tenant_project_id = e45fccdf84cf4b5abb66a1257e6cb2cd {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.392012 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] cinder_internal_tenant_user_id = 4a34e93fbd234e3bb82ff3ad9963ff66 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.392616 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] cloned_volume_same_az = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.393204 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] cluster = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.394077 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] compression_format = gzip {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.394717 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] compute_api_class = cinder.compute.nova.API {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.395352 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] config_dir = [] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.395867 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.396472 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] config_source = [] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.397038 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.397662 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] control_exchange = openstack {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.398402 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] debug = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.399610 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] default_availability_zone = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.400217 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] default_group_type = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.401100 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.401742 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] default_volume_type = ceph {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.402740 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] driver_client_cert = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.403093 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] driver_client_cert_key = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.403794 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] driver_data_namespace = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.404616 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] driver_ssl_cert_path = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.405210 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] driver_ssl_cert_verify = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.405840 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] driver_use_ssl = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.406453 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] enable_force_upload = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.406976 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] enable_new_services = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.407665 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] enable_unsupported_driver = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.408300 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] enabled_backends = ['ceph'] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.408872 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] enforce_multipath_for_image_xfer = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.409532 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] filter_function = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.410123 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] glance_api_insecure = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.410733 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] glance_api_servers = ['http://10.222.0.30/image'] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.411304 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] glance_api_ssl_compression = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.412007 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] glance_ca_certificates_file = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.412732 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] glance_catalog_info = image:glance:publicURL {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.413198 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] glance_certfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.675677 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.675677 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] glance_keyfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.675677 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] glance_num_retries = 3 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.675677 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] glance_request_timeout = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.675677 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] goodness_function = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.675677 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] graceful_shutdown_timeout = 5 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.697677 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] group_api_class = cinder.group.api.API {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.697677 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] host = ncdv-master-1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.697677 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] iet_conf = /etc/iet/ietd.conf {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.697677 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] image_compress_on_upload = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.697677 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] image_conversion_address_space_limit = 1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.697677 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] image_conversion_cpu_limit = 60 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.698169 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.698169 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] image_upload_use_cinder_backend = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.698169 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] image_upload_use_internal_tenant = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.698169 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] image_volume_cache_enabled = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.698169 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] image_volume_cache_max_count = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.698169 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] image_volume_cache_max_size_gb = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.698618 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-3618748a-7e47-4581-a084-1e693ceb70a4 None None] Starting volume driver RBDDriver (1.2.0) Mar 12 20:39:02.698709 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] init_host_max_objects_retrieval = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.698709 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] instance_format = [instance: %(uuid)s] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.698709 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.698709 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] iscsi_iotype = fileio {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.698709 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] iscsi_secondary_ip_addresses = [] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.698709 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] iscsi_target_flags = {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.698709 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] iscsi_write_cache = on {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.699232 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] iser_helper = tgtadm {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.699331 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3618748a-7e47-4581-a084-1e693ceb70a4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:39:02.699418 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] iser_ip_address = 10.222.0.30 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.699418 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] iser_port = 3260 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.699418 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.699418 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] log_config_append = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.699418 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.699418 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] log_dir = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.699879 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] log_file = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.699879 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] log_options = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.699879 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] log_rotate_interval = 1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.699879 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] log_rotate_interval_type = days {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.699879 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] log_rotation_type = none {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.699879 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.700339 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.700339 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.700339 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.700339 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.700339 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] max_age = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.700339 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] max_logfile_count = 30 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.700814 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] max_logfile_size_mb = 200 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.700814 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] max_over_subscription_ratio = 20.0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.700814 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] message_reap_interval = 86400 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.700814 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] message_ttl = 2592000 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.700814 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] migration_create_volume_timeout_secs = 300 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.700814 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] monkey_patch = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.700814 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] monkey_patch_modules = [] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.701327 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] my_ip = 10.222.0.30 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.701327 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] no_snapshot_gb_quota = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.701327 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] num_iser_scan_tries = 3 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.701327 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] num_shell_tries = 3 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.701327 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] num_volume_device_scan_tries = 3 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.701327 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] nvmet_ns_id = 10 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.701327 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] nvmet_port_id = 1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.702146 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] osapi_max_limit = 1000 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.702146 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] osapi_volume_ext_list = [] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.702146 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.702146 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] osapi_volume_listen = 0.0.0.0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.702146 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] osapi_volume_listen_port = 8776 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.702146 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] osapi_volume_use_ssl = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.702636 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] osapi_volume_workers = 2 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.702636 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] per_volume_size_limit = -1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.702636 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] periodic_fuzzy_delay = 60 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.702636 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] periodic_interval = 60 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.702636 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] project_id_regex = [0-9a-f\-]+ {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.702636 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] public_endpoint = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.702636 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] publish_errors = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.703155 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] quota_backup_gigabytes = 1000 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.703155 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] quota_backups = 10 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.703155 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] quota_consistencygroups = 10 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.703155 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.703155 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] quota_gigabytes = 1000 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.703155 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] quota_groups = 10 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.703155 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] quota_snapshots = 10 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.703672 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] quota_volumes = 10 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.703672 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] rate_limit_burst = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.703672 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] rate_limit_except_level = CRITICAL {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.703672 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] rate_limit_interval = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.703672 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] reinit_driver_count = 3 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.703672 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] replication_device = **** {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.703672 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] report_discard_supported = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.704251 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] report_interval = 10 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.704251 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] reservation_clean_interval = 86400 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.704251 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] reservation_expire = 86400 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.704251 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] reserved_percentage = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.704251 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.704251 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.704754 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] rpc_response_timeout = 120 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.704754 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] run_external_periodic_tasks = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.704754 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.704754 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] scst_target_driver = iscsi {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.704754 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] scst_target_iqn_name = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.704754 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] service_down_time = 60 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.705197 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] snapshot_name_template = snapshot-%s {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.705197 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] snapshot_same_host = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.705197 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] split_loggers = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.705197 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] state_path = /opt/stack/data/cinder {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.705197 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] storage_availability_zone = nova {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.705197 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] storage_protocol = iscsi {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.705197 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] syslog_log_facility = LOG_USER {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.705724 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] target_helper = lioadm {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.705724 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] target_ip_address = 10.222.0.30 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.705724 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] target_port = 3260 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.705724 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.705724 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] target_protocol = iscsi {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.705724 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] trace_flags = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.706181 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] transfer_api_class = cinder.transfer.api.API {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.706181 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] transport_url = **** {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.706181 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] until_refresh = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.706181 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] use_chap_auth = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.706181 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] use_default_quota_class = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.706181 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] use_eventlog = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.706181 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] use_journal = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.706686 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] use_json = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.706686 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] use_multipath_for_image_xfer = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.706686 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] use_stderr = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.706686 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] use_syslog = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.706686 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] verify_glance_signatures = enabled {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.706686 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] volume_api_class = cinder.volume.api.API {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.706686 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] volume_backend_name = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.707202 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] volume_clear = zero {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.707202 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] volume_clear_ionice = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.707202 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] volume_clear_size = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.707202 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.707202 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] volume_copy_bps_limit = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.707202 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] volume_dd_blocksize = 1M {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.707651 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.707651 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] volume_name_template = volume-%s {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.707651 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] volume_service_inithost_offload = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.707651 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] volume_usage_audit_period = month {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.707651 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.707651 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] watch_log_file = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.708350 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] zoning_mode = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:39:02.708350 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.708350 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.708350 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_policy.enforce_new_defaults = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.708350 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_policy.enforce_scope = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.708350 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_policy.policy_default_rule = default {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.708793 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.708793 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_policy.policy_file = policy.yaml {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.708793 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.708793 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.708793 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.708793 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.709334 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.709334 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_concurrency.disable_process_locking = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.709334 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.709334 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] keystone_authtoken.admin_password = **** {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.709334 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.709334 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] keystone_authtoken.admin_token = **** {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.710261 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] keystone_authtoken.admin_user = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.710261 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] keystone_authtoken.auth_admin_prefix = {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.710495 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3618748a-7e47-4581-a084-1e693ceb70a4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:39:02.710583 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.710583 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] keystone_authtoken.auth_port = 35357 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.710583 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] keystone_authtoken.auth_protocol = https {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.710583 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] keystone_authtoken.auth_section = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.710583 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] keystone_authtoken.auth_type = password {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.710583 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] keystone_authtoken.auth_uri = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.710583 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] keystone_authtoken.auth_version = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.711147 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] keystone_authtoken.cache = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.711147 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.711147 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] keystone_authtoken.certfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.711147 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.711147 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.711147 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.712193 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.712193 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] keystone_authtoken.identity_uri = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.712193 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] keystone_authtoken.include_service_catalog = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.712193 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] keystone_authtoken.insecure = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.712193 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] keystone_authtoken.interface = public {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.712193 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] keystone_authtoken.keyfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.712693 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.712693 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.712693 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.712693 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.712693 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.712693 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.713135 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.713135 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.713135 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.713135 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] keystone_authtoken.region_name = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.713135 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.713135 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] keystone_authtoken.service_token_roles_required = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.713563 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] keystone_authtoken.service_type = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.713563 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.713563 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.713563 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] cache.backend = dogpile.cache.null {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.713563 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] cache.backend_argument = **** {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.713563 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] cache.config_prefix = cache.oslo {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.714093 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] cache.dead_timeout = 60.0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.714093 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] cache.debug_cache_backend = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.714093 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] cache.enable_retry_client = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.714093 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] cache.enable_socket_keepalive = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.714093 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] cache.enabled = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.714093 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] cache.expiration_time = 600 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.714093 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] cache.hashclient_retry_attempts = 2 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.714696 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] cache.hashclient_retry_delay = 1.0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.714696 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] cache.memcache_dead_retry = 300 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.714696 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.714696 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.714696 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] cache.memcache_pool_maxsize = 10 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.714696 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.714696 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.715221 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] cache.memcache_socket_timeout = 1.0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.715221 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] cache.proxies = [] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.715221 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] cache.retry_attempts = 2 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.715221 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] cache.retry_delay = 0.0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.715221 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] cache.socket_keepalive_count = 1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.715221 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] cache.socket_keepalive_idle = 1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.715221 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] cache.socket_keepalive_interval = 1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.715709 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] cache.tls_allowed_ciphers = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.715709 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] cache.tls_cafile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.715709 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] cache.tls_certfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.715709 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] cache.tls_enabled = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.715709 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] cache.tls_keyfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.715709 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] coordination.backend_url = etcd3+http://10.222.0.30:2379 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.715709 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] database.backend = sqlalchemy {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.716193 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] database.connection = **** {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.716193 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] database.connection_debug = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.716193 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] database.connection_parameters = {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.716193 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] database.connection_recycle_time = 3600 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.716193 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] database.connection_trace = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.716193 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] database.db_inc_retry_interval = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.716633 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3618748a-7e47-4581-a084-1e693ceb70a4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:39:02.716712 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] database.db_max_retries = 20 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.716712 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] database.db_max_retry_interval = 10 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.716712 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] database.db_retry_interval = 1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.716712 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] database.max_overflow = 50 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.716712 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] database.max_pool_size = 5 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.716712 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] database.max_retries = 10 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.716712 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] database.mysql_enable_ndb = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.717225 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.717225 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] database.pool_timeout = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.717225 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] database.retry_interval = 10 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.717225 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] database.slave_connection = **** {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.717225 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] database.sqlite_synchronous = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.717225 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] database.use_db_reconnect = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.717225 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.717715 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.717715 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.717715 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.717715 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.717715 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] profiler.connection_string = messaging:// {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.717715 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] profiler.enabled = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.728744 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] profiler.es_doc_type = notification {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.728744 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] profiler.es_scroll_size = 10000 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.728744 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] profiler.es_scroll_time = 2m {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.728744 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] profiler.filter_error_trace = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.728744 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] profiler.hmac_keys = SECRET_KEY {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.728744 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] profiler.sentinel_service_name = mymaster {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.728744 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] profiler.socket_timeout = 0.1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.729237 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] profiler.trace_sqlalchemy = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.729237 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] privsep_osbrick.capabilities = [21] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.729237 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] privsep_osbrick.group = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.729237 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] privsep_osbrick.helper_command = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.729237 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.729237 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.729237 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] privsep_osbrick.user = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.729838 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.729838 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] cinder_sys_admin.group = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.729838 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] cinder_sys_admin.helper_command = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.729838 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.729838 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.729838 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] cinder_sys_admin.user = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.729838 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] service_user.auth_section = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.730365 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] service_user.auth_type = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.730365 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] service_user.cafile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.730365 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] service_user.certfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.730365 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] service_user.collect_timing = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.730365 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] service_user.insecure = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.730365 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] service_user.keyfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.730365 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] service_user.send_service_user_token = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.730893 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] service_user.split_loggers = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.730893 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] service_user.timeout = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.730893 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.backend_availability_zone = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.730893 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.730893 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.730893 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.chap_password = **** {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.731329 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.chap_username = {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.731329 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.731329 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.deferred_deletion_delay = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.731329 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.deferred_deletion_purge_interval = 60 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.731329 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.driver_client_cert = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.731329 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.driver_client_cert_key = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.731761 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.driver_data_namespace = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.731761 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.731761 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.731761 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.driver_use_ssl = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.731761 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.enable_deferred_deletion = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.731761 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.732193 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.732193 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.extra_capabilities = {} {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.732193 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.filter_function = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.732408 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.driver [None req-3618748a-7e47-4581-a084-1e693ceb70a4 None None] Driver hasn't implemented _init_vendor_properties() Mar 12 20:39:02.732502 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.goodness_function = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.732502 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.732643 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.driver [None req-3618748a-7e47-4581-a084-1e693ceb70a4 None None] Initialized capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:c639bb7d-414c-4067-b984-1a13e8932eb7:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=129531) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:811}} Mar 12 20:39:02.732744 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.732744 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.732744 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.732744 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.732744 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.732744 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.iscsi_iotype = fileio {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.733180 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.733180 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.iscsi_target_flags = {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.733180 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.iscsi_write_cache = on {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.733180 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.iser_helper = tgtadm {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.733180 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.iser_ip_address = 10.222.0.30 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.733180 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.iser_port = 3260 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.733591 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.733591 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.733591 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.733591 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.num_shell_tries = 3 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.733591 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.733591 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.738154 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.738154 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.rados_connect_timeout = -1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.738154 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.rados_connection_interval = 5 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.738154 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.rados_connection_retries = 3 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.738154 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.rbd_ceph_conf = {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.738154 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.rbd_cluster_name = ceph {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.738154 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.rbd_exclusive_cinder_pool = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.738655 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.rbd_flatten_volume_from_snapshot = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.738655 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.rbd_max_clone_depth = 5 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.738655 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.rbd_pool = rbd {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.738655 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.rbd_secret_uuid = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.738964 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-3618748a-7e47-4581-a084-1e693ceb70a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 20:39:02.739056 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.rbd_store_chunk_size = 4 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.739056 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.rbd_user = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.739056 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.replication_connect_timeout = 5 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.739056 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.replication_device = **** {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.739056 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.report_discard_supported = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.739056 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.report_dynamic_total_capacity = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.739478 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.reserved_percentage = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.739478 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.739478 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.739478 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.storage_protocol = iscsi {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.739478 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.739478 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.target_helper = tgtadm {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.739907 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.target_ip_address = 10.222.0.30 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.739907 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.target_port = 3260 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.739907 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.739907 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.target_protocol = iscsi {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.739907 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.trace_flags = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.739907 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.unique_fqdn_network = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.740644 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.use_chap_auth = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.740644 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.740644 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.volume_backend_name = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.740644 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.volume_clear = zero {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.740644 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.volume_clear_ionice = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.740644 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.volume_clear_size = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.741399 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.741399 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.741399 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.741399 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.742008 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.742614 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_reports.file_event_handler = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.743187 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.743731 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_reports.log_dir = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.744464 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.backend_availability_zone = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.745047 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.backend_host = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.745627 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.backend_native_threads_pool_size = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.746288 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.backup_use_temp_snapshot = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.746830 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.chap_password = **** {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.747362 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.chap_username = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.747900 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.chiscsi_conf = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.748430 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.deferred_deletion_delay = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.748956 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.deferred_deletion_purge_interval = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.749491 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.driver_client_cert = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.750048 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.driver_client_cert_key = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.750588 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.driver_data_namespace = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.751105 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.driver_ssl_cert_path = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.751620 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.driver_ssl_cert_verify = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.752153 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.driver_use_ssl = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.752678 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.enable_deferred_deletion = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.753238 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.enable_unsupported_driver = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.753812 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.enforce_multipath_for_image_xfer = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.755036 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.extra_capabilities = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.755643 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.filter_function = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.756179 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.goodness_function = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.756720 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.iet_conf = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.757247 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.image_upload_use_cinder_backend = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.757789 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.image_upload_use_internal_tenant = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.759297 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.image_volume_cache_enabled = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.759948 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.image_volume_cache_max_count = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.760497 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.image_volume_cache_max_size_gb = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.761028 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.iscsi_iotype = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.761575 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.iscsi_secondary_ip_addresses = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.762161 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.iscsi_target_flags = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.762698 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.iscsi_write_cache = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.763218 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.iser_helper = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.763740 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.iser_ip_address = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.764275 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.iser_port = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.765055 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.iser_target_prefix = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.765578 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.max_over_subscription_ratio = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.766134 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.num_iser_scan_tries = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.766675 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.num_shell_tries = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.767214 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.num_volume_device_scan_tries = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.767734 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.nvmet_ns_id = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.768278 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.nvmet_port_id = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.768951 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.rados_connect_timeout = -1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.769482 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.rados_connection_interval = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.770041 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.rados_connection_retries = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.770614 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.rbd_ceph_conf = /etc/ceph/ceph.conf {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.770996 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.db.sqlalchemy.api [None req-3618748a-7e47-4581-a084-1e693ceb70a4 None None] Building query based on filter {{(pid=129531) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3378}} Mar 12 20:39:02.771360 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.rbd_cluster_name = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.771878 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.rbd_exclusive_cinder_pool = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.772420 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.rbd_flatten_volume_from_snapshot = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.772968 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.rbd_max_clone_depth = 5 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.773501 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.rbd_pool = volumes {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.774161 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.rbd_secret_uuid = 5e3100ba-8a2c-4c90-b040-e119dab0eaf8 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.775386 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.rbd_store_chunk_size = 4 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.776104 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.rbd_user = cinder {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.776718 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.replication_connect_timeout = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.777291 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.replication_device = **** {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.777835 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.report_discard_supported = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.778382 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.report_dynamic_total_capacity = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.778905 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.reserved_percentage = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.779424 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.scst_target_driver = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.780034 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.scst_target_iqn_name = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.780566 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.storage_protocol = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.781102 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.suppress_requests_ssl_warnings = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.781622 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.target_helper = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.782178 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.target_ip_address = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.782710 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.target_port = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.783233 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.target_prefix = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.783747 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.target_protocol = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.784280 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.trace_flags = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.784883 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.unique_fqdn_network = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.785573 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.use_chap_auth = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.786123 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.use_multipath_for_image_xfer = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.786672 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.volume_backend_name = ceph {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.787206 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.volume_clear = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.787822 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.volume_clear_ionice = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.788344 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.volume_clear_size = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.788868 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.volume_copy_blkio_cgroup_name = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.789390 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.volume_copy_bps_limit = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.789998 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.volume_dd_blocksize = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.790531 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.volume_driver = cinder.volume.drivers.rbd.RBDDriver {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.791561 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ceph.volumes_dir = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.792218 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.792785 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.793350 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.793923 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.794479 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.795023 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.795438 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.image_utils [None req-3618748a-7e47-4581-a084-1e693ceb70a4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=129531) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:955}} Mar 12 20:39:02.795950 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.796481 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.797020 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.797570 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.798142 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.798692 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.799254 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.799797 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.800425 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.801119 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.801636 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.802212 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.802739 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.803284 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.804379 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.804923 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.805743 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_messaging_rabbit.ssl = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.806336 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.806885 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.807467 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.808025 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_messaging_rabbit.ssl_version = {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.808610 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_messaging_notifications.driver = [] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.809166 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_messaging_notifications.retry = -1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.809760 ncdv-master-1 cinder-volume[129531]: INFO cinder.keymgr.migration [None req-24908f72-68b4-41ef-a2b9-da2d578a6bed None None] Not migrating encryption keys because the ConfKeyManager is still in use. Mar 12 20:39:02.809946 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.810199 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.810518 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.810823 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] key_manager.fixed_key = **** {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.811231 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.811572 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] barbican.barbican_api_version = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.811916 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] barbican.barbican_endpoint = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.812283 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] barbican.barbican_endpoint_type = public {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.812374 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3618748a-7e47-4581-a084-1e693ceb70a4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:39:02.812624 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] barbican.barbican_region_name = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.812969 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] barbican.cafile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.813314 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] barbican.certfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.813663 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] barbican.collect_timing = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.814049 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] barbican.insecure = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.814382 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] barbican.keyfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.814727 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] barbican.number_of_retries = 60 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.815073 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] barbican.retry_delay = 1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.815415 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] barbican.send_service_user_token = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.815957 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] barbican.split_loggers = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.816301 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] barbican.timeout = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.816650 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] barbican.verify_ssl = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.817040 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] barbican.verify_ssl_path = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.817914 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] barbican_service_user.auth_section = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.817914 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] barbican_service_user.auth_type = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.818476 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] barbican_service_user.cafile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.819066 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] barbican_service_user.certfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.819198 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] barbican_service_user.collect_timing = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.819555 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] barbican_service_user.insecure = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.825836 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] barbican_service_user.keyfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.825836 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] barbican_service_user.split_loggers = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.825836 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] barbican_service_user.timeout = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.825836 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] vault.approle_role_id = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.825836 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] vault.approle_secret_id = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.825836 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] vault.cafile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.825836 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] vault.certfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.826384 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] vault.collect_timing = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.826384 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] vault.insecure = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.826384 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] vault.keyfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.826384 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] vault.kv_mountpoint = secret {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.826384 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] vault.kv_version = 2 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.826384 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] vault.namespace = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.826384 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] vault.root_token_id = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.826828 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] vault.split_loggers = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.826828 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] vault.ssl_ca_crt_file = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.833785 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] vault.timeout = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.834280 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] vault.use_ssl = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.834955 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:39:02.835246 ncdv-master-1 cinder-volume[129358]: DEBUG oslo_service.service [None req-69a421c0-fead-4c48-bc98-a76e4e596aa1 None None] ******************************************************************************** {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 12 20:39:02.858091 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3618748a-7e47-4581-a084-1e693ceb70a4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:39:02.892588 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-3618748a-7e47-4581-a084-1e693ceb70a4 None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 20:39:02.936384 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-3618748a-7e47-4581-a084-1e693ceb70a4 None None] Driver initialization completed successfully. Mar 12 20:39:02.946516 ncdv-master-1 cinder-volume[129531]: INFO cinder.manager [None req-3618748a-7e47-4581-a084-1e693ceb70a4 None None] Initiating service 3 cleanup Mar 12 20:39:02.952760 ncdv-master-1 cinder-volume[129531]: INFO cinder.manager [None req-3618748a-7e47-4581-a084-1e693ceb70a4 None None] Service 3 cleanup completed. Mar 12 20:39:02.953065 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.service [None req-3618748a-7e47-4581-a084-1e693ceb70a4 None None] Creating RPC server for service cinder-volume {{(pid=129531) start /opt/stack/cinder/cinder/service.py:231}} Mar 12 20:39:02.963580 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.service [None req-3618748a-7e47-4581-a084-1e693ceb70a4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=129531) start /opt/stack/cinder/cinder/service.py:237}} Mar 12 20:39:03.012685 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-3618748a-7e47-4581-a084-1e693ceb70a4 None None] Initializing RPC dependent components of volume driver RBDDriver (1.2.0) Mar 12 20:39:03.013632 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3618748a-7e47-4581-a084-1e693ceb70a4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:39:03.043707 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3618748a-7e47-4581-a084-1e693ceb70a4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:39:03.123011 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-3618748a-7e47-4581-a084-1e693ceb70a4 None None] Driver post RPC initialization completed successfully. Mar 12 20:40:51.126368 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 20:40:51.127130 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:40:51.149929 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:40:51.175370 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 20:41:51.131358 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 20:41:51.132026 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:41:51.154153 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:41:51.175288 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 20:42:51.131066 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 20:42:51.131764 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:42:51.152107 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:42:51.174121 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 20:43:51.129856 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 20:43:51.130531 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:43:51.151057 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:43:51.172311 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 20:44:51.127077 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 20:44:51.127726 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:44:51.150038 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:44:51.171059 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 20:45:51.126243 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 20:45:51.126877 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:45:51.147442 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:45:51.169531 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 20:46:51.124524 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 20:46:51.125182 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:46:51.145300 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:46:51.167913 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 20:47:51.122689 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 20:47:51.123432 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:47:51.148493 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:47:51.173803 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 20:48:51.118467 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 20:48:51.119473 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:48:51.189568 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:48:51.254969 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 20:49:51.116472 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 20:49:51.118074 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:49:51.143920 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:49:51.180296 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 20:50:13.134872 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2f37a21-1158-48d5-bc85-056327753a06 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 20:50:13.144444 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-e2f37a21-1158-48d5-bc85-056327753a06 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 20:50:13.150264 ncdv-master-1 cinder-volume[129531]: INFO cinder.rpc [None req-e2f37a21-1158-48d5-bc85-056327753a06 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Automatically selected cinder-backup objects version 1.39 as minimum service version. Mar 12 20:50:13.154845 ncdv-master-1 cinder-volume[129531]: INFO cinder.rpc [None req-e2f37a21-1158-48d5-bc85-056327753a06 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Automatically selected cinder-backup RPC version 2.3 as minimum service version. Mar 12 20:50:13.156013 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-e2f37a21-1158-48d5-bc85-056327753a06 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 20:50:13.156756 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-e2f37a21-1158-48d5-bc85-056327753a06 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 20:50:13.266590 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e2f37a21-1158-48d5-bc85-056327753a06 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Flow 'volume_create_manager' (3b122fc2-dad5-46bb-bd6e-dedd7c76b018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 20:50:13.273246 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e2f37a21-1158-48d5-bc85-056327753a06 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9195bc7-deff-4356-bbf4-e1fb267d0a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:50:13.280439 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-e2f37a21-1158-48d5-bc85-056327753a06 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 20:50:13.398574 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e2f37a21-1158-48d5-bc85-056327753a06 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9195bc7-deff-4356-bbf4-e1fb267d0a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T20:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveAutoBlockMigrationV225Test-volume-803921799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ef287d20-f6d2-4dff-bb11-f7a93fffa821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7417ea19a899461e99596d0df881a336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T20:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T20:50:13Z,use_quota=True,user_id='9c3556ea8eba477e92c2f6f765a30c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:50:13.405114 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e2f37a21-1158-48d5-bc85-056327753a06 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5034934f-d8a4-4541-8680-d5660e82922d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:50:13.409449 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e2f37a21-1158-48d5-bc85-056327753a06 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5034934f-d8a4-4541-8680-d5660e82922d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:50:13.414972 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e2f37a21-1158-48d5-bc85-056327753a06 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c8276f3-cab3-457e-b07f-5a38986ab403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:50:13.419368 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e2f37a21-1158-48d5-bc85-056327753a06 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c8276f3-cab3-457e-b07f-5a38986ab403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef287d20-f6d2-4dff-bb11-f7a93fffa821', 'volume_name': 'volume-ef287d20-f6d2-4dff-bb11-f7a93fffa821', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:50:13.425261 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e2f37a21-1158-48d5-bc85-056327753a06 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa82e7d4-01dc-4b93-af40-ab9d67a58368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:50:13.430508 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e2f37a21-1158-48d5-bc85-056327753a06 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa82e7d4-01dc-4b93-af40-ab9d67a58368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:50:13.435411 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e2f37a21-1158-48d5-bc85-056327753a06 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edb69a32-ed56-4221-bd52-a87027f73861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:50:13.436646 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-e2f37a21-1158-48d5-bc85-056327753a06 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Volume ef287d20-f6d2-4dff-bb11-f7a93fffa821: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef287d20-f6d2-4dff-bb11-f7a93fffa821', 'volume_size': 1} Mar 12 20:50:13.438150 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-e2f37a21-1158-48d5-bc85-056327753a06 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] creating volume 'volume-ef287d20-f6d2-4dff-bb11-f7a93fffa821' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 20:50:13.439746 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-e2f37a21-1158-48d5-bc85-056327753a06 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:50:13.675869 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-e2f37a21-1158-48d5-bc85-056327753a06 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 20:50:13.676251 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-e2f37a21-1158-48d5-bc85-056327753a06 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 20:50:13.697247 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e2f37a21-1158-48d5-bc85-056327753a06 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edb69a32-ed56-4221-bd52-a87027f73861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef287d20-f6d2-4dff-bb11-f7a93fffa821', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:50:13.707245 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e2f37a21-1158-48d5-bc85-056327753a06 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90c70547-4b01-49f0-8ac0-2a72f7d5fb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:50:13.729846 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-e2f37a21-1158-48d5-bc85-056327753a06 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Volume volume-ef287d20-f6d2-4dff-bb11-f7a93fffa821 (ef287d20-f6d2-4dff-bb11-f7a93fffa821): created successfully Mar 12 20:50:13.735793 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e2f37a21-1158-48d5-bc85-056327753a06 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90c70547-4b01-49f0-8ac0-2a72f7d5fb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:50:13.743831 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e2f37a21-1158-48d5-bc85-056327753a06 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Flow 'volume_create_manager' (3b122fc2-dad5-46bb-bd6e-dedd7c76b018) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 20:50:13.760516 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-e2f37a21-1158-48d5-bc85-056327753a06 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Created volume successfully. Mar 12 20:50:15.063575 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-cf01a733-e890-4caa-8950-da0ceac73bbc req-74afa00b-47c5-4201-9112-2e761bb3c2ab tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 20:50:16.186092 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-cf01a733-e890-4caa-8950-da0ceac73bbc req-74afa00b-47c5-4201-9112-2e761bb3c2ab tempest-LiveAutoBlockMigrationV225Test-1105998631 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.122s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 20:50:16.186906 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-cf01a733-e890-4caa-8950-da0ceac73bbc req-74afa00b-47c5-4201-9112-2e761bb3c2ab tempest-LiveAutoBlockMigrationV225Test-1105998631 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ef287d20-f6d2-4dff-bb11-f7a93fffa821', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': 'ef287d20-f6d2-4dff-bb11-f7a93fffa821', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 20:50:16.262494 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-cf01a733-e890-4caa-8950-da0ceac73bbc req-74afa00b-47c5-4201-9112-2e761bb3c2ab tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Connection info returned from driver {'name': 'volumes/volume-ef287d20-f6d2-4dff-bb11-f7a93fffa821', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ef287d20-f6d2-4dff-bb11-f7a93fffa821', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd96f3d5c-e9ed-43e6-929f-1b6612041901'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 20:50:16.413070 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-cf01a733-e890-4caa-8950-da0ceac73bbc req-74afa00b-47c5-4201-9112-2e761bb3c2ab tempest-LiveAutoBlockMigrationV225Test-1105998631 None] attachment_update completed successfully. Mar 12 20:50:28.990088 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cd2e831-d757-4a68-9113-1b39dd9d1562 tempest-LiveMigrationTest-1243457813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 20:50:28.995372 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-8cd2e831-d757-4a68-9113-1b39dd9d1562 tempest-LiveMigrationTest-1243457813 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 20:50:28.995872 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-8cd2e831-d757-4a68-9113-1b39dd9d1562 tempest-LiveMigrationTest-1243457813 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 20:50:29.029817 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8cd2e831-d757-4a68-9113-1b39dd9d1562 tempest-LiveMigrationTest-1243457813 None] Flow 'volume_create_manager' (8774e388-30af-41b3-b8c2-20da2a9a1b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 20:50:29.036808 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8cd2e831-d757-4a68-9113-1b39dd9d1562 tempest-LiveMigrationTest-1243457813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b034bdaf-0647-4bcb-90e2-e54db48751cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:50:29.044076 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-8cd2e831-d757-4a68-9113-1b39dd9d1562 tempest-LiveMigrationTest-1243457813 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 20:50:29.060619 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8cd2e831-d757-4a68-9113-1b39dd9d1562 tempest-LiveMigrationTest-1243457813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b034bdaf-0647-4bcb-90e2-e54db48751cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T20:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveMigrationTest-volume-453241277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ff97fd5d-587f-4513-8af9-0e14cbb1f919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c248ec2e2f0c457291cd412812c08e5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T20:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T20:50:29Z,use_quota=True,user_id='a7854cfb82544a70aee1a7d421bfce55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:50:29.066382 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8cd2e831-d757-4a68-9113-1b39dd9d1562 tempest-LiveMigrationTest-1243457813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1386f996-96f7-401d-b2ab-fa15eaa7f4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:50:29.071623 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8cd2e831-d757-4a68-9113-1b39dd9d1562 tempest-LiveMigrationTest-1243457813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1386f996-96f7-401d-b2ab-fa15eaa7f4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:50:29.076887 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8cd2e831-d757-4a68-9113-1b39dd9d1562 tempest-LiveMigrationTest-1243457813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf4c7429-da1a-4a9b-b195-1d19184bedb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:50:29.081357 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8cd2e831-d757-4a68-9113-1b39dd9d1562 tempest-LiveMigrationTest-1243457813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf4c7429-da1a-4a9b-b195-1d19184bedb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff97fd5d-587f-4513-8af9-0e14cbb1f919', 'volume_name': 'volume-ff97fd5d-587f-4513-8af9-0e14cbb1f919', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:50:29.086579 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8cd2e831-d757-4a68-9113-1b39dd9d1562 tempest-LiveMigrationTest-1243457813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1209fa6-2909-478b-a512-e91d9b2a0c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:50:29.091181 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8cd2e831-d757-4a68-9113-1b39dd9d1562 tempest-LiveMigrationTest-1243457813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1209fa6-2909-478b-a512-e91d9b2a0c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:50:29.096260 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8cd2e831-d757-4a68-9113-1b39dd9d1562 tempest-LiveMigrationTest-1243457813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21d06008-1abf-4ff8-89ae-f853f71d37de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:50:29.097517 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-8cd2e831-d757-4a68-9113-1b39dd9d1562 tempest-LiveMigrationTest-1243457813 None] Volume ff97fd5d-587f-4513-8af9-0e14cbb1f919: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff97fd5d-587f-4513-8af9-0e14cbb1f919', 'volume_size': 1} Mar 12 20:50:29.097985 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8cd2e831-d757-4a68-9113-1b39dd9d1562 tempest-LiveMigrationTest-1243457813 None] creating volume 'volume-ff97fd5d-587f-4513-8af9-0e14cbb1f919' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 20:50:29.099170 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8cd2e831-d757-4a68-9113-1b39dd9d1562 tempest-LiveMigrationTest-1243457813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:50:29.191430 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8cd2e831-d757-4a68-9113-1b39dd9d1562 tempest-LiveMigrationTest-1243457813 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 20:50:29.192523 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8cd2e831-d757-4a68-9113-1b39dd9d1562 tempest-LiveMigrationTest-1243457813 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 20:50:29.197298 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8cd2e831-d757-4a68-9113-1b39dd9d1562 tempest-LiveMigrationTest-1243457813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21d06008-1abf-4ff8-89ae-f853f71d37de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff97fd5d-587f-4513-8af9-0e14cbb1f919', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:50:29.203754 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8cd2e831-d757-4a68-9113-1b39dd9d1562 tempest-LiveMigrationTest-1243457813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33973a4f-2f68-4d37-a7af-55e0bfb930ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:50:29.213856 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-8cd2e831-d757-4a68-9113-1b39dd9d1562 tempest-LiveMigrationTest-1243457813 None] Volume volume-ff97fd5d-587f-4513-8af9-0e14cbb1f919 (ff97fd5d-587f-4513-8af9-0e14cbb1f919): created successfully Mar 12 20:50:29.217941 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8cd2e831-d757-4a68-9113-1b39dd9d1562 tempest-LiveMigrationTest-1243457813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33973a4f-2f68-4d37-a7af-55e0bfb930ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:50:29.224760 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8cd2e831-d757-4a68-9113-1b39dd9d1562 tempest-LiveMigrationTest-1243457813 None] Flow 'volume_create_manager' (8774e388-30af-41b3-b8c2-20da2a9a1b76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 20:50:29.237046 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-8cd2e831-d757-4a68-9113-1b39dd9d1562 tempest-LiveMigrationTest-1243457813 None] Created volume successfully. Mar 12 20:50:30.408182 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-852b220a-5bd9-4c57-aefb-618d962b39fa req-5294151b-48b6-45e4-ab4d-681a5bbafc92 tempest-LiveAutoBlockMigrationV225Test-1672002157 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 20:50:30.979683 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-41ede5d0-20ef-42ad-a313-cd6b3aabdf66 req-4ffd1e5c-0cca-4a17-8a75-54e241564188 tempest-LiveMigrationTest-1243457813 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 20:50:31.442128 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-852b220a-5bd9-4c57-aefb-618d962b39fa req-5294151b-48b6-45e4-ab4d-681a5bbafc92 tempest-LiveAutoBlockMigrationV225Test-1672002157 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.033s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 20:50:31.444215 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-852b220a-5bd9-4c57-aefb-618d962b39fa req-5294151b-48b6-45e4-ab4d-681a5bbafc92 tempest-LiveAutoBlockMigrationV225Test-1672002157 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ef287d20-f6d2-4dff-bb11-f7a93fffa821', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': 'ef287d20-f6d2-4dff-bb11-f7a93fffa821', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 20:50:31.470574 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-852b220a-5bd9-4c57-aefb-618d962b39fa req-5294151b-48b6-45e4-ab4d-681a5bbafc92 tempest-LiveAutoBlockMigrationV225Test-1672002157 None] Connection info returned from driver {'name': 'volumes/volume-ef287d20-f6d2-4dff-bb11-f7a93fffa821', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ef287d20-f6d2-4dff-bb11-f7a93fffa821', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '71f2c2a2-5fe9-4a9d-8bf8-c5b8d2052364'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 20:50:31.591548 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-852b220a-5bd9-4c57-aefb-618d962b39fa req-5294151b-48b6-45e4-ab4d-681a5bbafc92 tempest-LiveAutoBlockMigrationV225Test-1672002157 None] attachment_update completed successfully. Mar 12 20:50:32.024042 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-41ede5d0-20ef-42ad-a313-cd6b3aabdf66 req-4ffd1e5c-0cca-4a17-8a75-54e241564188 tempest-LiveMigrationTest-1243457813 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.045s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 20:50:32.024658 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-41ede5d0-20ef-42ad-a313-cd6b3aabdf66 req-4ffd1e5c-0cca-4a17-8a75-54e241564188 tempest-LiveMigrationTest-1243457813 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ff97fd5d-587f-4513-8af9-0e14cbb1f919', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': 'ff97fd5d-587f-4513-8af9-0e14cbb1f919', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 20:50:32.069643 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-41ede5d0-20ef-42ad-a313-cd6b3aabdf66 req-4ffd1e5c-0cca-4a17-8a75-54e241564188 tempest-LiveMigrationTest-1243457813 None] Connection info returned from driver {'name': 'volumes/volume-ff97fd5d-587f-4513-8af9-0e14cbb1f919', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ff97fd5d-587f-4513-8af9-0e14cbb1f919', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4e4b9523-6f63-4d3f-a8b8-dab0a83c561f'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 20:50:32.177436 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-41ede5d0-20ef-42ad-a313-cd6b3aabdf66 req-4ffd1e5c-0cca-4a17-8a75-54e241564188 tempest-LiveMigrationTest-1243457813 None] attachment_update completed successfully. Mar 12 20:50:51.121080 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 20:50:51.122999 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:50:51.214397 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:50:51.289665 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 20:50:59.667924 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-852b220a-5bd9-4c57-aefb-618d962b39fa req-7ec88944-6fe8-4914-9673-f69b2e8b780b tempest-LiveAutoBlockMigrationV225Test-1672002157 None] Terminate volume connection completed successfully. Mar 12 20:50:59.668533 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-852b220a-5bd9-4c57-aefb-618d962b39fa req-7ec88944-6fe8-4914-9673-f69b2e8b780b tempest-LiveAutoBlockMigrationV225Test-1672002157 None] Deleting attachment d96f3d5c-e9ed-43e6-929f-1b6612041901. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 20:51:04.293317 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-5e70258a-6065-4497-b689-ce581acce19c req-99f2bbf3-ff41-424f-94ab-4b361afef640 tempest-LiveMigrationTest-201003027 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 20:51:05.284563 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-5e70258a-6065-4497-b689-ce581acce19c req-99f2bbf3-ff41-424f-94ab-4b361afef640 tempest-LiveMigrationTest-201003027 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.991s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 20:51:05.286558 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-5e70258a-6065-4497-b689-ce581acce19c req-99f2bbf3-ff41-424f-94ab-4b361afef640 tempest-LiveMigrationTest-201003027 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ff97fd5d-587f-4513-8af9-0e14cbb1f919', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': 'ff97fd5d-587f-4513-8af9-0e14cbb1f919', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 20:51:05.320223 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-5e70258a-6065-4497-b689-ce581acce19c req-99f2bbf3-ff41-424f-94ab-4b361afef640 tempest-LiveMigrationTest-201003027 None] Connection info returned from driver {'name': 'volumes/volume-ff97fd5d-587f-4513-8af9-0e14cbb1f919', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ff97fd5d-587f-4513-8af9-0e14cbb1f919', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '74fb3434-4cc8-4834-9a70-8103cc9dbad8'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 20:51:05.396686 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-5e70258a-6065-4497-b689-ce581acce19c req-99f2bbf3-ff41-424f-94ab-4b361afef640 tempest-LiveMigrationTest-201003027 None] attachment_update completed successfully. Mar 12 20:51:06.466218 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-20f99f2b-2a03-48e1-8a77-9ac4e2907855 req-cbed8d42-1e93-4454-bcb5-03a2f05d8098 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Terminate volume connection completed successfully. Mar 12 20:51:06.466884 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-20f99f2b-2a03-48e1-8a77-9ac4e2907855 req-cbed8d42-1e93-4454-bcb5-03a2f05d8098 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Deleting attachment 71f2c2a2-5fe9-4a9d-8bf8-c5b8d2052364. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 20:51:08.009904 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 20:51:08.016848 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 20:51:08.019908 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 20:51:08.051601 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Flow 'volume_create_manager' (2cdc8dfe-592d-4dbc-9d42-47b2196edcb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 20:51:08.061094 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76859b70-a8ca-41a4-a28f-9d8cdf8b439a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:51:08.070997 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 20:51:08.115022 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76859b70-a8ca-41a4-a28f-9d8cdf8b439a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T20:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-630449482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9916cd82-3d9b-466f-a769-cf81bdc743fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7417ea19a899461e99596d0df881a336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T20:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T20:51:08Z,use_quota=True,user_id='9c3556ea8eba477e92c2f6f765a30c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:51:08.123278 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a661017e-a6e9-4ee3-93b5-970b07771c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:51:08.133958 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a661017e-a6e9-4ee3-93b5-970b07771c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:51:08.140268 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c1374b7-c475-449a-acdf-66b3712691ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:51:08.279076 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c1374b7-c475-449a-acdf-66b3712691ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9916cd82-3d9b-466f-a769-cf81bdc743fd', 'volume_name': 'volume-9916cd82-3d9b-466f-a769-cf81bdc743fd', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:51:08.300552 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d040528-6f10-45dc-b3fd-0167a948984e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:51:08.304961 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d040528-6f10-45dc-b3fd-0167a948984e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:51:08.311638 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4886ffe3-40b9-4d60-9e82-19567af5e537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:51:08.313050 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Volume 9916cd82-3d9b-466f-a769-cf81bdc743fd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9916cd82-3d9b-466f-a769-cf81bdc743fd', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 12 20:51:08.314292 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Cloning 9916cd82-3d9b-466f-a769-cf81bdc743fd from image 539171db-0bd3-4f16-95fd-a7cd5530137d at location (None, None). {{(pid=129531) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Mar 12 20:51:08.329510 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Lock "b'cinder-539171db-0bd3-4f16-95fd-a7cd5530137d'" acquired by "_prepare_image_cache_entry" :: waited 0.014s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 20:51:08.354151 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Preparing cache entry for image = 539171db-0bd3-4f16-95fd-a7cd5530137d on host ncdv-master-1@ceph#ceph. {{(pid=129531) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Mar 12 20:51:08.355674 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Attempting to retrieve cache entry for image = 539171db-0bd3-4f16-95fd-a7cd5530137d on host ncdv-master-1@ceph#ceph. {{(pid=129531) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Mar 12 20:51:22.760456 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-5e70258a-6065-4497-b689-ce581acce19c req-be0e14b7-d2eb-44ba-a7be-9fee96460705 tempest-LiveMigrationTest-201003027 None] Terminate volume connection completed successfully. Mar 12 20:51:22.761159 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-5e70258a-6065-4497-b689-ce581acce19c req-be0e14b7-d2eb-44ba-a7be-9fee96460705 tempest-LiveMigrationTest-201003027 None] Deleting attachment 4e4b9523-6f63-4d3f-a8b8-dab0a83c561f. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 20:51:24.707889 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.image_utils [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_539171db-0bd3-4f16-95fd-a7cd5530137d_o1nsfoafncdv-master-1@ceph, size 616.00 MB, duration 16.35 sec {{(pid=129531) fetch /opt/stack/cinder/cinder/image/image_utils.py:580}} Mar 12 20:51:24.708681 ncdv-master-1 cinder-volume[129531]: INFO cinder.image.image_utils [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Image download 616.00 MB at 37.69 MB/s Mar 12 20:51:24.760077 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_539171db-0bd3-4f16-95fd-a7cd5530137d_o1nsfoafncdv-master-1@ceph {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 20:51:24.941052 ncdv-master-1 sudo[139060]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_539171db-0bd3-4f16-95fd-a7cd5530137d_o1nsfoafncdv-master-1@ceph Mar 12 20:51:24.942695 ncdv-master-1 sudo[139060]: pam_unix(sudo:session): session opened for user root by (uid=0) Mar 12 20:51:26.388026 ncdv-master-1 sudo[139060]: pam_unix(sudo:session): session closed for user root Mar 12 20:51:26.390425 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_539171db-0bd3-4f16-95fd-a7cd5530137d_o1nsfoafncdv-master-1@ceph" returned: 0 in 1.630s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 20:51:26.396400 ncdv-master-1 cinder-volume[129531]: WARNING py.warnings [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Mar 12 20:51:26.396400 ncdv-master-1 cinder-volume[129531]: debtcollector.deprecate( Mar 12 20:51:26.396400 ncdv-master-1 cinder-volume[129531]: Mar 12 20:51:26.398702 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.image_utils [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Temporary image 539171db-0bd3-4f16-95fd-a7cd5530137d is fetched for user 9c3556ea8eba477e92c2f6f765a30c1f. {{(pid=129531) fetch /opt/stack/cinder/cinder/image/image_utils.py:1088}} Mar 12 20:51:26.470919 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_539171db-0bd3-4f16-95fd-a7cd5530137d_o1nsfoafncdv-master-1@ceph {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 20:51:26.599621 ncdv-master-1 sudo[139067]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_539171db-0bd3-4f16-95fd-a7cd5530137d_o1nsfoafncdv-master-1@ceph Mar 12 20:51:26.601567 ncdv-master-1 sudo[139067]: pam_unix(sudo:session): session opened for user root by (uid=0) Mar 12 20:51:28.583117 ncdv-master-1 sudo[139067]: pam_unix(sudo:session): session closed for user root Mar 12 20:51:28.585490 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_539171db-0bd3-4f16-95fd-a7cd5530137d_o1nsfoafncdv-master-1@ceph" returned: 0 in 2.114s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 20:51:28.586837 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] creating volume 'volume-9916cd82-3d9b-466f-a769-cf81bdc743fd' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 20:51:28.588641 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:51:28.717655 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 20:51:28.718182 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 20:51:28.753977 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.volume_utils [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Attempting download of 539171db-0bd3-4f16-95fd-a7cd5530137d ((None, None)) to volume 9916cd82-3d9b-466f-a769-cf81bdc743fd. {{(pid=129531) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Mar 12 20:51:28.855485 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_539171db-0bd3-4f16-95fd-a7cd5530137d_zojs8xfy {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 20:51:29.036425 ncdv-master-1 sudo[139103]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_539171db-0bd3-4f16-95fd-a7cd5530137d_zojs8xfy Mar 12 20:51:29.038164 ncdv-master-1 sudo[139103]: pam_unix(sudo:session): session opened for user root by (uid=0) Mar 12 20:51:30.380054 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-c64b91f0-5464-403c-9e8f-987071432941 req-be6316de-925c-4e5a-baea-6493441c8c16 tempest-LiveMigrationTest-1243457813 None] Terminate volume connection completed successfully. Mar 12 20:51:30.381202 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-c64b91f0-5464-403c-9e8f-987071432941 req-be6316de-925c-4e5a-baea-6493441c8c16 tempest-LiveMigrationTest-1243457813 None] Deleting attachment 74fb3434-4cc8-4834-9a70-8103cc9dbad8. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 20:51:30.474879 ncdv-master-1 sudo[139103]: pam_unix(sudo:session): session closed for user root Mar 12 20:51:30.476749 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_539171db-0bd3-4f16-95fd-a7cd5530137d_zojs8xfy" returned: 0 in 1.622s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 20:51:30.478472 ncdv-master-1 cinder-volume[129531]: WARNING py.warnings [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Mar 12 20:51:30.478472 ncdv-master-1 cinder-volume[129531]: debtcollector.deprecate( Mar 12 20:51:30.478472 ncdv-master-1 cinder-volume[129531]: Mar 12 20:51:30.480022 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_539171db-0bd3-4f16-95fd-a7cd5530137d_o1nsfoafncdv-master-1@ceph {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 20:51:30.660651 ncdv-master-1 sudo[139116]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_539171db-0bd3-4f16-95fd-a7cd5530137d_o1nsfoafncdv-master-1@ceph Mar 12 20:51:30.663919 ncdv-master-1 sudo[139116]: pam_unix(sudo:session): session opened for user root by (uid=0) Mar 12 20:51:32.133759 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 20:51:32.150302 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 20:51:32.152919 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 20:51:32.216735 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] Flow 'volume_create_manager' (8f632b67-d6c3-4a46-a45c-1173ac1005c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 20:51:32.250881 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (434c7893-ebd1-478d-a6f4-df8cb6886f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:51:32.278578 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 20:51:32.310328 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (434c7893-ebd1-478d-a6f4-df8cb6886f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T20:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1788972057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=50aafd1b-9074-4f5a-9416-a6b5a7b804d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c248ec2e2f0c457291cd412812c08e5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T20:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T20:51:32Z,use_quota=True,user_id='a7854cfb82544a70aee1a7d421bfce55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:51:32.349191 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa71a124-b4f2-4cd1-be23-d1af8b02d5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:51:32.362705 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa71a124-b4f2-4cd1-be23-d1af8b02d5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:51:32.370323 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bb0a4e4-a585-45c8-8476-05ace1a6cbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:51:32.550466 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bb0a4e4-a585-45c8-8476-05ace1a6cbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '50aafd1b-9074-4f5a-9416-a6b5a7b804d6', 'volume_name': 'volume-50aafd1b-9074-4f5a-9416-a6b5a7b804d6', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:51:32.570570 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bbd7a25-6b18-48b2-afb7-e3b580b5ff4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:51:32.574938 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bbd7a25-6b18-48b2-afb7-e3b580b5ff4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:51:32.609410 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c870e51a-b958-49be-b455-b6923b54161c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:51:32.636591 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] Volume 50aafd1b-9074-4f5a-9416-a6b5a7b804d6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-50aafd1b-9074-4f5a-9416-a6b5a7b804d6', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 12 20:51:32.638959 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] Cloning 50aafd1b-9074-4f5a-9416-a6b5a7b804d6 from image 539171db-0bd3-4f16-95fd-a7cd5530137d at location (None, None). {{(pid=129531) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Mar 12 20:51:32.950541 ncdv-master-1 sudo[139116]: pam_unix(sudo:session): session closed for user root Mar 12 20:51:32.952387 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_539171db-0bd3-4f16-95fd-a7cd5530137d_o1nsfoafncdv-master-1@ceph" returned: 0 in 2.472s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 20:51:32.953808 ncdv-master-1 cinder-volume[129531]: WARNING py.warnings [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Mar 12 20:51:32.953808 ncdv-master-1 cinder-volume[129531]: debtcollector.deprecate( Mar 12 20:51:32.953808 ncdv-master-1 cinder-volume[129531]: Mar 12 20:51:32.954449 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.image_utils [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] 539171db-0bd3-4f16-95fd-a7cd5530137d was vhdx, converting to raw {{(pid=129531) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:793}} Mar 12 20:51:32.956420 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_539171db-0bd3-4f16-95fd-a7cd5530137d_o1nsfoafncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpy0rjknir {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 20:51:33.040843 ncdv-master-1 sudo[139185]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_539171db-0bd3-4f16-95fd-a7cd5530137d_o1nsfoafncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpy0rjknir Mar 12 20:51:33.044658 ncdv-master-1 sudo[139185]: pam_unix(sudo:session): session opened for user root by (uid=0) Mar 12 20:51:35.696471 ncdv-master-1 sudo[139185]: pam_unix(sudo:session): session closed for user root Mar 12 20:51:35.698464 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_539171db-0bd3-4f16-95fd-a7cd5530137d_o1nsfoafncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpy0rjknir" returned: 0 in 2.742s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 20:51:35.700026 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_539171db-0bd3-4f16-95fd-a7cd5530137d_o1nsfoafncdv-master-1@ceph {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 20:51:35.865736 ncdv-master-1 sudo[139222]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_539171db-0bd3-4f16-95fd-a7cd5530137d_o1nsfoafncdv-master-1@ceph Mar 12 20:51:35.871071 ncdv-master-1 sudo[139222]: pam_unix(sudo:session): session opened for user root by (uid=0) Mar 12 20:51:37.858953 ncdv-master-1 sudo[139222]: pam_unix(sudo:session): session closed for user root Mar 12 20:51:37.862750 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_539171db-0bd3-4f16-95fd-a7cd5530137d_o1nsfoafncdv-master-1@ceph" returned: 0 in 2.161s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 20:51:37.864100 ncdv-master-1 cinder-volume[129531]: WARNING py.warnings [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Mar 12 20:51:37.864100 ncdv-master-1 cinder-volume[129531]: debtcollector.deprecate( Mar 12 20:51:37.864100 ncdv-master-1 cinder-volume[129531]: Mar 12 20:51:37.865087 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.image_utils [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_539171db-0bd3-4f16-95fd-a7cd5530137d_o1nsfoafncdv-master-1@ceph, size 700.00 MB, duration 2.74 sec, destination /opt/stack/data/cinder/conversion/tmpy0rjknir {{(pid=129531) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:412}} Mar 12 20:51:37.865627 ncdv-master-1 cinder-volume[129531]: INFO cinder.image.image_utils [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Converted 700.00 MB image at 255.05 MB/s Mar 12 20:51:37.868905 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:51:38.023011 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 20:51:38.038879 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Volume volume-9916cd82-3d9b-466f-a769-cf81bdc743fd is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 20:51:38.063498 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] deleting rbd volume volume-9916cd82-3d9b-466f-a769-cf81bdc743fd {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 20:51:38.447695 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Running cmd (subprocess): rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmpy0rjknir volume-9916cd82-3d9b-466f-a769-cf81bdc743fd --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 20:51:45.226147 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] CMD "rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmpy0rjknir volume-9916cd82-3d9b-466f-a769-cf81bdc743fd --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 6.779s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 20:51:45.560456 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:51:45.772493 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 20:51:45.773101 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 20:51:45.774594 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.volume_utils [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Downloaded image 539171db-0bd3-4f16-95fd-a7cd5530137d ((None, None)) to volume 9916cd82-3d9b-466f-a769-cf81bdc743fd successfully. {{(pid=129531) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1218}} Mar 12 20:51:45.906637 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.image_utils [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Temporary image 539171db-0bd3-4f16-95fd-a7cd5530137d for user 9c3556ea8eba477e92c2f6f765a30c1f is deleted. {{(pid=129531) fetch /opt/stack/cinder/cinder/image/image_utils.py:1092}} Mar 12 20:51:46.084050 ncdv-master-1 cinder-volume[129531]: WARNING cinder.quota [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Deprecated: Default quota for resource: volumes_ceph is set by the default quota flag: quota_volumes_ceph, it is now deprecated. Please use the default quota class for default quota. Mar 12 20:51:46.084866 ncdv-master-1 cinder-volume[129531]: WARNING cinder.quota [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Deprecated: Default quota for resource: gigabytes_ceph is set by the default quota flag: quota_gigabytes_ceph, it is now deprecated. Please use the default quota class for default quota. Mar 12 20:51:46.215937 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Created reservations ['81b0d60a-5b07-4d8a-b802-74da3d74bdcd', '7e2c634c-2d23-4ef3-81dc-61d0b7badda1', '1d1aba65-a93a-48b6-a8f5-0093e1507eb3', 'afd8e1d2-0aaa-4f71-bef4-f3100d56b45f'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 20:51:46.245388 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Creating image volume entry: {'deleted_at': None, 'updated_at': datetime.datetime(2022, 3, 12, 20, 51, 8, tzinfo=datetime.timezone.utc), 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'metadata': {}, 'deleted': False, 'service_uuid': None, 'provider_auth': None, 'launched_at': None, 'volume_type_id': 'ed93340d-f172-4ec4-a08b-9b8d4fe49a4c', 'consistencygroup_id': None, 'created_at': datetime.datetime(2022, 3, 12, 20, 51, 8, tzinfo=datetime.timezone.utc), 'volume_admin_metadata': [], 'provider_geometry': None, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'availability_zone': 'nova', 'shared_targets': True, 'host': 'ncdv-master-1@ceph#ceph', 'ec2_id': None, 'provider_location': None, 'display_name': 'image-539171db-0bd3-4f16-95fd-a7cd5530137d', 'encryption_key_id': None, 'multiattach': False, 'bootable': False, 'provider_id': None, 'project_id': 'e45fccdf84cf4b5abb66a1257e6cb2cd', 'cluster_name': None, 'previous_status': None, 'terminated_at': None, 'group_id': None, 'replication_driver_data': None, 'size': 1, 'display_description': None, 'replication_extended_status': None, 'volume_metadata': [], 'scheduled_at': datetime.datetime(2022, 3, 12, 20, 51, 8, tzinfo=datetime.timezone.utc), 'replication_status': None, 'attach_status': 'detached', 'status': 'creating', 'source_volid': '9916cd82-3d9b-466f-a769-cf81bdc743fd'}. {{(pid=129531) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1614}} Mar 12 20:51:46.399110 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Volume reschedule parameters: False retry: None {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 20:51:46.403370 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 20:51:46.404114 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 20:51:46.451022 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Flow 'volume_create_manager' (6ee36537-ce4c-4d56-b7de-366e5c67c192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 20:51:46.459751 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16354335-ee29-433b-934f-7e874435b561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:51:46.469555 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 20:51:46.495665 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16354335-ee29-433b-934f-7e874435b561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T20:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='image-539171db-0bd3-4f16-95fd-a7cd5530137d',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8d802c7b-bd34-4836-bd5d-90755a167ddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e45fccdf84cf4b5abb66a1257e6cb2cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T20:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=9916cd82-3d9b-466f-a769-cf81bdc743fd,status='creating',terminated_at=None,updated_at=2022-03-12T20:51:08Z,use_quota=True,user_id='9c3556ea8eba477e92c2f6f765a30c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:51:46.509921 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d692bf-57b4-416d-9828-7d1d1ea627c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:51:46.529119 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d692bf-57b4-416d-9828-7d1d1ea627c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:51:46.545191 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beaddb7b-344e-4bb6-aec9-d6b2df2c03e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:51:46.591544 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beaddb7b-344e-4bb6-aec9-d6b2df2c03e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8d802c7b-bd34-4836-bd5d-90755a167ddc', 'volume_name': 'volume-8d802c7b-bd34-4836-bd5d-90755a167ddc', 'volume_size': 1, 'source_volid': '9916cd82-3d9b-466f-a769-cf81bdc743fd', 'source_volstatus': 'downloading'}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:51:46.609570 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ec25244-8e97-40c6-8715-2d2851aded92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:51:46.614693 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ec25244-8e97-40c6-8715-2d2851aded92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:51:46.623375 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e06ac1f6-9bb4-48d7-8de9-dc7a86d972ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:51:46.626810 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Volume 8d802c7b-bd34-4836-bd5d-90755a167ddc: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8d802c7b-bd34-4836-bd5d-90755a167ddc', 'volume_size': 1, 'source_volid': '9916cd82-3d9b-466f-a769-cf81bdc743fd', 'source_volstatus': 'downloading'} Mar 12 20:51:46.656548 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:51:46.755028 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] creating snapshot='volume-8d802c7b-bd34-4836-bd5d-90755a167ddc.clone_snap' {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Mar 12 20:51:47.175784 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] cloning 'volume-9916cd82-3d9b-466f-a769-cf81bdc743fd@volume-8d802c7b-bd34-4836-bd5d-90755a167ddc.clone_snap' to 'volume-8d802c7b-bd34-4836-bd5d-90755a167ddc' {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Mar 12 20:51:47.351723 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Volume volume-9916cd82-3d9b-466f-a769-cf81bdc743fd is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 20:51:47.357075 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 20:51:47.357713 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 20:51:47.402054 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] clone created successfully {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Mar 12 20:51:47.405970 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e06ac1f6-9bb4-48d7-8de9-dc7a86d972ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d802c7b-bd34-4836-bd5d-90755a167ddc', 'volume_size': 1, 'source_volid': '9916cd82-3d9b-466f-a769-cf81bdc743fd', 'source_volstatus': 'downloading'}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:51:47.425031 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f9816b1-6995-4f74-b13a-6716c5a5afb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:51:47.450744 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Volume volume-8d802c7b-bd34-4836-bd5d-90755a167ddc (8d802c7b-bd34-4836-bd5d-90755a167ddc): created successfully Mar 12 20:51:47.454531 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f9816b1-6995-4f74-b13a-6716c5a5afb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:51:47.473606 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Flow 'volume_create_manager' (6ee36537-ce4c-4d56-b7de-366e5c67c192) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 20:51:47.498926 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Created volume successfully. Mar 12 20:51:47.571083 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Creating new image-volume cache entry for image 539171db-0bd3-4f16-95fd-a7cd5530137d on ncdv-master-1@ceph#ceph {{(pid=129531) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}} Mar 12 20:51:47.582823 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] New image-volume cache entry created: {'id': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'volume_id': '8d802c7b-bd34-4836-bd5d-90755a167ddc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34), 'last_used': datetime.datetime(2022, 3, 12, 20, 51, 47, 574503)}. {{(pid=129531) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}} Mar 12 20:51:47.587716 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Lock "b'cinder-539171db-0bd3-4f16-95fd-a7cd5530137d'" released by "_prepare_image_cache_entry" :: held 39.258s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 20:51:47.588271 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.volume_utils [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Marking volume 9916cd82-3d9b-466f-a769-cf81bdc743fd as bootable. {{(pid=129531) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 12 20:51:47.603261 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Copying metadata from image 539171db-0bd3-4f16-95fd-a7cd5530137d to 9916cd82-3d9b-466f-a769-cf81bdc743fd. {{(pid=129531) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Mar 12 20:51:47.604156 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Creating volume glance metadata for volume 9916cd82-3d9b-466f-a769-cf81bdc743fd backed by image 539171db-0bd3-4f16-95fd-a7cd5530137d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129531) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Mar 12 20:51:47.711285 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4886ffe3-40b9-4d60-9e82-19567af5e537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9916cd82-3d9b-466f-a769-cf81bdc743fd', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:51:47.716035 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93eda666-ad3e-4559-9478-51d4290018d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:51:47.741783 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Volume volume-9916cd82-3d9b-466f-a769-cf81bdc743fd (9916cd82-3d9b-466f-a769-cf81bdc743fd): created successfully Mar 12 20:51:47.745530 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93eda666-ad3e-4559-9478-51d4290018d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:51:47.756844 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Flow 'volume_create_manager' (2cdc8dfe-592d-4dbc-9d42-47b2196edcb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 20:51:47.766337 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-a8843f74-5631-413b-8faf-a92ee49b982e tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Created volume successfully. Mar 12 20:51:48.199421 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] Lock "b'cinder-539171db-0bd3-4f16-95fd-a7cd5530137d'" acquired by "_prepare_image_cache_entry" :: waited 15.555s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 20:51:48.216991 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] Found image-volume cache entry: {'id': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'volume_id': '8d802c7b-bd34-4836-bd5d-90755a167ddc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34), 'last_used': datetime.datetime(2022, 3, 12, 20, 51, 48, 209075)}. {{(pid=129531) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 12 20:51:48.219377 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] Image-volume cache entry image_update_at = 2022-03-12 20:39:34+00:00, requested image updated_at = 2022-03-12 20:39:34+00:00. {{(pid=129531) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 12 20:51:48.219979 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] Found cache entry for image = 539171db-0bd3-4f16-95fd-a7cd5530137d on host ncdv-master-1@ceph#ceph. {{(pid=129531) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Mar 12 20:51:48.228544 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] Lock "b'cinder-539171db-0bd3-4f16-95fd-a7cd5530137d'" released by "_prepare_image_cache_entry" :: held 0.030s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 20:51:48.232523 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] Attempting to retrieve cache entry for image = 539171db-0bd3-4f16-95fd-a7cd5530137d on host ncdv-master-1@ceph#ceph. {{(pid=129531) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Mar 12 20:51:48.248427 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] Found image-volume cache entry: {'id': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'volume_id': '8d802c7b-bd34-4836-bd5d-90755a167ddc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34), 'last_used': datetime.datetime(2022, 3, 12, 20, 51, 48, 237684)}. {{(pid=129531) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 12 20:51:48.249190 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] Image-volume cache entry image_update_at = 2022-03-12 20:39:34+00:00, requested image updated_at = 2022-03-12 20:39:34+00:00. {{(pid=129531) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 12 20:51:48.249787 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] Creating from source image-volume 8d802c7b-bd34-4836-bd5d-90755a167ddc {{(pid=129531) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Mar 12 20:51:48.278183 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:51:48.384388 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] creating snapshot='volume-50aafd1b-9074-4f5a-9416-a6b5a7b804d6.clone_snap' {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Mar 12 20:51:49.306260 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] cloning 'volume-8d802c7b-bd34-4836-bd5d-90755a167ddc@volume-50aafd1b-9074-4f5a-9416-a6b5a7b804d6.clone_snap' to 'volume-50aafd1b-9074-4f5a-9416-a6b5a7b804d6' {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Mar 12 20:51:49.576762 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] Volume volume-9916cd82-3d9b-466f-a769-cf81bdc743fd is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 20:51:49.578748 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 20:51:49.579901 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 20:51:49.624852 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] clone created successfully {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Mar 12 20:51:49.626298 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.volume_utils [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] Marking volume 50aafd1b-9074-4f5a-9416-a6b5a7b804d6 as bootable. {{(pid=129531) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 12 20:51:49.640264 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] Copying metadata from image 539171db-0bd3-4f16-95fd-a7cd5530137d to 50aafd1b-9074-4f5a-9416-a6b5a7b804d6. {{(pid=129531) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Mar 12 20:51:49.641135 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] Creating volume glance metadata for volume 50aafd1b-9074-4f5a-9416-a6b5a7b804d6 backed by image 539171db-0bd3-4f16-95fd-a7cd5530137d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129531) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Mar 12 20:51:49.869895 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c870e51a-b958-49be-b455-b6923b54161c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50aafd1b-9074-4f5a-9416-a6b5a7b804d6', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:51:49.881026 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c021d48-3fef-48f6-855b-b22611f01f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:51:49.904111 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] Volume volume-50aafd1b-9074-4f5a-9416-a6b5a7b804d6 (50aafd1b-9074-4f5a-9416-a6b5a7b804d6): created successfully Mar 12 20:51:49.908376 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c021d48-3fef-48f6-855b-b22611f01f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:51:49.920979 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] Flow 'volume_create_manager' (8f632b67-d6c3-4a46-a45c-1173ac1005c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 20:51:49.940870 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-7bfcbb1c-9633-47b3-a3a9-f3ef9fb3a624 tempest-LiveMigrationTest-1243457813 None] Created volume successfully. Mar 12 20:51:51.126706 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 20:51:51.127566 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:51:51.221584 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:51:51.316025 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 20:51:53.879930 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-aea4ac93-3e5c-426e-b4af-1359e6f1d601 req-d2809d21-c7e5-4527-9b23-2d20722b3406 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 20:51:55.735930 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-be8b2b37-9988-45e6-a693-7da1b1f48edf req-8f5f397a-00e7-45a8-b52f-0ff939cd7a40 tempest-LiveMigrationTest-1243457813 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 20:51:56.175322 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-aea4ac93-3e5c-426e-b4af-1359e6f1d601 req-d2809d21-c7e5-4527-9b23-2d20722b3406 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.295s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 20:51:56.176411 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-aea4ac93-3e5c-426e-b4af-1359e6f1d601 req-d2809d21-c7e5-4527-9b23-2d20722b3406 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9916cd82-3d9b-466f-a769-cf81bdc743fd', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': '9916cd82-3d9b-466f-a769-cf81bdc743fd', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 20:51:56.242597 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-aea4ac93-3e5c-426e-b4af-1359e6f1d601 req-d2809d21-c7e5-4527-9b23-2d20722b3406 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Connection info returned from driver {'name': 'volumes/volume-9916cd82-3d9b-466f-a769-cf81bdc743fd', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '9916cd82-3d9b-466f-a769-cf81bdc743fd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd20baf9f-1431-437a-aaa5-cf5ec410573e'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 20:51:56.422365 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-aea4ac93-3e5c-426e-b4af-1359e6f1d601 req-d2809d21-c7e5-4527-9b23-2d20722b3406 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] attachment_update completed successfully. Mar 12 20:51:57.380713 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-be8b2b37-9988-45e6-a693-7da1b1f48edf req-8f5f397a-00e7-45a8-b52f-0ff939cd7a40 tempest-LiveMigrationTest-1243457813 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.645s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 20:51:57.382240 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-be8b2b37-9988-45e6-a693-7da1b1f48edf req-8f5f397a-00e7-45a8-b52f-0ff939cd7a40 tempest-LiveMigrationTest-1243457813 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-50aafd1b-9074-4f5a-9416-a6b5a7b804d6', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': '50aafd1b-9074-4f5a-9416-a6b5a7b804d6', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 20:51:57.423375 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-be8b2b37-9988-45e6-a693-7da1b1f48edf req-8f5f397a-00e7-45a8-b52f-0ff939cd7a40 tempest-LiveMigrationTest-1243457813 None] Connection info returned from driver {'name': 'volumes/volume-50aafd1b-9074-4f5a-9416-a6b5a7b804d6', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '50aafd1b-9074-4f5a-9416-a6b5a7b804d6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3a8f19ef-56bf-4ca8-96df-4dc13792b7cc'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 20:51:57.527903 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-be8b2b37-9988-45e6-a693-7da1b1f48edf req-8f5f397a-00e7-45a8-b52f-0ff939cd7a40 tempest-LiveMigrationTest-1243457813 None] attachment_update completed successfully. Mar 12 20:52:00.569537 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-7007da3c-484a-4bef-9b36-7174274c62ef tempest-AttachVolumeShelveTestJSON-13164227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 20:52:00.583938 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-7007da3c-484a-4bef-9b36-7174274c62ef tempest-AttachVolumeShelveTestJSON-13164227 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 20:52:00.585131 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-7007da3c-484a-4bef-9b36-7174274c62ef tempest-AttachVolumeShelveTestJSON-13164227 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 20:52:00.623401 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7007da3c-484a-4bef-9b36-7174274c62ef tempest-AttachVolumeShelveTestJSON-13164227 None] Flow 'volume_create_manager' (6ec50ef9-a59d-4c42-a54a-c44cd8ff6e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 20:52:00.636317 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7007da3c-484a-4bef-9b36-7174274c62ef tempest-AttachVolumeShelveTestJSON-13164227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec4d3d36-4932-4105-a9e9-68efccf74f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:52:00.646195 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-7007da3c-484a-4bef-9b36-7174274c62ef tempest-AttachVolumeShelveTestJSON-13164227 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 20:52:00.669261 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7007da3c-484a-4bef-9b36-7174274c62ef tempest-AttachVolumeShelveTestJSON-13164227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec4d3d36-4932-4105-a9e9-68efccf74f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T20:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-816776110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5c01ce6d-3ce1-40f2-b374-ddff1153114b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0a5497c8a2449c89a200ddd03ce5aeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T20:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T20:52:00Z,use_quota=True,user_id='38372b69c92d4456879f7fa00239f0c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:52:00.695476 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7007da3c-484a-4bef-9b36-7174274c62ef tempest-AttachVolumeShelveTestJSON-13164227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17028334-7d41-40c0-bfb4-beccaba96ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:52:00.704421 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7007da3c-484a-4bef-9b36-7174274c62ef tempest-AttachVolumeShelveTestJSON-13164227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17028334-7d41-40c0-bfb4-beccaba96ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:52:00.711962 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7007da3c-484a-4bef-9b36-7174274c62ef tempest-AttachVolumeShelveTestJSON-13164227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f44d6fc-723e-45ca-9a8b-451d7620bc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:52:00.723775 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7007da3c-484a-4bef-9b36-7174274c62ef tempest-AttachVolumeShelveTestJSON-13164227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f44d6fc-723e-45ca-9a8b-451d7620bc97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c01ce6d-3ce1-40f2-b374-ddff1153114b', 'volume_name': 'volume-5c01ce6d-3ce1-40f2-b374-ddff1153114b', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:52:00.734289 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7007da3c-484a-4bef-9b36-7174274c62ef tempest-AttachVolumeShelveTestJSON-13164227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (520276bb-e11d-48f2-bb1b-85a2b04f7736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:52:00.741126 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7007da3c-484a-4bef-9b36-7174274c62ef tempest-AttachVolumeShelveTestJSON-13164227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (520276bb-e11d-48f2-bb1b-85a2b04f7736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:52:00.747443 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7007da3c-484a-4bef-9b36-7174274c62ef tempest-AttachVolumeShelveTestJSON-13164227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1b0f4f0-4100-4a39-a7af-b722b7f22581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:52:00.748795 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-7007da3c-484a-4bef-9b36-7174274c62ef tempest-AttachVolumeShelveTestJSON-13164227 None] Volume 5c01ce6d-3ce1-40f2-b374-ddff1153114b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c01ce6d-3ce1-40f2-b374-ddff1153114b', 'volume_size': 1} Mar 12 20:52:00.749749 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-7007da3c-484a-4bef-9b36-7174274c62ef tempest-AttachVolumeShelveTestJSON-13164227 None] creating volume 'volume-5c01ce6d-3ce1-40f2-b374-ddff1153114b' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 20:52:00.751199 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-7007da3c-484a-4bef-9b36-7174274c62ef tempest-AttachVolumeShelveTestJSON-13164227 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:52:00.896945 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-7007da3c-484a-4bef-9b36-7174274c62ef tempest-AttachVolumeShelveTestJSON-13164227 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 20:52:00.897510 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-7007da3c-484a-4bef-9b36-7174274c62ef tempest-AttachVolumeShelveTestJSON-13164227 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 20:52:00.903163 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7007da3c-484a-4bef-9b36-7174274c62ef tempest-AttachVolumeShelveTestJSON-13164227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1b0f4f0-4100-4a39-a7af-b722b7f22581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c01ce6d-3ce1-40f2-b374-ddff1153114b', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:52:00.913694 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7007da3c-484a-4bef-9b36-7174274c62ef tempest-AttachVolumeShelveTestJSON-13164227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d618ac01-f9d3-44e1-a031-15c690c63dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:52:00.935793 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-7007da3c-484a-4bef-9b36-7174274c62ef tempest-AttachVolumeShelveTestJSON-13164227 None] Volume volume-5c01ce6d-3ce1-40f2-b374-ddff1153114b (5c01ce6d-3ce1-40f2-b374-ddff1153114b): created successfully Mar 12 20:52:00.947392 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7007da3c-484a-4bef-9b36-7174274c62ef tempest-AttachVolumeShelveTestJSON-13164227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d618ac01-f9d3-44e1-a031-15c690c63dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:52:00.965637 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7007da3c-484a-4bef-9b36-7174274c62ef tempest-AttachVolumeShelveTestJSON-13164227 None] Flow 'volume_create_manager' (6ec50ef9-a59d-4c42-a54a-c44cd8ff6e5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 20:52:00.987212 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-7007da3c-484a-4bef-9b36-7174274c62ef tempest-AttachVolumeShelveTestJSON-13164227 None] Created volume successfully. Mar 12 20:52:26.798148 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-da2a68a0-ce6c-4dbe-b565-68727c91f4e4 req-66ede54b-b90c-4ed7-9d6a-aa2593c4c571 tempest-LiveAutoBlockMigrationV225Test-1672002157 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 20:52:28.420829 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-da2a68a0-ce6c-4dbe-b565-68727c91f4e4 req-66ede54b-b90c-4ed7-9d6a-aa2593c4c571 tempest-LiveAutoBlockMigrationV225Test-1672002157 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.622s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 20:52:28.423676 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-da2a68a0-ce6c-4dbe-b565-68727c91f4e4 req-66ede54b-b90c-4ed7-9d6a-aa2593c4c571 tempest-LiveAutoBlockMigrationV225Test-1672002157 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9916cd82-3d9b-466f-a769-cf81bdc743fd', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': '9916cd82-3d9b-466f-a769-cf81bdc743fd', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 20:52:28.467763 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-da2a68a0-ce6c-4dbe-b565-68727c91f4e4 req-66ede54b-b90c-4ed7-9d6a-aa2593c4c571 tempest-LiveAutoBlockMigrationV225Test-1672002157 None] Connection info returned from driver {'name': 'volumes/volume-9916cd82-3d9b-466f-a769-cf81bdc743fd', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '9916cd82-3d9b-466f-a769-cf81bdc743fd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4caae876-ed73-413d-a262-b73dffcdd159'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 20:52:28.553685 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-da2a68a0-ce6c-4dbe-b565-68727c91f4e4 req-66ede54b-b90c-4ed7-9d6a-aa2593c4c571 tempest-LiveAutoBlockMigrationV225Test-1672002157 None] attachment_update completed successfully. Mar 12 20:52:38.242944 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-da2a68a0-ce6c-4dbe-b565-68727c91f4e4 req-f4dbaed7-ed51-46ea-869a-d42eaf8672a6 tempest-LiveAutoBlockMigrationV225Test-1672002157 None] Terminate volume connection completed successfully. Mar 12 20:52:38.243597 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-da2a68a0-ce6c-4dbe-b565-68727c91f4e4 req-f4dbaed7-ed51-46ea-869a-d42eaf8672a6 tempest-LiveAutoBlockMigrationV225Test-1672002157 None] Deleting attachment d20baf9f-1431-437a-aaa5-cf5ec410573e. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 20:52:46.915055 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-45a83ff3-96ed-43bb-9aa4-627bcc23818e req-3fe833a6-c52e-4d6c-8b47-129058f560e0 tempest-LiveMigrationTest-201003027 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 20:52:48.466992 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-45a83ff3-96ed-43bb-9aa4-627bcc23818e req-3fe833a6-c52e-4d6c-8b47-129058f560e0 tempest-LiveMigrationTest-201003027 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.552s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 20:52:48.467909 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-45a83ff3-96ed-43bb-9aa4-627bcc23818e req-3fe833a6-c52e-4d6c-8b47-129058f560e0 tempest-LiveMigrationTest-201003027 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-50aafd1b-9074-4f5a-9416-a6b5a7b804d6', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': '50aafd1b-9074-4f5a-9416-a6b5a7b804d6', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 20:52:48.510450 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-45a83ff3-96ed-43bb-9aa4-627bcc23818e req-3fe833a6-c52e-4d6c-8b47-129058f560e0 tempest-LiveMigrationTest-201003027 None] Connection info returned from driver {'name': 'volumes/volume-50aafd1b-9074-4f5a-9416-a6b5a7b804d6', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '50aafd1b-9074-4f5a-9416-a6b5a7b804d6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ddebc862-f2cd-4459-9a69-a4dc843d26a2'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 20:52:48.616416 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-45a83ff3-96ed-43bb-9aa4-627bcc23818e req-3fe833a6-c52e-4d6c-8b47-129058f560e0 tempest-LiveMigrationTest-201003027 None] attachment_update completed successfully. Mar 12 20:52:51.122022 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 20:52:51.123853 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:52:51.196785 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:52:51.275668 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 20:52:51.937576 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-a7fbe52d-e51d-4a3d-b931-ce79e4cb25d8 req-904eb562-c023-4832-9397-78d2aacf2a02 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Terminate volume connection completed successfully. Mar 12 20:52:51.938163 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-a7fbe52d-e51d-4a3d-b931-ce79e4cb25d8 req-904eb562-c023-4832-9397-78d2aacf2a02 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Deleting attachment 4caae876-ed73-413d-a262-b73dffcdd159. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 20:52:52.235847 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [req-a7fbe52d-e51d-4a3d-b931-ce79e4cb25d8 req-92eee57b-50fc-4d9c-92da-a1437f8a3fd4 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Lock "b'cinder-9916cd82-3d9b-466f-a769-cf81bdc743fd-delete_volume'" acquired by "delete_volume" :: waited 0.041s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 20:52:52.337067 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-a7fbe52d-e51d-4a3d-b931-ce79e4cb25d8 req-92eee57b-50fc-4d9c-92da-a1437f8a3fd4 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:52:52.517590 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-a7fbe52d-e51d-4a3d-b931-ce79e4cb25d8 req-92eee57b-50fc-4d9c-92da-a1437f8a3fd4 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 20:52:52.518188 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-a7fbe52d-e51d-4a3d-b931-ce79e4cb25d8 req-92eee57b-50fc-4d9c-92da-a1437f8a3fd4 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] volume has clone snapshot(s) {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1284}} Mar 12 20:52:52.519512 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-a7fbe52d-e51d-4a3d-b931-ce79e4cb25d8 req-92eee57b-50fc-4d9c-92da-a1437f8a3fd4 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Volume volume-9916cd82-3d9b-466f-a769-cf81bdc743fd is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 20:52:52.830273 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [req-a7fbe52d-e51d-4a3d-b931-ce79e4cb25d8 req-92eee57b-50fc-4d9c-92da-a1437f8a3fd4 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Created reservations ['d80a905b-788d-44c1-9019-cc2df863bf12', '9891081e-bee3-42ec-b68e-a3f9e8813533', '09304f66-0b14-43c0-a75f-78bbde51ccc6', 'a5bbdfe3-1bd9-479f-af62-2b5cf70b8df4'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 20:52:53.023464 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-a7fbe52d-e51d-4a3d-b931-ce79e4cb25d8 req-92eee57b-50fc-4d9c-92da-a1437f8a3fd4 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:52:53.139088 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-a7fbe52d-e51d-4a3d-b931-ce79e4cb25d8 req-92eee57b-50fc-4d9c-92da-a1437f8a3fd4 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:52:53.220289 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [req-a7fbe52d-e51d-4a3d-b931-ce79e4cb25d8 req-92eee57b-50fc-4d9c-92da-a1437f8a3fd4 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 20:52:53.225149 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-a7fbe52d-e51d-4a3d-b931-ce79e4cb25d8 req-92eee57b-50fc-4d9c-92da-a1437f8a3fd4 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Deleted volume successfully. Mar 12 20:52:53.242644 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [req-a7fbe52d-e51d-4a3d-b931-ce79e4cb25d8 req-92eee57b-50fc-4d9c-92da-a1437f8a3fd4 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Lock "b'cinder-9916cd82-3d9b-466f-a769-cf81bdc743fd-delete_volume'" released by "delete_volume" :: held 1.008s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 20:52:57.684545 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-c6403820-a124-45c4-9d64-a2dfb8100251 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Lock "b'cinder-ef287d20-f6d2-4dff-bb11-f7a93fffa821-delete_volume'" acquired by "delete_volume" :: waited 0.031s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 20:52:57.780209 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c6403820-a124-45c4-9d64-a2dfb8100251 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:52:57.899906 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c6403820-a124-45c4-9d64-a2dfb8100251 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 20:52:57.900893 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c6403820-a124-45c4-9d64-a2dfb8100251 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Volume volume-ef287d20-f6d2-4dff-bb11-f7a93fffa821 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 20:52:57.909086 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c6403820-a124-45c4-9d64-a2dfb8100251 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] deleting rbd volume volume-ef287d20-f6d2-4dff-bb11-f7a93fffa821 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 20:52:58.614449 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-dbf7b736-0d57-48cf-bfe2-aa5d2af78468 req-99d48e58-9d63-49a1-a455-f611bb0d225d tempest-AttachVolumeShelveTestJSON-13164227 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 20:52:58.675399 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-c6403820-a124-45c4-9d64-a2dfb8100251 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Created reservations ['56bdde55-92e9-41b7-89e1-748d475b5b3e', '57ec1a66-e328-43e8-a45c-27fb4ee2fb03', '8207c324-81f7-460b-9d2c-1338604f5b55', '8d7ec36a-16b9-4c59-9010-e938194530d6'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 20:52:58.788787 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c6403820-a124-45c4-9d64-a2dfb8100251 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:52:58.877604 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c6403820-a124-45c4-9d64-a2dfb8100251 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:52:58.965349 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-c6403820-a124-45c4-9d64-a2dfb8100251 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 20:52:58.975734 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-c6403820-a124-45c4-9d64-a2dfb8100251 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Deleted volume successfully. Mar 12 20:52:58.997340 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-c6403820-a124-45c4-9d64-a2dfb8100251 tempest-LiveAutoBlockMigrationV225Test-1105998631 None] Lock "b'cinder-ef287d20-f6d2-4dff-bb11-f7a93fffa821-delete_volume'" released by "delete_volume" :: held 1.320s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 20:53:00.008036 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-dbf7b736-0d57-48cf-bfe2-aa5d2af78468 req-99d48e58-9d63-49a1-a455-f611bb0d225d tempest-AttachVolumeShelveTestJSON-13164227 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.392s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 20:53:00.009537 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-dbf7b736-0d57-48cf-bfe2-aa5d2af78468 req-99d48e58-9d63-49a1-a455-f611bb0d225d tempest-AttachVolumeShelveTestJSON-13164227 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5c01ce6d-3ce1-40f2-b374-ddff1153114b', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': '5c01ce6d-3ce1-40f2-b374-ddff1153114b', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 20:53:00.046135 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-dbf7b736-0d57-48cf-bfe2-aa5d2af78468 req-99d48e58-9d63-49a1-a455-f611bb0d225d tempest-AttachVolumeShelveTestJSON-13164227 None] Connection info returned from driver {'name': 'volumes/volume-5c01ce6d-3ce1-40f2-b374-ddff1153114b', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5c01ce6d-3ce1-40f2-b374-ddff1153114b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a82c90de-9d6a-41d6-8a44-1ae89181063d'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 20:53:00.161258 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-dbf7b736-0d57-48cf-bfe2-aa5d2af78468 req-99d48e58-9d63-49a1-a455-f611bb0d225d tempest-AttachVolumeShelveTestJSON-13164227 None] attachment_update completed successfully. Mar 12 20:53:03.446327 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-45a83ff3-96ed-43bb-9aa4-627bcc23818e req-6ed49d8c-3c50-4742-af56-f6577ba09e82 tempest-LiveMigrationTest-201003027 None] Terminate volume connection completed successfully. Mar 12 20:53:03.447792 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-45a83ff3-96ed-43bb-9aa4-627bcc23818e req-6ed49d8c-3c50-4742-af56-f6577ba09e82 tempest-LiveMigrationTest-201003027 None] Deleting attachment 3a8f19ef-56bf-4ca8-96df-4dc13792b7cc. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 20:53:21.571016 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2656d10-c1ce-443f-8312-e7548c9bed09 tempest-AttachSCSIVolumeTestJSON-1797125887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 20:53:21.576454 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-e2656d10-c1ce-443f-8312-e7548c9bed09 tempest-AttachSCSIVolumeTestJSON-1797125887 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 20:53:21.577615 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-e2656d10-c1ce-443f-8312-e7548c9bed09 tempest-AttachSCSIVolumeTestJSON-1797125887 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 20:53:21.599935 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e2656d10-c1ce-443f-8312-e7548c9bed09 tempest-AttachSCSIVolumeTestJSON-1797125887 None] Flow 'volume_create_manager' (7dc45f82-df81-4ac7-b491-e742025a91f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 20:53:21.606776 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e2656d10-c1ce-443f-8312-e7548c9bed09 tempest-AttachSCSIVolumeTestJSON-1797125887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8618dde7-a5da-4cc6-bb8e-8d11830dc8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:53:21.614490 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-e2656d10-c1ce-443f-8312-e7548c9bed09 tempest-AttachSCSIVolumeTestJSON-1797125887 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 20:53:21.632284 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e2656d10-c1ce-443f-8312-e7548c9bed09 tempest-AttachSCSIVolumeTestJSON-1797125887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8618dde7-a5da-4cc6-bb8e-8d11830dc8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T20:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-2019777012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=30c3b759-aaca-47e9-b4c6-dec2f4918184,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df0c010b1c1422d815a79929d733305',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T20:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T20:53:22Z,use_quota=True,user_id='ff84008edbbb475ab7c31f57d2455b02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:53:21.637796 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e2656d10-c1ce-443f-8312-e7548c9bed09 tempest-AttachSCSIVolumeTestJSON-1797125887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58adce58-b7aa-4ae7-87c4-86e7652067e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:53:21.642455 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e2656d10-c1ce-443f-8312-e7548c9bed09 tempest-AttachSCSIVolumeTestJSON-1797125887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58adce58-b7aa-4ae7-87c4-86e7652067e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:53:21.647606 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e2656d10-c1ce-443f-8312-e7548c9bed09 tempest-AttachSCSIVolumeTestJSON-1797125887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fea8ee5-f301-429d-9ba1-a39c973179e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:53:21.651871 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e2656d10-c1ce-443f-8312-e7548c9bed09 tempest-AttachSCSIVolumeTestJSON-1797125887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fea8ee5-f301-429d-9ba1-a39c973179e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30c3b759-aaca-47e9-b4c6-dec2f4918184', 'volume_name': 'volume-30c3b759-aaca-47e9-b4c6-dec2f4918184', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:53:21.658117 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e2656d10-c1ce-443f-8312-e7548c9bed09 tempest-AttachSCSIVolumeTestJSON-1797125887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd6c398-7376-4b97-97ff-53636f239416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:53:21.662587 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e2656d10-c1ce-443f-8312-e7548c9bed09 tempest-AttachSCSIVolumeTestJSON-1797125887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd6c398-7376-4b97-97ff-53636f239416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:53:21.680729 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e2656d10-c1ce-443f-8312-e7548c9bed09 tempest-AttachSCSIVolumeTestJSON-1797125887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d092b19-99ed-4e5e-b175-d52482c6d2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:53:21.682286 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-e2656d10-c1ce-443f-8312-e7548c9bed09 tempest-AttachSCSIVolumeTestJSON-1797125887 None] Volume 30c3b759-aaca-47e9-b4c6-dec2f4918184: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30c3b759-aaca-47e9-b4c6-dec2f4918184', 'volume_size': 1} Mar 12 20:53:21.682889 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-e2656d10-c1ce-443f-8312-e7548c9bed09 tempest-AttachSCSIVolumeTestJSON-1797125887 None] creating volume 'volume-30c3b759-aaca-47e9-b4c6-dec2f4918184' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 20:53:21.684199 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-e2656d10-c1ce-443f-8312-e7548c9bed09 tempest-AttachSCSIVolumeTestJSON-1797125887 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:53:21.809202 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-e2656d10-c1ce-443f-8312-e7548c9bed09 tempest-AttachSCSIVolumeTestJSON-1797125887 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 20:53:21.810042 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-e2656d10-c1ce-443f-8312-e7548c9bed09 tempest-AttachSCSIVolumeTestJSON-1797125887 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 20:53:21.814354 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e2656d10-c1ce-443f-8312-e7548c9bed09 tempest-AttachSCSIVolumeTestJSON-1797125887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d092b19-99ed-4e5e-b175-d52482c6d2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30c3b759-aaca-47e9-b4c6-dec2f4918184', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:53:21.819362 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e2656d10-c1ce-443f-8312-e7548c9bed09 tempest-AttachSCSIVolumeTestJSON-1797125887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf7ebdf2-7b4e-44cd-ad3d-db57d95b280f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:53:21.830804 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-e2656d10-c1ce-443f-8312-e7548c9bed09 tempest-AttachSCSIVolumeTestJSON-1797125887 None] Volume volume-30c3b759-aaca-47e9-b4c6-dec2f4918184 (30c3b759-aaca-47e9-b4c6-dec2f4918184): created successfully Mar 12 20:53:21.834757 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e2656d10-c1ce-443f-8312-e7548c9bed09 tempest-AttachSCSIVolumeTestJSON-1797125887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf7ebdf2-7b4e-44cd-ad3d-db57d95b280f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:53:21.840347 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e2656d10-c1ce-443f-8312-e7548c9bed09 tempest-AttachSCSIVolumeTestJSON-1797125887 None] Flow 'volume_create_manager' (7dc45f82-df81-4ac7-b491-e742025a91f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 20:53:21.850946 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-e2656d10-c1ce-443f-8312-e7548c9bed09 tempest-AttachSCSIVolumeTestJSON-1797125887 None] Created volume successfully. Mar 12 20:53:24.076286 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-f249d259-1fb8-42a9-a300-7fbdae29663d req-ba40355a-def1-4002-b76f-2dbc84043f4c tempest-AttachSCSIVolumeTestJSON-1797125887 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 20:53:25.782308 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-f249d259-1fb8-42a9-a300-7fbdae29663d req-ba40355a-def1-4002-b76f-2dbc84043f4c tempest-AttachSCSIVolumeTestJSON-1797125887 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.706s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 20:53:25.783173 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-f249d259-1fb8-42a9-a300-7fbdae29663d req-ba40355a-def1-4002-b76f-2dbc84043f4c tempest-AttachSCSIVolumeTestJSON-1797125887 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-30c3b759-aaca-47e9-b4c6-dec2f4918184', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': '30c3b759-aaca-47e9-b4c6-dec2f4918184', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 20:53:25.848768 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-f249d259-1fb8-42a9-a300-7fbdae29663d req-ba40355a-def1-4002-b76f-2dbc84043f4c tempest-AttachSCSIVolumeTestJSON-1797125887 None] Connection info returned from driver {'name': 'volumes/volume-30c3b759-aaca-47e9-b4c6-dec2f4918184', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '30c3b759-aaca-47e9-b4c6-dec2f4918184', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e51bc7cd-3ecc-4a6c-b028-9c85a696fa8f'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 20:53:26.016981 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-f249d259-1fb8-42a9-a300-7fbdae29663d req-ba40355a-def1-4002-b76f-2dbc84043f4c tempest-AttachSCSIVolumeTestJSON-1797125887 None] attachment_update completed successfully. Mar 12 20:53:30.174208 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-684a4899-6dac-4535-9599-e5b00d75c223 req-2d781068-b19b-4c16-ba3f-18c47bf69ae4 tempest-AttachSCSIVolumeTestJSON-1797125887 None] Terminate volume connection completed successfully. Mar 12 20:53:30.175080 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-684a4899-6dac-4535-9599-e5b00d75c223 req-2d781068-b19b-4c16-ba3f-18c47bf69ae4 tempest-AttachSCSIVolumeTestJSON-1797125887 None] Deleting attachment e51bc7cd-3ecc-4a6c-b028-9c85a696fa8f. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 20:53:34.537161 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-e841a731-5de0-4f8d-8e76-9e8dcb62e94b req-3b50a453-e33c-4dec-8f90-76a9b3df64e1 tempest-LiveMigrationTest-1243457813 None] Terminate volume connection completed successfully. Mar 12 20:53:34.537889 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-e841a731-5de0-4f8d-8e76-9e8dcb62e94b req-3b50a453-e33c-4dec-8f90-76a9b3df64e1 tempest-LiveMigrationTest-1243457813 None] Deleting attachment ddebc862-f2cd-4459-9a69-a4dc843d26a2. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 20:53:34.679490 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [req-e841a731-5de0-4f8d-8e76-9e8dcb62e94b req-94c9f27e-4039-44d0-a075-2530e507b858 tempest-LiveMigrationTest-1243457813 None] Lock "b'cinder-50aafd1b-9074-4f5a-9416-a6b5a7b804d6-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 20:53:34.715561 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-e841a731-5de0-4f8d-8e76-9e8dcb62e94b req-94c9f27e-4039-44d0-a075-2530e507b858 tempest-LiveMigrationTest-1243457813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:53:34.803730 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-e841a731-5de0-4f8d-8e76-9e8dcb62e94b req-94c9f27e-4039-44d0-a075-2530e507b858 tempest-LiveMigrationTest-1243457813 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 20:53:34.812956 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-e841a731-5de0-4f8d-8e76-9e8dcb62e94b req-94c9f27e-4039-44d0-a075-2530e507b858 tempest-LiveMigrationTest-1243457813 None] deleting rbd volume volume-50aafd1b-9074-4f5a-9416-a6b5a7b804d6 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 20:53:35.107435 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-e841a731-5de0-4f8d-8e76-9e8dcb62e94b req-94c9f27e-4039-44d0-a075-2530e507b858 tempest-LiveMigrationTest-1243457813 None] volume is a clone so cleaning references {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Mar 12 20:53:35.150287 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-e841a731-5de0-4f8d-8e76-9e8dcb62e94b req-94c9f27e-4039-44d0-a075-2530e507b858 tempest-LiveMigrationTest-1243457813 None] deleting parent snapshot volume-50aafd1b-9074-4f5a-9416-a6b5a7b804d6.clone_snap {{(pid=129531) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Mar 12 20:53:36.171931 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [req-e841a731-5de0-4f8d-8e76-9e8dcb62e94b req-94c9f27e-4039-44d0-a075-2530e507b858 tempest-LiveMigrationTest-1243457813 None] Created reservations ['b0fef448-c3ca-40d6-8d21-89f57eabce03', '43de1560-2624-4e3d-b2d7-dfc642d97aa2', '167b30ad-314c-4cd4-885b-19380396146a', '168f4771-b45b-4d9d-a20a-92e15e5187f9'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 20:53:36.243699 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-e841a731-5de0-4f8d-8e76-9e8dcb62e94b req-94c9f27e-4039-44d0-a075-2530e507b858 tempest-LiveMigrationTest-1243457813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:53:36.318398 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-e841a731-5de0-4f8d-8e76-9e8dcb62e94b req-94c9f27e-4039-44d0-a075-2530e507b858 tempest-LiveMigrationTest-1243457813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:53:36.399491 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [req-e841a731-5de0-4f8d-8e76-9e8dcb62e94b req-94c9f27e-4039-44d0-a075-2530e507b858 tempest-LiveMigrationTest-1243457813 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 20:53:36.425819 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-e841a731-5de0-4f8d-8e76-9e8dcb62e94b req-94c9f27e-4039-44d0-a075-2530e507b858 tempest-LiveMigrationTest-1243457813 None] Deleted volume successfully. Mar 12 20:53:36.444510 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-96220c36-0e19-46d2-b1b7-2e1b2afd244c tempest-LiveMigrationTest-1243457813 None] Lock "b'cinder-ff97fd5d-587f-4513-8af9-0e14cbb1f919-delete_volume'" acquired by "delete_volume" :: waited 0.031s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 20:53:36.455211 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [req-e841a731-5de0-4f8d-8e76-9e8dcb62e94b req-94c9f27e-4039-44d0-a075-2530e507b858 tempest-LiveMigrationTest-1243457813 None] Lock "b'cinder-50aafd1b-9074-4f5a-9416-a6b5a7b804d6-delete_volume'" released by "delete_volume" :: held 1.776s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 20:53:36.532635 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-96220c36-0e19-46d2-b1b7-2e1b2afd244c tempest-LiveMigrationTest-1243457813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:53:36.604991 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-96220c36-0e19-46d2-b1b7-2e1b2afd244c tempest-LiveMigrationTest-1243457813 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 20:53:36.605443 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-96220c36-0e19-46d2-b1b7-2e1b2afd244c tempest-LiveMigrationTest-1243457813 None] Volume volume-ff97fd5d-587f-4513-8af9-0e14cbb1f919 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 20:53:36.612591 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-96220c36-0e19-46d2-b1b7-2e1b2afd244c tempest-LiveMigrationTest-1243457813 None] deleting rbd volume volume-ff97fd5d-587f-4513-8af9-0e14cbb1f919 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 20:53:36.634960 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-af0ae052-50c9-42b5-aed2-46da5eec1ce1 tempest-AttachSCSIVolumeTestJSON-1797125887 None] Lock "b'cinder-30c3b759-aaca-47e9-b4c6-dec2f4918184-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 20:53:36.685628 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-af0ae052-50c9-42b5-aed2-46da5eec1ce1 tempest-AttachSCSIVolumeTestJSON-1797125887 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:53:36.749149 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-af0ae052-50c9-42b5-aed2-46da5eec1ce1 tempest-AttachSCSIVolumeTestJSON-1797125887 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 20:53:36.749578 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-af0ae052-50c9-42b5-aed2-46da5eec1ce1 tempest-AttachSCSIVolumeTestJSON-1797125887 None] Volume volume-30c3b759-aaca-47e9-b4c6-dec2f4918184 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 20:53:36.762243 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-af0ae052-50c9-42b5-aed2-46da5eec1ce1 tempest-AttachSCSIVolumeTestJSON-1797125887 None] deleting rbd volume volume-30c3b759-aaca-47e9-b4c6-dec2f4918184 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 20:53:37.011541 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-96220c36-0e19-46d2-b1b7-2e1b2afd244c tempest-LiveMigrationTest-1243457813 None] Created reservations ['1a158bf3-cb39-4c08-aa5f-afc265e79a4f', 'dbc8c6d5-f5bf-411e-b4ed-a65e1a0b21c4', 'd2f76f56-38bd-4623-910f-449d26d80d59', '9020f381-ffdf-4913-a598-27b4b288e8ec'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 20:53:37.104792 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-96220c36-0e19-46d2-b1b7-2e1b2afd244c tempest-LiveMigrationTest-1243457813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:53:37.158312 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-96220c36-0e19-46d2-b1b7-2e1b2afd244c tempest-LiveMigrationTest-1243457813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:53:37.214229 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-96220c36-0e19-46d2-b1b7-2e1b2afd244c tempest-LiveMigrationTest-1243457813 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 20:53:37.219360 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-96220c36-0e19-46d2-b1b7-2e1b2afd244c tempest-LiveMigrationTest-1243457813 None] Deleted volume successfully. Mar 12 20:53:37.266309 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-96220c36-0e19-46d2-b1b7-2e1b2afd244c tempest-LiveMigrationTest-1243457813 None] Lock "b'cinder-ff97fd5d-587f-4513-8af9-0e14cbb1f919-delete_volume'" released by "delete_volume" :: held 0.822s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 20:53:37.272591 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-af0ae052-50c9-42b5-aed2-46da5eec1ce1 tempest-AttachSCSIVolumeTestJSON-1797125887 None] Created reservations ['1d81bfb8-4b60-4bdc-bd9e-ca21f233af1e', '740f5582-4e68-44ee-8228-afc12b264c96', '7861acdf-0c9c-4235-8ec4-a9628d056bcd', '3e76c802-12f0-4108-bae2-dfefd718f5ef'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 20:53:37.318606 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-af0ae052-50c9-42b5-aed2-46da5eec1ce1 tempest-AttachSCSIVolumeTestJSON-1797125887 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:53:37.357133 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-af0ae052-50c9-42b5-aed2-46da5eec1ce1 tempest-AttachSCSIVolumeTestJSON-1797125887 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:53:37.398348 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-af0ae052-50c9-42b5-aed2-46da5eec1ce1 tempest-AttachSCSIVolumeTestJSON-1797125887 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 20:53:37.403118 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-af0ae052-50c9-42b5-aed2-46da5eec1ce1 tempest-AttachSCSIVolumeTestJSON-1797125887 None] Deleted volume successfully. Mar 12 20:53:37.416705 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-af0ae052-50c9-42b5-aed2-46da5eec1ce1 tempest-AttachSCSIVolumeTestJSON-1797125887 None] Lock "b'cinder-30c3b759-aaca-47e9-b4c6-dec2f4918184-delete_volume'" released by "delete_volume" :: held 0.782s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 20:53:51.126084 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 20:53:51.128553 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:53:51.215138 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:53:51.376158 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 20:54:08.881757 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a3e4a93-fcb8-4b30-9b97-e70c1efb16aa tempest-VolumesAdminNegativeTest-1400197357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 20:54:08.896019 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-3a3e4a93-fcb8-4b30-9b97-e70c1efb16aa tempest-VolumesAdminNegativeTest-1400197357 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 20:54:08.897104 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-3a3e4a93-fcb8-4b30-9b97-e70c1efb16aa tempest-VolumesAdminNegativeTest-1400197357 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 20:54:08.941487 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-3a3e4a93-fcb8-4b30-9b97-e70c1efb16aa tempest-VolumesAdminNegativeTest-1400197357 None] Flow 'volume_create_manager' (d3ef5636-e2b8-4ebc-b43e-3de163d5bfe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 20:54:08.950379 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-3a3e4a93-fcb8-4b30-9b97-e70c1efb16aa tempest-VolumesAdminNegativeTest-1400197357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (051d536e-ef17-4c58-ae33-56b77b293adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:54:08.961552 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-3a3e4a93-fcb8-4b30-9b97-e70c1efb16aa tempest-VolumesAdminNegativeTest-1400197357 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 20:54:08.974108 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-3a3e4a93-fcb8-4b30-9b97-e70c1efb16aa tempest-VolumesAdminNegativeTest-1400197357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (051d536e-ef17-4c58-ae33-56b77b293adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T20:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1757747458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fc52bc9e-4229-4fc2-83e4-87c98cd08513,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1245d37d56c46f0b1bc0525fe98289f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T20:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T20:54:09Z,use_quota=True,user_id='e04cb45776b9475cb0364b96a8bd1e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:54:08.979685 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-3a3e4a93-fcb8-4b30-9b97-e70c1efb16aa tempest-VolumesAdminNegativeTest-1400197357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03082785-9e40-478f-8801-f97d6a7e0a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:54:08.983932 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-3a3e4a93-fcb8-4b30-9b97-e70c1efb16aa tempest-VolumesAdminNegativeTest-1400197357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03082785-9e40-478f-8801-f97d6a7e0a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:54:08.989396 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-3a3e4a93-fcb8-4b30-9b97-e70c1efb16aa tempest-VolumesAdminNegativeTest-1400197357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7292ea46-ffbb-4622-a424-88d1db4a0ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:54:08.993802 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-3a3e4a93-fcb8-4b30-9b97-e70c1efb16aa tempest-VolumesAdminNegativeTest-1400197357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7292ea46-ffbb-4622-a424-88d1db4a0ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc52bc9e-4229-4fc2-83e4-87c98cd08513', 'volume_name': 'volume-fc52bc9e-4229-4fc2-83e4-87c98cd08513', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:54:08.999492 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-3a3e4a93-fcb8-4b30-9b97-e70c1efb16aa tempest-VolumesAdminNegativeTest-1400197357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c85de0-9765-42d7-b5bc-c30588189327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:54:09.003658 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-3a3e4a93-fcb8-4b30-9b97-e70c1efb16aa tempest-VolumesAdminNegativeTest-1400197357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c85de0-9765-42d7-b5bc-c30588189327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:54:09.009447 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-3a3e4a93-fcb8-4b30-9b97-e70c1efb16aa tempest-VolumesAdminNegativeTest-1400197357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d1be1df-40b8-4403-a6a9-20df02d77598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:54:09.010602 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-3a3e4a93-fcb8-4b30-9b97-e70c1efb16aa tempest-VolumesAdminNegativeTest-1400197357 None] Volume fc52bc9e-4229-4fc2-83e4-87c98cd08513: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc52bc9e-4229-4fc2-83e4-87c98cd08513', 'volume_size': 1} Mar 12 20:54:09.011008 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3a3e4a93-fcb8-4b30-9b97-e70c1efb16aa tempest-VolumesAdminNegativeTest-1400197357 None] creating volume 'volume-fc52bc9e-4229-4fc2-83e4-87c98cd08513' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 20:54:09.012048 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3a3e4a93-fcb8-4b30-9b97-e70c1efb16aa tempest-VolumesAdminNegativeTest-1400197357 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:54:09.099604 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3a3e4a93-fcb8-4b30-9b97-e70c1efb16aa tempest-VolumesAdminNegativeTest-1400197357 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 20:54:09.100133 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3a3e4a93-fcb8-4b30-9b97-e70c1efb16aa tempest-VolumesAdminNegativeTest-1400197357 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 20:54:09.103913 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-3a3e4a93-fcb8-4b30-9b97-e70c1efb16aa tempest-VolumesAdminNegativeTest-1400197357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d1be1df-40b8-4403-a6a9-20df02d77598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc52bc9e-4229-4fc2-83e4-87c98cd08513', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:54:09.108752 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-3a3e4a93-fcb8-4b30-9b97-e70c1efb16aa tempest-VolumesAdminNegativeTest-1400197357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c382ed8a-17bf-4ae7-b685-67a7985ee4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:54:09.123773 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-3a3e4a93-fcb8-4b30-9b97-e70c1efb16aa tempest-VolumesAdminNegativeTest-1400197357 None] Volume volume-fc52bc9e-4229-4fc2-83e4-87c98cd08513 (fc52bc9e-4229-4fc2-83e4-87c98cd08513): created successfully Mar 12 20:54:09.130052 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-3a3e4a93-fcb8-4b30-9b97-e70c1efb16aa tempest-VolumesAdminNegativeTest-1400197357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c382ed8a-17bf-4ae7-b685-67a7985ee4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:54:09.141751 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-3a3e4a93-fcb8-4b30-9b97-e70c1efb16aa tempest-VolumesAdminNegativeTest-1400197357 None] Flow 'volume_create_manager' (d3ef5636-e2b8-4ebc-b43e-3de163d5bfe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 20:54:09.156341 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-3a3e4a93-fcb8-4b30-9b97-e70c1efb16aa tempest-VolumesAdminNegativeTest-1400197357 None] Created volume successfully. Mar 12 20:54:10.591059 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-a71de697-991c-4d79-86d8-110c1bf486cf req-8f33d6a4-4622-49dc-a097-e950bf71e2d8 tempest-VolumesAdminNegativeTest-1400197357 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 20:54:11.312590 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-a71de697-991c-4d79-86d8-110c1bf486cf req-8f33d6a4-4622-49dc-a097-e950bf71e2d8 tempest-VolumesAdminNegativeTest-1400197357 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.721s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 20:54:11.313429 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-a71de697-991c-4d79-86d8-110c1bf486cf req-8f33d6a4-4622-49dc-a097-e950bf71e2d8 tempest-VolumesAdminNegativeTest-1400197357 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-fc52bc9e-4229-4fc2-83e4-87c98cd08513', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': 'fc52bc9e-4229-4fc2-83e4-87c98cd08513', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 20:54:11.337578 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-a71de697-991c-4d79-86d8-110c1bf486cf req-8f33d6a4-4622-49dc-a097-e950bf71e2d8 tempest-VolumesAdminNegativeTest-1400197357 None] Connection info returned from driver {'name': 'volumes/volume-fc52bc9e-4229-4fc2-83e4-87c98cd08513', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'fc52bc9e-4229-4fc2-83e4-87c98cd08513', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0f3aea85-3a4b-456c-b84b-69a0768622aa'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 20:54:11.403463 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-a71de697-991c-4d79-86d8-110c1bf486cf req-8f33d6a4-4622-49dc-a097-e950bf71e2d8 tempest-VolumesAdminNegativeTest-1400197357 None] attachment_update completed successfully. Mar 12 20:54:18.235777 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-3e71f587-bc7e-4ff4-a00e-2d76f97ef509 req-793c6e39-dba1-4a1c-8504-bb305d9930ae tempest-VolumesAdminNegativeTest-1400197357 None] Terminate volume connection completed successfully. Mar 12 20:54:18.236809 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-3e71f587-bc7e-4ff4-a00e-2d76f97ef509 req-793c6e39-dba1-4a1c-8504-bb305d9930ae tempest-VolumesAdminNegativeTest-1400197357 None] Deleting attachment 0f3aea85-3a4b-456c-b84b-69a0768622aa. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 20:54:22.043986 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-6800a4da-8a7f-4d25-ae98-05a44da69afe tempest-VolumesAdminNegativeTest-1400197357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 20:54:22.047927 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-6800a4da-8a7f-4d25-ae98-05a44da69afe tempest-VolumesAdminNegativeTest-1400197357 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 20:54:22.048431 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-6800a4da-8a7f-4d25-ae98-05a44da69afe tempest-VolumesAdminNegativeTest-1400197357 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 20:54:22.069091 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6800a4da-8a7f-4d25-ae98-05a44da69afe tempest-VolumesAdminNegativeTest-1400197357 None] Flow 'volume_create_manager' (69032f1c-df0c-4dd1-b2fb-c3cab4781633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 20:54:22.076409 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6800a4da-8a7f-4d25-ae98-05a44da69afe tempest-VolumesAdminNegativeTest-1400197357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eda4fe3b-bb80-4c2a-9984-322e5675a30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:54:22.083992 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-6800a4da-8a7f-4d25-ae98-05a44da69afe tempest-VolumesAdminNegativeTest-1400197357 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 20:54:22.099915 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6800a4da-8a7f-4d25-ae98-05a44da69afe tempest-VolumesAdminNegativeTest-1400197357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eda4fe3b-bb80-4c2a-9984-322e5675a30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T20:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-235058948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0e450d0f-5dac-431a-b92e-5d59fbc5e32a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1245d37d56c46f0b1bc0525fe98289f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T20:54:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T20:54:22Z,use_quota=True,user_id='e04cb45776b9475cb0364b96a8bd1e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:54:22.105583 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6800a4da-8a7f-4d25-ae98-05a44da69afe tempest-VolumesAdminNegativeTest-1400197357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e43f89e-17db-48ba-b167-433ba6b40532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:54:22.109979 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6800a4da-8a7f-4d25-ae98-05a44da69afe tempest-VolumesAdminNegativeTest-1400197357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e43f89e-17db-48ba-b167-433ba6b40532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:54:22.115252 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6800a4da-8a7f-4d25-ae98-05a44da69afe tempest-VolumesAdminNegativeTest-1400197357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc6294cf-31b3-4ec2-ae0d-5ac2715c3f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:54:22.120579 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6800a4da-8a7f-4d25-ae98-05a44da69afe tempest-VolumesAdminNegativeTest-1400197357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc6294cf-31b3-4ec2-ae0d-5ac2715c3f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e450d0f-5dac-431a-b92e-5d59fbc5e32a', 'volume_name': 'volume-0e450d0f-5dac-431a-b92e-5d59fbc5e32a', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:54:22.125727 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6800a4da-8a7f-4d25-ae98-05a44da69afe tempest-VolumesAdminNegativeTest-1400197357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ac0be1d-91c3-4afb-ac93-888cd92f87ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:54:22.129826 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6800a4da-8a7f-4d25-ae98-05a44da69afe tempest-VolumesAdminNegativeTest-1400197357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ac0be1d-91c3-4afb-ac93-888cd92f87ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:54:22.135023 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6800a4da-8a7f-4d25-ae98-05a44da69afe tempest-VolumesAdminNegativeTest-1400197357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71f71ffe-c1a3-4ac6-a98f-a22b3e60d237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:54:22.136116 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-6800a4da-8a7f-4d25-ae98-05a44da69afe tempest-VolumesAdminNegativeTest-1400197357 None] Volume 0e450d0f-5dac-431a-b92e-5d59fbc5e32a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e450d0f-5dac-431a-b92e-5d59fbc5e32a', 'volume_size': 1} Mar 12 20:54:22.136530 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-6800a4da-8a7f-4d25-ae98-05a44da69afe tempest-VolumesAdminNegativeTest-1400197357 None] creating volume 'volume-0e450d0f-5dac-431a-b92e-5d59fbc5e32a' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 20:54:22.137704 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-6800a4da-8a7f-4d25-ae98-05a44da69afe tempest-VolumesAdminNegativeTest-1400197357 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:54:22.193794 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-6800a4da-8a7f-4d25-ae98-05a44da69afe tempest-VolumesAdminNegativeTest-1400197357 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 20:54:22.194432 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-6800a4da-8a7f-4d25-ae98-05a44da69afe tempest-VolumesAdminNegativeTest-1400197357 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 20:54:22.201856 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6800a4da-8a7f-4d25-ae98-05a44da69afe tempest-VolumesAdminNegativeTest-1400197357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71f71ffe-c1a3-4ac6-a98f-a22b3e60d237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e450d0f-5dac-431a-b92e-5d59fbc5e32a', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:54:22.207012 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6800a4da-8a7f-4d25-ae98-05a44da69afe tempest-VolumesAdminNegativeTest-1400197357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ac8d3c-a17c-48f3-b4dc-44e35009385a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:54:22.215860 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-6800a4da-8a7f-4d25-ae98-05a44da69afe tempest-VolumesAdminNegativeTest-1400197357 None] Volume volume-0e450d0f-5dac-431a-b92e-5d59fbc5e32a (0e450d0f-5dac-431a-b92e-5d59fbc5e32a): created successfully Mar 12 20:54:22.220198 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6800a4da-8a7f-4d25-ae98-05a44da69afe tempest-VolumesAdminNegativeTest-1400197357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ac8d3c-a17c-48f3-b4dc-44e35009385a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:54:22.226214 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6800a4da-8a7f-4d25-ae98-05a44da69afe tempest-VolumesAdminNegativeTest-1400197357 None] Flow 'volume_create_manager' (69032f1c-df0c-4dd1-b2fb-c3cab4781633) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 20:54:22.234634 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-6800a4da-8a7f-4d25-ae98-05a44da69afe tempest-VolumesAdminNegativeTest-1400197357 None] Created volume successfully. Mar 12 20:54:24.529635 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-a51e58f0-7212-4600-9538-44e06bdaa0bb tempest-VolumesAdminNegativeTest-1400197357 None] Lock "b'cinder-0e450d0f-5dac-431a-b92e-5d59fbc5e32a-delete_volume'" acquired by "delete_volume" :: waited 0.029s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 20:54:24.592064 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a51e58f0-7212-4600-9538-44e06bdaa0bb tempest-VolumesAdminNegativeTest-1400197357 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:54:24.674854 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a51e58f0-7212-4600-9538-44e06bdaa0bb tempest-VolumesAdminNegativeTest-1400197357 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 20:54:24.676068 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a51e58f0-7212-4600-9538-44e06bdaa0bb tempest-VolumesAdminNegativeTest-1400197357 None] Volume volume-0e450d0f-5dac-431a-b92e-5d59fbc5e32a is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 20:54:24.683082 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a51e58f0-7212-4600-9538-44e06bdaa0bb tempest-VolumesAdminNegativeTest-1400197357 None] deleting rbd volume volume-0e450d0f-5dac-431a-b92e-5d59fbc5e32a {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 20:54:25.035265 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-a51e58f0-7212-4600-9538-44e06bdaa0bb tempest-VolumesAdminNegativeTest-1400197357 None] Created reservations ['99a81fb5-2d99-406f-9c9e-db519b5858a8', 'ff9340f4-99c1-4801-a30c-d0adab821948', '13521eed-d51d-49d0-910c-c048254c6dfc', 'eca40630-fc7c-4c94-9b49-2e1d7e714f7f'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 20:54:25.130760 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a51e58f0-7212-4600-9538-44e06bdaa0bb tempest-VolumesAdminNegativeTest-1400197357 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:54:25.237711 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a51e58f0-7212-4600-9538-44e06bdaa0bb tempest-VolumesAdminNegativeTest-1400197357 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:54:25.311926 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a51e58f0-7212-4600-9538-44e06bdaa0bb tempest-VolumesAdminNegativeTest-1400197357 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 20:54:25.322136 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-a51e58f0-7212-4600-9538-44e06bdaa0bb tempest-VolumesAdminNegativeTest-1400197357 None] Deleted volume successfully. Mar 12 20:54:25.342311 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-a51e58f0-7212-4600-9538-44e06bdaa0bb tempest-VolumesAdminNegativeTest-1400197357 None] Lock "b'cinder-0e450d0f-5dac-431a-b92e-5d59fbc5e32a-delete_volume'" released by "delete_volume" :: held 0.812s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 20:54:25.729446 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-736a749d-6459-40d5-b742-74d28584621f tempest-VolumesAdminNegativeTest-1400197357 None] Lock "b'cinder-fc52bc9e-4229-4fc2-83e4-87c98cd08513-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 20:54:25.828078 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-736a749d-6459-40d5-b742-74d28584621f tempest-VolumesAdminNegativeTest-1400197357 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:54:25.885887 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-736a749d-6459-40d5-b742-74d28584621f tempest-VolumesAdminNegativeTest-1400197357 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 20:54:25.886411 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-736a749d-6459-40d5-b742-74d28584621f tempest-VolumesAdminNegativeTest-1400197357 None] Volume volume-fc52bc9e-4229-4fc2-83e4-87c98cd08513 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 20:54:25.894794 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-736a749d-6459-40d5-b742-74d28584621f tempest-VolumesAdminNegativeTest-1400197357 None] deleting rbd volume volume-fc52bc9e-4229-4fc2-83e4-87c98cd08513 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 20:54:26.172581 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-736a749d-6459-40d5-b742-74d28584621f tempest-VolumesAdminNegativeTest-1400197357 None] Created reservations ['d19ad649-c432-482c-a8de-fd152ee1b587', '1c5a6efc-8618-4afc-aacf-1f42815c90cd', 'cd2a7906-ce3a-4997-ac64-be8f68e3361c', '5e804261-21a1-44d0-bf6d-4b08c9849961'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 20:54:26.224551 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-736a749d-6459-40d5-b742-74d28584621f tempest-VolumesAdminNegativeTest-1400197357 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:54:26.269076 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-736a749d-6459-40d5-b742-74d28584621f tempest-VolumesAdminNegativeTest-1400197357 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:54:26.316964 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-736a749d-6459-40d5-b742-74d28584621f tempest-VolumesAdminNegativeTest-1400197357 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 20:54:26.323669 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-736a749d-6459-40d5-b742-74d28584621f tempest-VolumesAdminNegativeTest-1400197357 None] Deleted volume successfully. Mar 12 20:54:26.339302 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-736a749d-6459-40d5-b742-74d28584621f tempest-VolumesAdminNegativeTest-1400197357 None] Lock "b'cinder-fc52bc9e-4229-4fc2-83e4-87c98cd08513-delete_volume'" released by "delete_volume" :: held 0.610s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 20:54:51.121740 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 20:54:51.124249 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:54:51.176487 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:54:51.206225 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 20:54:56.667177 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-a35eb9f7-8a7c-42fc-acb5-45b14910ab0f req-a9a547f8-ee17-40d2-9420-e0c86b3c92cb tempest-AttachVolumeShelveTestJSON-13164227 None] Terminate volume connection completed successfully. Mar 12 20:54:56.667870 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-a35eb9f7-8a7c-42fc-acb5-45b14910ab0f req-a9a547f8-ee17-40d2-9420-e0c86b3c92cb tempest-AttachVolumeShelveTestJSON-13164227 None] Deleting attachment a82c90de-9d6a-41d6-8a44-1ae89181063d. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 20:55:51.123715 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 20:55:51.125190 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:55:51.236611 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:55:51.331557 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 20:56:01.564452 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 20:56:01.568248 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 20:56:01.569027 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 20:56:01.588736 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] Flow 'volume_create_manager' (c60db05a-37b6-40a7-9ebc-f4b66a400f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 20:56:01.596037 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29ef0852-9391-4a55-95cc-7cd0c170420e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:56:01.603084 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 20:56:01.622555 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29ef0852-9391-4a55-95cc-7cd0c170420e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T20:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-680667926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6f1be946-45cc-48af-a0e2-eb5cba840969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2b785d4ebf43779d20d8d18d4ef5af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T20:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T20:56:02Z,use_quota=True,user_id='32fae6060ad1458891c8c19554a03582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:56:01.628502 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8dfef6-6d92-4d9f-9143-230d63b599cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:56:01.633287 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8dfef6-6d92-4d9f-9143-230d63b599cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:56:01.638827 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32bca706-6304-477c-ab88-453b83dda2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:56:01.754493 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32bca706-6304-477c-ab88-453b83dda2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6f1be946-45cc-48af-a0e2-eb5cba840969', 'volume_name': 'volume-6f1be946-45cc-48af-a0e2-eb5cba840969', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:56:01.760647 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ffa8193-b06d-4a3e-bcfd-852e19b58e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:56:01.765616 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ffa8193-b06d-4a3e-bcfd-852e19b58e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:56:01.775136 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09d769f4-cf76-4959-af0a-bed25c53445a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:56:01.775136 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] Volume 6f1be946-45cc-48af-a0e2-eb5cba840969: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6f1be946-45cc-48af-a0e2-eb5cba840969', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 12 20:56:01.775392 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] Cloning 6f1be946-45cc-48af-a0e2-eb5cba840969 from image 539171db-0bd3-4f16-95fd-a7cd5530137d at location (None, None). {{(pid=129531) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Mar 12 20:56:01.782414 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] Lock "b'cinder-539171db-0bd3-4f16-95fd-a7cd5530137d'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 20:56:01.793301 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] Found image-volume cache entry: {'id': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'volume_id': '8d802c7b-bd34-4836-bd5d-90755a167ddc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34), 'last_used': datetime.datetime(2022, 3, 12, 20, 56, 1, 786868)}. {{(pid=129531) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 12 20:56:01.793916 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] Image-volume cache entry image_update_at = 2022-03-12 20:39:34+00:00, requested image updated_at = 2022-03-12 20:39:34+00:00. {{(pid=129531) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 12 20:56:01.794399 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] Found cache entry for image = 539171db-0bd3-4f16-95fd-a7cd5530137d on host ncdv-master-1@ceph#ceph. {{(pid=129531) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Mar 12 20:56:01.799223 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] Lock "b'cinder-539171db-0bd3-4f16-95fd-a7cd5530137d'" released by "_prepare_image_cache_entry" :: held 0.017s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 20:56:01.800250 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] Attempting to retrieve cache entry for image = 539171db-0bd3-4f16-95fd-a7cd5530137d on host ncdv-master-1@ceph#ceph. {{(pid=129531) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Mar 12 20:56:01.806509 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] Found image-volume cache entry: {'id': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'volume_id': '8d802c7b-bd34-4836-bd5d-90755a167ddc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34), 'last_used': datetime.datetime(2022, 3, 12, 20, 56, 1, 804194)}. {{(pid=129531) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 12 20:56:01.807004 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] Image-volume cache entry image_update_at = 2022-03-12 20:39:34+00:00, requested image updated_at = 2022-03-12 20:39:34+00:00. {{(pid=129531) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 12 20:56:01.807632 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] Creating from source image-volume 8d802c7b-bd34-4836-bd5d-90755a167ddc {{(pid=129531) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Mar 12 20:56:01.819560 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:56:01.897905 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] creating snapshot='volume-6f1be946-45cc-48af-a0e2-eb5cba840969.clone_snap' {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Mar 12 20:56:02.427558 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] cloning 'volume-8d802c7b-bd34-4836-bd5d-90755a167ddc@volume-6f1be946-45cc-48af-a0e2-eb5cba840969.clone_snap' to 'volume-6f1be946-45cc-48af-a0e2-eb5cba840969' {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Mar 12 20:56:02.633050 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] Volume volume-9916cd82-3d9b-466f-a769-cf81bdc743fd.deleted is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 20:56:02.634339 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 20:56:02.634758 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 20:56:02.656136 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] clone created successfully {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Mar 12 20:56:02.656883 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.volume_utils [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] Marking volume 6f1be946-45cc-48af-a0e2-eb5cba840969 as bootable. {{(pid=129531) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 12 20:56:02.664621 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] Copying metadata from image 539171db-0bd3-4f16-95fd-a7cd5530137d to 6f1be946-45cc-48af-a0e2-eb5cba840969. {{(pid=129531) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Mar 12 20:56:02.665378 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] Creating volume glance metadata for volume 6f1be946-45cc-48af-a0e2-eb5cba840969 backed by image 539171db-0bd3-4f16-95fd-a7cd5530137d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129531) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Mar 12 20:56:02.723373 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09d769f4-cf76-4959-af0a-bed25c53445a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f1be946-45cc-48af-a0e2-eb5cba840969', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:56:02.728230 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95d268e8-6ae7-46d4-b013-b4461b307972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:56:02.737102 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] Volume volume-6f1be946-45cc-48af-a0e2-eb5cba840969 (6f1be946-45cc-48af-a0e2-eb5cba840969): created successfully Mar 12 20:56:02.741084 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95d268e8-6ae7-46d4-b013-b4461b307972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:56:02.751219 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] Flow 'volume_create_manager' (c60db05a-37b6-40a7-9ebc-f4b66a400f22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 20:56:02.762760 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-9e8e4fb7-0e94-4734-8ef0-c8b85d67697a tempest-TaggedBootDevicesTest_v242-514267230 None] Created volume successfully. Mar 12 20:56:04.269930 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-90253e75-b1b1-43c1-8cd3-4fb8121a7fb6 tempest-TaggedBootDevicesTest_v242-514267230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 20:56:04.275719 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-90253e75-b1b1-43c1-8cd3-4fb8121a7fb6 tempest-TaggedBootDevicesTest_v242-514267230 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 20:56:04.276449 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-90253e75-b1b1-43c1-8cd3-4fb8121a7fb6 tempest-TaggedBootDevicesTest_v242-514267230 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 20:56:04.299207 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-90253e75-b1b1-43c1-8cd3-4fb8121a7fb6 tempest-TaggedBootDevicesTest_v242-514267230 None] Flow 'volume_create_manager' (af486d70-c353-42a2-8706-6392186f412e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 20:56:04.307657 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-90253e75-b1b1-43c1-8cd3-4fb8121a7fb6 tempest-TaggedBootDevicesTest_v242-514267230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (994dc10c-cef3-4181-a15e-8effe12a6a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:56:04.317169 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-90253e75-b1b1-43c1-8cd3-4fb8121a7fb6 tempest-TaggedBootDevicesTest_v242-514267230 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 20:56:04.342130 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-90253e75-b1b1-43c1-8cd3-4fb8121a7fb6 tempest-TaggedBootDevicesTest_v242-514267230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (994dc10c-cef3-4181-a15e-8effe12a6a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T20:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1910983428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=aa9089c6-1fb1-4cbd-a05a-f93ed5efcab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2b785d4ebf43779d20d8d18d4ef5af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T20:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T20:56:04Z,use_quota=True,user_id='32fae6060ad1458891c8c19554a03582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:56:04.348888 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-90253e75-b1b1-43c1-8cd3-4fb8121a7fb6 tempest-TaggedBootDevicesTest_v242-514267230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04ab6ee9-c6b2-49da-aed9-fd6d903ded26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:56:04.354213 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-90253e75-b1b1-43c1-8cd3-4fb8121a7fb6 tempest-TaggedBootDevicesTest_v242-514267230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04ab6ee9-c6b2-49da-aed9-fd6d903ded26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:56:04.360875 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-90253e75-b1b1-43c1-8cd3-4fb8121a7fb6 tempest-TaggedBootDevicesTest_v242-514267230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0568fc31-fa6e-4e98-87d1-73421e5b8b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:56:04.366589 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-90253e75-b1b1-43c1-8cd3-4fb8121a7fb6 tempest-TaggedBootDevicesTest_v242-514267230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0568fc31-fa6e-4e98-87d1-73421e5b8b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa9089c6-1fb1-4cbd-a05a-f93ed5efcab8', 'volume_name': 'volume-aa9089c6-1fb1-4cbd-a05a-f93ed5efcab8', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:56:04.373619 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-90253e75-b1b1-43c1-8cd3-4fb8121a7fb6 tempest-TaggedBootDevicesTest_v242-514267230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cf1cf4c-1ced-4ec7-b8fe-c7d4bc695489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:56:04.378150 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-90253e75-b1b1-43c1-8cd3-4fb8121a7fb6 tempest-TaggedBootDevicesTest_v242-514267230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cf1cf4c-1ced-4ec7-b8fe-c7d4bc695489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:56:04.383615 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-90253e75-b1b1-43c1-8cd3-4fb8121a7fb6 tempest-TaggedBootDevicesTest_v242-514267230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f58524a-4da0-4543-bd1c-0948c6aa96e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:56:04.384995 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-90253e75-b1b1-43c1-8cd3-4fb8121a7fb6 tempest-TaggedBootDevicesTest_v242-514267230 None] Volume aa9089c6-1fb1-4cbd-a05a-f93ed5efcab8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa9089c6-1fb1-4cbd-a05a-f93ed5efcab8', 'volume_size': 1} Mar 12 20:56:04.385570 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-90253e75-b1b1-43c1-8cd3-4fb8121a7fb6 tempest-TaggedBootDevicesTest_v242-514267230 None] creating volume 'volume-aa9089c6-1fb1-4cbd-a05a-f93ed5efcab8' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 20:56:04.387466 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-90253e75-b1b1-43c1-8cd3-4fb8121a7fb6 tempest-TaggedBootDevicesTest_v242-514267230 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:56:04.480509 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-90253e75-b1b1-43c1-8cd3-4fb8121a7fb6 tempest-TaggedBootDevicesTest_v242-514267230 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 20:56:04.481936 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-90253e75-b1b1-43c1-8cd3-4fb8121a7fb6 tempest-TaggedBootDevicesTest_v242-514267230 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 20:56:04.489114 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-90253e75-b1b1-43c1-8cd3-4fb8121a7fb6 tempest-TaggedBootDevicesTest_v242-514267230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f58524a-4da0-4543-bd1c-0948c6aa96e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa9089c6-1fb1-4cbd-a05a-f93ed5efcab8', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:56:04.495598 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-90253e75-b1b1-43c1-8cd3-4fb8121a7fb6 tempest-TaggedBootDevicesTest_v242-514267230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afcde314-9773-4514-9d1c-b71ff200b859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:56:04.510576 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-90253e75-b1b1-43c1-8cd3-4fb8121a7fb6 tempest-TaggedBootDevicesTest_v242-514267230 None] Volume volume-aa9089c6-1fb1-4cbd-a05a-f93ed5efcab8 (aa9089c6-1fb1-4cbd-a05a-f93ed5efcab8): created successfully Mar 12 20:56:04.516355 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-90253e75-b1b1-43c1-8cd3-4fb8121a7fb6 tempest-TaggedBootDevicesTest_v242-514267230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afcde314-9773-4514-9d1c-b71ff200b859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:56:04.523529 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-90253e75-b1b1-43c1-8cd3-4fb8121a7fb6 tempest-TaggedBootDevicesTest_v242-514267230 None] Flow 'volume_create_manager' (af486d70-c353-42a2-8706-6392186f412e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 20:56:04.534106 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-90253e75-b1b1-43c1-8cd3-4fb8121a7fb6 tempest-TaggedBootDevicesTest_v242-514267230 None] Created volume successfully. Mar 12 20:56:05.794825 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-7434ba61-1aba-4e53-86df-63da466b0ab7 tempest-TaggedBootDevicesTest_v242-514267230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 20:56:05.798732 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-7434ba61-1aba-4e53-86df-63da466b0ab7 tempest-TaggedBootDevicesTest_v242-514267230 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 20:56:05.799210 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-7434ba61-1aba-4e53-86df-63da466b0ab7 tempest-TaggedBootDevicesTest_v242-514267230 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 20:56:05.862015 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7434ba61-1aba-4e53-86df-63da466b0ab7 tempest-TaggedBootDevicesTest_v242-514267230 None] Flow 'volume_create_manager' (c0c77b84-a965-4c8d-b19e-bad02cfb6ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 20:56:05.869188 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7434ba61-1aba-4e53-86df-63da466b0ab7 tempest-TaggedBootDevicesTest_v242-514267230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35bd653a-bf22-4a46-ba67-0bf7d5f92662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:56:05.877636 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-7434ba61-1aba-4e53-86df-63da466b0ab7 tempest-TaggedBootDevicesTest_v242-514267230 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 20:56:05.908042 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7434ba61-1aba-4e53-86df-63da466b0ab7 tempest-TaggedBootDevicesTest_v242-514267230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35bd653a-bf22-4a46-ba67-0bf7d5f92662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T20:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1822032757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e8c35abf-0b4f-4a90-bee3-81247d77c9d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2b785d4ebf43779d20d8d18d4ef5af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T20:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T20:56:06Z,use_quota=True,user_id='32fae6060ad1458891c8c19554a03582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:56:05.914150 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7434ba61-1aba-4e53-86df-63da466b0ab7 tempest-TaggedBootDevicesTest_v242-514267230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b82aac1c-c163-4743-b9b0-490c318c74b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:56:05.918812 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7434ba61-1aba-4e53-86df-63da466b0ab7 tempest-TaggedBootDevicesTest_v242-514267230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b82aac1c-c163-4743-b9b0-490c318c74b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:56:05.925161 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7434ba61-1aba-4e53-86df-63da466b0ab7 tempest-TaggedBootDevicesTest_v242-514267230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6a06345-7e5e-49b9-afd8-4f3c5de8c37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:56:05.929686 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7434ba61-1aba-4e53-86df-63da466b0ab7 tempest-TaggedBootDevicesTest_v242-514267230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6a06345-7e5e-49b9-afd8-4f3c5de8c37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8c35abf-0b4f-4a90-bee3-81247d77c9d6', 'volume_name': 'volume-e8c35abf-0b4f-4a90-bee3-81247d77c9d6', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:56:05.935573 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7434ba61-1aba-4e53-86df-63da466b0ab7 tempest-TaggedBootDevicesTest_v242-514267230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49a73d6f-ebf9-431f-b186-2b07ca3bbe6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:56:05.946951 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7434ba61-1aba-4e53-86df-63da466b0ab7 tempest-TaggedBootDevicesTest_v242-514267230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49a73d6f-ebf9-431f-b186-2b07ca3bbe6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:56:05.952648 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7434ba61-1aba-4e53-86df-63da466b0ab7 tempest-TaggedBootDevicesTest_v242-514267230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a27d25f3-73e4-4943-8b3f-5452d2e850a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:56:05.953671 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-7434ba61-1aba-4e53-86df-63da466b0ab7 tempest-TaggedBootDevicesTest_v242-514267230 None] Volume e8c35abf-0b4f-4a90-bee3-81247d77c9d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8c35abf-0b4f-4a90-bee3-81247d77c9d6', 'volume_size': 1} Mar 12 20:56:05.954093 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-7434ba61-1aba-4e53-86df-63da466b0ab7 tempest-TaggedBootDevicesTest_v242-514267230 None] creating volume 'volume-e8c35abf-0b4f-4a90-bee3-81247d77c9d6' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 20:56:05.955133 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-7434ba61-1aba-4e53-86df-63da466b0ab7 tempest-TaggedBootDevicesTest_v242-514267230 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:56:06.060074 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-7434ba61-1aba-4e53-86df-63da466b0ab7 tempest-TaggedBootDevicesTest_v242-514267230 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 20:56:06.061172 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-7434ba61-1aba-4e53-86df-63da466b0ab7 tempest-TaggedBootDevicesTest_v242-514267230 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 20:56:06.064540 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7434ba61-1aba-4e53-86df-63da466b0ab7 tempest-TaggedBootDevicesTest_v242-514267230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a27d25f3-73e4-4943-8b3f-5452d2e850a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8c35abf-0b4f-4a90-bee3-81247d77c9d6', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:56:06.069811 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7434ba61-1aba-4e53-86df-63da466b0ab7 tempest-TaggedBootDevicesTest_v242-514267230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d55697a6-11d7-4d94-8764-7d75f62f4879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:56:06.080816 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-7434ba61-1aba-4e53-86df-63da466b0ab7 tempest-TaggedBootDevicesTest_v242-514267230 None] Volume volume-e8c35abf-0b4f-4a90-bee3-81247d77c9d6 (e8c35abf-0b4f-4a90-bee3-81247d77c9d6): created successfully Mar 12 20:56:06.084994 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7434ba61-1aba-4e53-86df-63da466b0ab7 tempest-TaggedBootDevicesTest_v242-514267230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d55697a6-11d7-4d94-8764-7d75f62f4879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:56:06.090767 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7434ba61-1aba-4e53-86df-63da466b0ab7 tempest-TaggedBootDevicesTest_v242-514267230 None] Flow 'volume_create_manager' (c0c77b84-a965-4c8d-b19e-bad02cfb6ef6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 20:56:06.100563 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-7434ba61-1aba-4e53-86df-63da466b0ab7 tempest-TaggedBootDevicesTest_v242-514267230 None] Created volume successfully. Mar 12 20:56:24.302616 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-b08f2c12-8c01-49ba-98a7-7cd2dcaae946 req-07dacbcc-6e9e-4c91-a459-4ad0fbc216d6 tempest-TaggedBootDevicesTest_v242-514267230 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 20:56:24.757285 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8f7c7d4-dfbb-4872-a398-e29e38aafe47 tempest-AttachVolumeShelveTestJSON-13164227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 20:56:24.763474 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-f8f7c7d4-dfbb-4872-a398-e29e38aafe47 tempest-AttachVolumeShelveTestJSON-13164227 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 20:56:24.764330 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-f8f7c7d4-dfbb-4872-a398-e29e38aafe47 tempest-AttachVolumeShelveTestJSON-13164227 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 20:56:24.792980 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f8f7c7d4-dfbb-4872-a398-e29e38aafe47 tempest-AttachVolumeShelveTestJSON-13164227 None] Flow 'volume_create_manager' (dbf6325a-2f59-4adb-a9a6-000e94df3ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 20:56:24.800498 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f8f7c7d4-dfbb-4872-a398-e29e38aafe47 tempest-AttachVolumeShelveTestJSON-13164227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d61bc270-c8dd-4a32-9b5a-807089dced2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:56:24.808043 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-f8f7c7d4-dfbb-4872-a398-e29e38aafe47 tempest-AttachVolumeShelveTestJSON-13164227 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 20:56:24.825823 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f8f7c7d4-dfbb-4872-a398-e29e38aafe47 tempest-AttachVolumeShelveTestJSON-13164227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d61bc270-c8dd-4a32-9b5a-807089dced2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T20:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2061919135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6353a058-d60e-41ef-a491-c72834a85958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0a5497c8a2449c89a200ddd03ce5aeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T20:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T20:56:25Z,use_quota=True,user_id='38372b69c92d4456879f7fa00239f0c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:56:24.832889 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f8f7c7d4-dfbb-4872-a398-e29e38aafe47 tempest-AttachVolumeShelveTestJSON-13164227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1115e5c4-1967-4b24-860b-b7e5fb3f9c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:56:24.838374 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f8f7c7d4-dfbb-4872-a398-e29e38aafe47 tempest-AttachVolumeShelveTestJSON-13164227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1115e5c4-1967-4b24-860b-b7e5fb3f9c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:56:24.854669 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f8f7c7d4-dfbb-4872-a398-e29e38aafe47 tempest-AttachVolumeShelveTestJSON-13164227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec17fb66-50a6-4cca-98f9-1ca6d8060c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:56:24.866777 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f8f7c7d4-dfbb-4872-a398-e29e38aafe47 tempest-AttachVolumeShelveTestJSON-13164227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec17fb66-50a6-4cca-98f9-1ca6d8060c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6353a058-d60e-41ef-a491-c72834a85958', 'volume_name': 'volume-6353a058-d60e-41ef-a491-c72834a85958', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:56:24.877877 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f8f7c7d4-dfbb-4872-a398-e29e38aafe47 tempest-AttachVolumeShelveTestJSON-13164227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (197c1696-f2dc-46d3-8cd3-5b2544f8e744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:56:24.883963 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f8f7c7d4-dfbb-4872-a398-e29e38aafe47 tempest-AttachVolumeShelveTestJSON-13164227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (197c1696-f2dc-46d3-8cd3-5b2544f8e744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:56:24.889628 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f8f7c7d4-dfbb-4872-a398-e29e38aafe47 tempest-AttachVolumeShelveTestJSON-13164227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f0f2815-0474-40c7-9a17-7e0092fd4740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:56:24.891043 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-f8f7c7d4-dfbb-4872-a398-e29e38aafe47 tempest-AttachVolumeShelveTestJSON-13164227 None] Volume 6353a058-d60e-41ef-a491-c72834a85958: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6353a058-d60e-41ef-a491-c72834a85958', 'volume_size': 1} Mar 12 20:56:24.891564 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f8f7c7d4-dfbb-4872-a398-e29e38aafe47 tempest-AttachVolumeShelveTestJSON-13164227 None] creating volume 'volume-6353a058-d60e-41ef-a491-c72834a85958' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 20:56:24.892889 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f8f7c7d4-dfbb-4872-a398-e29e38aafe47 tempest-AttachVolumeShelveTestJSON-13164227 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:56:24.987162 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f8f7c7d4-dfbb-4872-a398-e29e38aafe47 tempest-AttachVolumeShelveTestJSON-13164227 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 20:56:24.987819 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f8f7c7d4-dfbb-4872-a398-e29e38aafe47 tempest-AttachVolumeShelveTestJSON-13164227 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 20:56:24.992378 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f8f7c7d4-dfbb-4872-a398-e29e38aafe47 tempest-AttachVolumeShelveTestJSON-13164227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f0f2815-0474-40c7-9a17-7e0092fd4740) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6353a058-d60e-41ef-a491-c72834a85958', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:56:25.005649 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f8f7c7d4-dfbb-4872-a398-e29e38aafe47 tempest-AttachVolumeShelveTestJSON-13164227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3249e1e-9ef1-4616-8654-5da10bf85ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:56:25.020430 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-f8f7c7d4-dfbb-4872-a398-e29e38aafe47 tempest-AttachVolumeShelveTestJSON-13164227 None] Volume volume-6353a058-d60e-41ef-a491-c72834a85958 (6353a058-d60e-41ef-a491-c72834a85958): created successfully Mar 12 20:56:25.024728 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f8f7c7d4-dfbb-4872-a398-e29e38aafe47 tempest-AttachVolumeShelveTestJSON-13164227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3249e1e-9ef1-4616-8654-5da10bf85ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:56:25.033126 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f8f7c7d4-dfbb-4872-a398-e29e38aafe47 tempest-AttachVolumeShelveTestJSON-13164227 None] Flow 'volume_create_manager' (dbf6325a-2f59-4adb-a9a6-000e94df3ef2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 20:56:25.055859 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-f8f7c7d4-dfbb-4872-a398-e29e38aafe47 tempest-AttachVolumeShelveTestJSON-13164227 None] Created volume successfully. Mar 12 20:56:25.122048 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-b08f2c12-8c01-49ba-98a7-7cd2dcaae946 req-07dacbcc-6e9e-4c91-a459-4ad0fbc216d6 tempest-TaggedBootDevicesTest_v242-514267230 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.819s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 20:56:25.123147 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-b08f2c12-8c01-49ba-98a7-7cd2dcaae946 req-07dacbcc-6e9e-4c91-a459-4ad0fbc216d6 tempest-TaggedBootDevicesTest_v242-514267230 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6f1be946-45cc-48af-a0e2-eb5cba840969', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': '6f1be946-45cc-48af-a0e2-eb5cba840969', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 20:56:25.155412 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-b08f2c12-8c01-49ba-98a7-7cd2dcaae946 req-07dacbcc-6e9e-4c91-a459-4ad0fbc216d6 tempest-TaggedBootDevicesTest_v242-514267230 None] Connection info returned from driver {'name': 'volumes/volume-6f1be946-45cc-48af-a0e2-eb5cba840969', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '6f1be946-45cc-48af-a0e2-eb5cba840969', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e71b0fa7-7493-4d2e-8dcf-41bbff6d151d'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 20:56:25.212895 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-b08f2c12-8c01-49ba-98a7-7cd2dcaae946 req-07dacbcc-6e9e-4c91-a459-4ad0fbc216d6 tempest-TaggedBootDevicesTest_v242-514267230 None] attachment_update completed successfully. Mar 12 20:56:25.531755 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-b08f2c12-8c01-49ba-98a7-7cd2dcaae946 req-df792aba-1676-4a8f-9dee-18a0160e59dc tempest-TaggedBootDevicesTest_v242-514267230 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 20:56:26.307260 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-b08f2c12-8c01-49ba-98a7-7cd2dcaae946 req-df792aba-1676-4a8f-9dee-18a0160e59dc tempest-TaggedBootDevicesTest_v242-514267230 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.775s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 20:56:26.310412 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-b08f2c12-8c01-49ba-98a7-7cd2dcaae946 req-df792aba-1676-4a8f-9dee-18a0160e59dc tempest-TaggedBootDevicesTest_v242-514267230 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-aa9089c6-1fb1-4cbd-a05a-f93ed5efcab8', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': 'aa9089c6-1fb1-4cbd-a05a-f93ed5efcab8', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 20:56:26.339550 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-b08f2c12-8c01-49ba-98a7-7cd2dcaae946 req-df792aba-1676-4a8f-9dee-18a0160e59dc tempest-TaggedBootDevicesTest_v242-514267230 None] Connection info returned from driver {'name': 'volumes/volume-aa9089c6-1fb1-4cbd-a05a-f93ed5efcab8', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'aa9089c6-1fb1-4cbd-a05a-f93ed5efcab8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8f991ecd-5b59-4cd4-9bff-98e364c5a2b5'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 20:56:26.388289 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-b08f2c12-8c01-49ba-98a7-7cd2dcaae946 req-df792aba-1676-4a8f-9dee-18a0160e59dc tempest-TaggedBootDevicesTest_v242-514267230 None] attachment_update completed successfully. Mar 12 20:56:26.732438 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-b08f2c12-8c01-49ba-98a7-7cd2dcaae946 req-fca52afd-db91-4e2f-8718-acb5a5934753 tempest-TaggedBootDevicesTest_v242-514267230 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 20:56:27.585612 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-b08f2c12-8c01-49ba-98a7-7cd2dcaae946 req-fca52afd-db91-4e2f-8718-acb5a5934753 tempest-TaggedBootDevicesTest_v242-514267230 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.853s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 20:56:27.586775 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-b08f2c12-8c01-49ba-98a7-7cd2dcaae946 req-fca52afd-db91-4e2f-8718-acb5a5934753 tempest-TaggedBootDevicesTest_v242-514267230 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e8c35abf-0b4f-4a90-bee3-81247d77c9d6', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': 'e8c35abf-0b4f-4a90-bee3-81247d77c9d6', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 20:56:27.631531 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-b08f2c12-8c01-49ba-98a7-7cd2dcaae946 req-fca52afd-db91-4e2f-8718-acb5a5934753 tempest-TaggedBootDevicesTest_v242-514267230 None] Connection info returned from driver {'name': 'volumes/volume-e8c35abf-0b4f-4a90-bee3-81247d77c9d6', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e8c35abf-0b4f-4a90-bee3-81247d77c9d6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '339ac0f1-644b-4e09-a05c-25c4cbaa011c'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 20:56:27.734537 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-b08f2c12-8c01-49ba-98a7-7cd2dcaae946 req-fca52afd-db91-4e2f-8718-acb5a5934753 tempest-TaggedBootDevicesTest_v242-514267230 None] attachment_update completed successfully. Mar 12 20:56:51.127406 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 20:56:51.128427 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:56:51.206470 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:56:51.302327 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 20:57:00.109833 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 20:57:00.114562 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 20:57:00.115346 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 20:57:00.136364 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] Flow 'volume_create_manager' (c1d3e083-0366-47fe-96d2-8b0af30dab00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 20:57:00.143154 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ae09e6b-df35-4f56-aef8-0e1cbdcbdb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:57:00.150518 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 20:57:00.180346 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ae09e6b-df35-4f56-aef8-0e1cbdcbdb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T20:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-376010499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9ac4bf34-1155-4331-8494-1fdbe3a58339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='399f94948e49454d9b058817feac550a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T20:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T20:57:00Z,use_quota=True,user_id='cd7e5a284a5c44f7b941b18974da4e33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:57:00.186954 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ced0d4c-1fe8-422e-92b5-49f6df823753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:57:00.191653 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ced0d4c-1fe8-422e-92b5-49f6df823753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:57:00.198451 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a479c7-4925-4713-bef9-cb686b7f1721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:57:00.292560 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a479c7-4925-4713-bef9-cb686b7f1721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9ac4bf34-1155-4331-8494-1fdbe3a58339', 'volume_name': 'volume-9ac4bf34-1155-4331-8494-1fdbe3a58339', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:57:00.298912 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (116d28ad-b578-49d5-8984-bdd5cdb0b189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:57:00.303290 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (116d28ad-b578-49d5-8984-bdd5cdb0b189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:57:00.312480 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35fc68ae-92bf-4500-afed-971686f11b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:57:00.313677 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] Volume 9ac4bf34-1155-4331-8494-1fdbe3a58339: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9ac4bf34-1155-4331-8494-1fdbe3a58339', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 12 20:57:00.314295 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] Cloning 9ac4bf34-1155-4331-8494-1fdbe3a58339 from image 539171db-0bd3-4f16-95fd-a7cd5530137d at location (None, None). {{(pid=129531) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Mar 12 20:57:00.332222 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] Lock "b'cinder-539171db-0bd3-4f16-95fd-a7cd5530137d'" acquired by "_prepare_image_cache_entry" :: waited 0.015s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 20:57:00.344340 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] Found image-volume cache entry: {'id': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'volume_id': '8d802c7b-bd34-4836-bd5d-90755a167ddc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34), 'last_used': datetime.datetime(2022, 3, 12, 20, 57, 0, 336475)}. {{(pid=129531) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 12 20:57:00.344811 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] Image-volume cache entry image_update_at = 2022-03-12 20:39:34+00:00, requested image updated_at = 2022-03-12 20:39:34+00:00. {{(pid=129531) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 12 20:57:00.345274 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] Found cache entry for image = 539171db-0bd3-4f16-95fd-a7cd5530137d on host ncdv-master-1@ceph#ceph. {{(pid=129531) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Mar 12 20:57:00.352189 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] Lock "b'cinder-539171db-0bd3-4f16-95fd-a7cd5530137d'" released by "_prepare_image_cache_entry" :: held 0.022s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 20:57:00.353125 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] Attempting to retrieve cache entry for image = 539171db-0bd3-4f16-95fd-a7cd5530137d on host ncdv-master-1@ceph#ceph. {{(pid=129531) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Mar 12 20:57:00.373400 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] Found image-volume cache entry: {'id': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'volume_id': '8d802c7b-bd34-4836-bd5d-90755a167ddc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34), 'last_used': datetime.datetime(2022, 3, 12, 20, 57, 0, 370974)}. {{(pid=129531) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 12 20:57:00.373853 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] Image-volume cache entry image_update_at = 2022-03-12 20:39:34+00:00, requested image updated_at = 2022-03-12 20:39:34+00:00. {{(pid=129531) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 12 20:57:00.374257 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] Creating from source image-volume 8d802c7b-bd34-4836-bd5d-90755a167ddc {{(pid=129531) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Mar 12 20:57:00.392174 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:57:00.465512 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] creating snapshot='volume-9ac4bf34-1155-4331-8494-1fdbe3a58339.clone_snap' {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Mar 12 20:57:01.457622 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] cloning 'volume-8d802c7b-bd34-4836-bd5d-90755a167ddc@volume-9ac4bf34-1155-4331-8494-1fdbe3a58339.clone_snap' to 'volume-9ac4bf34-1155-4331-8494-1fdbe3a58339' {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Mar 12 20:57:01.684267 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] Volume volume-9916cd82-3d9b-466f-a769-cf81bdc743fd.deleted is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 20:57:01.685634 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 20:57:01.686046 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 20:57:01.720264 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] clone created successfully {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Mar 12 20:57:01.721210 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.volume_utils [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] Marking volume 9ac4bf34-1155-4331-8494-1fdbe3a58339 as bootable. {{(pid=129531) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 12 20:57:01.736192 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] Copying metadata from image 539171db-0bd3-4f16-95fd-a7cd5530137d to 9ac4bf34-1155-4331-8494-1fdbe3a58339. {{(pid=129531) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Mar 12 20:57:01.736958 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] Creating volume glance metadata for volume 9ac4bf34-1155-4331-8494-1fdbe3a58339 backed by image 539171db-0bd3-4f16-95fd-a7cd5530137d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129531) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Mar 12 20:57:01.831935 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35fc68ae-92bf-4500-afed-971686f11b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ac4bf34-1155-4331-8494-1fdbe3a58339', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:57:01.839420 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (798f24c7-776a-4065-a854-eb284f91c760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:57:01.850691 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] Volume volume-9ac4bf34-1155-4331-8494-1fdbe3a58339 (9ac4bf34-1155-4331-8494-1fdbe3a58339): created successfully Mar 12 20:57:01.857562 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (798f24c7-776a-4065-a854-eb284f91c760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:57:01.867808 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] Flow 'volume_create_manager' (c1d3e083-0366-47fe-96d2-8b0af30dab00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 20:57:01.888433 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-8465350b-bb99-4bc2-a0a1-bcfd6f6b52f4 tempest-ServersTestBootFromVolume-1495046152 None] Created volume successfully. Mar 12 20:57:05.961392 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-fc56f326-536e-446c-b9dc-6412e1b5eee2 req-2d98033c-d9c7-4aa5-a749-43f22f755c2e tempest-ServersTestBootFromVolume-1495046152 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 20:57:06.691308 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-fc56f326-536e-446c-b9dc-6412e1b5eee2 req-2d98033c-d9c7-4aa5-a749-43f22f755c2e tempest-ServersTestBootFromVolume-1495046152 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.730s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 20:57:06.692643 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-fc56f326-536e-446c-b9dc-6412e1b5eee2 req-2d98033c-d9c7-4aa5-a749-43f22f755c2e tempest-ServersTestBootFromVolume-1495046152 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9ac4bf34-1155-4331-8494-1fdbe3a58339', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': '9ac4bf34-1155-4331-8494-1fdbe3a58339', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 20:57:06.731535 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-fc56f326-536e-446c-b9dc-6412e1b5eee2 req-2d98033c-d9c7-4aa5-a749-43f22f755c2e tempest-ServersTestBootFromVolume-1495046152 None] Connection info returned from driver {'name': 'volumes/volume-9ac4bf34-1155-4331-8494-1fdbe3a58339', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '9ac4bf34-1155-4331-8494-1fdbe3a58339', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4d1f4605-35d4-40bf-b6f2-65cfc47a2126'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 20:57:06.820955 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-fc56f326-536e-446c-b9dc-6412e1b5eee2 req-2d98033c-d9c7-4aa5-a749-43f22f755c2e tempest-ServersTestBootFromVolume-1495046152 None] attachment_update completed successfully. Mar 12 20:57:07.558501 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-2a0692ee-ce96-469a-b526-75991744252e req-b4972248-62b0-4ae0-8ef4-c14367aefac2 tempest-AttachVolumeShelveTestJSON-13164227 None] No connector for attachment 33cffe6a-784d-445b-a999-5464b15e4133; skipping storage backend terminate_connection call. {{(pid=129531) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4908}} Mar 12 20:57:07.559217 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-2a0692ee-ce96-469a-b526-75991744252e req-b4972248-62b0-4ae0-8ef4-c14367aefac2 tempest-AttachVolumeShelveTestJSON-13164227 None] Deleting attachment 33cffe6a-784d-445b-a999-5464b15e4133. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 20:57:51.131526 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 20:57:51.133308 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:57:51.187123 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:57:51.232546 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 20:58:40.451524 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-cde14eba-91e9-4e05-9634-8d88b57757a8 req-b533cd97-36c1-4060-b886-af057b16fbd5 tempest-ServersTestBootFromVolume-1495046152 None] Terminate volume connection completed successfully. Mar 12 20:58:40.452637 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-cde14eba-91e9-4e05-9634-8d88b57757a8 req-b533cd97-36c1-4060-b886-af057b16fbd5 tempest-ServersTestBootFromVolume-1495046152 None] Deleting attachment 4d1f4605-35d4-40bf-b6f2-65cfc47a2126. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 20:58:40.664971 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [req-cde14eba-91e9-4e05-9634-8d88b57757a8 req-7347fa2e-8742-428c-9db6-dd23e9d2bbfc tempest-ServersTestBootFromVolume-1495046152 None] Lock "b'cinder-9ac4bf34-1155-4331-8494-1fdbe3a58339-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 20:58:40.715651 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-cde14eba-91e9-4e05-9634-8d88b57757a8 req-7347fa2e-8742-428c-9db6-dd23e9d2bbfc tempest-ServersTestBootFromVolume-1495046152 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:58:40.842353 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-cde14eba-91e9-4e05-9634-8d88b57757a8 req-7347fa2e-8742-428c-9db6-dd23e9d2bbfc tempest-ServersTestBootFromVolume-1495046152 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 20:58:40.852362 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-cde14eba-91e9-4e05-9634-8d88b57757a8 req-7347fa2e-8742-428c-9db6-dd23e9d2bbfc tempest-ServersTestBootFromVolume-1495046152 None] deleting rbd volume volume-9ac4bf34-1155-4331-8494-1fdbe3a58339 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 20:58:41.334469 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-cde14eba-91e9-4e05-9634-8d88b57757a8 req-7347fa2e-8742-428c-9db6-dd23e9d2bbfc tempest-ServersTestBootFromVolume-1495046152 None] volume is a clone so cleaning references {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Mar 12 20:58:41.396469 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-cde14eba-91e9-4e05-9634-8d88b57757a8 req-7347fa2e-8742-428c-9db6-dd23e9d2bbfc tempest-ServersTestBootFromVolume-1495046152 None] deleting parent snapshot volume-9ac4bf34-1155-4331-8494-1fdbe3a58339.clone_snap {{(pid=129531) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Mar 12 20:58:42.567471 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [req-cde14eba-91e9-4e05-9634-8d88b57757a8 req-7347fa2e-8742-428c-9db6-dd23e9d2bbfc tempest-ServersTestBootFromVolume-1495046152 None] Created reservations ['79d52552-3bb7-46b1-8179-578de3ed22ef', 'e03ec21f-8171-46cb-9942-511ca55f361f', '14459e62-9adc-4993-85a6-1690222a87ce', 'cfb6f575-06cc-46b6-8716-9e2b4a02e208'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 20:58:42.635680 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-cde14eba-91e9-4e05-9634-8d88b57757a8 req-7347fa2e-8742-428c-9db6-dd23e9d2bbfc tempest-ServersTestBootFromVolume-1495046152 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:58:42.682866 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-cde14eba-91e9-4e05-9634-8d88b57757a8 req-7347fa2e-8742-428c-9db6-dd23e9d2bbfc tempest-ServersTestBootFromVolume-1495046152 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:58:42.725921 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [req-cde14eba-91e9-4e05-9634-8d88b57757a8 req-7347fa2e-8742-428c-9db6-dd23e9d2bbfc tempest-ServersTestBootFromVolume-1495046152 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 20:58:42.737836 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-cde14eba-91e9-4e05-9634-8d88b57757a8 req-7347fa2e-8742-428c-9db6-dd23e9d2bbfc tempest-ServersTestBootFromVolume-1495046152 None] Deleted volume successfully. Mar 12 20:58:42.750300 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [req-cde14eba-91e9-4e05-9634-8d88b57757a8 req-7347fa2e-8742-428c-9db6-dd23e9d2bbfc tempest-ServersTestBootFromVolume-1495046152 None] Lock "b'cinder-9ac4bf34-1155-4331-8494-1fdbe3a58339-delete_volume'" released by "delete_volume" :: held 2.086s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 20:58:51.130567 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 20:58:51.131127 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:58:51.160186 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:58:51.189879 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 20:59:11.139281 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-16503788-207a-4ba4-a408-9691cf14d426 tempest-AttachVolumeShelveTestJSON-13164227 None] Lock "b'cinder-6353a058-d60e-41ef-a491-c72834a85958-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 20:59:11.213541 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-16503788-207a-4ba4-a408-9691cf14d426 tempest-AttachVolumeShelveTestJSON-13164227 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:59:11.283990 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-16503788-207a-4ba4-a408-9691cf14d426 tempest-AttachVolumeShelveTestJSON-13164227 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 20:59:11.284477 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-16503788-207a-4ba4-a408-9691cf14d426 tempest-AttachVolumeShelveTestJSON-13164227 None] Volume volume-6353a058-d60e-41ef-a491-c72834a85958 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 20:59:11.306825 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-16503788-207a-4ba4-a408-9691cf14d426 tempest-AttachVolumeShelveTestJSON-13164227 None] deleting rbd volume volume-6353a058-d60e-41ef-a491-c72834a85958 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 20:59:11.636352 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-16503788-207a-4ba4-a408-9691cf14d426 tempest-AttachVolumeShelveTestJSON-13164227 None] Created reservations ['887cf4e5-3da6-45a9-820e-bf9ca344e3e9', '567f892e-41be-4740-bd22-6045338fc37b', '4fd631f0-0f6c-4273-aabc-7684b9280615', 'ddc31cb9-cc84-4c60-a936-837d2769d7b1'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 20:59:11.683991 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-16503788-207a-4ba4-a408-9691cf14d426 tempest-AttachVolumeShelveTestJSON-13164227 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:59:11.717517 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-16503788-207a-4ba4-a408-9691cf14d426 tempest-AttachVolumeShelveTestJSON-13164227 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:59:11.754120 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-16503788-207a-4ba4-a408-9691cf14d426 tempest-AttachVolumeShelveTestJSON-13164227 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 20:59:11.759392 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-16503788-207a-4ba4-a408-9691cf14d426 tempest-AttachVolumeShelveTestJSON-13164227 None] Deleted volume successfully. Mar 12 20:59:11.775362 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-16503788-207a-4ba4-a408-9691cf14d426 tempest-AttachVolumeShelveTestJSON-13164227 None] Lock "b'cinder-6353a058-d60e-41ef-a491-c72834a85958-delete_volume'" released by "delete_volume" :: held 0.636s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 20:59:13.289055 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-290e7d65-3935-4637-b32a-df507139f4ad tempest-AttachVolumeShelveTestJSON-13164227 None] Lock "b'cinder-5c01ce6d-3ce1-40f2-b374-ddff1153114b-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 20:59:13.322076 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-290e7d65-3935-4637-b32a-df507139f4ad tempest-AttachVolumeShelveTestJSON-13164227 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:59:13.380825 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-290e7d65-3935-4637-b32a-df507139f4ad tempest-AttachVolumeShelveTestJSON-13164227 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 20:59:13.381422 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-290e7d65-3935-4637-b32a-df507139f4ad tempest-AttachVolumeShelveTestJSON-13164227 None] Volume volume-5c01ce6d-3ce1-40f2-b374-ddff1153114b is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 20:59:13.392623 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-290e7d65-3935-4637-b32a-df507139f4ad tempest-AttachVolumeShelveTestJSON-13164227 None] deleting rbd volume volume-5c01ce6d-3ce1-40f2-b374-ddff1153114b {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 20:59:13.777835 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-290e7d65-3935-4637-b32a-df507139f4ad tempest-AttachVolumeShelveTestJSON-13164227 None] Created reservations ['dc525e38-0fc7-4857-8127-497791e51856', '5058ab7f-c011-4fde-bd5e-7496caae2415', 'f9133287-e4e4-4967-915a-2bb11b1bd271', 'c7ece49e-6d41-423c-b920-969beb01f80b'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 20:59:13.838672 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-290e7d65-3935-4637-b32a-df507139f4ad tempest-AttachVolumeShelveTestJSON-13164227 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:59:13.897305 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-290e7d65-3935-4637-b32a-df507139f4ad tempest-AttachVolumeShelveTestJSON-13164227 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:59:13.930736 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-290e7d65-3935-4637-b32a-df507139f4ad tempest-AttachVolumeShelveTestJSON-13164227 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 20:59:13.941967 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-290e7d65-3935-4637-b32a-df507139f4ad tempest-AttachVolumeShelveTestJSON-13164227 None] Deleted volume successfully. Mar 12 20:59:13.962926 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-290e7d65-3935-4637-b32a-df507139f4ad tempest-AttachVolumeShelveTestJSON-13164227 None] Lock "b'cinder-5c01ce6d-3ce1-40f2-b374-ddff1153114b-delete_volume'" released by "delete_volume" :: held 0.674s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 20:59:18.301992 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6df7f1c-6b51-4956-856a-e6a47ce94a94 tempest-AttachVolumeTestJSON-704258411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 20:59:18.319644 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-a6df7f1c-6b51-4956-856a-e6a47ce94a94 tempest-AttachVolumeTestJSON-704258411 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 20:59:18.321120 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-a6df7f1c-6b51-4956-856a-e6a47ce94a94 tempest-AttachVolumeTestJSON-704258411 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 20:59:18.344640 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a6df7f1c-6b51-4956-856a-e6a47ce94a94 tempest-AttachVolumeTestJSON-704258411 None] Flow 'volume_create_manager' (6411bc58-d8c7-494a-a294-536dcf46bca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 20:59:18.355377 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a6df7f1c-6b51-4956-856a-e6a47ce94a94 tempest-AttachVolumeTestJSON-704258411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd950b2e-4d08-46ac-b12a-7c048d863fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:59:18.363014 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-a6df7f1c-6b51-4956-856a-e6a47ce94a94 tempest-AttachVolumeTestJSON-704258411 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 20:59:18.379381 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a6df7f1c-6b51-4956-856a-e6a47ce94a94 tempest-AttachVolumeTestJSON-704258411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd950b2e-4d08-46ac-b12a-7c048d863fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T20:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-627426226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=95a67390-c847-4eb9-8783-620ee1d3b1ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4da7920d54243cd8381e283021d7745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T20:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T20:59:18Z,use_quota=True,user_id='ec384ea1fe344a08a8b9491f10f3b211',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:59:18.386048 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a6df7f1c-6b51-4956-856a-e6a47ce94a94 tempest-AttachVolumeTestJSON-704258411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a746286b-0fb8-4cda-a209-f2c24b6eaa50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:59:18.390384 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a6df7f1c-6b51-4956-856a-e6a47ce94a94 tempest-AttachVolumeTestJSON-704258411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a746286b-0fb8-4cda-a209-f2c24b6eaa50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:59:18.411407 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a6df7f1c-6b51-4956-856a-e6a47ce94a94 tempest-AttachVolumeTestJSON-704258411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c734db34-8e34-4b5f-a704-8a5de3bd36d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:59:18.427089 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a6df7f1c-6b51-4956-856a-e6a47ce94a94 tempest-AttachVolumeTestJSON-704258411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c734db34-8e34-4b5f-a704-8a5de3bd36d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95a67390-c847-4eb9-8783-620ee1d3b1ae', 'volume_name': 'volume-95a67390-c847-4eb9-8783-620ee1d3b1ae', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:59:18.437107 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a6df7f1c-6b51-4956-856a-e6a47ce94a94 tempest-AttachVolumeTestJSON-704258411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ead1c94-3100-4a66-a902-549c94a3fe67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:59:18.451738 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a6df7f1c-6b51-4956-856a-e6a47ce94a94 tempest-AttachVolumeTestJSON-704258411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ead1c94-3100-4a66-a902-549c94a3fe67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:59:18.462003 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a6df7f1c-6b51-4956-856a-e6a47ce94a94 tempest-AttachVolumeTestJSON-704258411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c105077-9b3f-4441-b242-4ee41b0bd07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:59:18.464027 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-a6df7f1c-6b51-4956-856a-e6a47ce94a94 tempest-AttachVolumeTestJSON-704258411 None] Volume 95a67390-c847-4eb9-8783-620ee1d3b1ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95a67390-c847-4eb9-8783-620ee1d3b1ae', 'volume_size': 1} Mar 12 20:59:18.465708 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a6df7f1c-6b51-4956-856a-e6a47ce94a94 tempest-AttachVolumeTestJSON-704258411 None] creating volume 'volume-95a67390-c847-4eb9-8783-620ee1d3b1ae' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 20:59:18.467176 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a6df7f1c-6b51-4956-856a-e6a47ce94a94 tempest-AttachVolumeTestJSON-704258411 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:59:18.550407 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a6df7f1c-6b51-4956-856a-e6a47ce94a94 tempest-AttachVolumeTestJSON-704258411 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 20:59:18.551188 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a6df7f1c-6b51-4956-856a-e6a47ce94a94 tempest-AttachVolumeTestJSON-704258411 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 20:59:18.557424 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a6df7f1c-6b51-4956-856a-e6a47ce94a94 tempest-AttachVolumeTestJSON-704258411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c105077-9b3f-4441-b242-4ee41b0bd07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95a67390-c847-4eb9-8783-620ee1d3b1ae', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:59:18.565699 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a6df7f1c-6b51-4956-856a-e6a47ce94a94 tempest-AttachVolumeTestJSON-704258411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc82f86d-a608-43c6-b350-11300e43c58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:59:18.579218 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-a6df7f1c-6b51-4956-856a-e6a47ce94a94 tempest-AttachVolumeTestJSON-704258411 None] Volume volume-95a67390-c847-4eb9-8783-620ee1d3b1ae (95a67390-c847-4eb9-8783-620ee1d3b1ae): created successfully Mar 12 20:59:18.585932 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a6df7f1c-6b51-4956-856a-e6a47ce94a94 tempest-AttachVolumeTestJSON-704258411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc82f86d-a608-43c6-b350-11300e43c58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:59:18.595685 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a6df7f1c-6b51-4956-856a-e6a47ce94a94 tempest-AttachVolumeTestJSON-704258411 None] Flow 'volume_create_manager' (6411bc58-d8c7-494a-a294-536dcf46bca8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 20:59:18.609733 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-a6df7f1c-6b51-4956-856a-e6a47ce94a94 tempest-AttachVolumeTestJSON-704258411 None] Created volume successfully. Mar 12 20:59:21.102497 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-65b81053-bce0-479b-ae2b-718218b638a5 req-6b62bf58-56ba-440f-aa3a-f178e1102f7b tempest-AttachVolumeTestJSON-704258411 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 20:59:22.137128 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-65b81053-bce0-479b-ae2b-718218b638a5 req-6b62bf58-56ba-440f-aa3a-f178e1102f7b tempest-AttachVolumeTestJSON-704258411 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.035s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 20:59:22.137985 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-65b81053-bce0-479b-ae2b-718218b638a5 req-6b62bf58-56ba-440f-aa3a-f178e1102f7b tempest-AttachVolumeTestJSON-704258411 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-95a67390-c847-4eb9-8783-620ee1d3b1ae', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': '95a67390-c847-4eb9-8783-620ee1d3b1ae', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 20:59:22.165251 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-65b81053-bce0-479b-ae2b-718218b638a5 req-6b62bf58-56ba-440f-aa3a-f178e1102f7b tempest-AttachVolumeTestJSON-704258411 None] Connection info returned from driver {'name': 'volumes/volume-95a67390-c847-4eb9-8783-620ee1d3b1ae', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '95a67390-c847-4eb9-8783-620ee1d3b1ae', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4954b9ed-bc57-472e-bf35-8b19fd61064e'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 20:59:22.231609 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-65b81053-bce0-479b-ae2b-718218b638a5 req-6b62bf58-56ba-440f-aa3a-f178e1102f7b tempest-AttachVolumeTestJSON-704258411 None] attachment_update completed successfully. Mar 12 20:59:25.304298 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [req-7ae216a0-fd39-451e-8de4-942459ba243a req-765f443d-da5f-4393-96d2-a605b1d9fc5b tempest-VolumesSnapshotsTestJSON-2093236484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 20:59:25.319729 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [req-7ae216a0-fd39-451e-8de4-942459ba243a req-765f443d-da5f-4393-96d2-a605b1d9fc5b tempest-VolumesSnapshotsTestJSON-2093236484 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 20:59:25.320547 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [req-7ae216a0-fd39-451e-8de4-942459ba243a req-765f443d-da5f-4393-96d2-a605b1d9fc5b tempest-VolumesSnapshotsTestJSON-2093236484 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 20:59:25.363788 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-7ae216a0-fd39-451e-8de4-942459ba243a req-765f443d-da5f-4393-96d2-a605b1d9fc5b tempest-VolumesSnapshotsTestJSON-2093236484 None] Flow 'volume_create_manager' (14e7f86d-1f84-4c60-9ca6-bf7b4b07f114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 20:59:25.376483 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-7ae216a0-fd39-451e-8de4-942459ba243a req-765f443d-da5f-4393-96d2-a605b1d9fc5b tempest-VolumesSnapshotsTestJSON-2093236484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a53bb347-850f-4c74-b004-888400f747f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:59:25.385882 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [req-7ae216a0-fd39-451e-8de4-942459ba243a req-765f443d-da5f-4393-96d2-a605b1d9fc5b tempest-VolumesSnapshotsTestJSON-2093236484 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 20:59:25.405853 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-7ae216a0-fd39-451e-8de4-942459ba243a req-765f443d-da5f-4393-96d2-a605b1d9fc5b tempest-VolumesSnapshotsTestJSON-2093236484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a53bb347-850f-4c74-b004-888400f747f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T20:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1915648721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4ab8a844-ffba-4215-bb18-002b14927dd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce90097b732a4a25bc33a39cba4d70ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T20:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T20:59:25Z,use_quota=True,user_id='1ac4300f9f8949e98814f3ff676915ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:59:25.414910 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-7ae216a0-fd39-451e-8de4-942459ba243a req-765f443d-da5f-4393-96d2-a605b1d9fc5b tempest-VolumesSnapshotsTestJSON-2093236484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58ac52a6-54a0-4d39-baf0-239568d961a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:59:25.422233 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-7ae216a0-fd39-451e-8de4-942459ba243a req-765f443d-da5f-4393-96d2-a605b1d9fc5b tempest-VolumesSnapshotsTestJSON-2093236484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58ac52a6-54a0-4d39-baf0-239568d961a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:59:25.428075 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-7ae216a0-fd39-451e-8de4-942459ba243a req-765f443d-da5f-4393-96d2-a605b1d9fc5b tempest-VolumesSnapshotsTestJSON-2093236484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20fd9e9b-ddbd-4879-8f1a-bbc2f79f3704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:59:25.433399 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-7ae216a0-fd39-451e-8de4-942459ba243a req-765f443d-da5f-4393-96d2-a605b1d9fc5b tempest-VolumesSnapshotsTestJSON-2093236484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20fd9e9b-ddbd-4879-8f1a-bbc2f79f3704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ab8a844-ffba-4215-bb18-002b14927dd6', 'volume_name': 'volume-4ab8a844-ffba-4215-bb18-002b14927dd6', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:59:25.441257 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-7ae216a0-fd39-451e-8de4-942459ba243a req-765f443d-da5f-4393-96d2-a605b1d9fc5b tempest-VolumesSnapshotsTestJSON-2093236484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86952c3d-c815-4ace-84e2-b97d43db8fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:59:25.448023 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-7ae216a0-fd39-451e-8de4-942459ba243a req-765f443d-da5f-4393-96d2-a605b1d9fc5b tempest-VolumesSnapshotsTestJSON-2093236484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86952c3d-c815-4ace-84e2-b97d43db8fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:59:25.456610 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-7ae216a0-fd39-451e-8de4-942459ba243a req-765f443d-da5f-4393-96d2-a605b1d9fc5b tempest-VolumesSnapshotsTestJSON-2093236484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ed7973-e067-4b06-a36e-3940851a9593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:59:25.458558 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [req-7ae216a0-fd39-451e-8de4-942459ba243a req-765f443d-da5f-4393-96d2-a605b1d9fc5b tempest-VolumesSnapshotsTestJSON-2093236484 None] Volume 4ab8a844-ffba-4215-bb18-002b14927dd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ab8a844-ffba-4215-bb18-002b14927dd6', 'volume_size': 1} Mar 12 20:59:25.458970 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-7ae216a0-fd39-451e-8de4-942459ba243a req-765f443d-da5f-4393-96d2-a605b1d9fc5b tempest-VolumesSnapshotsTestJSON-2093236484 None] creating volume 'volume-4ab8a844-ffba-4215-bb18-002b14927dd6' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 20:59:25.460212 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-7ae216a0-fd39-451e-8de4-942459ba243a req-765f443d-da5f-4393-96d2-a605b1d9fc5b tempest-VolumesSnapshotsTestJSON-2093236484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:59:25.570496 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-7ae216a0-fd39-451e-8de4-942459ba243a req-765f443d-da5f-4393-96d2-a605b1d9fc5b tempest-VolumesSnapshotsTestJSON-2093236484 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 20:59:25.571293 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-7ae216a0-fd39-451e-8de4-942459ba243a req-765f443d-da5f-4393-96d2-a605b1d9fc5b tempest-VolumesSnapshotsTestJSON-2093236484 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 20:59:25.578837 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-7ae216a0-fd39-451e-8de4-942459ba243a req-765f443d-da5f-4393-96d2-a605b1d9fc5b tempest-VolumesSnapshotsTestJSON-2093236484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ed7973-e067-4b06-a36e-3940851a9593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ab8a844-ffba-4215-bb18-002b14927dd6', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:59:25.589985 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-7ae216a0-fd39-451e-8de4-942459ba243a req-765f443d-da5f-4393-96d2-a605b1d9fc5b tempest-VolumesSnapshotsTestJSON-2093236484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a131094b-aa29-498b-8087-c3449408f3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 20:59:25.603011 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [req-7ae216a0-fd39-451e-8de4-942459ba243a req-765f443d-da5f-4393-96d2-a605b1d9fc5b tempest-VolumesSnapshotsTestJSON-2093236484 None] Volume volume-4ab8a844-ffba-4215-bb18-002b14927dd6 (4ab8a844-ffba-4215-bb18-002b14927dd6): created successfully Mar 12 20:59:25.610326 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-7ae216a0-fd39-451e-8de4-942459ba243a req-765f443d-da5f-4393-96d2-a605b1d9fc5b tempest-VolumesSnapshotsTestJSON-2093236484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a131094b-aa29-498b-8087-c3449408f3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 20:59:25.632398 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-7ae216a0-fd39-451e-8de4-942459ba243a req-765f443d-da5f-4393-96d2-a605b1d9fc5b tempest-VolumesSnapshotsTestJSON-2093236484 None] Flow 'volume_create_manager' (14e7f86d-1f84-4c60-9ca6-bf7b4b07f114) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 20:59:25.655394 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-7ae216a0-fd39-451e-8de4-942459ba243a req-765f443d-da5f-4393-96d2-a605b1d9fc5b tempest-VolumesSnapshotsTestJSON-2093236484 None] Created volume successfully. Mar 12 20:59:27.356380 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-a5f2c12f-9632-4afd-8dee-001cc0d49820 req-e297f409-6e97-47e5-b8f3-3dd9ff9cccd3 tempest-VolumesSnapshotsTestJSON-2093236484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:59:27.728216 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-a5f2c12f-9632-4afd-8dee-001cc0d49820 req-e297f409-6e97-47e5-b8f3-3dd9ff9cccd3 tempest-VolumesSnapshotsTestJSON-2093236484 None] Create snapshot completed successfully Mar 12 20:59:29.596796 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [req-6bc20bb4-fe8a-451b-8498-d95de8210a47 req-46ec5655-6398-4de7-8874-90601e1ecdfd tempest-VolumesSnapshotsTestJSON-2093236484 None] Lock "b'cinder-5947feaa-49fb-417e-9482-6b71436149c3-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 20:59:29.598262 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-6bc20bb4-fe8a-451b-8498-d95de8210a47 req-46ec5655-6398-4de7-8874-90601e1ecdfd tempest-VolumesSnapshotsTestJSON-2093236484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:59:30.766716 ncdv-master-1 cinder-volume[129531]: WARNING cinder.quota [req-6bc20bb4-fe8a-451b-8498-d95de8210a47 req-46ec5655-6398-4de7-8874-90601e1ecdfd tempest-VolumesSnapshotsTestJSON-2093236484 None] Deprecated: Default quota for resource: snapshots_ceph is set by the default quota flag: quota_snapshots_ceph, it is now deprecated. Please use the default quota class for default quota. Mar 12 20:59:30.795094 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [req-6bc20bb4-fe8a-451b-8498-d95de8210a47 req-46ec5655-6398-4de7-8874-90601e1ecdfd tempest-VolumesSnapshotsTestJSON-2093236484 None] Created reservations ['6a35dad2-8550-4be0-b690-a5430d439f0e', 'a10d78aa-b6f4-4777-a12b-d07b3bf536bc', '07ea5e14-9446-4850-b4d9-c74c62b4304a', '349b6260-06e3-42e3-a2cc-cad0e0e9ea41'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 20:59:30.870539 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-6bc20bb4-fe8a-451b-8498-d95de8210a47 req-46ec5655-6398-4de7-8874-90601e1ecdfd tempest-VolumesSnapshotsTestJSON-2093236484 None] Delete snapshot completed successfully. Mar 12 20:59:30.877890 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [req-6bc20bb4-fe8a-451b-8498-d95de8210a47 req-46ec5655-6398-4de7-8874-90601e1ecdfd tempest-VolumesSnapshotsTestJSON-2093236484 None] Lock "b'cinder-5947feaa-49fb-417e-9482-6b71436149c3-delete_snapshot'" released by "delete_snapshot" :: held 1.281s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 20:59:31.726176 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [req-f600522c-af14-4d5c-b778-d85b5ef09b9d req-31ef47b4-5f18-449c-bed8-45323e051089 tempest-VolumesSnapshotsTestJSON-2093236484 None] Lock "b'cinder-4ab8a844-ffba-4215-bb18-002b14927dd6-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 20:59:31.781970 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-f600522c-af14-4d5c-b778-d85b5ef09b9d req-31ef47b4-5f18-449c-bed8-45323e051089 tempest-VolumesSnapshotsTestJSON-2093236484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:59:31.867604 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-f600522c-af14-4d5c-b778-d85b5ef09b9d req-31ef47b4-5f18-449c-bed8-45323e051089 tempest-VolumesSnapshotsTestJSON-2093236484 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 20:59:31.868062 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-f600522c-af14-4d5c-b778-d85b5ef09b9d req-31ef47b4-5f18-449c-bed8-45323e051089 tempest-VolumesSnapshotsTestJSON-2093236484 None] Volume volume-4ab8a844-ffba-4215-bb18-002b14927dd6 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 20:59:31.881276 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-f600522c-af14-4d5c-b778-d85b5ef09b9d req-31ef47b4-5f18-449c-bed8-45323e051089 tempest-VolumesSnapshotsTestJSON-2093236484 None] deleting rbd volume volume-4ab8a844-ffba-4215-bb18-002b14927dd6 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 20:59:32.345318 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [req-f600522c-af14-4d5c-b778-d85b5ef09b9d req-31ef47b4-5f18-449c-bed8-45323e051089 tempest-VolumesSnapshotsTestJSON-2093236484 None] Created reservations ['6578c6e9-a7b7-43f5-a4f3-2daaa44f1794', '2fa5d38f-e4a3-4da6-bd19-02ab7262d498', '58c01934-c8bf-4d4a-94d3-18ade542c143', '2fa153c0-36ea-4904-a79a-e74b70f0563e'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 20:59:32.426635 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-f600522c-af14-4d5c-b778-d85b5ef09b9d req-31ef47b4-5f18-449c-bed8-45323e051089 tempest-VolumesSnapshotsTestJSON-2093236484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:59:32.479734 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-f600522c-af14-4d5c-b778-d85b5ef09b9d req-31ef47b4-5f18-449c-bed8-45323e051089 tempest-VolumesSnapshotsTestJSON-2093236484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:59:32.564476 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [req-f600522c-af14-4d5c-b778-d85b5ef09b9d req-31ef47b4-5f18-449c-bed8-45323e051089 tempest-VolumesSnapshotsTestJSON-2093236484 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 20:59:32.569716 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-f600522c-af14-4d5c-b778-d85b5ef09b9d req-31ef47b4-5f18-449c-bed8-45323e051089 tempest-VolumesSnapshotsTestJSON-2093236484 None] Deleted volume successfully. Mar 12 20:59:32.590524 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [req-f600522c-af14-4d5c-b778-d85b5ef09b9d req-31ef47b4-5f18-449c-bed8-45323e051089 tempest-VolumesSnapshotsTestJSON-2093236484 None] Lock "b'cinder-4ab8a844-ffba-4215-bb18-002b14927dd6-delete_volume'" released by "delete_volume" :: held 0.865s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 20:59:51.135136 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 20:59:51.138217 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:59:51.245196 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 20:59:51.312831 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:00:04.234849 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-e824b30a-2bd8-4451-897f-199097a51f9b tempest-ServerRescueNegativeTestJSON-1387184555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:00:04.255717 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-e824b30a-2bd8-4451-897f-199097a51f9b tempest-ServerRescueNegativeTestJSON-1387184555 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:00:04.260993 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-e824b30a-2bd8-4451-897f-199097a51f9b tempest-ServerRescueNegativeTestJSON-1387184555 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:00:04.296246 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e824b30a-2bd8-4451-897f-199097a51f9b tempest-ServerRescueNegativeTestJSON-1387184555 None] Flow 'volume_create_manager' (0354966f-27b2-40c3-82cd-1eb74cd657e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:00:04.306922 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e824b30a-2bd8-4451-897f-199097a51f9b tempest-ServerRescueNegativeTestJSON-1387184555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1741a3f8-3b40-44cd-b993-fc8d8ea29f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:00:04.315442 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-e824b30a-2bd8-4451-897f-199097a51f9b tempest-ServerRescueNegativeTestJSON-1387184555 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:00:04.333226 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e824b30a-2bd8-4451-897f-199097a51f9b tempest-ServerRescueNegativeTestJSON-1387184555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1741a3f8-3b40-44cd-b993-fc8d8ea29f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-167090360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b2b4ff35-6d46-4d5b-896a-625a1abdc7b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3570c0185b7b4af9954a67a763797f37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:00:04Z,use_quota=True,user_id='21f6deda19914710bccc01abf47935f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:00:04.345002 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e824b30a-2bd8-4451-897f-199097a51f9b tempest-ServerRescueNegativeTestJSON-1387184555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e6273cc-4efd-4c08-833d-4b854d4e7173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:00:04.353207 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e824b30a-2bd8-4451-897f-199097a51f9b tempest-ServerRescueNegativeTestJSON-1387184555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e6273cc-4efd-4c08-833d-4b854d4e7173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:00:04.358786 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e824b30a-2bd8-4451-897f-199097a51f9b tempest-ServerRescueNegativeTestJSON-1387184555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e184260-8159-4454-8b58-f11e60dfb7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:00:04.363306 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e824b30a-2bd8-4451-897f-199097a51f9b tempest-ServerRescueNegativeTestJSON-1387184555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e184260-8159-4454-8b58-f11e60dfb7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2b4ff35-6d46-4d5b-896a-625a1abdc7b1', 'volume_name': 'volume-b2b4ff35-6d46-4d5b-896a-625a1abdc7b1', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:00:04.369634 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e824b30a-2bd8-4451-897f-199097a51f9b tempest-ServerRescueNegativeTestJSON-1387184555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f9d6b53-3243-4ff1-817a-db463bb90bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:00:04.374433 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e824b30a-2bd8-4451-897f-199097a51f9b tempest-ServerRescueNegativeTestJSON-1387184555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f9d6b53-3243-4ff1-817a-db463bb90bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:00:04.380045 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e824b30a-2bd8-4451-897f-199097a51f9b tempest-ServerRescueNegativeTestJSON-1387184555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bad1acc-671c-48bc-9f55-e0c8b2ab7498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:00:04.382860 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-e824b30a-2bd8-4451-897f-199097a51f9b tempest-ServerRescueNegativeTestJSON-1387184555 None] Volume b2b4ff35-6d46-4d5b-896a-625a1abdc7b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2b4ff35-6d46-4d5b-896a-625a1abdc7b1', 'volume_size': 1} Mar 12 21:00:04.383274 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-e824b30a-2bd8-4451-897f-199097a51f9b tempest-ServerRescueNegativeTestJSON-1387184555 None] creating volume 'volume-b2b4ff35-6d46-4d5b-896a-625a1abdc7b1' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:00:04.384798 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-e824b30a-2bd8-4451-897f-199097a51f9b tempest-ServerRescueNegativeTestJSON-1387184555 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:00:04.502281 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-e824b30a-2bd8-4451-897f-199097a51f9b tempest-ServerRescueNegativeTestJSON-1387184555 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:00:04.503151 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-e824b30a-2bd8-4451-897f-199097a51f9b tempest-ServerRescueNegativeTestJSON-1387184555 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:00:04.509124 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e824b30a-2bd8-4451-897f-199097a51f9b tempest-ServerRescueNegativeTestJSON-1387184555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bad1acc-671c-48bc-9f55-e0c8b2ab7498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2b4ff35-6d46-4d5b-896a-625a1abdc7b1', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:00:04.517513 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e824b30a-2bd8-4451-897f-199097a51f9b tempest-ServerRescueNegativeTestJSON-1387184555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dae93918-4b88-429b-b4b5-f831a8c08760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:00:04.529045 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-e824b30a-2bd8-4451-897f-199097a51f9b tempest-ServerRescueNegativeTestJSON-1387184555 None] Volume volume-b2b4ff35-6d46-4d5b-896a-625a1abdc7b1 (b2b4ff35-6d46-4d5b-896a-625a1abdc7b1): created successfully Mar 12 21:00:04.546510 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e824b30a-2bd8-4451-897f-199097a51f9b tempest-ServerRescueNegativeTestJSON-1387184555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dae93918-4b88-429b-b4b5-f831a8c08760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:00:04.561068 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e824b30a-2bd8-4451-897f-199097a51f9b tempest-ServerRescueNegativeTestJSON-1387184555 None] Flow 'volume_create_manager' (0354966f-27b2-40c3-82cd-1eb74cd657e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:00:04.588865 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-e824b30a-2bd8-4451-897f-199097a51f9b tempest-ServerRescueNegativeTestJSON-1387184555 None] Created volume successfully. Mar 12 21:00:29.112064 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d12489b-9d42-4f07-b960-52b25cb00bbc tempest-ServerRescueNegativeTestJSON-1387184555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:00:29.125702 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-9d12489b-9d42-4f07-b960-52b25cb00bbc tempest-ServerRescueNegativeTestJSON-1387184555 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:00:29.126306 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-9d12489b-9d42-4f07-b960-52b25cb00bbc tempest-ServerRescueNegativeTestJSON-1387184555 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:00:29.190624 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9d12489b-9d42-4f07-b960-52b25cb00bbc tempest-ServerRescueNegativeTestJSON-1387184555 None] Flow 'volume_create_manager' (7c96d7a4-9e7d-4048-a6b4-9f5968cdf0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:00:29.198423 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9d12489b-9d42-4f07-b960-52b25cb00bbc tempest-ServerRescueNegativeTestJSON-1387184555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75b8cf8-034b-4a9a-928a-2af57716ee29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:00:29.215146 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-9d12489b-9d42-4f07-b960-52b25cb00bbc tempest-ServerRescueNegativeTestJSON-1387184555 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:00:29.235917 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9d12489b-9d42-4f07-b960-52b25cb00bbc tempest-ServerRescueNegativeTestJSON-1387184555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75b8cf8-034b-4a9a-928a-2af57716ee29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-22975490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fd57576e-68d3-4a4b-af68-9b423f85de28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3570c0185b7b4af9954a67a763797f37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:00:29Z,use_quota=True,user_id='21f6deda19914710bccc01abf47935f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:00:29.243150 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9d12489b-9d42-4f07-b960-52b25cb00bbc tempest-ServerRescueNegativeTestJSON-1387184555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a88d5441-95da-42b5-9999-a6149cde59d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:00:29.248876 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9d12489b-9d42-4f07-b960-52b25cb00bbc tempest-ServerRescueNegativeTestJSON-1387184555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a88d5441-95da-42b5-9999-a6149cde59d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:00:29.256286 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9d12489b-9d42-4f07-b960-52b25cb00bbc tempest-ServerRescueNegativeTestJSON-1387184555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd36c7a4-bec6-4cd7-8144-93e5eac5f3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:00:29.261409 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9d12489b-9d42-4f07-b960-52b25cb00bbc tempest-ServerRescueNegativeTestJSON-1387184555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd36c7a4-bec6-4cd7-8144-93e5eac5f3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd57576e-68d3-4a4b-af68-9b423f85de28', 'volume_name': 'volume-fd57576e-68d3-4a4b-af68-9b423f85de28', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:00:29.267218 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9d12489b-9d42-4f07-b960-52b25cb00bbc tempest-ServerRescueNegativeTestJSON-1387184555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edb44cd1-906a-40a4-b74a-68e8af80c4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:00:29.271752 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9d12489b-9d42-4f07-b960-52b25cb00bbc tempest-ServerRescueNegativeTestJSON-1387184555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edb44cd1-906a-40a4-b74a-68e8af80c4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:00:29.278761 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9d12489b-9d42-4f07-b960-52b25cb00bbc tempest-ServerRescueNegativeTestJSON-1387184555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9e9301d-bc99-4fd3-a453-3368ca2332d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:00:29.281658 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-9d12489b-9d42-4f07-b960-52b25cb00bbc tempest-ServerRescueNegativeTestJSON-1387184555 None] Volume fd57576e-68d3-4a4b-af68-9b423f85de28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd57576e-68d3-4a4b-af68-9b423f85de28', 'volume_size': 1} Mar 12 21:00:29.282272 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9d12489b-9d42-4f07-b960-52b25cb00bbc tempest-ServerRescueNegativeTestJSON-1387184555 None] creating volume 'volume-fd57576e-68d3-4a4b-af68-9b423f85de28' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:00:29.283475 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9d12489b-9d42-4f07-b960-52b25cb00bbc tempest-ServerRescueNegativeTestJSON-1387184555 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:00:29.412531 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9d12489b-9d42-4f07-b960-52b25cb00bbc tempest-ServerRescueNegativeTestJSON-1387184555 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:00:29.413035 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9d12489b-9d42-4f07-b960-52b25cb00bbc tempest-ServerRescueNegativeTestJSON-1387184555 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:00:29.417079 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9d12489b-9d42-4f07-b960-52b25cb00bbc tempest-ServerRescueNegativeTestJSON-1387184555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9e9301d-bc99-4fd3-a453-3368ca2332d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd57576e-68d3-4a4b-af68-9b423f85de28', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:00:29.421958 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9d12489b-9d42-4f07-b960-52b25cb00bbc tempest-ServerRescueNegativeTestJSON-1387184555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (669ef7e8-90b5-4da0-b93f-ad38c9788632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:00:29.454073 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-9d12489b-9d42-4f07-b960-52b25cb00bbc tempest-ServerRescueNegativeTestJSON-1387184555 None] Volume volume-fd57576e-68d3-4a4b-af68-9b423f85de28 (fd57576e-68d3-4a4b-af68-9b423f85de28): created successfully Mar 12 21:00:29.458154 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9d12489b-9d42-4f07-b960-52b25cb00bbc tempest-ServerRescueNegativeTestJSON-1387184555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (669ef7e8-90b5-4da0-b93f-ad38c9788632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:00:29.463946 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9d12489b-9d42-4f07-b960-52b25cb00bbc tempest-ServerRescueNegativeTestJSON-1387184555 None] Flow 'volume_create_manager' (7c96d7a4-9e7d-4048-a6b4-9f5968cdf0e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:00:29.483930 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-9d12489b-9d42-4f07-b960-52b25cb00bbc tempest-ServerRescueNegativeTestJSON-1387184555 None] Created volume successfully. Mar 12 21:00:31.743869 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-3ac5d0d0-a486-4b3f-ad09-7385c4a3a301 req-7fa005c5-5b2b-4980-816d-15f80e384cd4 tempest-ServerRescueNegativeTestJSON-1387184555 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 21:00:33.060723 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-3ac5d0d0-a486-4b3f-ad09-7385c4a3a301 req-7fa005c5-5b2b-4980-816d-15f80e384cd4 tempest-ServerRescueNegativeTestJSON-1387184555 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.316s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 21:00:33.062595 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-3ac5d0d0-a486-4b3f-ad09-7385c4a3a301 req-7fa005c5-5b2b-4980-816d-15f80e384cd4 tempest-ServerRescueNegativeTestJSON-1387184555 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-fd57576e-68d3-4a4b-af68-9b423f85de28', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': 'fd57576e-68d3-4a4b-af68-9b423f85de28', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 21:00:33.115405 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-3ac5d0d0-a486-4b3f-ad09-7385c4a3a301 req-7fa005c5-5b2b-4980-816d-15f80e384cd4 tempest-ServerRescueNegativeTestJSON-1387184555 None] Connection info returned from driver {'name': 'volumes/volume-fd57576e-68d3-4a4b-af68-9b423f85de28', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'fd57576e-68d3-4a4b-af68-9b423f85de28', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f39432cb-2634-40fd-8db3-77bce9cdca38'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 21:00:33.236147 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-3ac5d0d0-a486-4b3f-ad09-7385c4a3a301 req-7fa005c5-5b2b-4980-816d-15f80e384cd4 tempest-ServerRescueNegativeTestJSON-1387184555 None] attachment_update completed successfully. Mar 12 21:00:33.929044 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-e761e173-17bd-46bf-ab29-aa89ea2b8f5c req-fb929a68-2417-4512-9974-57d40831a8d9 tempest-AttachVolumeTestJSON-704258411 None] Terminate volume connection completed successfully. Mar 12 21:00:33.931762 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-e761e173-17bd-46bf-ab29-aa89ea2b8f5c req-fb929a68-2417-4512-9974-57d40831a8d9 tempest-AttachVolumeTestJSON-704258411 None] Deleting attachment 4954b9ed-bc57-472e-bf35-8b19fd61064e. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 21:00:51.139490 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:00:51.140575 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:00:51.275906 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:00:51.384395 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:01:02.215648 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-18c122c6-b05f-4773-bdfd-bf3f4849d10b req-f86da561-9bb8-444c-95c2-92b09b1c215f tempest-TaggedBootDevicesTest_v242-514267230 None] Terminate volume connection completed successfully. Mar 12 21:01:02.216311 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-18c122c6-b05f-4773-bdfd-bf3f4849d10b req-f86da561-9bb8-444c-95c2-92b09b1c215f tempest-TaggedBootDevicesTest_v242-514267230 None] Deleting attachment e71b0fa7-7493-4d2e-8dcf-41bbff6d151d. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 21:01:02.365426 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-18c122c6-b05f-4773-bdfd-bf3f4849d10b req-2af7af86-c6fc-488d-8bdd-de5c9d2cb795 tempest-TaggedBootDevicesTest_v242-514267230 None] Terminate volume connection completed successfully. Mar 12 21:01:02.366264 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-18c122c6-b05f-4773-bdfd-bf3f4849d10b req-2af7af86-c6fc-488d-8bdd-de5c9d2cb795 tempest-TaggedBootDevicesTest_v242-514267230 None] Deleting attachment 8f991ecd-5b59-4cd4-9bff-98e364c5a2b5. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 21:01:02.523941 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-18c122c6-b05f-4773-bdfd-bf3f4849d10b req-d5b8b9c0-cfaa-40dc-8516-b115ce818a87 tempest-TaggedBootDevicesTest_v242-514267230 None] Terminate volume connection completed successfully. Mar 12 21:01:02.524823 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-18c122c6-b05f-4773-bdfd-bf3f4849d10b req-d5b8b9c0-cfaa-40dc-8516-b115ce818a87 tempest-TaggedBootDevicesTest_v242-514267230 None] Deleting attachment 339ac0f1-644b-4e09-a05c-25c4cbaa011c. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 21:01:15.070919 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-6860666c-1f88-4677-80cc-fbf67377c6fe tempest-TaggedBootDevicesTest_v242-514267230 None] Lock "b'cinder-e8c35abf-0b4f-4a90-bee3-81247d77c9d6-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:01:15.175243 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-6860666c-1f88-4677-80cc-fbf67377c6fe tempest-TaggedBootDevicesTest_v242-514267230 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:01:15.277594 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-6860666c-1f88-4677-80cc-fbf67377c6fe tempest-TaggedBootDevicesTest_v242-514267230 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:01:15.278306 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-6860666c-1f88-4677-80cc-fbf67377c6fe tempest-TaggedBootDevicesTest_v242-514267230 None] Volume volume-e8c35abf-0b4f-4a90-bee3-81247d77c9d6 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:01:15.289936 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-6860666c-1f88-4677-80cc-fbf67377c6fe tempest-TaggedBootDevicesTest_v242-514267230 None] deleting rbd volume volume-e8c35abf-0b4f-4a90-bee3-81247d77c9d6 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:01:16.131306 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-6860666c-1f88-4677-80cc-fbf67377c6fe tempest-TaggedBootDevicesTest_v242-514267230 None] Created reservations ['9ec2a3c9-883a-471f-89f4-c59074e25484', 'a466a379-38f3-43b8-9480-efd914cf1370', '81bf53da-d745-4a8d-8bbe-5fdaa1a8f018', '572a3be7-bbdb-4f2e-bcf7-610901210a4d'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:01:16.298391 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-6860666c-1f88-4677-80cc-fbf67377c6fe tempest-TaggedBootDevicesTest_v242-514267230 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:01:16.381663 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-6860666c-1f88-4677-80cc-fbf67377c6fe tempest-TaggedBootDevicesTest_v242-514267230 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:01:16.468873 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-6860666c-1f88-4677-80cc-fbf67377c6fe tempest-TaggedBootDevicesTest_v242-514267230 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:01:16.476184 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-6860666c-1f88-4677-80cc-fbf67377c6fe tempest-TaggedBootDevicesTest_v242-514267230 None] Deleted volume successfully. Mar 12 21:01:16.509340 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-6860666c-1f88-4677-80cc-fbf67377c6fe tempest-TaggedBootDevicesTest_v242-514267230 None] Lock "b'cinder-e8c35abf-0b4f-4a90-bee3-81247d77c9d6-delete_volume'" released by "delete_volume" :: held 1.438s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:01:17.375114 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-dc9d3c0b-8e51-4e70-a0f3-40c1b639ab8b tempest-TaggedBootDevicesTest_v242-514267230 None] Lock "b'cinder-aa9089c6-1fb1-4cbd-a05a-f93ed5efcab8-delete_volume'" acquired by "delete_volume" :: waited 0.034s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:01:17.423479 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-dc9d3c0b-8e51-4e70-a0f3-40c1b639ab8b tempest-TaggedBootDevicesTest_v242-514267230 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:01:17.526543 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-dc9d3c0b-8e51-4e70-a0f3-40c1b639ab8b tempest-TaggedBootDevicesTest_v242-514267230 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:01:17.526976 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-dc9d3c0b-8e51-4e70-a0f3-40c1b639ab8b tempest-TaggedBootDevicesTest_v242-514267230 None] Volume volume-aa9089c6-1fb1-4cbd-a05a-f93ed5efcab8 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:01:17.539331 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-dc9d3c0b-8e51-4e70-a0f3-40c1b639ab8b tempest-TaggedBootDevicesTest_v242-514267230 None] deleting rbd volume volume-aa9089c6-1fb1-4cbd-a05a-f93ed5efcab8 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:01:18.119766 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-dc9d3c0b-8e51-4e70-a0f3-40c1b639ab8b tempest-TaggedBootDevicesTest_v242-514267230 None] Created reservations ['f39e871a-4669-47ae-9a0b-a63be43ed90c', 'e5ccc3e5-55e0-4142-86f6-d3f2f064dfbc', 'e8688085-1263-41bd-9722-f286031b180a', '4d5c0d6f-0043-45cd-a074-ad62cb8cf595'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:01:18.219322 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-dc9d3c0b-8e51-4e70-a0f3-40c1b639ab8b tempest-TaggedBootDevicesTest_v242-514267230 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:01:18.276302 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-dc9d3c0b-8e51-4e70-a0f3-40c1b639ab8b tempest-TaggedBootDevicesTest_v242-514267230 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:01:18.373502 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-dc9d3c0b-8e51-4e70-a0f3-40c1b639ab8b tempest-TaggedBootDevicesTest_v242-514267230 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:01:18.384808 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-dc9d3c0b-8e51-4e70-a0f3-40c1b639ab8b tempest-TaggedBootDevicesTest_v242-514267230 None] Deleted volume successfully. Mar 12 21:01:18.406939 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-dc9d3c0b-8e51-4e70-a0f3-40c1b639ab8b tempest-TaggedBootDevicesTest_v242-514267230 None] Lock "b'cinder-aa9089c6-1fb1-4cbd-a05a-f93ed5efcab8-delete_volume'" released by "delete_volume" :: held 1.032s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:01:18.676382 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-208905e2-7457-4996-afbb-38d78a50b22f tempest-TaggedBootDevicesTest_v242-514267230 None] Lock "b'cinder-6f1be946-45cc-48af-a0e2-eb5cba840969-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:01:18.781495 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-208905e2-7457-4996-afbb-38d78a50b22f tempest-TaggedBootDevicesTest_v242-514267230 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:01:18.898057 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-208905e2-7457-4996-afbb-38d78a50b22f tempest-TaggedBootDevicesTest_v242-514267230 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:01:18.928873 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-208905e2-7457-4996-afbb-38d78a50b22f tempest-TaggedBootDevicesTest_v242-514267230 None] deleting rbd volume volume-6f1be946-45cc-48af-a0e2-eb5cba840969 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:01:19.430970 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-208905e2-7457-4996-afbb-38d78a50b22f tempest-TaggedBootDevicesTest_v242-514267230 None] volume is a clone so cleaning references {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Mar 12 21:01:19.494771 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-208905e2-7457-4996-afbb-38d78a50b22f tempest-TaggedBootDevicesTest_v242-514267230 None] deleting parent snapshot volume-6f1be946-45cc-48af-a0e2-eb5cba840969.clone_snap {{(pid=129531) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Mar 12 21:01:20.628005 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-208905e2-7457-4996-afbb-38d78a50b22f tempest-TaggedBootDevicesTest_v242-514267230 None] Created reservations ['95757f83-f537-4102-8bfb-44ca698d0c52', '14a012c8-a4ff-4d06-9803-673b801d505b', '27125521-2222-4623-b2cf-74d67d527160', 'cd24a723-b225-40ce-8fda-c132aa52a320'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:01:20.765420 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-208905e2-7457-4996-afbb-38d78a50b22f tempest-TaggedBootDevicesTest_v242-514267230 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:01:20.847040 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-208905e2-7457-4996-afbb-38d78a50b22f tempest-TaggedBootDevicesTest_v242-514267230 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:01:20.951391 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-208905e2-7457-4996-afbb-38d78a50b22f tempest-TaggedBootDevicesTest_v242-514267230 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:01:20.959423 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-208905e2-7457-4996-afbb-38d78a50b22f tempest-TaggedBootDevicesTest_v242-514267230 None] Deleted volume successfully. Mar 12 21:01:20.980933 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-208905e2-7457-4996-afbb-38d78a50b22f tempest-TaggedBootDevicesTest_v242-514267230 None] Lock "b'cinder-6f1be946-45cc-48af-a0e2-eb5cba840969-delete_volume'" released by "delete_volume" :: held 2.304s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:01:32.352133 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-0500fa20-b9d9-4343-971b-b9b7cdbe31f0 req-e155e26e-262f-4212-9437-d021c74998d6 tempest-ServerRescueNegativeTestJSON-1387184555 None] Terminate volume connection completed successfully. Mar 12 21:01:32.352927 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-0500fa20-b9d9-4343-971b-b9b7cdbe31f0 req-e155e26e-262f-4212-9437-d021c74998d6 tempest-ServerRescueNegativeTestJSON-1387184555 None] Deleting attachment f39432cb-2634-40fd-8db3-77bce9cdca38. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 21:01:38.049548 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-71cbc3ea-1551-40ec-ab84-065fdecf7997 tempest-ServerRescueNegativeTestJSON-1387184555 None] Lock "b'cinder-fd57576e-68d3-4a4b-af68-9b423f85de28-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:01:38.150985 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-71cbc3ea-1551-40ec-ab84-065fdecf7997 tempest-ServerRescueNegativeTestJSON-1387184555 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:01:38.263321 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-71cbc3ea-1551-40ec-ab84-065fdecf7997 tempest-ServerRescueNegativeTestJSON-1387184555 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:01:38.264792 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-71cbc3ea-1551-40ec-ab84-065fdecf7997 tempest-ServerRescueNegativeTestJSON-1387184555 None] Volume volume-fd57576e-68d3-4a4b-af68-9b423f85de28 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:01:38.280531 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-71cbc3ea-1551-40ec-ab84-065fdecf7997 tempest-ServerRescueNegativeTestJSON-1387184555 None] deleting rbd volume volume-fd57576e-68d3-4a4b-af68-9b423f85de28 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:01:38.747818 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-71cbc3ea-1551-40ec-ab84-065fdecf7997 tempest-ServerRescueNegativeTestJSON-1387184555 None] Created reservations ['f1836070-2302-4419-942d-562ddc1581a8', '117ec56c-ec2c-4fc7-a875-d5aee043dd40', '1c1dcf99-746c-4174-b302-b61d9a22eeb7', '19462725-8038-441c-9cd3-09b8f09382ec'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:01:38.821857 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-71cbc3ea-1551-40ec-ab84-065fdecf7997 tempest-ServerRescueNegativeTestJSON-1387184555 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:01:38.873314 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-71cbc3ea-1551-40ec-ab84-065fdecf7997 tempest-ServerRescueNegativeTestJSON-1387184555 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:01:38.922826 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-71cbc3ea-1551-40ec-ab84-065fdecf7997 tempest-ServerRescueNegativeTestJSON-1387184555 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:01:38.928546 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-71cbc3ea-1551-40ec-ab84-065fdecf7997 tempest-ServerRescueNegativeTestJSON-1387184555 None] Deleted volume successfully. Mar 12 21:01:38.944528 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-71cbc3ea-1551-40ec-ab84-065fdecf7997 tempest-ServerRescueNegativeTestJSON-1387184555 None] Lock "b'cinder-fd57576e-68d3-4a4b-af68-9b423f85de28-delete_volume'" released by "delete_volume" :: held 0.895s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:01:39.294707 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-9955c6df-5744-47f2-8cba-c1506c19a8b3 tempest-ServerRescueNegativeTestJSON-1387184555 None] Lock "b'cinder-b2b4ff35-6d46-4d5b-896a-625a1abdc7b1-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:01:39.367133 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9955c6df-5744-47f2-8cba-c1506c19a8b3 tempest-ServerRescueNegativeTestJSON-1387184555 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:01:39.456791 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9955c6df-5744-47f2-8cba-c1506c19a8b3 tempest-ServerRescueNegativeTestJSON-1387184555 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:01:39.457220 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9955c6df-5744-47f2-8cba-c1506c19a8b3 tempest-ServerRescueNegativeTestJSON-1387184555 None] Volume volume-b2b4ff35-6d46-4d5b-896a-625a1abdc7b1 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:01:39.476932 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9955c6df-5744-47f2-8cba-c1506c19a8b3 tempest-ServerRescueNegativeTestJSON-1387184555 None] deleting rbd volume volume-b2b4ff35-6d46-4d5b-896a-625a1abdc7b1 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:01:39.968178 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-9955c6df-5744-47f2-8cba-c1506c19a8b3 tempest-ServerRescueNegativeTestJSON-1387184555 None] Created reservations ['61a1dcc4-dfe3-4425-b783-8ad1ce68a31e', '3856770d-7695-4dc6-86f9-33074a752893', 'dfba6f6c-1c4d-439d-9667-a1f7b2e6b593', '997ae9ec-9266-4367-937f-6208b9dece59'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:01:40.046113 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9955c6df-5744-47f2-8cba-c1506c19a8b3 tempest-ServerRescueNegativeTestJSON-1387184555 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:01:40.157649 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9955c6df-5744-47f2-8cba-c1506c19a8b3 tempest-ServerRescueNegativeTestJSON-1387184555 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:01:40.212812 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-9955c6df-5744-47f2-8cba-c1506c19a8b3 tempest-ServerRescueNegativeTestJSON-1387184555 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:01:40.217618 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-9955c6df-5744-47f2-8cba-c1506c19a8b3 tempest-ServerRescueNegativeTestJSON-1387184555 None] Deleted volume successfully. Mar 12 21:01:40.235213 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-9955c6df-5744-47f2-8cba-c1506c19a8b3 tempest-ServerRescueNegativeTestJSON-1387184555 None] Lock "b'cinder-b2b4ff35-6d46-4d5b-896a-625a1abdc7b1-delete_volume'" released by "delete_volume" :: held 0.940s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:01:51.142645 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:01:51.142645 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:01:51.236206 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:01:51.317955 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:02:51.143161 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:02:51.144601 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:02:51.229211 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:02:51.334374 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:03:22.097119 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-417bdd7b-b2c9-418c-88fb-a3994f07c4c6 tempest-AttachVolumeTestJSON-704258411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:03:22.109757 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-417bdd7b-b2c9-418c-88fb-a3994f07c4c6 tempest-AttachVolumeTestJSON-704258411 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:03:22.112442 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-417bdd7b-b2c9-418c-88fb-a3994f07c4c6 tempest-AttachVolumeTestJSON-704258411 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:03:22.173667 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-417bdd7b-b2c9-418c-88fb-a3994f07c4c6 tempest-AttachVolumeTestJSON-704258411 None] Flow 'volume_create_manager' (20b81950-fcd9-47c3-aaf0-6209f171f371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:03:22.198053 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-417bdd7b-b2c9-418c-88fb-a3994f07c4c6 tempest-AttachVolumeTestJSON-704258411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ff72e3-1b86-4c97-b9db-a33dba843393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:03:22.211875 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-417bdd7b-b2c9-418c-88fb-a3994f07c4c6 tempest-AttachVolumeTestJSON-704258411 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:03:22.255887 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-417bdd7b-b2c9-418c-88fb-a3994f07c4c6 tempest-AttachVolumeTestJSON-704258411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ff72e3-1b86-4c97-b9db-a33dba843393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1793859671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6f03d07d-1804-458a-9612-e9595afeb76a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4da7920d54243cd8381e283021d7745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:03:22Z,use_quota=True,user_id='ec384ea1fe344a08a8b9491f10f3b211',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:03:22.274767 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-417bdd7b-b2c9-418c-88fb-a3994f07c4c6 tempest-AttachVolumeTestJSON-704258411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc89018-185b-4523-ac75-86e2b1518a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:03:22.286830 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-417bdd7b-b2c9-418c-88fb-a3994f07c4c6 tempest-AttachVolumeTestJSON-704258411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc89018-185b-4523-ac75-86e2b1518a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:03:22.304399 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-417bdd7b-b2c9-418c-88fb-a3994f07c4c6 tempest-AttachVolumeTestJSON-704258411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (656f258a-34d1-4a45-974a-40015291e294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:03:22.314890 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-417bdd7b-b2c9-418c-88fb-a3994f07c4c6 tempest-AttachVolumeTestJSON-704258411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (656f258a-34d1-4a45-974a-40015291e294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f03d07d-1804-458a-9612-e9595afeb76a', 'volume_name': 'volume-6f03d07d-1804-458a-9612-e9595afeb76a', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:03:22.327400 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-417bdd7b-b2c9-418c-88fb-a3994f07c4c6 tempest-AttachVolumeTestJSON-704258411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f394ee-b753-4d40-ad2a-08f622880bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:03:22.341527 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-417bdd7b-b2c9-418c-88fb-a3994f07c4c6 tempest-AttachVolumeTestJSON-704258411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f394ee-b753-4d40-ad2a-08f622880bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:03:22.358695 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-417bdd7b-b2c9-418c-88fb-a3994f07c4c6 tempest-AttachVolumeTestJSON-704258411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7885503d-47ac-4107-adce-89e939a5aac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:03:22.363785 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-417bdd7b-b2c9-418c-88fb-a3994f07c4c6 tempest-AttachVolumeTestJSON-704258411 None] Volume 6f03d07d-1804-458a-9612-e9595afeb76a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f03d07d-1804-458a-9612-e9595afeb76a', 'volume_size': 1} Mar 12 21:03:22.364537 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-417bdd7b-b2c9-418c-88fb-a3994f07c4c6 tempest-AttachVolumeTestJSON-704258411 None] creating volume 'volume-6f03d07d-1804-458a-9612-e9595afeb76a' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:03:22.369505 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-417bdd7b-b2c9-418c-88fb-a3994f07c4c6 tempest-AttachVolumeTestJSON-704258411 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:03:22.534559 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-417bdd7b-b2c9-418c-88fb-a3994f07c4c6 tempest-AttachVolumeTestJSON-704258411 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:03:22.535429 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-417bdd7b-b2c9-418c-88fb-a3994f07c4c6 tempest-AttachVolumeTestJSON-704258411 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:03:22.541047 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-417bdd7b-b2c9-418c-88fb-a3994f07c4c6 tempest-AttachVolumeTestJSON-704258411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7885503d-47ac-4107-adce-89e939a5aac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f03d07d-1804-458a-9612-e9595afeb76a', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:03:22.554048 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-417bdd7b-b2c9-418c-88fb-a3994f07c4c6 tempest-AttachVolumeTestJSON-704258411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a154c315-3bfd-43f8-b5e6-e19778a19346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:03:22.577366 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-417bdd7b-b2c9-418c-88fb-a3994f07c4c6 tempest-AttachVolumeTestJSON-704258411 None] Volume volume-6f03d07d-1804-458a-9612-e9595afeb76a (6f03d07d-1804-458a-9612-e9595afeb76a): created successfully Mar 12 21:03:22.593348 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-417bdd7b-b2c9-418c-88fb-a3994f07c4c6 tempest-AttachVolumeTestJSON-704258411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a154c315-3bfd-43f8-b5e6-e19778a19346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:03:22.610342 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-417bdd7b-b2c9-418c-88fb-a3994f07c4c6 tempest-AttachVolumeTestJSON-704258411 None] Flow 'volume_create_manager' (20b81950-fcd9-47c3-aaf0-6209f171f371) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:03:22.621467 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-417bdd7b-b2c9-418c-88fb-a3994f07c4c6 tempest-AttachVolumeTestJSON-704258411 None] Created volume successfully. Mar 12 21:03:24.901138 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-f148f9cb-74d2-405f-a8f2-99ae5f104054 req-1a153e44-4c04-4467-9f73-4e0e0ae1c276 tempest-AttachVolumeTestJSON-704258411 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 21:03:26.063686 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-f148f9cb-74d2-405f-a8f2-99ae5f104054 req-1a153e44-4c04-4467-9f73-4e0e0ae1c276 tempest-AttachVolumeTestJSON-704258411 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.162s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 21:03:26.064515 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-f148f9cb-74d2-405f-a8f2-99ae5f104054 req-1a153e44-4c04-4467-9f73-4e0e0ae1c276 tempest-AttachVolumeTestJSON-704258411 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6f03d07d-1804-458a-9612-e9595afeb76a', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': '6f03d07d-1804-458a-9612-e9595afeb76a', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 21:03:26.127878 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-f148f9cb-74d2-405f-a8f2-99ae5f104054 req-1a153e44-4c04-4467-9f73-4e0e0ae1c276 tempest-AttachVolumeTestJSON-704258411 None] Connection info returned from driver {'name': 'volumes/volume-6f03d07d-1804-458a-9612-e9595afeb76a', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '6f03d07d-1804-458a-9612-e9595afeb76a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '1f041cc2-41c8-4abe-bdd0-365866f0e330'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 21:03:26.209486 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-f148f9cb-74d2-405f-a8f2-99ae5f104054 req-1a153e44-4c04-4467-9f73-4e0e0ae1c276 tempest-AttachVolumeTestJSON-704258411 None] attachment_update completed successfully. Mar 12 21:03:30.348400 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9369646-5a51-48b3-91bc-931ef294bea3 tempest-AttachVolumeTestJSON-704258411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:03:30.366270 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-d9369646-5a51-48b3-91bc-931ef294bea3 tempest-AttachVolumeTestJSON-704258411 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:03:30.367186 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-d9369646-5a51-48b3-91bc-931ef294bea3 tempest-AttachVolumeTestJSON-704258411 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:03:30.422476 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d9369646-5a51-48b3-91bc-931ef294bea3 tempest-AttachVolumeTestJSON-704258411 None] Flow 'volume_create_manager' (049a30b3-c4e1-4d8f-a88b-baa786f5bcb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:03:30.441590 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d9369646-5a51-48b3-91bc-931ef294bea3 tempest-AttachVolumeTestJSON-704258411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf7ca8b-148e-46c2-8e5b-72746c2e2807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:03:30.449848 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-d9369646-5a51-48b3-91bc-931ef294bea3 tempest-AttachVolumeTestJSON-704258411 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:03:30.472683 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d9369646-5a51-48b3-91bc-931ef294bea3 tempest-AttachVolumeTestJSON-704258411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf7ca8b-148e-46c2-8e5b-72746c2e2807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-224030377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e2b7192d-10f9-48ef-a117-75f8bbc93b0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4da7920d54243cd8381e283021d7745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:03:30Z,use_quota=True,user_id='ec384ea1fe344a08a8b9491f10f3b211',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:03:30.479603 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d9369646-5a51-48b3-91bc-931ef294bea3 tempest-AttachVolumeTestJSON-704258411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8472c0c3-7c40-47ff-ba02-1dc9d2ebf2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:03:30.485169 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d9369646-5a51-48b3-91bc-931ef294bea3 tempest-AttachVolumeTestJSON-704258411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8472c0c3-7c40-47ff-ba02-1dc9d2ebf2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:03:30.491347 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d9369646-5a51-48b3-91bc-931ef294bea3 tempest-AttachVolumeTestJSON-704258411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c04fc9-f099-4e28-8f40-6ff0b37bb07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:03:30.496036 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d9369646-5a51-48b3-91bc-931ef294bea3 tempest-AttachVolumeTestJSON-704258411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c04fc9-f099-4e28-8f40-6ff0b37bb07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2b7192d-10f9-48ef-a117-75f8bbc93b0f', 'volume_name': 'volume-e2b7192d-10f9-48ef-a117-75f8bbc93b0f', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:03:30.502863 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d9369646-5a51-48b3-91bc-931ef294bea3 tempest-AttachVolumeTestJSON-704258411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdd2419c-f5f5-486f-af69-200f3e86e94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:03:30.510640 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d9369646-5a51-48b3-91bc-931ef294bea3 tempest-AttachVolumeTestJSON-704258411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdd2419c-f5f5-486f-af69-200f3e86e94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:03:30.517195 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d9369646-5a51-48b3-91bc-931ef294bea3 tempest-AttachVolumeTestJSON-704258411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f7c39f3-55ba-43b0-a8d8-1e0596ace741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:03:30.518631 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-d9369646-5a51-48b3-91bc-931ef294bea3 tempest-AttachVolumeTestJSON-704258411 None] Volume e2b7192d-10f9-48ef-a117-75f8bbc93b0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2b7192d-10f9-48ef-a117-75f8bbc93b0f', 'volume_size': 1} Mar 12 21:03:30.519284 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d9369646-5a51-48b3-91bc-931ef294bea3 tempest-AttachVolumeTestJSON-704258411 None] creating volume 'volume-e2b7192d-10f9-48ef-a117-75f8bbc93b0f' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:03:30.520738 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d9369646-5a51-48b3-91bc-931ef294bea3 tempest-AttachVolumeTestJSON-704258411 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:03:30.639247 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d9369646-5a51-48b3-91bc-931ef294bea3 tempest-AttachVolumeTestJSON-704258411 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:03:30.639626 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d9369646-5a51-48b3-91bc-931ef294bea3 tempest-AttachVolumeTestJSON-704258411 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:03:30.644285 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d9369646-5a51-48b3-91bc-931ef294bea3 tempest-AttachVolumeTestJSON-704258411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f7c39f3-55ba-43b0-a8d8-1e0596ace741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2b7192d-10f9-48ef-a117-75f8bbc93b0f', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:03:30.648899 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d9369646-5a51-48b3-91bc-931ef294bea3 tempest-AttachVolumeTestJSON-704258411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (647a4032-385c-4ec8-8ed5-60c60c7d48bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:03:30.659033 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-d9369646-5a51-48b3-91bc-931ef294bea3 tempest-AttachVolumeTestJSON-704258411 None] Volume volume-e2b7192d-10f9-48ef-a117-75f8bbc93b0f (e2b7192d-10f9-48ef-a117-75f8bbc93b0f): created successfully Mar 12 21:03:30.663118 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d9369646-5a51-48b3-91bc-931ef294bea3 tempest-AttachVolumeTestJSON-704258411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (647a4032-385c-4ec8-8ed5-60c60c7d48bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:03:30.670177 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d9369646-5a51-48b3-91bc-931ef294bea3 tempest-AttachVolumeTestJSON-704258411 None] Flow 'volume_create_manager' (049a30b3-c4e1-4d8f-a88b-baa786f5bcb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:03:30.686332 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-d9369646-5a51-48b3-91bc-931ef294bea3 tempest-AttachVolumeTestJSON-704258411 None] Created volume successfully. Mar 12 21:03:33.038319 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-d83b1b4b-b95f-4564-8956-ecd276bbaebe req-0f120e68-d29d-4e71-ae25-6bafa4e8edee tempest-AttachVolumeTestJSON-704258411 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 21:03:34.358637 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-d83b1b4b-b95f-4564-8956-ecd276bbaebe req-0f120e68-d29d-4e71-ae25-6bafa4e8edee tempest-AttachVolumeTestJSON-704258411 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.326s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 21:03:34.359989 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-d83b1b4b-b95f-4564-8956-ecd276bbaebe req-0f120e68-d29d-4e71-ae25-6bafa4e8edee tempest-AttachVolumeTestJSON-704258411 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e2b7192d-10f9-48ef-a117-75f8bbc93b0f', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': 'e2b7192d-10f9-48ef-a117-75f8bbc93b0f', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 21:03:34.387033 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-d83b1b4b-b95f-4564-8956-ecd276bbaebe req-0f120e68-d29d-4e71-ae25-6bafa4e8edee tempest-AttachVolumeTestJSON-704258411 None] Connection info returned from driver {'name': 'volumes/volume-e2b7192d-10f9-48ef-a117-75f8bbc93b0f', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e2b7192d-10f9-48ef-a117-75f8bbc93b0f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a18ac30e-3955-4c61-affd-8ed4362f4ef0'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 21:03:34.492199 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-d83b1b4b-b95f-4564-8956-ecd276bbaebe req-0f120e68-d29d-4e71-ae25-6bafa4e8edee tempest-AttachVolumeTestJSON-704258411 None] attachment_update completed successfully. Mar 12 21:03:38.046497 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-1652e84e-3abb-45de-bfb9-66fa17b89239 req-6fcc8e13-88d8-482e-8131-d73374f2b8d7 tempest-AttachVolumeTestJSON-704258411 None] Terminate volume connection completed successfully. Mar 12 21:03:38.047166 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-1652e84e-3abb-45de-bfb9-66fa17b89239 req-6fcc8e13-88d8-482e-8131-d73374f2b8d7 tempest-AttachVolumeTestJSON-704258411 None] Deleting attachment 1f041cc2-41c8-4abe-bdd0-365866f0e330. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 21:03:40.719288 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-78f3d75d-cd71-4eef-81d2-226f73c44538 req-c1eb81f9-032b-4f87-933c-82805cb449b2 tempest-AttachVolumeTestJSON-704258411 None] Terminate volume connection completed successfully. Mar 12 21:03:40.722052 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-78f3d75d-cd71-4eef-81d2-226f73c44538 req-c1eb81f9-032b-4f87-933c-82805cb449b2 tempest-AttachVolumeTestJSON-704258411 None] Deleting attachment a18ac30e-3955-4c61-affd-8ed4362f4ef0. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 21:03:51.107507 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-36ccbcce-5f56-46a8-9da5-a426e1f16a99 tempest-AttachVolumeTestJSON-704258411 None] Lock "b'cinder-e2b7192d-10f9-48ef-a117-75f8bbc93b0f-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:03:51.145632 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:03:51.147867 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:03:51.215394 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:03:51.282671 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:03:51.301249 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-36ccbcce-5f56-46a8-9da5-a426e1f16a99 tempest-AttachVolumeTestJSON-704258411 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:03:51.373407 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-36ccbcce-5f56-46a8-9da5-a426e1f16a99 tempest-AttachVolumeTestJSON-704258411 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:03:51.374017 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-36ccbcce-5f56-46a8-9da5-a426e1f16a99 tempest-AttachVolumeTestJSON-704258411 None] Volume volume-e2b7192d-10f9-48ef-a117-75f8bbc93b0f is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:03:51.388626 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-36ccbcce-5f56-46a8-9da5-a426e1f16a99 tempest-AttachVolumeTestJSON-704258411 None] deleting rbd volume volume-e2b7192d-10f9-48ef-a117-75f8bbc93b0f {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:03:51.829696 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-36ccbcce-5f56-46a8-9da5-a426e1f16a99 tempest-AttachVolumeTestJSON-704258411 None] Created reservations ['89ab3fb2-67c5-4e56-9fae-cd9081626ef2', '9371a97b-d4a6-422b-b6d3-e12d858ee997', '902c96a9-d90c-439b-9ef0-1192326d5f25', 'd8cb04a3-626a-4413-b704-8e53c4375633'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:03:51.925605 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-36ccbcce-5f56-46a8-9da5-a426e1f16a99 tempest-AttachVolumeTestJSON-704258411 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:03:51.982249 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-36ccbcce-5f56-46a8-9da5-a426e1f16a99 tempest-AttachVolumeTestJSON-704258411 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:03:52.036928 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-36ccbcce-5f56-46a8-9da5-a426e1f16a99 tempest-AttachVolumeTestJSON-704258411 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:03:52.040998 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-36ccbcce-5f56-46a8-9da5-a426e1f16a99 tempest-AttachVolumeTestJSON-704258411 None] Deleted volume successfully. Mar 12 21:03:52.061149 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-36ccbcce-5f56-46a8-9da5-a426e1f16a99 tempest-AttachVolumeTestJSON-704258411 None] Lock "b'cinder-e2b7192d-10f9-48ef-a117-75f8bbc93b0f-delete_volume'" released by "delete_volume" :: held 0.954s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:03:52.281690 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-c06b024f-a953-43fc-aaef-c42f85764c1b tempest-AttachVolumeTestJSON-704258411 None] Lock "b'cinder-6f03d07d-1804-458a-9612-e9595afeb76a-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:03:52.349322 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c06b024f-a953-43fc-aaef-c42f85764c1b tempest-AttachVolumeTestJSON-704258411 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:03:52.417599 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c06b024f-a953-43fc-aaef-c42f85764c1b tempest-AttachVolumeTestJSON-704258411 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:03:52.418256 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c06b024f-a953-43fc-aaef-c42f85764c1b tempest-AttachVolumeTestJSON-704258411 None] Volume volume-6f03d07d-1804-458a-9612-e9595afeb76a is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:03:52.425445 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c06b024f-a953-43fc-aaef-c42f85764c1b tempest-AttachVolumeTestJSON-704258411 None] deleting rbd volume volume-6f03d07d-1804-458a-9612-e9595afeb76a {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:03:52.829154 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-c06b024f-a953-43fc-aaef-c42f85764c1b tempest-AttachVolumeTestJSON-704258411 None] Created reservations ['0d2b9129-1165-407d-8069-1c5f22da9035', 'f0470243-fe56-4f85-b8b2-62a5e1646a25', '395f7d6e-5273-4b1a-bb43-6950470c9532', 'cc5041ab-588a-4e16-b1c1-0a1152d26f57'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:03:52.892793 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c06b024f-a953-43fc-aaef-c42f85764c1b tempest-AttachVolumeTestJSON-704258411 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:03:52.944274 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c06b024f-a953-43fc-aaef-c42f85764c1b tempest-AttachVolumeTestJSON-704258411 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:03:53.021728 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-c06b024f-a953-43fc-aaef-c42f85764c1b tempest-AttachVolumeTestJSON-704258411 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:03:53.025707 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-c06b024f-a953-43fc-aaef-c42f85764c1b tempest-AttachVolumeTestJSON-704258411 None] Deleted volume successfully. Mar 12 21:03:53.050512 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-c06b024f-a953-43fc-aaef-c42f85764c1b tempest-AttachVolumeTestJSON-704258411 None] Lock "b'cinder-6f03d07d-1804-458a-9612-e9595afeb76a-delete_volume'" released by "delete_volume" :: held 0.769s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:03:54.790820 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-e6455596-97e0-4408-9025-8fc6cee82fad tempest-AttachVolumeTestJSON-704258411 None] Lock "b'cinder-95a67390-c847-4eb9-8783-620ee1d3b1ae-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:03:54.851937 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-e6455596-97e0-4408-9025-8fc6cee82fad tempest-AttachVolumeTestJSON-704258411 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:03:54.933301 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-e6455596-97e0-4408-9025-8fc6cee82fad tempest-AttachVolumeTestJSON-704258411 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:03:54.934031 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-e6455596-97e0-4408-9025-8fc6cee82fad tempest-AttachVolumeTestJSON-704258411 None] Volume volume-95a67390-c847-4eb9-8783-620ee1d3b1ae is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:03:54.952587 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-e6455596-97e0-4408-9025-8fc6cee82fad tempest-AttachVolumeTestJSON-704258411 None] deleting rbd volume volume-95a67390-c847-4eb9-8783-620ee1d3b1ae {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:03:55.422760 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-e6455596-97e0-4408-9025-8fc6cee82fad tempest-AttachVolumeTestJSON-704258411 None] Created reservations ['1be2bcd3-ba5e-4494-9d89-5fe6613cf2ce', 'bda46997-885b-4cb4-9c8e-2be1bae21777', '3d8d9739-b1d9-4c2a-8e7f-a577c29be796', 'b7003988-db69-4830-b4f1-838d6de6f570'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:03:55.496258 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-e6455596-97e0-4408-9025-8fc6cee82fad tempest-AttachVolumeTestJSON-704258411 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:03:55.602347 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-e6455596-97e0-4408-9025-8fc6cee82fad tempest-AttachVolumeTestJSON-704258411 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:03:55.723725 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-e6455596-97e0-4408-9025-8fc6cee82fad tempest-AttachVolumeTestJSON-704258411 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:03:55.729483 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-e6455596-97e0-4408-9025-8fc6cee82fad tempest-AttachVolumeTestJSON-704258411 None] Deleted volume successfully. Mar 12 21:03:55.747730 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-e6455596-97e0-4408-9025-8fc6cee82fad tempest-AttachVolumeTestJSON-704258411 None] Lock "b'cinder-95a67390-c847-4eb9-8783-620ee1d3b1ae-delete_volume'" released by "delete_volume" :: held 0.957s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:04:51.148215 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:04:51.148892 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:04:51.204770 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:04:51.271238 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:05:23.616590 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [req-a4015660-bcb6-4a9e-beb0-ef60a44da7ff req-18e6efb8-6b9b-4a9e-a7fd-3e3bed38611f tempest-VolumesGetTestJSON-276097430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:05:23.630746 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [req-a4015660-bcb6-4a9e-beb0-ef60a44da7ff req-18e6efb8-6b9b-4a9e-a7fd-3e3bed38611f tempest-VolumesGetTestJSON-276097430 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:05:23.631392 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [req-a4015660-bcb6-4a9e-beb0-ef60a44da7ff req-18e6efb8-6b9b-4a9e-a7fd-3e3bed38611f tempest-VolumesGetTestJSON-276097430 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:05:23.673082 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-a4015660-bcb6-4a9e-beb0-ef60a44da7ff req-18e6efb8-6b9b-4a9e-a7fd-3e3bed38611f tempest-VolumesGetTestJSON-276097430 None] Flow 'volume_create_manager' (906e2402-947a-45e5-8253-8ac991e52c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:05:23.695702 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-a4015660-bcb6-4a9e-beb0-ef60a44da7ff req-18e6efb8-6b9b-4a9e-a7fd-3e3bed38611f tempest-VolumesGetTestJSON-276097430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f17e9dd-0daa-4bb1-99be-8bd833276e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:05:23.711663 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [req-a4015660-bcb6-4a9e-beb0-ef60a44da7ff req-18e6efb8-6b9b-4a9e-a7fd-3e3bed38611f tempest-VolumesGetTestJSON-276097430 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:05:23.753945 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-a4015660-bcb6-4a9e-beb0-ef60a44da7ff req-18e6efb8-6b9b-4a9e-a7fd-3e3bed38611f tempest-VolumesGetTestJSON-276097430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f17e9dd-0daa-4bb1-99be-8bd833276e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-984486755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7489ff1a-97c7-403d-81cf-f73f3c2317d1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='42b4cb4f2eb746c6aaa4175db350986f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:05:24Z,use_quota=True,user_id='af332515da484aca91cdbd42e1c00b92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:05:23.764578 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-a4015660-bcb6-4a9e-beb0-ef60a44da7ff req-18e6efb8-6b9b-4a9e-a7fd-3e3bed38611f tempest-VolumesGetTestJSON-276097430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ce2fe65-3b09-43c4-b9d1-da16bce265ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:05:23.769994 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-a4015660-bcb6-4a9e-beb0-ef60a44da7ff req-18e6efb8-6b9b-4a9e-a7fd-3e3bed38611f tempest-VolumesGetTestJSON-276097430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ce2fe65-3b09-43c4-b9d1-da16bce265ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:05:23.776265 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-a4015660-bcb6-4a9e-beb0-ef60a44da7ff req-18e6efb8-6b9b-4a9e-a7fd-3e3bed38611f tempest-VolumesGetTestJSON-276097430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2074fd80-d306-4faf-a37b-2c0ec7e755dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:05:23.782323 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-a4015660-bcb6-4a9e-beb0-ef60a44da7ff req-18e6efb8-6b9b-4a9e-a7fd-3e3bed38611f tempest-VolumesGetTestJSON-276097430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2074fd80-d306-4faf-a37b-2c0ec7e755dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7489ff1a-97c7-403d-81cf-f73f3c2317d1', 'volume_name': 'volume-7489ff1a-97c7-403d-81cf-f73f3c2317d1', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:05:23.789215 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-a4015660-bcb6-4a9e-beb0-ef60a44da7ff req-18e6efb8-6b9b-4a9e-a7fd-3e3bed38611f tempest-VolumesGetTestJSON-276097430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30b3a349-5cf2-4e17-b1be-0c3e4bcebefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:05:23.796688 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-a4015660-bcb6-4a9e-beb0-ef60a44da7ff req-18e6efb8-6b9b-4a9e-a7fd-3e3bed38611f tempest-VolumesGetTestJSON-276097430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30b3a349-5cf2-4e17-b1be-0c3e4bcebefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:05:23.804113 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-a4015660-bcb6-4a9e-beb0-ef60a44da7ff req-18e6efb8-6b9b-4a9e-a7fd-3e3bed38611f tempest-VolumesGetTestJSON-276097430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d3be304-3929-4105-91da-fec82443aea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:05:23.815923 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [req-a4015660-bcb6-4a9e-beb0-ef60a44da7ff req-18e6efb8-6b9b-4a9e-a7fd-3e3bed38611f tempest-VolumesGetTestJSON-276097430 None] Volume 7489ff1a-97c7-403d-81cf-f73f3c2317d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7489ff1a-97c7-403d-81cf-f73f3c2317d1', 'volume_size': 1} Mar 12 21:05:23.821391 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-a4015660-bcb6-4a9e-beb0-ef60a44da7ff req-18e6efb8-6b9b-4a9e-a7fd-3e3bed38611f tempest-VolumesGetTestJSON-276097430 None] creating volume 'volume-7489ff1a-97c7-403d-81cf-f73f3c2317d1' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:05:23.822846 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-a4015660-bcb6-4a9e-beb0-ef60a44da7ff req-18e6efb8-6b9b-4a9e-a7fd-3e3bed38611f tempest-VolumesGetTestJSON-276097430 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:05:23.977536 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-a4015660-bcb6-4a9e-beb0-ef60a44da7ff req-18e6efb8-6b9b-4a9e-a7fd-3e3bed38611f tempest-VolumesGetTestJSON-276097430 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:05:23.978220 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-a4015660-bcb6-4a9e-beb0-ef60a44da7ff req-18e6efb8-6b9b-4a9e-a7fd-3e3bed38611f tempest-VolumesGetTestJSON-276097430 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:05:23.984784 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-a4015660-bcb6-4a9e-beb0-ef60a44da7ff req-18e6efb8-6b9b-4a9e-a7fd-3e3bed38611f tempest-VolumesGetTestJSON-276097430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d3be304-3929-4105-91da-fec82443aea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7489ff1a-97c7-403d-81cf-f73f3c2317d1', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:05:23.990182 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-a4015660-bcb6-4a9e-beb0-ef60a44da7ff req-18e6efb8-6b9b-4a9e-a7fd-3e3bed38611f tempest-VolumesGetTestJSON-276097430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e836cfb-7717-4a82-9485-378384452d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:05:24.015206 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [req-a4015660-bcb6-4a9e-beb0-ef60a44da7ff req-18e6efb8-6b9b-4a9e-a7fd-3e3bed38611f tempest-VolumesGetTestJSON-276097430 None] Volume volume-7489ff1a-97c7-403d-81cf-f73f3c2317d1 (7489ff1a-97c7-403d-81cf-f73f3c2317d1): created successfully Mar 12 21:05:24.020557 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-a4015660-bcb6-4a9e-beb0-ef60a44da7ff req-18e6efb8-6b9b-4a9e-a7fd-3e3bed38611f tempest-VolumesGetTestJSON-276097430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e836cfb-7717-4a82-9485-378384452d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:05:24.035397 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-a4015660-bcb6-4a9e-beb0-ef60a44da7ff req-18e6efb8-6b9b-4a9e-a7fd-3e3bed38611f tempest-VolumesGetTestJSON-276097430 None] Flow 'volume_create_manager' (906e2402-947a-45e5-8253-8ac991e52c23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:05:24.055473 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-a4015660-bcb6-4a9e-beb0-ef60a44da7ff req-18e6efb8-6b9b-4a9e-a7fd-3e3bed38611f tempest-VolumesGetTestJSON-276097430 None] Created volume successfully. Mar 12 21:05:25.765404 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [req-eaa0ffef-34a5-4ce9-8529-f85a3b6c40b6 req-64c0b506-a5f1-4bd4-afb4-2b5dec834e7f tempest-VolumesGetTestJSON-276097430 None] Lock "b'cinder-7489ff1a-97c7-403d-81cf-f73f3c2317d1-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:05:25.846064 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-eaa0ffef-34a5-4ce9-8529-f85a3b6c40b6 req-64c0b506-a5f1-4bd4-afb4-2b5dec834e7f tempest-VolumesGetTestJSON-276097430 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:05:25.922429 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-eaa0ffef-34a5-4ce9-8529-f85a3b6c40b6 req-64c0b506-a5f1-4bd4-afb4-2b5dec834e7f tempest-VolumesGetTestJSON-276097430 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:05:25.923136 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-eaa0ffef-34a5-4ce9-8529-f85a3b6c40b6 req-64c0b506-a5f1-4bd4-afb4-2b5dec834e7f tempest-VolumesGetTestJSON-276097430 None] Volume volume-7489ff1a-97c7-403d-81cf-f73f3c2317d1 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:05:25.937686 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-eaa0ffef-34a5-4ce9-8529-f85a3b6c40b6 req-64c0b506-a5f1-4bd4-afb4-2b5dec834e7f tempest-VolumesGetTestJSON-276097430 None] deleting rbd volume volume-7489ff1a-97c7-403d-81cf-f73f3c2317d1 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:05:26.374980 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [req-eaa0ffef-34a5-4ce9-8529-f85a3b6c40b6 req-64c0b506-a5f1-4bd4-afb4-2b5dec834e7f tempest-VolumesGetTestJSON-276097430 None] Created reservations ['b6fee5fa-20b6-4940-ab00-14b611c9c2ad', '3f1e8c43-5d60-42cc-b2c7-e1851002f2c0', '29072034-85b6-46ab-8a74-56a0bcf63d8c', '2eeef115-cbed-4fd6-afe2-ba7ae8a48ed4'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:05:26.454639 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-eaa0ffef-34a5-4ce9-8529-f85a3b6c40b6 req-64c0b506-a5f1-4bd4-afb4-2b5dec834e7f tempest-VolumesGetTestJSON-276097430 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:05:26.517626 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-eaa0ffef-34a5-4ce9-8529-f85a3b6c40b6 req-64c0b506-a5f1-4bd4-afb4-2b5dec834e7f tempest-VolumesGetTestJSON-276097430 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:05:26.602270 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [req-eaa0ffef-34a5-4ce9-8529-f85a3b6c40b6 req-64c0b506-a5f1-4bd4-afb4-2b5dec834e7f tempest-VolumesGetTestJSON-276097430 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:05:26.607274 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-eaa0ffef-34a5-4ce9-8529-f85a3b6c40b6 req-64c0b506-a5f1-4bd4-afb4-2b5dec834e7f tempest-VolumesGetTestJSON-276097430 None] Deleted volume successfully. Mar 12 21:05:26.630692 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [req-eaa0ffef-34a5-4ce9-8529-f85a3b6c40b6 req-64c0b506-a5f1-4bd4-afb4-2b5dec834e7f tempest-VolumesGetTestJSON-276097430 None] Lock "b'cinder-7489ff1a-97c7-403d-81cf-f73f3c2317d1-delete_volume'" released by "delete_volume" :: held 0.865s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:05:32.489136 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-5acd3afd-589e-4a0b-a3ff-01456a37457f tempest-VolumesTestJSON-1218278566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:05:32.494001 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-5acd3afd-589e-4a0b-a3ff-01456a37457f tempest-VolumesTestJSON-1218278566 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:05:32.494564 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-5acd3afd-589e-4a0b-a3ff-01456a37457f tempest-VolumesTestJSON-1218278566 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:05:32.525040 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5acd3afd-589e-4a0b-a3ff-01456a37457f tempest-VolumesTestJSON-1218278566 None] Flow 'volume_create_manager' (1ee5d56c-e21e-4e41-acdf-ce68a5fabd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:05:32.534596 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5acd3afd-589e-4a0b-a3ff-01456a37457f tempest-VolumesTestJSON-1218278566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b883ee16-276a-46c7-a7ab-45d29dd3ccd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:05:32.543138 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-5acd3afd-589e-4a0b-a3ff-01456a37457f tempest-VolumesTestJSON-1218278566 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:05:32.567031 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5acd3afd-589e-4a0b-a3ff-01456a37457f tempest-VolumesTestJSON-1218278566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b883ee16-276a-46c7-a7ab-45d29dd3ccd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1099615690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=74d3515f-fbf5-4ec1-a8fc-b152f24929df,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='833f998e436241b09c1d95d2a6a3e181',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:05:32Z,use_quota=True,user_id='62679027e43449ffbf91674df969e860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:05:32.575817 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5acd3afd-589e-4a0b-a3ff-01456a37457f tempest-VolumesTestJSON-1218278566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0926b292-b5b1-44d1-9282-bcd19cd1be3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:05:32.581076 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5acd3afd-589e-4a0b-a3ff-01456a37457f tempest-VolumesTestJSON-1218278566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0926b292-b5b1-44d1-9282-bcd19cd1be3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:05:32.587331 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5acd3afd-589e-4a0b-a3ff-01456a37457f tempest-VolumesTestJSON-1218278566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b68a3011-5f49-4be8-a32b-2fa982175dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:05:32.592104 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5acd3afd-589e-4a0b-a3ff-01456a37457f tempest-VolumesTestJSON-1218278566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b68a3011-5f49-4be8-a32b-2fa982175dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74d3515f-fbf5-4ec1-a8fc-b152f24929df', 'volume_name': 'volume-74d3515f-fbf5-4ec1-a8fc-b152f24929df', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:05:32.599478 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5acd3afd-589e-4a0b-a3ff-01456a37457f tempest-VolumesTestJSON-1218278566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07934d47-928b-44f7-a74b-08ed632c6dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:05:32.604142 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5acd3afd-589e-4a0b-a3ff-01456a37457f tempest-VolumesTestJSON-1218278566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07934d47-928b-44f7-a74b-08ed632c6dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:05:32.609791 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5acd3afd-589e-4a0b-a3ff-01456a37457f tempest-VolumesTestJSON-1218278566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (249806a8-3b5e-456c-a76e-42e667ccba8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:05:32.611203 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-5acd3afd-589e-4a0b-a3ff-01456a37457f tempest-VolumesTestJSON-1218278566 None] Volume 74d3515f-fbf5-4ec1-a8fc-b152f24929df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74d3515f-fbf5-4ec1-a8fc-b152f24929df', 'volume_size': 1} Mar 12 21:05:32.611762 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-5acd3afd-589e-4a0b-a3ff-01456a37457f tempest-VolumesTestJSON-1218278566 None] creating volume 'volume-74d3515f-fbf5-4ec1-a8fc-b152f24929df' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:05:32.612968 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-5acd3afd-589e-4a0b-a3ff-01456a37457f tempest-VolumesTestJSON-1218278566 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:05:32.717385 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-5acd3afd-589e-4a0b-a3ff-01456a37457f tempest-VolumesTestJSON-1218278566 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:05:32.718220 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-5acd3afd-589e-4a0b-a3ff-01456a37457f tempest-VolumesTestJSON-1218278566 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:05:32.727910 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5acd3afd-589e-4a0b-a3ff-01456a37457f tempest-VolumesTestJSON-1218278566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (249806a8-3b5e-456c-a76e-42e667ccba8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74d3515f-fbf5-4ec1-a8fc-b152f24929df', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:05:32.738210 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5acd3afd-589e-4a0b-a3ff-01456a37457f tempest-VolumesTestJSON-1218278566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec400dc5-7e55-43f6-b5d0-d97f2d13f299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:05:32.759709 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-5acd3afd-589e-4a0b-a3ff-01456a37457f tempest-VolumesTestJSON-1218278566 None] Volume volume-74d3515f-fbf5-4ec1-a8fc-b152f24929df (74d3515f-fbf5-4ec1-a8fc-b152f24929df): created successfully Mar 12 21:05:32.767585 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5acd3afd-589e-4a0b-a3ff-01456a37457f tempest-VolumesTestJSON-1218278566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec400dc5-7e55-43f6-b5d0-d97f2d13f299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:05:32.780895 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5acd3afd-589e-4a0b-a3ff-01456a37457f tempest-VolumesTestJSON-1218278566 None] Flow 'volume_create_manager' (1ee5d56c-e21e-4e41-acdf-ce68a5fabd18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:05:32.797478 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-5acd3afd-589e-4a0b-a3ff-01456a37457f tempest-VolumesTestJSON-1218278566 None] Created volume successfully. Mar 12 21:05:34.794836 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e30a3de-6541-4d72-8939-efdc590b8855 tempest-VolumesTestJSON-1218278566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:05:34.805095 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-1e30a3de-6541-4d72-8939-efdc590b8855 tempest-VolumesTestJSON-1218278566 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:05:34.807242 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-1e30a3de-6541-4d72-8939-efdc590b8855 tempest-VolumesTestJSON-1218278566 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:05:34.866049 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-1e30a3de-6541-4d72-8939-efdc590b8855 tempest-VolumesTestJSON-1218278566 None] Flow 'volume_create_manager' (9ac0aab7-25cd-4c32-ba97-ee68ce5eb02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:05:34.873355 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-1e30a3de-6541-4d72-8939-efdc590b8855 tempest-VolumesTestJSON-1218278566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02e2ed88-4d95-4363-ae17-2127e4b79b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:05:34.880698 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-1e30a3de-6541-4d72-8939-efdc590b8855 tempest-VolumesTestJSON-1218278566 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:05:34.898426 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-1e30a3de-6541-4d72-8939-efdc590b8855 tempest-VolumesTestJSON-1218278566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02e2ed88-4d95-4363-ae17-2127e4b79b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-322329826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6bac85e2-e94b-4965-9dcc-aed7e738c21f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='833f998e436241b09c1d95d2a6a3e181',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:05:35Z,use_quota=True,user_id='62679027e43449ffbf91674df969e860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:05:34.904145 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-1e30a3de-6541-4d72-8939-efdc590b8855 tempest-VolumesTestJSON-1218278566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b70e196-f9ef-4bf6-9dbb-bf732b6213fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:05:34.913256 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-1e30a3de-6541-4d72-8939-efdc590b8855 tempest-VolumesTestJSON-1218278566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b70e196-f9ef-4bf6-9dbb-bf732b6213fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:05:34.931398 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-1e30a3de-6541-4d72-8939-efdc590b8855 tempest-VolumesTestJSON-1218278566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff4c22f9-ca78-4541-baa5-0b4ed610bd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:05:34.940752 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-1e30a3de-6541-4d72-8939-efdc590b8855 tempest-VolumesTestJSON-1218278566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff4c22f9-ca78-4541-baa5-0b4ed610bd25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bac85e2-e94b-4965-9dcc-aed7e738c21f', 'volume_name': 'volume-6bac85e2-e94b-4965-9dcc-aed7e738c21f', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:05:34.950543 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-1e30a3de-6541-4d72-8939-efdc590b8855 tempest-VolumesTestJSON-1218278566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b3194aa-146c-444e-adc1-da21f729edd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:05:34.960288 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-1e30a3de-6541-4d72-8939-efdc590b8855 tempest-VolumesTestJSON-1218278566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b3194aa-146c-444e-adc1-da21f729edd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:05:34.968022 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-1e30a3de-6541-4d72-8939-efdc590b8855 tempest-VolumesTestJSON-1218278566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae856cb6-f18a-4999-99b8-4fa491a2400d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:05:34.969848 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-1e30a3de-6541-4d72-8939-efdc590b8855 tempest-VolumesTestJSON-1218278566 None] Volume 6bac85e2-e94b-4965-9dcc-aed7e738c21f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bac85e2-e94b-4965-9dcc-aed7e738c21f', 'volume_size': 1} Mar 12 21:05:34.970657 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-1e30a3de-6541-4d72-8939-efdc590b8855 tempest-VolumesTestJSON-1218278566 None] creating volume 'volume-6bac85e2-e94b-4965-9dcc-aed7e738c21f' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:05:34.972612 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-1e30a3de-6541-4d72-8939-efdc590b8855 tempest-VolumesTestJSON-1218278566 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:05:35.073342 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-1e30a3de-6541-4d72-8939-efdc590b8855 tempest-VolumesTestJSON-1218278566 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:05:35.074130 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-1e30a3de-6541-4d72-8939-efdc590b8855 tempest-VolumesTestJSON-1218278566 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:05:35.079862 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-1e30a3de-6541-4d72-8939-efdc590b8855 tempest-VolumesTestJSON-1218278566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae856cb6-f18a-4999-99b8-4fa491a2400d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bac85e2-e94b-4965-9dcc-aed7e738c21f', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:05:35.085612 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-1e30a3de-6541-4d72-8939-efdc590b8855 tempest-VolumesTestJSON-1218278566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1126c2cc-0350-4d7c-960c-2c1b5656ff04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:05:35.108330 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-1e30a3de-6541-4d72-8939-efdc590b8855 tempest-VolumesTestJSON-1218278566 None] Volume volume-6bac85e2-e94b-4965-9dcc-aed7e738c21f (6bac85e2-e94b-4965-9dcc-aed7e738c21f): created successfully Mar 12 21:05:35.113708 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-1e30a3de-6541-4d72-8939-efdc590b8855 tempest-VolumesTestJSON-1218278566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1126c2cc-0350-4d7c-960c-2c1b5656ff04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:05:35.122598 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-1e30a3de-6541-4d72-8939-efdc590b8855 tempest-VolumesTestJSON-1218278566 None] Flow 'volume_create_manager' (9ac0aab7-25cd-4c32-ba97-ee68ce5eb02c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:05:35.134321 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-1e30a3de-6541-4d72-8939-efdc590b8855 tempest-VolumesTestJSON-1218278566 None] Created volume successfully. Mar 12 21:05:36.437595 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-15d76be7-ae83-4a01-9c60-a1cd0d32b857 tempest-VolumesTestJSON-1218278566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:05:36.445877 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-15d76be7-ae83-4a01-9c60-a1cd0d32b857 tempest-VolumesTestJSON-1218278566 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:05:36.446710 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-15d76be7-ae83-4a01-9c60-a1cd0d32b857 tempest-VolumesTestJSON-1218278566 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:05:36.491181 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-15d76be7-ae83-4a01-9c60-a1cd0d32b857 tempest-VolumesTestJSON-1218278566 None] Flow 'volume_create_manager' (91b67e3c-ec4d-4cfa-b31b-9d300b536e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:05:36.513611 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-15d76be7-ae83-4a01-9c60-a1cd0d32b857 tempest-VolumesTestJSON-1218278566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1f9df89-52db-4caa-8e76-cb7f890af0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:05:36.537056 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-15d76be7-ae83-4a01-9c60-a1cd0d32b857 tempest-VolumesTestJSON-1218278566 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:05:36.554963 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-15d76be7-ae83-4a01-9c60-a1cd0d32b857 tempest-VolumesTestJSON-1218278566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1f9df89-52db-4caa-8e76-cb7f890af0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1473917878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8a7b36d2-ee2d-4f1b-a526-9c1c7503b4ef,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='833f998e436241b09c1d95d2a6a3e181',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:05:36Z,use_quota=True,user_id='62679027e43449ffbf91674df969e860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:05:36.562796 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-15d76be7-ae83-4a01-9c60-a1cd0d32b857 tempest-VolumesTestJSON-1218278566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f72110c9-d337-4fe7-b555-83455bf3f43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:05:36.567651 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-15d76be7-ae83-4a01-9c60-a1cd0d32b857 tempest-VolumesTestJSON-1218278566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f72110c9-d337-4fe7-b555-83455bf3f43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:05:36.575023 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-15d76be7-ae83-4a01-9c60-a1cd0d32b857 tempest-VolumesTestJSON-1218278566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7737187c-a174-4cd9-8254-1ab239b1e2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:05:36.579577 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-15d76be7-ae83-4a01-9c60-a1cd0d32b857 tempest-VolumesTestJSON-1218278566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7737187c-a174-4cd9-8254-1ab239b1e2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a7b36d2-ee2d-4f1b-a526-9c1c7503b4ef', 'volume_name': 'volume-8a7b36d2-ee2d-4f1b-a526-9c1c7503b4ef', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:05:36.585222 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-15d76be7-ae83-4a01-9c60-a1cd0d32b857 tempest-VolumesTestJSON-1218278566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e49e2784-05a2-4de6-9fa0-d02ff42c0f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:05:36.589489 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-15d76be7-ae83-4a01-9c60-a1cd0d32b857 tempest-VolumesTestJSON-1218278566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e49e2784-05a2-4de6-9fa0-d02ff42c0f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:05:36.594945 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-15d76be7-ae83-4a01-9c60-a1cd0d32b857 tempest-VolumesTestJSON-1218278566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ac29c1-14dc-49c8-8c56-234771059e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:05:36.596231 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-15d76be7-ae83-4a01-9c60-a1cd0d32b857 tempest-VolumesTestJSON-1218278566 None] Volume 8a7b36d2-ee2d-4f1b-a526-9c1c7503b4ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a7b36d2-ee2d-4f1b-a526-9c1c7503b4ef', 'volume_size': 1} Mar 12 21:05:36.596820 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-15d76be7-ae83-4a01-9c60-a1cd0d32b857 tempest-VolumesTestJSON-1218278566 None] creating volume 'volume-8a7b36d2-ee2d-4f1b-a526-9c1c7503b4ef' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:05:36.598033 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-15d76be7-ae83-4a01-9c60-a1cd0d32b857 tempest-VolumesTestJSON-1218278566 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:05:36.715661 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-15d76be7-ae83-4a01-9c60-a1cd0d32b857 tempest-VolumesTestJSON-1218278566 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:05:36.716240 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-15d76be7-ae83-4a01-9c60-a1cd0d32b857 tempest-VolumesTestJSON-1218278566 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:05:36.720349 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-15d76be7-ae83-4a01-9c60-a1cd0d32b857 tempest-VolumesTestJSON-1218278566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ac29c1-14dc-49c8-8c56-234771059e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a7b36d2-ee2d-4f1b-a526-9c1c7503b4ef', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:05:36.731362 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-15d76be7-ae83-4a01-9c60-a1cd0d32b857 tempest-VolumesTestJSON-1218278566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (296eef41-cc95-4db3-9883-7cc9c8454e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:05:36.747326 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-15d76be7-ae83-4a01-9c60-a1cd0d32b857 tempest-VolumesTestJSON-1218278566 None] Volume volume-8a7b36d2-ee2d-4f1b-a526-9c1c7503b4ef (8a7b36d2-ee2d-4f1b-a526-9c1c7503b4ef): created successfully Mar 12 21:05:36.752706 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-15d76be7-ae83-4a01-9c60-a1cd0d32b857 tempest-VolumesTestJSON-1218278566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (296eef41-cc95-4db3-9883-7cc9c8454e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:05:36.758984 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-15d76be7-ae83-4a01-9c60-a1cd0d32b857 tempest-VolumesTestJSON-1218278566 None] Flow 'volume_create_manager' (91b67e3c-ec4d-4cfa-b31b-9d300b536e65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:05:36.775976 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-15d76be7-ae83-4a01-9c60-a1cd0d32b857 tempest-VolumesTestJSON-1218278566 None] Created volume successfully. Mar 12 21:05:42.671304 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-cfc2b979-5040-4e99-8c31-e5960d999973 tempest-VolumesTestJSON-1218278566 None] Lock "b'cinder-8a7b36d2-ee2d-4f1b-a526-9c1c7503b4ef-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:05:42.752327 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-cfc2b979-5040-4e99-8c31-e5960d999973 tempest-VolumesTestJSON-1218278566 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:05:42.841555 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-cfc2b979-5040-4e99-8c31-e5960d999973 tempest-VolumesTestJSON-1218278566 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:05:42.842112 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-cfc2b979-5040-4e99-8c31-e5960d999973 tempest-VolumesTestJSON-1218278566 None] Volume volume-8a7b36d2-ee2d-4f1b-a526-9c1c7503b4ef is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:05:42.852545 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-cfc2b979-5040-4e99-8c31-e5960d999973 tempest-VolumesTestJSON-1218278566 None] deleting rbd volume volume-8a7b36d2-ee2d-4f1b-a526-9c1c7503b4ef {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:05:43.308562 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-cfc2b979-5040-4e99-8c31-e5960d999973 tempest-VolumesTestJSON-1218278566 None] Created reservations ['4a7a2033-eb4c-4b6a-bf44-0f70784042b2', 'fa56dfd0-3563-4919-ac68-94f5e1ae7e40', 'b3a48788-fa59-4c81-a6e7-12d747ea0810', '6747d362-c10b-4410-a6c5-5a0d25201219'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:05:43.382202 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-cfc2b979-5040-4e99-8c31-e5960d999973 tempest-VolumesTestJSON-1218278566 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:05:43.447301 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-cfc2b979-5040-4e99-8c31-e5960d999973 tempest-VolumesTestJSON-1218278566 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:05:43.492542 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-cfc2b979-5040-4e99-8c31-e5960d999973 tempest-VolumesTestJSON-1218278566 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:05:43.512276 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-cfc2b979-5040-4e99-8c31-e5960d999973 tempest-VolumesTestJSON-1218278566 None] Deleted volume successfully. Mar 12 21:05:43.538968 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-cfc2b979-5040-4e99-8c31-e5960d999973 tempest-VolumesTestJSON-1218278566 None] Lock "b'cinder-8a7b36d2-ee2d-4f1b-a526-9c1c7503b4ef-delete_volume'" released by "delete_volume" :: held 0.869s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:05:43.886164 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-1006b5dc-ba6e-4355-bb57-81e99bc8cebe tempest-VolumesTestJSON-1218278566 None] Lock "b'cinder-6bac85e2-e94b-4965-9dcc-aed7e738c21f-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:05:43.964824 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-1006b5dc-ba6e-4355-bb57-81e99bc8cebe tempest-VolumesTestJSON-1218278566 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:05:44.096577 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-1006b5dc-ba6e-4355-bb57-81e99bc8cebe tempest-VolumesTestJSON-1218278566 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:05:44.097003 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-1006b5dc-ba6e-4355-bb57-81e99bc8cebe tempest-VolumesTestJSON-1218278566 None] Volume volume-6bac85e2-e94b-4965-9dcc-aed7e738c21f is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:05:44.110609 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-1006b5dc-ba6e-4355-bb57-81e99bc8cebe tempest-VolumesTestJSON-1218278566 None] deleting rbd volume volume-6bac85e2-e94b-4965-9dcc-aed7e738c21f {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:05:44.580238 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-1006b5dc-ba6e-4355-bb57-81e99bc8cebe tempest-VolumesTestJSON-1218278566 None] Created reservations ['e9470d87-536e-479b-b819-7c55978830c2', '86df9496-9ae8-4e2b-b13d-9055a13c1f34', 'ad63f54d-afbe-4216-9f34-270b4b191bb1', '44b9fdcc-095c-4657-b699-87db150d6008'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:05:44.689040 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-1006b5dc-ba6e-4355-bb57-81e99bc8cebe tempest-VolumesTestJSON-1218278566 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:05:44.807552 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-1006b5dc-ba6e-4355-bb57-81e99bc8cebe tempest-VolumesTestJSON-1218278566 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:05:44.880033 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-1006b5dc-ba6e-4355-bb57-81e99bc8cebe tempest-VolumesTestJSON-1218278566 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:05:44.884744 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-1006b5dc-ba6e-4355-bb57-81e99bc8cebe tempest-VolumesTestJSON-1218278566 None] Deleted volume successfully. Mar 12 21:05:44.907048 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-1006b5dc-ba6e-4355-bb57-81e99bc8cebe tempest-VolumesTestJSON-1218278566 None] Lock "b'cinder-6bac85e2-e94b-4965-9dcc-aed7e738c21f-delete_volume'" released by "delete_volume" :: held 1.021s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:05:45.578783 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-d9ee9b8c-132f-432a-8eb8-b83637301008 tempest-VolumesTestJSON-1218278566 None] Lock "b'cinder-74d3515f-fbf5-4ec1-a8fc-b152f24929df-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:05:45.647985 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d9ee9b8c-132f-432a-8eb8-b83637301008 tempest-VolumesTestJSON-1218278566 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:05:45.718801 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d9ee9b8c-132f-432a-8eb8-b83637301008 tempest-VolumesTestJSON-1218278566 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:05:45.719398 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d9ee9b8c-132f-432a-8eb8-b83637301008 tempest-VolumesTestJSON-1218278566 None] Volume volume-74d3515f-fbf5-4ec1-a8fc-b152f24929df is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:05:45.732225 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d9ee9b8c-132f-432a-8eb8-b83637301008 tempest-VolumesTestJSON-1218278566 None] deleting rbd volume volume-74d3515f-fbf5-4ec1-a8fc-b152f24929df {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:05:46.201317 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-d9ee9b8c-132f-432a-8eb8-b83637301008 tempest-VolumesTestJSON-1218278566 None] Created reservations ['3688c2d5-3437-4178-9c77-576ca41a3ddf', '8c41e07f-7ab8-43ec-84db-e8df6380e956', '6525c151-a258-49d0-a240-9ee63c11ca2e', '92256ee1-0aa4-4569-9940-babff6e9de72'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:05:46.261217 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d9ee9b8c-132f-432a-8eb8-b83637301008 tempest-VolumesTestJSON-1218278566 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:05:46.296829 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d9ee9b8c-132f-432a-8eb8-b83637301008 tempest-VolumesTestJSON-1218278566 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:05:46.334716 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-d9ee9b8c-132f-432a-8eb8-b83637301008 tempest-VolumesTestJSON-1218278566 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:05:46.346516 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-d9ee9b8c-132f-432a-8eb8-b83637301008 tempest-VolumesTestJSON-1218278566 None] Deleted volume successfully. Mar 12 21:05:46.362549 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-d9ee9b8c-132f-432a-8eb8-b83637301008 tempest-VolumesTestJSON-1218278566 None] Lock "b'cinder-74d3515f-fbf5-4ec1-a8fc-b152f24929df-delete_volume'" released by "delete_volume" :: held 0.784s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:05:51.147903 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:05:51.149560 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:05:51.216518 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:05:51.268349 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:06:02.054297 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-c43ac25c-ee28-4e9a-9d61-f9d3d7264d5c tempest-DeleteServersTestJSON-152948620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:06:02.060404 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-c43ac25c-ee28-4e9a-9d61-f9d3d7264d5c tempest-DeleteServersTestJSON-152948620 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:06:02.061429 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-c43ac25c-ee28-4e9a-9d61-f9d3d7264d5c tempest-DeleteServersTestJSON-152948620 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:06:02.099186 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c43ac25c-ee28-4e9a-9d61-f9d3d7264d5c tempest-DeleteServersTestJSON-152948620 None] Flow 'volume_create_manager' (b0ff8f60-4e00-4734-b941-7b231f1bab05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:06:02.109480 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c43ac25c-ee28-4e9a-9d61-f9d3d7264d5c tempest-DeleteServersTestJSON-152948620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88781adb-4414-4eb6-a723-168d742c8322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:06:02.119336 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-c43ac25c-ee28-4e9a-9d61-f9d3d7264d5c tempest-DeleteServersTestJSON-152948620 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:06:02.139830 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c43ac25c-ee28-4e9a-9d61-f9d3d7264d5c tempest-DeleteServersTestJSON-152948620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88781adb-4414-4eb6-a723-168d742c8322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-720057371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=99013433-1e4a-4016-bd5e-c6bb6e234b6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a2c21b1992d496bab772b5ff8f601a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:06:02Z,use_quota=True,user_id='10e1e3bae5b94b5589b47488329ad756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:06:02.147315 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c43ac25c-ee28-4e9a-9d61-f9d3d7264d5c tempest-DeleteServersTestJSON-152948620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83375702-8b1f-47df-85d2-6080d87b5459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:06:02.153711 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c43ac25c-ee28-4e9a-9d61-f9d3d7264d5c tempest-DeleteServersTestJSON-152948620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83375702-8b1f-47df-85d2-6080d87b5459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:06:02.160579 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c43ac25c-ee28-4e9a-9d61-f9d3d7264d5c tempest-DeleteServersTestJSON-152948620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (854383a0-8f9d-4896-b093-59f0de6b3c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:06:02.168066 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c43ac25c-ee28-4e9a-9d61-f9d3d7264d5c tempest-DeleteServersTestJSON-152948620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (854383a0-8f9d-4896-b093-59f0de6b3c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99013433-1e4a-4016-bd5e-c6bb6e234b6e', 'volume_name': 'volume-99013433-1e4a-4016-bd5e-c6bb6e234b6e', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:06:02.175404 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c43ac25c-ee28-4e9a-9d61-f9d3d7264d5c tempest-DeleteServersTestJSON-152948620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e19de65c-57b4-452f-b1e1-6de7f3eec4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:06:02.180857 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c43ac25c-ee28-4e9a-9d61-f9d3d7264d5c tempest-DeleteServersTestJSON-152948620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e19de65c-57b4-452f-b1e1-6de7f3eec4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:06:02.187797 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c43ac25c-ee28-4e9a-9d61-f9d3d7264d5c tempest-DeleteServersTestJSON-152948620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51c4097f-22b6-4516-914d-ae37adb5e8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:06:02.189721 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-c43ac25c-ee28-4e9a-9d61-f9d3d7264d5c tempest-DeleteServersTestJSON-152948620 None] Volume 99013433-1e4a-4016-bd5e-c6bb6e234b6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99013433-1e4a-4016-bd5e-c6bb6e234b6e', 'volume_size': 1} Mar 12 21:06:02.191045 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c43ac25c-ee28-4e9a-9d61-f9d3d7264d5c tempest-DeleteServersTestJSON-152948620 None] creating volume 'volume-99013433-1e4a-4016-bd5e-c6bb6e234b6e' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:06:02.192318 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c43ac25c-ee28-4e9a-9d61-f9d3d7264d5c tempest-DeleteServersTestJSON-152948620 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:06:02.309878 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c43ac25c-ee28-4e9a-9d61-f9d3d7264d5c tempest-DeleteServersTestJSON-152948620 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:06:02.310252 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c43ac25c-ee28-4e9a-9d61-f9d3d7264d5c tempest-DeleteServersTestJSON-152948620 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:06:02.328028 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c43ac25c-ee28-4e9a-9d61-f9d3d7264d5c tempest-DeleteServersTestJSON-152948620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51c4097f-22b6-4516-914d-ae37adb5e8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99013433-1e4a-4016-bd5e-c6bb6e234b6e', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:06:02.334483 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c43ac25c-ee28-4e9a-9d61-f9d3d7264d5c tempest-DeleteServersTestJSON-152948620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d04d82f9-932a-4aeb-8490-528630ff370b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:06:02.348371 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-c43ac25c-ee28-4e9a-9d61-f9d3d7264d5c tempest-DeleteServersTestJSON-152948620 None] Volume volume-99013433-1e4a-4016-bd5e-c6bb6e234b6e (99013433-1e4a-4016-bd5e-c6bb6e234b6e): created successfully Mar 12 21:06:02.357377 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c43ac25c-ee28-4e9a-9d61-f9d3d7264d5c tempest-DeleteServersTestJSON-152948620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d04d82f9-932a-4aeb-8490-528630ff370b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:06:02.364385 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c43ac25c-ee28-4e9a-9d61-f9d3d7264d5c tempest-DeleteServersTestJSON-152948620 None] Flow 'volume_create_manager' (b0ff8f60-4e00-4734-b941-7b231f1bab05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:06:02.376235 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-c43ac25c-ee28-4e9a-9d61-f9d3d7264d5c tempest-DeleteServersTestJSON-152948620 None] Created volume successfully. Mar 12 21:06:03.672847 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-ce5c6fec-6561-42c1-885e-91d6c23baf67 req-ca69d55e-c907-44ff-b922-2c571aa8f4f0 tempest-DeleteServersTestJSON-152948620 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 21:06:04.744006 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-ce5c6fec-6561-42c1-885e-91d6c23baf67 req-ca69d55e-c907-44ff-b922-2c571aa8f4f0 tempest-DeleteServersTestJSON-152948620 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.070s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 21:06:04.745880 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-ce5c6fec-6561-42c1-885e-91d6c23baf67 req-ca69d55e-c907-44ff-b922-2c571aa8f4f0 tempest-DeleteServersTestJSON-152948620 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-99013433-1e4a-4016-bd5e-c6bb6e234b6e', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': '99013433-1e4a-4016-bd5e-c6bb6e234b6e', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 21:06:04.791361 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-ce5c6fec-6561-42c1-885e-91d6c23baf67 req-ca69d55e-c907-44ff-b922-2c571aa8f4f0 tempest-DeleteServersTestJSON-152948620 None] Connection info returned from driver {'name': 'volumes/volume-99013433-1e4a-4016-bd5e-c6bb6e234b6e', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '99013433-1e4a-4016-bd5e-c6bb6e234b6e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd345b250-82b9-47fc-8144-a7691805e4d3'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 21:06:04.905404 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-ce5c6fec-6561-42c1-885e-91d6c23baf67 req-ca69d55e-c907-44ff-b922-2c571aa8f4f0 tempest-DeleteServersTestJSON-152948620 None] attachment_update completed successfully. Mar 12 21:06:10.162739 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-429b63c6-163d-4bc2-bf56-5ce99fda6eaa tempest-AttachVolumeNegativeTest-2014367252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:06:10.175274 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-429b63c6-163d-4bc2-bf56-5ce99fda6eaa tempest-AttachVolumeNegativeTest-2014367252 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:06:10.175798 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-429b63c6-163d-4bc2-bf56-5ce99fda6eaa tempest-AttachVolumeNegativeTest-2014367252 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:06:10.225648 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-429b63c6-163d-4bc2-bf56-5ce99fda6eaa tempest-AttachVolumeNegativeTest-2014367252 None] Flow 'volume_create_manager' (d8e9aeca-1411-4faf-ab53-71082091e551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:06:10.240622 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-429b63c6-163d-4bc2-bf56-5ce99fda6eaa tempest-AttachVolumeNegativeTest-2014367252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f2f536d-b0cc-47c1-8702-7685bc76aa9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:06:10.251900 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-429b63c6-163d-4bc2-bf56-5ce99fda6eaa tempest-AttachVolumeNegativeTest-2014367252 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:06:10.288421 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-429b63c6-163d-4bc2-bf56-5ce99fda6eaa tempest-AttachVolumeNegativeTest-2014367252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f2f536d-b0cc-47c1-8702-7685bc76aa9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2000875952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ba7d5c32-c844-466a-925a-148040924690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f427010b06749289b20e8b776a8b8c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:06:10Z,use_quota=True,user_id='f2c8058e4e8d475c9377a065b4018a2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:06:10.303194 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-429b63c6-163d-4bc2-bf56-5ce99fda6eaa tempest-AttachVolumeNegativeTest-2014367252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (594da10d-059c-4cbd-855a-8f0c3af8a082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:06:10.311370 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-429b63c6-163d-4bc2-bf56-5ce99fda6eaa tempest-AttachVolumeNegativeTest-2014367252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (594da10d-059c-4cbd-855a-8f0c3af8a082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:06:10.322886 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-429b63c6-163d-4bc2-bf56-5ce99fda6eaa tempest-AttachVolumeNegativeTest-2014367252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (835074d8-b1f8-4545-a6b9-e38ffa63c62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:06:10.331981 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-429b63c6-163d-4bc2-bf56-5ce99fda6eaa tempest-AttachVolumeNegativeTest-2014367252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (835074d8-b1f8-4545-a6b9-e38ffa63c62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba7d5c32-c844-466a-925a-148040924690', 'volume_name': 'volume-ba7d5c32-c844-466a-925a-148040924690', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:06:10.343765 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-429b63c6-163d-4bc2-bf56-5ce99fda6eaa tempest-AttachVolumeNegativeTest-2014367252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec6f08b-e6f2-451f-bd6d-10be28fb55ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:06:10.372521 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-429b63c6-163d-4bc2-bf56-5ce99fda6eaa tempest-AttachVolumeNegativeTest-2014367252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec6f08b-e6f2-451f-bd6d-10be28fb55ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:06:10.380932 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-429b63c6-163d-4bc2-bf56-5ce99fda6eaa tempest-AttachVolumeNegativeTest-2014367252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97bd6d46-9a09-415c-bd94-3f1d6056dde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:06:10.382125 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-429b63c6-163d-4bc2-bf56-5ce99fda6eaa tempest-AttachVolumeNegativeTest-2014367252 None] Volume ba7d5c32-c844-466a-925a-148040924690: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba7d5c32-c844-466a-925a-148040924690', 'volume_size': 1} Mar 12 21:06:10.382764 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-429b63c6-163d-4bc2-bf56-5ce99fda6eaa tempest-AttachVolumeNegativeTest-2014367252 None] creating volume 'volume-ba7d5c32-c844-466a-925a-148040924690' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:06:10.402032 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-429b63c6-163d-4bc2-bf56-5ce99fda6eaa tempest-AttachVolumeNegativeTest-2014367252 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:06:10.508041 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-429b63c6-163d-4bc2-bf56-5ce99fda6eaa tempest-AttachVolumeNegativeTest-2014367252 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:06:10.509721 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-429b63c6-163d-4bc2-bf56-5ce99fda6eaa tempest-AttachVolumeNegativeTest-2014367252 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:06:10.515969 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-429b63c6-163d-4bc2-bf56-5ce99fda6eaa tempest-AttachVolumeNegativeTest-2014367252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97bd6d46-9a09-415c-bd94-3f1d6056dde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba7d5c32-c844-466a-925a-148040924690', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:06:10.523514 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-429b63c6-163d-4bc2-bf56-5ce99fda6eaa tempest-AttachVolumeNegativeTest-2014367252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa42442d-dc12-474c-8264-3fe9ae4d4675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:06:10.542359 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-429b63c6-163d-4bc2-bf56-5ce99fda6eaa tempest-AttachVolumeNegativeTest-2014367252 None] Volume volume-ba7d5c32-c844-466a-925a-148040924690 (ba7d5c32-c844-466a-925a-148040924690): created successfully Mar 12 21:06:10.548834 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-429b63c6-163d-4bc2-bf56-5ce99fda6eaa tempest-AttachVolumeNegativeTest-2014367252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa42442d-dc12-474c-8264-3fe9ae4d4675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:06:10.556614 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-429b63c6-163d-4bc2-bf56-5ce99fda6eaa tempest-AttachVolumeNegativeTest-2014367252 None] Flow 'volume_create_manager' (d8e9aeca-1411-4faf-ab53-71082091e551) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:06:10.575070 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-429b63c6-163d-4bc2-bf56-5ce99fda6eaa tempest-AttachVolumeNegativeTest-2014367252 None] Created volume successfully. Mar 12 21:06:10.942207 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-4638f00d-d3b9-4546-900a-d8794088f1c4 req-79a8e475-cb75-450e-9fa7-d0e914afe4f4 tempest-DeleteServersTestJSON-152948620 None] Terminate volume connection completed successfully. Mar 12 21:06:10.942824 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-4638f00d-d3b9-4546-900a-d8794088f1c4 req-79a8e475-cb75-450e-9fa7-d0e914afe4f4 tempest-DeleteServersTestJSON-152948620 None] Deleting attachment d345b250-82b9-47fc-8144-a7691805e4d3. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 21:06:11.886217 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-0d66ef3d-4516-4201-ac4f-b8cd1c1741a5 req-88b95cc7-7775-4a0b-8567-a0c8cd8cdfca tempest-AttachVolumeNegativeTest-2014367252 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 21:06:12.867176 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-0d66ef3d-4516-4201-ac4f-b8cd1c1741a5 req-88b95cc7-7775-4a0b-8567-a0c8cd8cdfca tempest-AttachVolumeNegativeTest-2014367252 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.981s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 21:06:12.868709 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-0d66ef3d-4516-4201-ac4f-b8cd1c1741a5 req-88b95cc7-7775-4a0b-8567-a0c8cd8cdfca tempest-AttachVolumeNegativeTest-2014367252 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ba7d5c32-c844-466a-925a-148040924690', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': 'ba7d5c32-c844-466a-925a-148040924690', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 21:06:12.912646 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-0d66ef3d-4516-4201-ac4f-b8cd1c1741a5 req-88b95cc7-7775-4a0b-8567-a0c8cd8cdfca tempest-AttachVolumeNegativeTest-2014367252 None] Connection info returned from driver {'name': 'volumes/volume-ba7d5c32-c844-466a-925a-148040924690', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ba7d5c32-c844-466a-925a-148040924690', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '6eb14818-dd59-439d-adee-f21db388f7ea'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 21:06:13.018406 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-0d66ef3d-4516-4201-ac4f-b8cd1c1741a5 req-88b95cc7-7775-4a0b-8567-a0c8cd8cdfca tempest-AttachVolumeNegativeTest-2014367252 None] attachment_update completed successfully. Mar 12 21:06:16.532527 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cc1cd99-af2d-427c-822c-a855ebbace58 tempest-SnapshotsActionsTest-998235387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:06:16.540656 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-4cc1cd99-af2d-427c-822c-a855ebbace58 tempest-SnapshotsActionsTest-998235387 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:06:16.542360 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-4cc1cd99-af2d-427c-822c-a855ebbace58 tempest-SnapshotsActionsTest-998235387 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:06:16.603874 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4cc1cd99-af2d-427c-822c-a855ebbace58 tempest-SnapshotsActionsTest-998235387 None] Flow 'volume_create_manager' (4c8c2dfa-787f-4f0f-8af8-dbf59b863bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:06:16.624206 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4cc1cd99-af2d-427c-822c-a855ebbace58 tempest-SnapshotsActionsTest-998235387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e60a47b-1a53-4a1a-9078-8349a23c22c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:06:16.640096 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-4cc1cd99-af2d-427c-822c-a855ebbace58 tempest-SnapshotsActionsTest-998235387 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:06:16.670359 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4cc1cd99-af2d-427c-822c-a855ebbace58 tempest-SnapshotsActionsTest-998235387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e60a47b-1a53-4a1a-9078-8349a23c22c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1114150089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2f71ae8a-ee02-4f22-9c8b-8e479fa75a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd49571492f43fd9b08d72a826d02b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:06:16Z,use_quota=True,user_id='ccf3942fdf6e468380bbd417c65c3a68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:06:16.678054 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4cc1cd99-af2d-427c-822c-a855ebbace58 tempest-SnapshotsActionsTest-998235387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2982e272-58fc-4ab7-ba50-ee3059294be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:06:16.687649 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4cc1cd99-af2d-427c-822c-a855ebbace58 tempest-SnapshotsActionsTest-998235387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2982e272-58fc-4ab7-ba50-ee3059294be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:06:16.693295 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4cc1cd99-af2d-427c-822c-a855ebbace58 tempest-SnapshotsActionsTest-998235387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (519c679c-087f-47f5-aca8-4cb1dc87de61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:06:16.699028 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4cc1cd99-af2d-427c-822c-a855ebbace58 tempest-SnapshotsActionsTest-998235387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (519c679c-087f-47f5-aca8-4cb1dc87de61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f71ae8a-ee02-4f22-9c8b-8e479fa75a12', 'volume_name': 'volume-2f71ae8a-ee02-4f22-9c8b-8e479fa75a12', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:06:16.706405 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4cc1cd99-af2d-427c-822c-a855ebbace58 tempest-SnapshotsActionsTest-998235387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b12e99-c1af-44fe-85d7-3cbe7280b645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:06:16.713119 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4cc1cd99-af2d-427c-822c-a855ebbace58 tempest-SnapshotsActionsTest-998235387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b12e99-c1af-44fe-85d7-3cbe7280b645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:06:16.720856 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4cc1cd99-af2d-427c-822c-a855ebbace58 tempest-SnapshotsActionsTest-998235387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35ded85e-f027-4d96-9fe5-8cafb3a4f019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:06:16.722656 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-4cc1cd99-af2d-427c-822c-a855ebbace58 tempest-SnapshotsActionsTest-998235387 None] Volume 2f71ae8a-ee02-4f22-9c8b-8e479fa75a12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f71ae8a-ee02-4f22-9c8b-8e479fa75a12', 'volume_size': 1} Mar 12 21:06:16.723699 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-4cc1cd99-af2d-427c-822c-a855ebbace58 tempest-SnapshotsActionsTest-998235387 None] creating volume 'volume-2f71ae8a-ee02-4f22-9c8b-8e479fa75a12' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:06:16.725434 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-4cc1cd99-af2d-427c-822c-a855ebbace58 tempest-SnapshotsActionsTest-998235387 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:06:16.865856 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-4cc1cd99-af2d-427c-822c-a855ebbace58 tempest-SnapshotsActionsTest-998235387 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:06:16.866345 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-4cc1cd99-af2d-427c-822c-a855ebbace58 tempest-SnapshotsActionsTest-998235387 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:06:16.871267 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4cc1cd99-af2d-427c-822c-a855ebbace58 tempest-SnapshotsActionsTest-998235387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35ded85e-f027-4d96-9fe5-8cafb3a4f019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f71ae8a-ee02-4f22-9c8b-8e479fa75a12', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:06:16.882113 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4cc1cd99-af2d-427c-822c-a855ebbace58 tempest-SnapshotsActionsTest-998235387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae901671-5508-4ed5-a211-dfdc7df4faa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:06:16.902604 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-4cc1cd99-af2d-427c-822c-a855ebbace58 tempest-SnapshotsActionsTest-998235387 None] Volume volume-2f71ae8a-ee02-4f22-9c8b-8e479fa75a12 (2f71ae8a-ee02-4f22-9c8b-8e479fa75a12): created successfully Mar 12 21:06:16.906762 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4cc1cd99-af2d-427c-822c-a855ebbace58 tempest-SnapshotsActionsTest-998235387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae901671-5508-4ed5-a211-dfdc7df4faa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:06:16.924268 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4cc1cd99-af2d-427c-822c-a855ebbace58 tempest-SnapshotsActionsTest-998235387 None] Flow 'volume_create_manager' (4c8c2dfa-787f-4f0f-8af8-dbf59b863bac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:06:16.939696 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-4cc1cd99-af2d-427c-822c-a855ebbace58 tempest-SnapshotsActionsTest-998235387 None] Created volume successfully. Mar 12 21:06:17.819416 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a7f804d6-a03c-4f74-95ba-913c7a5d4783 tempest-SnapshotsActionsTest-998235387 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:06:18.509296 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-a7f804d6-a03c-4f74-95ba-913c7a5d4783 tempest-SnapshotsActionsTest-998235387 None] Create snapshot completed successfully Mar 12 21:06:19.810794 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a7673084-6e5b-4a04-97bf-fecf971bb24b tempest-SnapshotsActionsTest-998235387 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:06:20.607962 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-a7673084-6e5b-4a04-97bf-fecf971bb24b tempest-SnapshotsActionsTest-998235387 None] Create snapshot completed successfully Mar 12 21:06:21.080012 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-ae71a287-d64f-4286-bb25-52d67510d431 tempest-SnapshotsActionsTest-1625232635 None] Lock "b'cinder-59a6a5c4-bcb3-44bd-a853-83280ee2e5b4-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.019s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:06:21.085901 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-ae71a287-d64f-4286-bb25-52d67510d431 tempest-SnapshotsActionsTest-1625232635 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:06:21.729904 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-ae71a287-d64f-4286-bb25-52d67510d431 tempest-SnapshotsActionsTest-1625232635 None] Created reservations ['6d269564-f92c-4f53-a88e-c4a0f9b75267', '9a97840e-4534-4aff-8004-e1ffe40fae28', '815398b3-0aee-431b-baf5-84a3ed655371', '928184a0-1fe2-4760-9f3b-86852f4ecfd6'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:06:21.854595 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-ae71a287-d64f-4286-bb25-52d67510d431 tempest-SnapshotsActionsTest-1625232635 None] Delete snapshot completed successfully. Mar 12 21:06:21.862341 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-ae71a287-d64f-4286-bb25-52d67510d431 tempest-SnapshotsActionsTest-1625232635 None] Lock "b'cinder-59a6a5c4-bcb3-44bd-a853-83280ee2e5b4-delete_snapshot'" released by "delete_snapshot" :: held 0.782s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:06:22.731960 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-ff480534-49a6-49e0-a143-92df0c74e5e1 tempest-SnapshotsActionsTest-998235387 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:06:23.796976 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-ff480534-49a6-49e0-a143-92df0c74e5e1 tempest-SnapshotsActionsTest-998235387 None] Create snapshot completed successfully Mar 12 21:06:25.061540 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-c36c4ef4-1748-423d-9780-8d8e9fb93cb0 tempest-SnapshotsActionsTest-1625232635 None] Lock "b'cinder-cf9c80ea-9986-4e08-b89f-278fc72bb702-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:06:25.070363 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c36c4ef4-1748-423d-9780-8d8e9fb93cb0 tempest-SnapshotsActionsTest-1625232635 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:06:25.796195 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-c36c4ef4-1748-423d-9780-8d8e9fb93cb0 tempest-SnapshotsActionsTest-1625232635 None] Created reservations ['361fef15-0f92-4762-89b8-2367fc14058f', 'da2fdaca-adcd-4982-91cb-72fc662f068c', '53624453-66ee-439c-bcbf-36d3a6f481ff', '66819b9e-8a2a-4707-941b-887b15a60aa6'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:06:25.948475 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-c36c4ef4-1748-423d-9780-8d8e9fb93cb0 tempest-SnapshotsActionsTest-1625232635 None] Delete snapshot completed successfully. Mar 12 21:06:25.956361 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-c36c4ef4-1748-423d-9780-8d8e9fb93cb0 tempest-SnapshotsActionsTest-1625232635 None] Lock "b'cinder-cf9c80ea-9986-4e08-b89f-278fc72bb702-delete_snapshot'" released by "delete_snapshot" :: held 0.899s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:06:26.669637 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2ddb0523-1744-4426-a256-bf3252ff11a0 tempest-SnapshotsActionsTest-998235387 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:06:27.906033 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-2ddb0523-1744-4426-a256-bf3252ff11a0 tempest-SnapshotsActionsTest-998235387 None] Create snapshot completed successfully Mar 12 21:06:28.960129 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-97782ad7-bcc4-4630-82e2-8e37ee60c3c3 tempest-SnapshotsActionsTest-1625232635 None] Lock "b'cinder-e6ea8132-1b54-45d7-9918-831a176c07b4-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:06:28.968039 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-97782ad7-bcc4-4630-82e2-8e37ee60c3c3 tempest-SnapshotsActionsTest-1625232635 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:06:29.915687 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-97782ad7-bcc4-4630-82e2-8e37ee60c3c3 tempest-SnapshotsActionsTest-1625232635 None] Created reservations ['ccbdbcd9-0daf-48b1-bbfd-d4447dfb12d4', '86674726-eefa-4886-8cdb-2710d0465972', '6dea3528-eebb-4bed-805b-14f500ce4495', '9f3ebd91-0509-49e9-9af7-c1b2742f4c9f'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:06:30.037582 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-97782ad7-bcc4-4630-82e2-8e37ee60c3c3 tempest-SnapshotsActionsTest-1625232635 None] Delete snapshot completed successfully. Mar 12 21:06:30.067606 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-97782ad7-bcc4-4630-82e2-8e37ee60c3c3 tempest-SnapshotsActionsTest-1625232635 None] Lock "b'cinder-e6ea8132-1b54-45d7-9918-831a176c07b4-delete_snapshot'" released by "delete_snapshot" :: held 1.104s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:06:30.655961 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-134c978a-e27b-4b4f-b501-0ac8049a2fd6 tempest-SnapshotsActionsTest-998235387 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:06:31.897252 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-134c978a-e27b-4b4f-b501-0ac8049a2fd6 tempest-SnapshotsActionsTest-998235387 None] Create snapshot completed successfully Mar 12 21:06:32.968773 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-5361f738-a0b2-46ee-86a4-e735bc95fe23 tempest-SnapshotsActionsTest-1625232635 None] Lock "b'cinder-1c23b550-93f6-4de0-be2a-7040084d26fb-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.043s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:06:32.971184 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-5361f738-a0b2-46ee-86a4-e735bc95fe23 tempest-SnapshotsActionsTest-1625232635 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:06:33.946276 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-5361f738-a0b2-46ee-86a4-e735bc95fe23 tempest-SnapshotsActionsTest-1625232635 None] Created reservations ['af23a204-6ac2-458f-b286-ab528aca98f5', '426b256e-e7da-4b3b-960a-0b16ccaa9afe', 'be92a03f-7b41-4e36-93fe-4a4bd741c45e', '7fe41961-e7b8-4618-9960-03f96a1e41ef'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:06:34.008047 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-5361f738-a0b2-46ee-86a4-e735bc95fe23 tempest-SnapshotsActionsTest-1625232635 None] Delete snapshot completed successfully. Mar 12 21:06:34.015726 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-5361f738-a0b2-46ee-86a4-e735bc95fe23 tempest-SnapshotsActionsTest-1625232635 None] Lock "b'cinder-1c23b550-93f6-4de0-be2a-7040084d26fb-delete_snapshot'" released by "delete_snapshot" :: held 1.047s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:06:35.040198 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-3419928f-3370-40f0-b0ca-69605ff5c446 tempest-SnapshotsActionsTest-998235387 None] Lock "b'cinder-aff828e9-5526-44f6-b274-645ff7e1cb81-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.016s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:06:35.043091 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3419928f-3370-40f0-b0ca-69605ff5c446 tempest-SnapshotsActionsTest-998235387 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:06:36.065895 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-3419928f-3370-40f0-b0ca-69605ff5c446 tempest-SnapshotsActionsTest-998235387 None] Created reservations ['95f87cc3-da3e-420e-bfa6-449543faf978', '6ad781ac-b733-4308-8e9c-2247dbdd5389', '2538d170-d93d-4f9e-8f14-7e60b8f30a99', 'c8af6b8d-9757-4c86-87e1-79ad582f9989'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:06:36.118990 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-3419928f-3370-40f0-b0ca-69605ff5c446 tempest-SnapshotsActionsTest-998235387 None] Delete snapshot completed successfully. Mar 12 21:06:36.139009 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-3419928f-3370-40f0-b0ca-69605ff5c446 tempest-SnapshotsActionsTest-998235387 None] Lock "b'cinder-aff828e9-5526-44f6-b274-645ff7e1cb81-delete_snapshot'" released by "delete_snapshot" :: held 1.099s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:06:36.319417 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-8160e68f-9497-4659-b3a3-90e8ffada3f9 tempest-SnapshotsActionsTest-998235387 None] Lock "b'cinder-2f71ae8a-ee02-4f22-9c8b-8e479fa75a12-delete_volume'" acquired by "delete_volume" :: waited 0.031s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:06:36.415063 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8160e68f-9497-4659-b3a3-90e8ffada3f9 tempest-SnapshotsActionsTest-998235387 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:06:36.545084 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8160e68f-9497-4659-b3a3-90e8ffada3f9 tempest-SnapshotsActionsTest-998235387 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:06:36.545538 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8160e68f-9497-4659-b3a3-90e8ffada3f9 tempest-SnapshotsActionsTest-998235387 None] Volume volume-2f71ae8a-ee02-4f22-9c8b-8e479fa75a12 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:06:36.559415 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8160e68f-9497-4659-b3a3-90e8ffada3f9 tempest-SnapshotsActionsTest-998235387 None] deleting rbd volume volume-2f71ae8a-ee02-4f22-9c8b-8e479fa75a12 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:06:37.122528 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-8160e68f-9497-4659-b3a3-90e8ffada3f9 tempest-SnapshotsActionsTest-998235387 None] Created reservations ['311a735d-1f0e-415a-8ad0-0b5d33b42c1a', '7e9711ca-a788-4a27-b017-20f75729ea69', 'e7760a44-bb59-4921-8e2a-1a9a87d0e985', '6819c968-6f01-40db-846b-f5e0fc0b4a22'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:06:37.256549 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8160e68f-9497-4659-b3a3-90e8ffada3f9 tempest-SnapshotsActionsTest-998235387 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:06:37.359524 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8160e68f-9497-4659-b3a3-90e8ffada3f9 tempest-SnapshotsActionsTest-998235387 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:06:37.500067 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-8160e68f-9497-4659-b3a3-90e8ffada3f9 tempest-SnapshotsActionsTest-998235387 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:06:37.505217 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-8160e68f-9497-4659-b3a3-90e8ffada3f9 tempest-SnapshotsActionsTest-998235387 None] Deleted volume successfully. Mar 12 21:06:37.528486 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-8160e68f-9497-4659-b3a3-90e8ffada3f9 tempest-SnapshotsActionsTest-998235387 None] Lock "b'cinder-2f71ae8a-ee02-4f22-9c8b-8e479fa75a12-delete_volume'" released by "delete_volume" :: held 1.209s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:06:51.149419 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:06:51.151539 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:06:51.213958 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:06:51.274964 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:06:53.672097 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-f036a72f-9be7-4138-8502-ff1ac9d5573c tempest-VolumeQuotasAdminTestJSON-1099842428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:06:53.680922 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-f036a72f-9be7-4138-8502-ff1ac9d5573c tempest-VolumeQuotasAdminTestJSON-1099842428 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:06:53.681367 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-f036a72f-9be7-4138-8502-ff1ac9d5573c tempest-VolumeQuotasAdminTestJSON-1099842428 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:06:53.731241 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f036a72f-9be7-4138-8502-ff1ac9d5573c tempest-VolumeQuotasAdminTestJSON-1099842428 None] Flow 'volume_create_manager' (8e92f63f-1fb5-4567-ac37-cb039fecc5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:06:53.759885 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f036a72f-9be7-4138-8502-ff1ac9d5573c tempest-VolumeQuotasAdminTestJSON-1099842428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f98ad7e2-50dc-4f95-ae1f-7084ab31b769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:06:53.772418 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-f036a72f-9be7-4138-8502-ff1ac9d5573c tempest-VolumeQuotasAdminTestJSON-1099842428 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:06:53.796056 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f036a72f-9be7-4138-8502-ff1ac9d5573c tempest-VolumeQuotasAdminTestJSON-1099842428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f98ad7e2-50dc-4f95-ae1f-7084ab31b769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-115491287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4169384f-e174-4132-ac95-090c6c9799f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f24e1a9275949d3ae00e746a5d2a689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:06:54Z,use_quota=True,user_id='b8d4a986989c454dbd7613a55d62ec4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:06:53.802882 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f036a72f-9be7-4138-8502-ff1ac9d5573c tempest-VolumeQuotasAdminTestJSON-1099842428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22e61d56-1d62-4bb6-82c9-2ccbfab9aa84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:06:53.808539 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f036a72f-9be7-4138-8502-ff1ac9d5573c tempest-VolumeQuotasAdminTestJSON-1099842428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22e61d56-1d62-4bb6-82c9-2ccbfab9aa84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:06:53.815333 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f036a72f-9be7-4138-8502-ff1ac9d5573c tempest-VolumeQuotasAdminTestJSON-1099842428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02dda5cc-830d-4f51-a844-0c66505b2db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:06:53.820880 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f036a72f-9be7-4138-8502-ff1ac9d5573c tempest-VolumeQuotasAdminTestJSON-1099842428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02dda5cc-830d-4f51-a844-0c66505b2db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4169384f-e174-4132-ac95-090c6c9799f3', 'volume_name': 'volume-4169384f-e174-4132-ac95-090c6c9799f3', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:06:53.828063 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f036a72f-9be7-4138-8502-ff1ac9d5573c tempest-VolumeQuotasAdminTestJSON-1099842428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e4edd3-43d5-4c1a-97bc-f87f344dc4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:06:53.833693 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f036a72f-9be7-4138-8502-ff1ac9d5573c tempest-VolumeQuotasAdminTestJSON-1099842428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e4edd3-43d5-4c1a-97bc-f87f344dc4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:06:53.839777 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f036a72f-9be7-4138-8502-ff1ac9d5573c tempest-VolumeQuotasAdminTestJSON-1099842428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b49791-48fe-43cc-bf25-85c8b349db08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:06:53.841164 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-f036a72f-9be7-4138-8502-ff1ac9d5573c tempest-VolumeQuotasAdminTestJSON-1099842428 None] Volume 4169384f-e174-4132-ac95-090c6c9799f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4169384f-e174-4132-ac95-090c6c9799f3', 'volume_size': 1} Mar 12 21:06:53.841740 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f036a72f-9be7-4138-8502-ff1ac9d5573c tempest-VolumeQuotasAdminTestJSON-1099842428 None] creating volume 'volume-4169384f-e174-4132-ac95-090c6c9799f3' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:06:53.843265 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f036a72f-9be7-4138-8502-ff1ac9d5573c tempest-VolumeQuotasAdminTestJSON-1099842428 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:06:53.990539 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f036a72f-9be7-4138-8502-ff1ac9d5573c tempest-VolumeQuotasAdminTestJSON-1099842428 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:06:53.996053 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f036a72f-9be7-4138-8502-ff1ac9d5573c tempest-VolumeQuotasAdminTestJSON-1099842428 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:06:54.002121 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f036a72f-9be7-4138-8502-ff1ac9d5573c tempest-VolumeQuotasAdminTestJSON-1099842428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b49791-48fe-43cc-bf25-85c8b349db08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4169384f-e174-4132-ac95-090c6c9799f3', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:06:54.006919 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f036a72f-9be7-4138-8502-ff1ac9d5573c tempest-VolumeQuotasAdminTestJSON-1099842428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75574e97-82cd-4c19-84a6-9920ba8c0d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:06:54.030913 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-f036a72f-9be7-4138-8502-ff1ac9d5573c tempest-VolumeQuotasAdminTestJSON-1099842428 None] Volume volume-4169384f-e174-4132-ac95-090c6c9799f3 (4169384f-e174-4132-ac95-090c6c9799f3): created successfully Mar 12 21:06:54.045993 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f036a72f-9be7-4138-8502-ff1ac9d5573c tempest-VolumeQuotasAdminTestJSON-1099842428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75574e97-82cd-4c19-84a6-9920ba8c0d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:06:54.057181 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f036a72f-9be7-4138-8502-ff1ac9d5573c tempest-VolumeQuotasAdminTestJSON-1099842428 None] Flow 'volume_create_manager' (8e92f63f-1fb5-4567-ac37-cb039fecc5a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:06:54.110855 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-f036a72f-9be7-4138-8502-ff1ac9d5573c tempest-VolumeQuotasAdminTestJSON-1099842428 None] Created volume successfully. Mar 12 21:06:54.928226 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-03589168-4652-49c5-90b6-e968906bb9bc tempest-VolumeQuotasAdminTestJSON-1099842428 None] Lock "b'cinder-4169384f-e174-4132-ac95-090c6c9799f3-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:06:55.006457 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-03589168-4652-49c5-90b6-e968906bb9bc tempest-VolumeQuotasAdminTestJSON-1099842428 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:06:55.091023 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-03589168-4652-49c5-90b6-e968906bb9bc tempest-VolumeQuotasAdminTestJSON-1099842428 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:06:55.091518 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-03589168-4652-49c5-90b6-e968906bb9bc tempest-VolumeQuotasAdminTestJSON-1099842428 None] Volume volume-4169384f-e174-4132-ac95-090c6c9799f3 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:06:55.105151 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-03589168-4652-49c5-90b6-e968906bb9bc tempest-VolumeQuotasAdminTestJSON-1099842428 None] deleting rbd volume volume-4169384f-e174-4132-ac95-090c6c9799f3 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:06:55.687134 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-03589168-4652-49c5-90b6-e968906bb9bc tempest-VolumeQuotasAdminTestJSON-1099842428 None] Created reservations ['d8516588-d3c6-4f6b-bb05-a94f9c04cdfd', '2a18b1e6-fbb3-4269-8039-8847a9789c6e', 'c0e1aa1a-4f64-4e68-a97f-c9f815066491', 'cf75c565-04f8-449c-922c-315bcb0983a3'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:06:55.780122 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-03589168-4652-49c5-90b6-e968906bb9bc tempest-VolumeQuotasAdminTestJSON-1099842428 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:06:55.871120 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-03589168-4652-49c5-90b6-e968906bb9bc tempest-VolumeQuotasAdminTestJSON-1099842428 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:06:55.957303 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-03589168-4652-49c5-90b6-e968906bb9bc tempest-VolumeQuotasAdminTestJSON-1099842428 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:06:55.965697 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-03589168-4652-49c5-90b6-e968906bb9bc tempest-VolumeQuotasAdminTestJSON-1099842428 None] Deleted volume successfully. Mar 12 21:06:55.986572 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-03589168-4652-49c5-90b6-e968906bb9bc tempest-VolumeQuotasAdminTestJSON-1099842428 None] Lock "b'cinder-4169384f-e174-4132-ac95-090c6c9799f3-delete_volume'" released by "delete_volume" :: held 1.058s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:06:56.794858 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-70838e8f-5e65-4fae-9b76-649ded27f644 tempest-VolumeQuotasAdminTestJSON-1099842428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:06:56.803360 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-70838e8f-5e65-4fae-9b76-649ded27f644 tempest-VolumeQuotasAdminTestJSON-1099842428 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:06:56.803918 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-70838e8f-5e65-4fae-9b76-649ded27f644 tempest-VolumeQuotasAdminTestJSON-1099842428 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:06:56.847810 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-70838e8f-5e65-4fae-9b76-649ded27f644 tempest-VolumeQuotasAdminTestJSON-1099842428 None] Flow 'volume_create_manager' (066ad7b0-5eab-4edb-9cd7-fbe31200a4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:06:56.872832 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-70838e8f-5e65-4fae-9b76-649ded27f644 tempest-VolumeQuotasAdminTestJSON-1099842428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a43114e2-c842-4fe1-9b93-b8c31df4ac3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:06:56.888449 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-70838e8f-5e65-4fae-9b76-649ded27f644 tempest-VolumeQuotasAdminTestJSON-1099842428 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:06:56.927756 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-70838e8f-5e65-4fae-9b76-649ded27f644 tempest-VolumeQuotasAdminTestJSON-1099842428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a43114e2-c842-4fe1-9b93-b8c31df4ac3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1095384489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a6886e08-01df-4a10-a11e-904ca36a4a65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f24e1a9275949d3ae00e746a5d2a689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:06:57Z,use_quota=True,user_id='b8d4a986989c454dbd7613a55d62ec4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:06:56.943293 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-70838e8f-5e65-4fae-9b76-649ded27f644 tempest-VolumeQuotasAdminTestJSON-1099842428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f64141-bb01-4f8f-a9f3-0d58e6f515ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:06:56.960955 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-70838e8f-5e65-4fae-9b76-649ded27f644 tempest-VolumeQuotasAdminTestJSON-1099842428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f64141-bb01-4f8f-a9f3-0d58e6f515ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:06:56.972223 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-70838e8f-5e65-4fae-9b76-649ded27f644 tempest-VolumeQuotasAdminTestJSON-1099842428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (763dd3b7-d263-4806-b585-40f3f672a7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:06:56.984413 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-70838e8f-5e65-4fae-9b76-649ded27f644 tempest-VolumeQuotasAdminTestJSON-1099842428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (763dd3b7-d263-4806-b585-40f3f672a7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6886e08-01df-4a10-a11e-904ca36a4a65', 'volume_name': 'volume-a6886e08-01df-4a10-a11e-904ca36a4a65', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:06:57.001143 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-70838e8f-5e65-4fae-9b76-649ded27f644 tempest-VolumeQuotasAdminTestJSON-1099842428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fab5512e-b2d1-441d-83c4-b4dcc6a385b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:06:57.006451 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-70838e8f-5e65-4fae-9b76-649ded27f644 tempest-VolumeQuotasAdminTestJSON-1099842428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fab5512e-b2d1-441d-83c4-b4dcc6a385b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:06:57.015321 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-70838e8f-5e65-4fae-9b76-649ded27f644 tempest-VolumeQuotasAdminTestJSON-1099842428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6a06a16-cd3a-4b75-8fb7-6da3d5c26015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:06:57.017157 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-70838e8f-5e65-4fae-9b76-649ded27f644 tempest-VolumeQuotasAdminTestJSON-1099842428 None] Volume a6886e08-01df-4a10-a11e-904ca36a4a65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6886e08-01df-4a10-a11e-904ca36a4a65', 'volume_size': 1} Mar 12 21:06:57.017841 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-70838e8f-5e65-4fae-9b76-649ded27f644 tempest-VolumeQuotasAdminTestJSON-1099842428 None] creating volume 'volume-a6886e08-01df-4a10-a11e-904ca36a4a65' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:06:57.019349 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-70838e8f-5e65-4fae-9b76-649ded27f644 tempest-VolumeQuotasAdminTestJSON-1099842428 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:06:57.164830 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-70838e8f-5e65-4fae-9b76-649ded27f644 tempest-VolumeQuotasAdminTestJSON-1099842428 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:06:57.165671 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-70838e8f-5e65-4fae-9b76-649ded27f644 tempest-VolumeQuotasAdminTestJSON-1099842428 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:06:57.172367 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-70838e8f-5e65-4fae-9b76-649ded27f644 tempest-VolumeQuotasAdminTestJSON-1099842428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6a06a16-cd3a-4b75-8fb7-6da3d5c26015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6886e08-01df-4a10-a11e-904ca36a4a65', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:06:57.177236 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-70838e8f-5e65-4fae-9b76-649ded27f644 tempest-VolumeQuotasAdminTestJSON-1099842428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c986c4f4-f605-4453-9f74-7ac4fbc622a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:06:57.217716 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-70838e8f-5e65-4fae-9b76-649ded27f644 tempest-VolumeQuotasAdminTestJSON-1099842428 None] Volume volume-a6886e08-01df-4a10-a11e-904ca36a4a65 (a6886e08-01df-4a10-a11e-904ca36a4a65): created successfully Mar 12 21:06:57.228813 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-70838e8f-5e65-4fae-9b76-649ded27f644 tempest-VolumeQuotasAdminTestJSON-1099842428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c986c4f4-f605-4453-9f74-7ac4fbc622a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:06:57.237261 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-70838e8f-5e65-4fae-9b76-649ded27f644 tempest-VolumeQuotasAdminTestJSON-1099842428 None] Flow 'volume_create_manager' (066ad7b0-5eab-4edb-9cd7-fbe31200a4ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:06:57.269750 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-70838e8f-5e65-4fae-9b76-649ded27f644 tempest-VolumeQuotasAdminTestJSON-1099842428 None] Created volume successfully. Mar 12 21:06:58.779906 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-c9eb5719-a3c1-4dae-a759-08ac0598d2d6 tempest-VolumeQuotasAdminTestJSON-461297318 None] Transfer volume completed successfully. Mar 12 21:06:59.244658 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-2c4b4960-ae10-4aac-8958-325745dfa168 tempest-VolumeQuotasAdminTestJSON-1008510883 None] Lock "b'cinder-a6886e08-01df-4a10-a11e-904ca36a4a65-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:06:59.304472 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2c4b4960-ae10-4aac-8958-325745dfa168 tempest-VolumeQuotasAdminTestJSON-1008510883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:06:59.372348 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2c4b4960-ae10-4aac-8958-325745dfa168 tempest-VolumeQuotasAdminTestJSON-1008510883 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:06:59.372860 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2c4b4960-ae10-4aac-8958-325745dfa168 tempest-VolumeQuotasAdminTestJSON-1008510883 None] Volume volume-a6886e08-01df-4a10-a11e-904ca36a4a65 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:06:59.379688 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2c4b4960-ae10-4aac-8958-325745dfa168 tempest-VolumeQuotasAdminTestJSON-1008510883 None] deleting rbd volume volume-a6886e08-01df-4a10-a11e-904ca36a4a65 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:06:59.714580 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-2c4b4960-ae10-4aac-8958-325745dfa168 tempest-VolumeQuotasAdminTestJSON-1008510883 None] Created reservations ['f6c5853d-d44a-4319-bac6-df655475d4c9', '1f045b65-6310-4970-b238-c8c2399f648d', '0f5037a4-cb07-4275-9500-e22199c4734e', '57ee302b-f7e5-4b5c-84ec-2e08d25cd37a'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:06:59.784195 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2c4b4960-ae10-4aac-8958-325745dfa168 tempest-VolumeQuotasAdminTestJSON-1008510883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:06:59.860481 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2c4b4960-ae10-4aac-8958-325745dfa168 tempest-VolumeQuotasAdminTestJSON-1008510883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:06:59.937527 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-2c4b4960-ae10-4aac-8958-325745dfa168 tempest-VolumeQuotasAdminTestJSON-1008510883 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:06:59.944658 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-2c4b4960-ae10-4aac-8958-325745dfa168 tempest-VolumeQuotasAdminTestJSON-1008510883 None] Deleted volume successfully. Mar 12 21:06:59.963989 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-2c4b4960-ae10-4aac-8958-325745dfa168 tempest-VolumeQuotasAdminTestJSON-1008510883 None] Lock "b'cinder-a6886e08-01df-4a10-a11e-904ca36a4a65-delete_volume'" released by "delete_volume" :: held 0.720s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:07:08.470898 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-5349a16d-742e-4ea8-bd95-15532735ad11 tempest-AbsoluteLimitsTests-1195124341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:07:08.479241 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-5349a16d-742e-4ea8-bd95-15532735ad11 tempest-AbsoluteLimitsTests-1195124341 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:07:08.479961 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-5349a16d-742e-4ea8-bd95-15532735ad11 tempest-AbsoluteLimitsTests-1195124341 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:07:08.510807 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5349a16d-742e-4ea8-bd95-15532735ad11 tempest-AbsoluteLimitsTests-1195124341 None] Flow 'volume_create_manager' (2f31dc04-56a0-417c-a244-f33b65b00ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:07:08.519114 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5349a16d-742e-4ea8-bd95-15532735ad11 tempest-AbsoluteLimitsTests-1195124341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c44aa44c-0f78-4a3d-a2bc-8bb0317d4d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:07:08.534246 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-5349a16d-742e-4ea8-bd95-15532735ad11 tempest-AbsoluteLimitsTests-1195124341 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:07:08.565162 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5349a16d-742e-4ea8-bd95-15532735ad11 tempest-AbsoluteLimitsTests-1195124341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c44aa44c-0f78-4a3d-a2bc-8bb0317d4d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1655575268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8f53d930-82b7-4be6-89c9-4c903f655bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09fa6a81447d4ac0b6449ce9ae782b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:07:08Z,use_quota=True,user_id='dd91bc2bcabb40509de4db3dd960a5b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:07:08.574809 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5349a16d-742e-4ea8-bd95-15532735ad11 tempest-AbsoluteLimitsTests-1195124341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1f3a173-8878-4091-85bc-eebdf05dc2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:07:08.579360 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5349a16d-742e-4ea8-bd95-15532735ad11 tempest-AbsoluteLimitsTests-1195124341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1f3a173-8878-4091-85bc-eebdf05dc2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:07:08.584692 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5349a16d-742e-4ea8-bd95-15532735ad11 tempest-AbsoluteLimitsTests-1195124341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c540643d-ba3c-47b6-957f-3f527d29c2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:07:08.589713 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5349a16d-742e-4ea8-bd95-15532735ad11 tempest-AbsoluteLimitsTests-1195124341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c540643d-ba3c-47b6-957f-3f527d29c2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f53d930-82b7-4be6-89c9-4c903f655bc2', 'volume_name': 'volume-8f53d930-82b7-4be6-89c9-4c903f655bc2', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:07:08.594932 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5349a16d-742e-4ea8-bd95-15532735ad11 tempest-AbsoluteLimitsTests-1195124341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7eeb9aa-cfe9-499b-85ee-8096adba6884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:07:08.599161 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5349a16d-742e-4ea8-bd95-15532735ad11 tempest-AbsoluteLimitsTests-1195124341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7eeb9aa-cfe9-499b-85ee-8096adba6884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:07:08.604725 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5349a16d-742e-4ea8-bd95-15532735ad11 tempest-AbsoluteLimitsTests-1195124341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f819c023-757b-4644-8388-2b39e3f2700a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:07:08.605912 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-5349a16d-742e-4ea8-bd95-15532735ad11 tempest-AbsoluteLimitsTests-1195124341 None] Volume 8f53d930-82b7-4be6-89c9-4c903f655bc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f53d930-82b7-4be6-89c9-4c903f655bc2', 'volume_size': 1} Mar 12 21:07:08.606373 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-5349a16d-742e-4ea8-bd95-15532735ad11 tempest-AbsoluteLimitsTests-1195124341 None] creating volume 'volume-8f53d930-82b7-4be6-89c9-4c903f655bc2' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:07:08.607459 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-5349a16d-742e-4ea8-bd95-15532735ad11 tempest-AbsoluteLimitsTests-1195124341 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:07:08.694624 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-5349a16d-742e-4ea8-bd95-15532735ad11 tempest-AbsoluteLimitsTests-1195124341 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:07:08.695581 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-5349a16d-742e-4ea8-bd95-15532735ad11 tempest-AbsoluteLimitsTests-1195124341 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:07:08.702347 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5349a16d-742e-4ea8-bd95-15532735ad11 tempest-AbsoluteLimitsTests-1195124341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f819c023-757b-4644-8388-2b39e3f2700a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f53d930-82b7-4be6-89c9-4c903f655bc2', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:07:08.710574 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5349a16d-742e-4ea8-bd95-15532735ad11 tempest-AbsoluteLimitsTests-1195124341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cf16d14-d0b6-43d4-a4eb-702b92c0397c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:07:08.725039 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-5349a16d-742e-4ea8-bd95-15532735ad11 tempest-AbsoluteLimitsTests-1195124341 None] Volume volume-8f53d930-82b7-4be6-89c9-4c903f655bc2 (8f53d930-82b7-4be6-89c9-4c903f655bc2): created successfully Mar 12 21:07:08.735378 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5349a16d-742e-4ea8-bd95-15532735ad11 tempest-AbsoluteLimitsTests-1195124341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cf16d14-d0b6-43d4-a4eb-702b92c0397c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:07:08.743347 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5349a16d-742e-4ea8-bd95-15532735ad11 tempest-AbsoluteLimitsTests-1195124341 None] Flow 'volume_create_manager' (2f31dc04-56a0-417c-a244-f33b65b00ced) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:07:08.756573 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-5349a16d-742e-4ea8-bd95-15532735ad11 tempest-AbsoluteLimitsTests-1195124341 None] Created volume successfully. Mar 12 21:07:09.501969 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-701caac6-ba62-450f-a12b-aea5a1758e9a tempest-AbsoluteLimitsTests-1195124341 None] Lock "b'cinder-8f53d930-82b7-4be6-89c9-4c903f655bc2-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:07:09.566307 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-701caac6-ba62-450f-a12b-aea5a1758e9a tempest-AbsoluteLimitsTests-1195124341 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:07:09.663516 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-701caac6-ba62-450f-a12b-aea5a1758e9a tempest-AbsoluteLimitsTests-1195124341 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:07:09.664199 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-701caac6-ba62-450f-a12b-aea5a1758e9a tempest-AbsoluteLimitsTests-1195124341 None] Volume volume-8f53d930-82b7-4be6-89c9-4c903f655bc2 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:07:09.676401 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-701caac6-ba62-450f-a12b-aea5a1758e9a tempest-AbsoluteLimitsTests-1195124341 None] deleting rbd volume volume-8f53d930-82b7-4be6-89c9-4c903f655bc2 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:07:10.128624 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-701caac6-ba62-450f-a12b-aea5a1758e9a tempest-AbsoluteLimitsTests-1195124341 None] Created reservations ['dbd62e8a-5efa-4bcb-b1c7-cade8f18d31c', 'e7411e3d-85b6-4eb3-942e-210310803089', '990457ef-1a78-482a-9899-0bd975a1810a', '6dd5e7c3-a1c7-4d18-a35c-fea553075aa5'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:07:10.203875 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-701caac6-ba62-450f-a12b-aea5a1758e9a tempest-AbsoluteLimitsTests-1195124341 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:07:10.261462 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-701caac6-ba62-450f-a12b-aea5a1758e9a tempest-AbsoluteLimitsTests-1195124341 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:07:10.333330 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-701caac6-ba62-450f-a12b-aea5a1758e9a tempest-AbsoluteLimitsTests-1195124341 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:07:10.342822 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-701caac6-ba62-450f-a12b-aea5a1758e9a tempest-AbsoluteLimitsTests-1195124341 None] Deleted volume successfully. Mar 12 21:07:10.366574 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-701caac6-ba62-450f-a12b-aea5a1758e9a tempest-AbsoluteLimitsTests-1195124341 None] Lock "b'cinder-8f53d930-82b7-4be6-89c9-4c903f655bc2-delete_volume'" released by "delete_volume" :: held 0.865s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:07:16.168307 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfccb1d3-5769-4b2c-bd5f-52d21155eb14 tempest-VolumesBackupsTest-1109530946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:07:16.175249 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-dfccb1d3-5769-4b2c-bd5f-52d21155eb14 tempest-VolumesBackupsTest-1109530946 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:07:16.175697 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-dfccb1d3-5769-4b2c-bd5f-52d21155eb14 tempest-VolumesBackupsTest-1109530946 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:07:16.224820 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-dfccb1d3-5769-4b2c-bd5f-52d21155eb14 tempest-VolumesBackupsTest-1109530946 None] Flow 'volume_create_manager' (26ced857-fcb8-4d82-a29e-fa4d8f549524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:07:16.251327 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-dfccb1d3-5769-4b2c-bd5f-52d21155eb14 tempest-VolumesBackupsTest-1109530946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0926feb7-75f4-4ecb-bbbe-7353530896d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:07:16.262276 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-dfccb1d3-5769-4b2c-bd5f-52d21155eb14 tempest-VolumesBackupsTest-1109530946 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:07:16.305023 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-dfccb1d3-5769-4b2c-bd5f-52d21155eb14 tempest-VolumesBackupsTest-1109530946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0926feb7-75f4-4ecb-bbbe-7353530896d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-2059428678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0d219623-5b71-4651-9d9b-3c7aadd4b36f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2ea29aba17e41fcac0b47522cf48b4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:07:16Z,use_quota=True,user_id='c5601cc6a01a4c35bceb33df0cad0acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:07:16.312146 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-dfccb1d3-5769-4b2c-bd5f-52d21155eb14 tempest-VolumesBackupsTest-1109530946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9b67221-dc00-4422-97eb-c2029d88e837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:07:16.316881 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-dfccb1d3-5769-4b2c-bd5f-52d21155eb14 tempest-VolumesBackupsTest-1109530946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9b67221-dc00-4422-97eb-c2029d88e837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:07:16.328529 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-dfccb1d3-5769-4b2c-bd5f-52d21155eb14 tempest-VolumesBackupsTest-1109530946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcae37dd-b1fe-43d1-903c-a14c4f80fc86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:07:16.336086 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-dfccb1d3-5769-4b2c-bd5f-52d21155eb14 tempest-VolumesBackupsTest-1109530946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcae37dd-b1fe-43d1-903c-a14c4f80fc86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d219623-5b71-4651-9d9b-3c7aadd4b36f', 'volume_name': 'volume-0d219623-5b71-4651-9d9b-3c7aadd4b36f', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:07:16.342926 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-dfccb1d3-5769-4b2c-bd5f-52d21155eb14 tempest-VolumesBackupsTest-1109530946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70e17fb5-4974-49ce-b371-a43a30972eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:07:16.347572 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-dfccb1d3-5769-4b2c-bd5f-52d21155eb14 tempest-VolumesBackupsTest-1109530946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70e17fb5-4974-49ce-b371-a43a30972eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:07:16.358788 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-dfccb1d3-5769-4b2c-bd5f-52d21155eb14 tempest-VolumesBackupsTest-1109530946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c00ab92-f80b-443e-9d32-c58cee44577d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:07:16.360780 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-dfccb1d3-5769-4b2c-bd5f-52d21155eb14 tempest-VolumesBackupsTest-1109530946 None] Volume 0d219623-5b71-4651-9d9b-3c7aadd4b36f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d219623-5b71-4651-9d9b-3c7aadd4b36f', 'volume_size': 1} Mar 12 21:07:16.362973 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-dfccb1d3-5769-4b2c-bd5f-52d21155eb14 tempest-VolumesBackupsTest-1109530946 None] creating volume 'volume-0d219623-5b71-4651-9d9b-3c7aadd4b36f' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:07:16.364331 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-dfccb1d3-5769-4b2c-bd5f-52d21155eb14 tempest-VolumesBackupsTest-1109530946 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:07:16.496253 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-dfccb1d3-5769-4b2c-bd5f-52d21155eb14 tempest-VolumesBackupsTest-1109530946 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:07:16.497358 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-dfccb1d3-5769-4b2c-bd5f-52d21155eb14 tempest-VolumesBackupsTest-1109530946 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:07:16.502000 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-dfccb1d3-5769-4b2c-bd5f-52d21155eb14 tempest-VolumesBackupsTest-1109530946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c00ab92-f80b-443e-9d32-c58cee44577d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d219623-5b71-4651-9d9b-3c7aadd4b36f', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:07:16.515418 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-dfccb1d3-5769-4b2c-bd5f-52d21155eb14 tempest-VolumesBackupsTest-1109530946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4fbbdf7-7b33-420e-9cf1-d9a896ae2b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:07:16.542751 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-dfccb1d3-5769-4b2c-bd5f-52d21155eb14 tempest-VolumesBackupsTest-1109530946 None] Volume volume-0d219623-5b71-4651-9d9b-3c7aadd4b36f (0d219623-5b71-4651-9d9b-3c7aadd4b36f): created successfully Mar 12 21:07:16.546803 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-dfccb1d3-5769-4b2c-bd5f-52d21155eb14 tempest-VolumesBackupsTest-1109530946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4fbbdf7-7b33-420e-9cf1-d9a896ae2b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:07:16.561815 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-dfccb1d3-5769-4b2c-bd5f-52d21155eb14 tempest-VolumesBackupsTest-1109530946 None] Flow 'volume_create_manager' (26ced857-fcb8-4d82-a29e-fa4d8f549524) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:07:16.597239 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-dfccb1d3-5769-4b2c-bd5f-52d21155eb14 tempest-VolumesBackupsTest-1109530946 None] Created volume successfully. Mar 12 21:07:40.002562 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-9f7976f4-aee8-4831-981d-f7b10214eaf0 req-03299253-1dc0-4a7b-aa91-33894df6dee5 tempest-VolumesBackupsTest-1109530946 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 21:07:41.600857 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-9f7976f4-aee8-4831-981d-f7b10214eaf0 req-03299253-1dc0-4a7b-aa91-33894df6dee5 tempest-VolumesBackupsTest-1109530946 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.598s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 21:07:41.604348 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-9f7976f4-aee8-4831-981d-f7b10214eaf0 req-03299253-1dc0-4a7b-aa91-33894df6dee5 tempest-VolumesBackupsTest-1109530946 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0d219623-5b71-4651-9d9b-3c7aadd4b36f', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': '0d219623-5b71-4651-9d9b-3c7aadd4b36f', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 21:07:41.694303 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-9f7976f4-aee8-4831-981d-f7b10214eaf0 req-03299253-1dc0-4a7b-aa91-33894df6dee5 tempest-VolumesBackupsTest-1109530946 None] Connection info returned from driver {'name': 'volumes/volume-0d219623-5b71-4651-9d9b-3c7aadd4b36f', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0d219623-5b71-4651-9d9b-3c7aadd4b36f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd44cd2ba-1e57-4040-9658-b1ce02db25fd'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 21:07:41.876270 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-9f7976f4-aee8-4831-981d-f7b10214eaf0 req-03299253-1dc0-4a7b-aa91-33894df6dee5 tempest-VolumesBackupsTest-1109530946 None] attachment_update completed successfully. Mar 12 21:07:44.929751 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-76a7779f-a2d1-41a8-8cd3-fba7036f8380 tempest-VolumesBackupsTest-1109530946 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-03-12T21:07:44Z,data_timestamp=2022-03-12T21:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-2068028501',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=9c644465-cf94-4bc3-9e83-5aa42b218df0,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='e2ea29aba17e41fcac0b47522cf48b4f',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='c5601cc6a01a4c35bceb33df0cad0acc',volume_id=0d219623-5b71-4651-9d9b-3c7aadd4b36f) Mar 12 21:07:44.941178 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.backup.rpcapi [None req-76a7779f-a2d1-41a8-8cd3-fba7036f8380 tempest-VolumesBackupsTest-1109530946 None] continue_backup in rpcapi backup_id 9c644465-cf94-4bc3-9e83-5aa42b218df0 {{(pid=129531) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Mar 12 21:07:51.151051 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:07:51.152345 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:07:51.243197 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:07:51.325365 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:07:56.031962 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [None req-76a7779f-a2d1-41a8-8cd3-fba7036f8380 tempest-VolumesBackupsTest-1109530946 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 21:07:57.397133 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [None req-76a7779f-a2d1-41a8-8cd3-fba7036f8380 tempest-VolumesBackupsTest-1109530946 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.365s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 21:07:57.399198 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-76a7779f-a2d1-41a8-8cd3-fba7036f8380 tempest-VolumesBackupsTest-1109530946 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0d219623-5b71-4651-9d9b-3c7aadd4b36f', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': '0d219623-5b71-4651-9d9b-3c7aadd4b36f', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 21:07:57.435719 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-76a7779f-a2d1-41a8-8cd3-fba7036f8380 tempest-VolumesBackupsTest-1109530946 None] Initialize volume connection completed successfully. Mar 12 21:08:02.041553 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-76a7779f-a2d1-41a8-8cd3-fba7036f8380 tempest-VolumesBackupsTest-1109530946 None] Terminate volume connection completed successfully. Mar 12 21:08:02.080193 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-76a7779f-a2d1-41a8-8cd3-fba7036f8380 tempest-VolumesBackupsTest-1109530946 None] Remove volume export completed successfully. Mar 12 21:08:05.876782 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-ec6bb934-4a81-4131-abb4-47cc5d59934d req-ca43f908-30b8-4e7a-a674-ce77807f9fdf tempest-VolumesBackupsTest-1109530946 None] Terminate volume connection completed successfully. Mar 12 21:08:05.877462 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-ec6bb934-4a81-4131-abb4-47cc5d59934d req-ca43f908-30b8-4e7a-a674-ce77807f9fdf tempest-VolumesBackupsTest-1109530946 None] Deleting attachment d44cd2ba-1e57-4040-9658-b1ce02db25fd. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 21:08:12.305948 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-b54492db-9ab9-4df3-b222-62764cca8976 tempest-VolumesBackupsTest-1109530946 None] Lock "b'cinder-0d219623-5b71-4651-9d9b-3c7aadd4b36f-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:08:12.397933 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b54492db-9ab9-4df3-b222-62764cca8976 tempest-VolumesBackupsTest-1109530946 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:08:13.517449 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b54492db-9ab9-4df3-b222-62764cca8976 tempest-VolumesBackupsTest-1109530946 None] Volume volume-0d219623-5b71-4651-9d9b-3c7aadd4b36f is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:08:13.555810 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b54492db-9ab9-4df3-b222-62764cca8976 tempest-VolumesBackupsTest-1109530946 None] deleting rbd volume volume-0d219623-5b71-4651-9d9b-3c7aadd4b36f {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:08:13.604904 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-a1179fcd-ab47-4340-a0f9-b9ed662648f5 req-97f6f964-49d5-4fe2-b1cf-8ee518885fbe tempest-AttachVolumeNegativeTest-2014367252 None] Terminate volume connection completed successfully. Mar 12 21:08:13.605240 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-a1179fcd-ab47-4340-a0f9-b9ed662648f5 req-97f6f964-49d5-4fe2-b1cf-8ee518885fbe tempest-AttachVolumeNegativeTest-2014367252 None] Deleting attachment 6eb14818-dd59-439d-adee-f21db388f7ea. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 21:08:14.058464 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-b54492db-9ab9-4df3-b222-62764cca8976 tempest-VolumesBackupsTest-1109530946 None] Created reservations ['f7edf0cf-491d-49e4-ae86-40f4062e1e43', '4c8b3b79-a3fd-42d5-ac2c-68a04132d0f1', '82dbd2f4-6e3c-49dc-b220-2b7189c656f9', '80c43fa7-87d2-404d-b612-21b6d47e620b'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:08:14.152965 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b54492db-9ab9-4df3-b222-62764cca8976 tempest-VolumesBackupsTest-1109530946 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:08:14.247330 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b54492db-9ab9-4df3-b222-62764cca8976 tempest-VolumesBackupsTest-1109530946 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:08:14.321191 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-b54492db-9ab9-4df3-b222-62764cca8976 tempest-VolumesBackupsTest-1109530946 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:08:14.330726 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-b54492db-9ab9-4df3-b222-62764cca8976 tempest-VolumesBackupsTest-1109530946 None] Deleted volume successfully. Mar 12 21:08:14.345152 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-b54492db-9ab9-4df3-b222-62764cca8976 tempest-VolumesBackupsTest-1109530946 None] Lock "b'cinder-0d219623-5b71-4651-9d9b-3c7aadd4b36f-delete_volume'" released by "delete_volume" :: held 2.042s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:08:15.568487 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:08:15.579935 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:08:15.580938 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:08:15.650637 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] Flow 'volume_create_manager' (ed404e88-abaa-43d4-9665-ad3ba894031b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:08:15.669656 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a19f2a0-edda-454d-8baa-28e423c36b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:08:15.687498 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:08:15.716294 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a19f2a0-edda-454d-8baa-28e423c36b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-774715929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f03f9c6c-6781-4beb-b4e3-e9cab44747d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2ea29aba17e41fcac0b47522cf48b4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:08:15Z,use_quota=True,user_id='c5601cc6a01a4c35bceb33df0cad0acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:08:15.742336 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41069966-b539-4541-806e-355d8ef36555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:08:15.751076 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41069966-b539-4541-806e-355d8ef36555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:08:15.766940 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (436923f1-92be-4494-8f70-571a11b50e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:08:15.899830 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (436923f1-92be-4494-8f70-571a11b50e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f03f9c6c-6781-4beb-b4e3-e9cab44747d1', 'volume_name': 'volume-f03f9c6c-6781-4beb-b4e3-e9cab44747d1', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:08:15.908025 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f959de56-8ffe-425f-9959-7994e45a5cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:08:15.912792 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f959de56-8ffe-425f-9959-7994e45a5cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:08:15.918914 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e076848-e129-4e84-9374-525397bdaa74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:08:15.920303 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] Volume f03f9c6c-6781-4beb-b4e3-e9cab44747d1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f03f9c6c-6781-4beb-b4e3-e9cab44747d1', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 12 21:08:15.925035 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] Cloning f03f9c6c-6781-4beb-b4e3-e9cab44747d1 from image 539171db-0bd3-4f16-95fd-a7cd5530137d at location (None, None). {{(pid=129531) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Mar 12 21:08:15.950508 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] Lock "b'cinder-539171db-0bd3-4f16-95fd-a7cd5530137d'" acquired by "_prepare_image_cache_entry" :: waited 0.024s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:08:15.966324 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] Found image-volume cache entry: {'id': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'volume_id': '8d802c7b-bd34-4836-bd5d-90755a167ddc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34), 'last_used': datetime.datetime(2022, 3, 12, 21, 8, 15, 954900)}. {{(pid=129531) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 12 21:08:15.966772 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] Image-volume cache entry image_update_at = 2022-03-12 20:39:34+00:00, requested image updated_at = 2022-03-12 20:39:34+00:00. {{(pid=129531) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 12 21:08:15.967171 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] Found cache entry for image = 539171db-0bd3-4f16-95fd-a7cd5530137d on host ncdv-master-1@ceph#ceph. {{(pid=129531) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Mar 12 21:08:15.974920 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] Lock "b'cinder-539171db-0bd3-4f16-95fd-a7cd5530137d'" released by "_prepare_image_cache_entry" :: held 0.024s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:08:15.975905 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] Attempting to retrieve cache entry for image = 539171db-0bd3-4f16-95fd-a7cd5530137d on host ncdv-master-1@ceph#ceph. {{(pid=129531) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Mar 12 21:08:15.982117 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] Found image-volume cache entry: {'id': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'volume_id': '8d802c7b-bd34-4836-bd5d-90755a167ddc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34), 'last_used': datetime.datetime(2022, 3, 12, 21, 8, 15, 979481)}. {{(pid=129531) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 12 21:08:15.982766 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] Image-volume cache entry image_update_at = 2022-03-12 20:39:34+00:00, requested image updated_at = 2022-03-12 20:39:34+00:00. {{(pid=129531) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 12 21:08:15.983314 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] Creating from source image-volume 8d802c7b-bd34-4836-bd5d-90755a167ddc {{(pid=129531) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Mar 12 21:08:16.013875 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:08:16.118808 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] creating snapshot='volume-f03f9c6c-6781-4beb-b4e3-e9cab44747d1.clone_snap' {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Mar 12 21:08:16.623434 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] cloning 'volume-8d802c7b-bd34-4836-bd5d-90755a167ddc@volume-f03f9c6c-6781-4beb-b4e3-e9cab44747d1.clone_snap' to 'volume-f03f9c6c-6781-4beb-b4e3-e9cab44747d1' {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Mar 12 21:08:16.877611 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] Volume volume-9916cd82-3d9b-466f-a769-cf81bdc743fd.deleted is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:08:16.879070 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:08:16.879662 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:08:16.952512 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] clone created successfully {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Mar 12 21:08:16.953402 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.volume_utils [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] Marking volume f03f9c6c-6781-4beb-b4e3-e9cab44747d1 as bootable. {{(pid=129531) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 12 21:08:16.967329 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] Copying metadata from image 539171db-0bd3-4f16-95fd-a7cd5530137d to f03f9c6c-6781-4beb-b4e3-e9cab44747d1. {{(pid=129531) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Mar 12 21:08:16.967821 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] Creating volume glance metadata for volume f03f9c6c-6781-4beb-b4e3-e9cab44747d1 backed by image 539171db-0bd3-4f16-95fd-a7cd5530137d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129531) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Mar 12 21:08:17.092069 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e076848-e129-4e84-9374-525397bdaa74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f03f9c6c-6781-4beb-b4e3-e9cab44747d1', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:08:17.099002 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c9f04f8-fc85-4d72-9906-192ada5a2811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:08:17.115719 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] Volume volume-f03f9c6c-6781-4beb-b4e3-e9cab44747d1 (f03f9c6c-6781-4beb-b4e3-e9cab44747d1): created successfully Mar 12 21:08:17.122221 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c9f04f8-fc85-4d72-9906-192ada5a2811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:08:17.130346 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] Flow 'volume_create_manager' (ed404e88-abaa-43d4-9665-ad3ba894031b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:08:17.155928 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-bc9a196d-1a60-420e-8a36-0645b48f96de tempest-VolumesBackupsTest-1109530946 None] Created volume successfully. Mar 12 21:08:18.178020 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-ec2d74ee-1852-4db0-988f-24f676b6b6b0 tempest-VolumesBackupsTest-1109530946 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-03-12T21:08:17Z,data_timestamp=2022-03-12T21:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1876115641',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=be532a8a-f536-44e2-bb12-cb0e3ae303c1,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='e2ea29aba17e41fcac0b47522cf48b4f',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='c5601cc6a01a4c35bceb33df0cad0acc',volume_id=f03f9c6c-6781-4beb-b4e3-e9cab44747d1) Mar 12 21:08:18.181024 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.backup.rpcapi [None req-ec2d74ee-1852-4db0-988f-24f676b6b6b0 tempest-VolumesBackupsTest-1109530946 None] continue_backup in rpcapi backup_id be532a8a-f536-44e2-bb12-cb0e3ae303c1 {{(pid=129531) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Mar 12 21:08:18.476048 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [None req-ec2d74ee-1852-4db0-988f-24f676b6b6b0 tempest-VolumesBackupsTest-1109530946 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 21:08:19.921945 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [None req-ec2d74ee-1852-4db0-988f-24f676b6b6b0 tempest-VolumesBackupsTest-1109530946 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.446s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 21:08:19.924113 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-ec2d74ee-1852-4db0-988f-24f676b6b6b0 tempest-VolumesBackupsTest-1109530946 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f03f9c6c-6781-4beb-b4e3-e9cab44747d1', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': 'f03f9c6c-6781-4beb-b4e3-e9cab44747d1', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 21:08:19.952861 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-ec2d74ee-1852-4db0-988f-24f676b6b6b0 tempest-VolumesBackupsTest-1109530946 None] Initialize volume connection completed successfully. Mar 12 21:08:29.995117 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-ec2d74ee-1852-4db0-988f-24f676b6b6b0 tempest-VolumesBackupsTest-1109530946 None] Terminate volume connection completed successfully. Mar 12 21:08:30.020075 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-ec2d74ee-1852-4db0-988f-24f676b6b6b0 tempest-VolumesBackupsTest-1109530946 None] Remove volume export completed successfully. Mar 12 21:08:30.749272 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1549f7c-ccf0-437c-952c-493c198f048e tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:08:30.755200 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-e1549f7c-ccf0-437c-952c-493c198f048e tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:08:30.756924 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-e1549f7c-ccf0-437c-952c-493c198f048e tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:08:30.842952 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e1549f7c-ccf0-437c-952c-493c198f048e tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] Flow 'volume_create_manager' (e3571a87-d122-4eca-b426-19bcb8be1113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:08:30.851810 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e1549f7c-ccf0-437c-952c-493c198f048e tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92a7d027-16e0-4fe4-af66-af23f8687bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:08:30.868251 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-e1549f7c-ccf0-437c-952c-493c198f048e tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:08:30.889974 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e1549f7c-ccf0-437c-952c-493c198f048e tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92a7d027-16e0-4fe4-af66-af23f8687bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1282670991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e36d7572-c7ce-4ae8-9687-8ec75b1a35bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d006b3dbe7f43c49755a83c5e02805a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:08:31Z,use_quota=True,user_id='56e5b998110c49d2b1d40192d6c8b91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25a88052-78ca-4d59-b661-7f2f92d0cf49),volume_type_id=25a88052-78ca-4d59-b661-7f2f92d0cf49)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:08:30.899628 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e1549f7c-ccf0-437c-952c-493c198f048e tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01f56c1-93c5-433e-af0e-19faf0a8a3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:08:30.906617 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e1549f7c-ccf0-437c-952c-493c198f048e tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01f56c1-93c5-433e-af0e-19faf0a8a3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:08:30.916973 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e1549f7c-ccf0-437c-952c-493c198f048e tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1937fc3-de64-4627-a1cf-32d53c4082c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:08:30.922664 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e1549f7c-ccf0-437c-952c-493c198f048e tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1937fc3-de64-4627-a1cf-32d53c4082c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e36d7572-c7ce-4ae8-9687-8ec75b1a35bb', 'volume_name': 'volume-e36d7572-c7ce-4ae8-9687-8ec75b1a35bb', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:08:30.942435 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e1549f7c-ccf0-437c-952c-493c198f048e tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9636f041-6750-4d0f-aefa-882aa1d6d616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:08:30.949385 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e1549f7c-ccf0-437c-952c-493c198f048e tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9636f041-6750-4d0f-aefa-882aa1d6d616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:08:30.957891 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e1549f7c-ccf0-437c-952c-493c198f048e tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20c3d225-1432-4da7-80d9-b0e85fb18fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:08:30.960357 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-e1549f7c-ccf0-437c-952c-493c198f048e tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] Volume e36d7572-c7ce-4ae8-9687-8ec75b1a35bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e36d7572-c7ce-4ae8-9687-8ec75b1a35bb', 'volume_size': 1} Mar 12 21:08:30.960782 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-e1549f7c-ccf0-437c-952c-493c198f048e tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] creating volume 'volume-e36d7572-c7ce-4ae8-9687-8ec75b1a35bb' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:08:30.963156 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-e1549f7c-ccf0-437c-952c-493c198f048e tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:08:31.090186 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-e1549f7c-ccf0-437c-952c-493c198f048e tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] extra_specs: {} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:08:31.091717 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-e1549f7c-ccf0-437c-952c-493c198f048e tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] extra_specs: {} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:08:31.096147 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e1549f7c-ccf0-437c-952c-493c198f048e tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20c3d225-1432-4da7-80d9-b0e85fb18fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e36d7572-c7ce-4ae8-9687-8ec75b1a35bb', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:08:31.101568 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e1549f7c-ccf0-437c-952c-493c198f048e tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7e19a88-e2f3-4880-a566-f8c665d0e8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:08:31.128521 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-e1549f7c-ccf0-437c-952c-493c198f048e tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] Volume volume-e36d7572-c7ce-4ae8-9687-8ec75b1a35bb (e36d7572-c7ce-4ae8-9687-8ec75b1a35bb): created successfully Mar 12 21:08:31.132502 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e1549f7c-ccf0-437c-952c-493c198f048e tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7e19a88-e2f3-4880-a566-f8c665d0e8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:08:31.140572 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e1549f7c-ccf0-437c-952c-493c198f048e tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] Flow 'volume_create_manager' (e3571a87-d122-4eca-b426-19bcb8be1113) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:08:31.165699 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-e1549f7c-ccf0-437c-952c-493c198f048e tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] Created volume successfully. Mar 12 21:08:31.412733 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6970f7e-d78e-4c5f-81fe-0a2a82ae0382 tempest-VolumesBackupsTest-1109530946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:08:31.422013 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-a6970f7e-d78e-4c5f-81fe-0a2a82ae0382 tempest-VolumesBackupsTest-1109530946 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:08:31.423221 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-a6970f7e-d78e-4c5f-81fe-0a2a82ae0382 tempest-VolumesBackupsTest-1109530946 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:08:31.462289 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a6970f7e-d78e-4c5f-81fe-0a2a82ae0382 tempest-VolumesBackupsTest-1109530946 None] Flow 'volume_create_manager' (16070f2d-dc8a-4da0-bf84-e4ac86f7b550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:08:31.482077 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a6970f7e-d78e-4c5f-81fe-0a2a82ae0382 tempest-VolumesBackupsTest-1109530946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3359e8d8-cabf-477d-9f8a-57677486769e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:08:31.497373 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-a6970f7e-d78e-4c5f-81fe-0a2a82ae0382 tempest-VolumesBackupsTest-1109530946 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:08:31.519526 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a6970f7e-d78e-4c5f-81fe-0a2a82ae0382 tempest-VolumesBackupsTest-1109530946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3359e8d8-cabf-477d-9f8a-57677486769e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:08:31Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_be532a8a-f536-44e2-bb12-cb0e3ae303c1',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2f3956a4-e9b1-4ded-ab9b-6e1370102687,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2ea29aba17e41fcac0b47522cf48b4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:08:31Z,use_quota=True,user_id='c5601cc6a01a4c35bceb33df0cad0acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:08:31.546294 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a6970f7e-d78e-4c5f-81fe-0a2a82ae0382 tempest-VolumesBackupsTest-1109530946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41740f0b-f75b-472b-bb41-5893a6e5cfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:08:31.550828 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a6970f7e-d78e-4c5f-81fe-0a2a82ae0382 tempest-VolumesBackupsTest-1109530946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41740f0b-f75b-472b-bb41-5893a6e5cfdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:08:31.573851 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a6970f7e-d78e-4c5f-81fe-0a2a82ae0382 tempest-VolumesBackupsTest-1109530946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74196dd3-cd5e-4023-bdaa-b9a68d5d8579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:08:31.578492 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a6970f7e-d78e-4c5f-81fe-0a2a82ae0382 tempest-VolumesBackupsTest-1109530946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74196dd3-cd5e-4023-bdaa-b9a68d5d8579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f3956a4-e9b1-4ded-ab9b-6e1370102687', 'volume_name': 'volume-2f3956a4-e9b1-4ded-ab9b-6e1370102687', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:08:31.587653 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a6970f7e-d78e-4c5f-81fe-0a2a82ae0382 tempest-VolumesBackupsTest-1109530946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea0091a4-b147-42db-a7ab-61e1694d9794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:08:31.593493 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a6970f7e-d78e-4c5f-81fe-0a2a82ae0382 tempest-VolumesBackupsTest-1109530946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea0091a4-b147-42db-a7ab-61e1694d9794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:08:31.603170 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a6970f7e-d78e-4c5f-81fe-0a2a82ae0382 tempest-VolumesBackupsTest-1109530946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ba294d-3f48-4f9c-9d40-eddfa6a343b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:08:31.619133 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-a6970f7e-d78e-4c5f-81fe-0a2a82ae0382 tempest-VolumesBackupsTest-1109530946 None] Volume 2f3956a4-e9b1-4ded-ab9b-6e1370102687: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f3956a4-e9b1-4ded-ab9b-6e1370102687', 'volume_size': 1} Mar 12 21:08:31.619752 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a6970f7e-d78e-4c5f-81fe-0a2a82ae0382 tempest-VolumesBackupsTest-1109530946 None] creating volume 'volume-2f3956a4-e9b1-4ded-ab9b-6e1370102687' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:08:31.620886 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a6970f7e-d78e-4c5f-81fe-0a2a82ae0382 tempest-VolumesBackupsTest-1109530946 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:08:31.762564 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a6970f7e-d78e-4c5f-81fe-0a2a82ae0382 tempest-VolumesBackupsTest-1109530946 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:08:31.762934 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a6970f7e-d78e-4c5f-81fe-0a2a82ae0382 tempest-VolumesBackupsTest-1109530946 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:08:31.766853 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a6970f7e-d78e-4c5f-81fe-0a2a82ae0382 tempest-VolumesBackupsTest-1109530946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ba294d-3f48-4f9c-9d40-eddfa6a343b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f3956a4-e9b1-4ded-ab9b-6e1370102687', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:08:31.778276 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a6970f7e-d78e-4c5f-81fe-0a2a82ae0382 tempest-VolumesBackupsTest-1109530946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (378c3e53-079e-437d-9a68-f523a778d6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:08:31.800299 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-a6970f7e-d78e-4c5f-81fe-0a2a82ae0382 tempest-VolumesBackupsTest-1109530946 None] Volume volume-2f3956a4-e9b1-4ded-ab9b-6e1370102687 (2f3956a4-e9b1-4ded-ab9b-6e1370102687): created successfully Mar 12 21:08:31.804927 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a6970f7e-d78e-4c5f-81fe-0a2a82ae0382 tempest-VolumesBackupsTest-1109530946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (378c3e53-079e-437d-9a68-f523a778d6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:08:31.818148 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a6970f7e-d78e-4c5f-81fe-0a2a82ae0382 tempest-VolumesBackupsTest-1109530946 None] Flow 'volume_create_manager' (16070f2d-dc8a-4da0-bf84-e4ac86f7b550) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:08:31.851449 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-a6970f7e-d78e-4c5f-81fe-0a2a82ae0382 tempest-VolumesBackupsTest-1109530946 None] Created volume successfully. Mar 12 21:08:32.391566 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f5c05658-facd-40a8-94cc-ff41e327155a tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:08:32.496474 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f5c05658-facd-40a8-94cc-ff41e327155a tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:08:32.581540 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-f5c05658-facd-40a8-94cc-ff41e327155a tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:08:32.586341 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-f5c05658-facd-40a8-94cc-ff41e327155a tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] Retype volume completed successfully. Mar 12 21:08:32.704466 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [None req-a6970f7e-d78e-4c5f-81fe-0a2a82ae0382 tempest-VolumesBackupsTest-1109530946 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 21:08:33.734647 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-2b438960-1014-4531-9d95-8cb85c4ae22d tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] Lock "b'cinder-e36d7572-c7ce-4ae8-9687-8ec75b1a35bb-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:08:33.842610 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2b438960-1014-4531-9d95-8cb85c4ae22d tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:08:34.001384 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2b438960-1014-4531-9d95-8cb85c4ae22d tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:08:34.001862 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2b438960-1014-4531-9d95-8cb85c4ae22d tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] Volume volume-e36d7572-c7ce-4ae8-9687-8ec75b1a35bb is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:08:34.029289 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2b438960-1014-4531-9d95-8cb85c4ae22d tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] deleting rbd volume volume-e36d7572-c7ce-4ae8-9687-8ec75b1a35bb {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:08:34.105994 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [None req-a6970f7e-d78e-4c5f-81fe-0a2a82ae0382 tempest-VolumesBackupsTest-1109530946 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.395s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 21:08:34.105994 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a6970f7e-d78e-4c5f-81fe-0a2a82ae0382 tempest-VolumesBackupsTest-1109530946 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2f3956a4-e9b1-4ded-ab9b-6e1370102687', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': '2f3956a4-e9b1-4ded-ab9b-6e1370102687', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 21:08:34.122089 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-a6970f7e-d78e-4c5f-81fe-0a2a82ae0382 tempest-VolumesBackupsTest-1109530946 None] Initialize volume connection completed successfully. Mar 12 21:08:34.441922 ncdv-master-1 cinder-volume[129531]: WARNING cinder.quota [None req-2b438960-1014-4531-9d95-8cb85c4ae22d tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Mar 12 21:08:34.442732 ncdv-master-1 cinder-volume[129531]: WARNING cinder.quota [None req-2b438960-1014-4531-9d95-8cb85c4ae22d tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Mar 12 21:08:34.466958 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-2b438960-1014-4531-9d95-8cb85c4ae22d tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] Created reservations ['703c1a2a-f585-4dc1-8061-0aa8177b4259', 'fd568a43-95bb-4bbf-b926-719b64a08e93', 'b78eda0c-5d65-437a-9a03-f23daf498609', 'f8eb56e3-846d-4183-a2d8-75258a42cefa'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:08:34.556074 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2b438960-1014-4531-9d95-8cb85c4ae22d tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:08:34.609870 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2b438960-1014-4531-9d95-8cb85c4ae22d tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:08:34.687738 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-2b438960-1014-4531-9d95-8cb85c4ae22d tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:08:34.696236 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-2b438960-1014-4531-9d95-8cb85c4ae22d tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] Deleted volume successfully. Mar 12 21:08:34.722620 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-2b438960-1014-4531-9d95-8cb85c4ae22d tempest-VolumeRetypeWithoutMigrationTest-1178058827 None] Lock "b'cinder-e36d7572-c7ce-4ae8-9687-8ec75b1a35bb-delete_volume'" released by "delete_volume" :: held 0.988s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:08:41.554963 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-a6970f7e-d78e-4c5f-81fe-0a2a82ae0382 tempest-VolumesBackupsTest-1109530946 None] Terminate volume connection completed successfully. Mar 12 21:08:41.594589 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-a6970f7e-d78e-4c5f-81fe-0a2a82ae0382 tempest-VolumesBackupsTest-1109530946 None] Remove volume export completed successfully. Mar 12 21:08:42.381094 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-c14d289f-1a76-426a-8a8a-0898c6cf765e tempest-VolumesBackupsTest-1109530946 None] Lock "b'cinder-2f3956a4-e9b1-4ded-ab9b-6e1370102687-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:08:42.478871 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c14d289f-1a76-426a-8a8a-0898c6cf765e tempest-VolumesBackupsTest-1109530946 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:08:43.671990 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c14d289f-1a76-426a-8a8a-0898c6cf765e tempest-VolumesBackupsTest-1109530946 None] Volume volume-2f3956a4-e9b1-4ded-ab9b-6e1370102687 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:08:43.718314 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c14d289f-1a76-426a-8a8a-0898c6cf765e tempest-VolumesBackupsTest-1109530946 None] deleting rbd volume volume-2f3956a4-e9b1-4ded-ab9b-6e1370102687 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:08:43.869328 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-eed37d7d-6142-4e1c-ac0f-cef93c619113 tempest-VolumesDeleteCascade-350081394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:08:43.895600 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-eed37d7d-6142-4e1c-ac0f-cef93c619113 tempest-VolumesDeleteCascade-350081394 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:08:43.895600 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-eed37d7d-6142-4e1c-ac0f-cef93c619113 tempest-VolumesDeleteCascade-350081394 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:08:43.975240 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-eed37d7d-6142-4e1c-ac0f-cef93c619113 tempest-VolumesDeleteCascade-350081394 None] Flow 'volume_create_manager' (2110edaf-bd04-4f68-a8f8-4dabb400ebf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:08:43.997882 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-eed37d7d-6142-4e1c-ac0f-cef93c619113 tempest-VolumesDeleteCascade-350081394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2ff1a2e-8565-425d-a36b-ba441bf2cd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:08:44.025870 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-eed37d7d-6142-4e1c-ac0f-cef93c619113 tempest-VolumesDeleteCascade-350081394 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:08:44.080736 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-eed37d7d-6142-4e1c-ac0f-cef93c619113 tempest-VolumesDeleteCascade-350081394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2ff1a2e-8565-425d-a36b-ba441bf2cd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-974763949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=36e91f42-e0ec-444d-8b38-4a328463a0aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7be73c3e310491aa2726609894886f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:08:42Z,use_quota=True,user_id='3e9a424b669943bc86b1e07a84b8f313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:08:44.092020 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-eed37d7d-6142-4e1c-ac0f-cef93c619113 tempest-VolumesDeleteCascade-350081394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c7f34ae-4ef3-4542-a7aa-735cc991e07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:08:44.111761 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-eed37d7d-6142-4e1c-ac0f-cef93c619113 tempest-VolumesDeleteCascade-350081394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c7f34ae-4ef3-4542-a7aa-735cc991e07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:08:44.127916 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-eed37d7d-6142-4e1c-ac0f-cef93c619113 tempest-VolumesDeleteCascade-350081394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5adb45c9-b9db-4f06-926a-bf81e694eb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:08:44.132608 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-eed37d7d-6142-4e1c-ac0f-cef93c619113 tempest-VolumesDeleteCascade-350081394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5adb45c9-b9db-4f06-926a-bf81e694eb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36e91f42-e0ec-444d-8b38-4a328463a0aa', 'volume_name': 'volume-36e91f42-e0ec-444d-8b38-4a328463a0aa', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:08:44.157048 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-eed37d7d-6142-4e1c-ac0f-cef93c619113 tempest-VolumesDeleteCascade-350081394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b55f3b9-5432-40e6-b1fe-10ac3cc61c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:08:44.172080 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-eed37d7d-6142-4e1c-ac0f-cef93c619113 tempest-VolumesDeleteCascade-350081394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b55f3b9-5432-40e6-b1fe-10ac3cc61c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:08:44.183669 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-eed37d7d-6142-4e1c-ac0f-cef93c619113 tempest-VolumesDeleteCascade-350081394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc0de6b-0feb-42f4-9598-30e2dfcbefb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:08:44.188009 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-eed37d7d-6142-4e1c-ac0f-cef93c619113 tempest-VolumesDeleteCascade-350081394 None] Volume 36e91f42-e0ec-444d-8b38-4a328463a0aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36e91f42-e0ec-444d-8b38-4a328463a0aa', 'volume_size': 1} Mar 12 21:08:44.189101 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-eed37d7d-6142-4e1c-ac0f-cef93c619113 tempest-VolumesDeleteCascade-350081394 None] creating volume 'volume-36e91f42-e0ec-444d-8b38-4a328463a0aa' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:08:44.190795 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-eed37d7d-6142-4e1c-ac0f-cef93c619113 tempest-VolumesDeleteCascade-350081394 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:08:44.383118 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-eed37d7d-6142-4e1c-ac0f-cef93c619113 tempest-VolumesDeleteCascade-350081394 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:08:44.383651 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-eed37d7d-6142-4e1c-ac0f-cef93c619113 tempest-VolumesDeleteCascade-350081394 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:08:44.391928 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-eed37d7d-6142-4e1c-ac0f-cef93c619113 tempest-VolumesDeleteCascade-350081394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc0de6b-0feb-42f4-9598-30e2dfcbefb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36e91f42-e0ec-444d-8b38-4a328463a0aa', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:08:44.402780 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-eed37d7d-6142-4e1c-ac0f-cef93c619113 tempest-VolumesDeleteCascade-350081394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dc619f6-5a5e-436b-be0b-e5a169bc2f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:08:44.415110 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-eed37d7d-6142-4e1c-ac0f-cef93c619113 tempest-VolumesDeleteCascade-350081394 None] Volume volume-36e91f42-e0ec-444d-8b38-4a328463a0aa (36e91f42-e0ec-444d-8b38-4a328463a0aa): created successfully Mar 12 21:08:44.424684 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-eed37d7d-6142-4e1c-ac0f-cef93c619113 tempest-VolumesDeleteCascade-350081394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dc619f6-5a5e-436b-be0b-e5a169bc2f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:08:44.446070 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-eed37d7d-6142-4e1c-ac0f-cef93c619113 tempest-VolumesDeleteCascade-350081394 None] Flow 'volume_create_manager' (2110edaf-bd04-4f68-a8f8-4dabb400ebf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:08:44.461511 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-eed37d7d-6142-4e1c-ac0f-cef93c619113 tempest-VolumesDeleteCascade-350081394 None] Created volume successfully. Mar 12 21:08:44.610060 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-c14d289f-1a76-426a-8a8a-0898c6cf765e tempest-VolumesBackupsTest-1109530946 None] Created reservations ['69b91b9c-e519-4ddd-b63e-66e15e19af0d', 'f04864a5-3c58-4f1e-8015-4fadf5cb057f', '2db54b7a-99d8-42c3-a9c7-86a761003ed0', '848e65e9-e94d-4f02-9b38-230897e6efcf'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:08:44.698676 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c14d289f-1a76-426a-8a8a-0898c6cf765e tempest-VolumesBackupsTest-1109530946 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:08:44.772875 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c14d289f-1a76-426a-8a8a-0898c6cf765e tempest-VolumesBackupsTest-1109530946 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:08:44.859889 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-c14d289f-1a76-426a-8a8a-0898c6cf765e tempest-VolumesBackupsTest-1109530946 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:08:44.865406 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-c14d289f-1a76-426a-8a8a-0898c6cf765e tempest-VolumesBackupsTest-1109530946 None] Deleted volume successfully. Mar 12 21:08:44.886213 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-c14d289f-1a76-426a-8a8a-0898c6cf765e tempest-VolumesBackupsTest-1109530946 None] Lock "b'cinder-2f3956a4-e9b1-4ded-ab9b-6e1370102687-delete_volume'" released by "delete_volume" :: held 2.505s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:08:45.044830 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a98b5bbb-6520-4088-8e1a-f92673840187 tempest-VolumesDeleteCascade-350081394 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:08:45.817311 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-a98b5bbb-6520-4088-8e1a-f92673840187 tempest-VolumesDeleteCascade-350081394 None] Create snapshot completed successfully Mar 12 21:08:46.404573 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-ef0d5491-cb45-4a8f-9a20-546d4f2aa4c1 tempest-VolumesDeleteCascade-350081394 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:08:46.459776 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-62ccbeaa-0115-4faf-8603-6e9c91dca5d0 tempest-BackendsCapabilitiesAdminTestsJSON-1421222584 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:c639bb7d-414c-4067-b984-1a13e8932eb7:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=129531) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4731}} Mar 12 21:08:46.501144 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a3c19b19-eafc-49c4-a249-cfd1299fd12f tempest-BackendsCapabilitiesAdminTestsJSON-1421222584 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:c639bb7d-414c-4067-b984-1a13e8932eb7:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=129531) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4731}} Mar 12 21:08:46.840230 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-ef0d5491-cb45-4a8f-9a20-546d4f2aa4c1 tempest-VolumesDeleteCascade-350081394 None] Create snapshot completed successfully Mar 12 21:08:47.627400 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-bb1c6715-4ea0-4af6-b471-21e1722e5732 tempest-VolumesDeleteCascade-350081394 None] Lock "b'cinder-36e91f42-e0ec-444d-8b38-4a328463a0aa-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:08:47.731819 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-bb1c6715-4ea0-4af6-b471-21e1722e5732 tempest-VolumesDeleteCascade-350081394 None] Performing cascade delete. {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/manager.py:963}} Mar 12 21:08:47.761300 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-bb1c6715-4ea0-4af6-b471-21e1722e5732 tempest-VolumesDeleteCascade-350081394 None] Lock "b'cinder-490af884-fda9-48b1-849d-896f13a62567-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.016s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:08:47.778837 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-bb1c6715-4ea0-4af6-b471-21e1722e5732 tempest-VolumesDeleteCascade-350081394 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:08:48.082970 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-f4186469-1f6e-4293-91a5-8a2b691b766f tempest-VolumesBackupsTest-1109530946 None] Lock "b'cinder-f03f9c6c-6781-4beb-b4e3-e9cab44747d1-delete_volume'" acquired by "delete_volume" :: waited 0.027s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:08:48.163965 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f4186469-1f6e-4293-91a5-8a2b691b766f tempest-VolumesBackupsTest-1109530946 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:08:48.831428 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f4186469-1f6e-4293-91a5-8a2b691b766f tempest-VolumesBackupsTest-1109530946 None] deleting rbd volume volume-f03f9c6c-6781-4beb-b4e3-e9cab44747d1 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:08:48.953191 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-bb1c6715-4ea0-4af6-b471-21e1722e5732 tempest-VolumesDeleteCascade-350081394 None] Created reservations ['1cc06a0d-d91e-491f-9048-c9a3ef68c492', 'f48e702c-b31d-42e5-ab3e-4577a881ad67', '7e0f833e-73df-4626-9e28-a9fc3a623211', 'cbc23190-2a01-4e67-88a2-24286c04d9cf'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:08:49.021924 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-bb1c6715-4ea0-4af6-b471-21e1722e5732 tempest-VolumesDeleteCascade-350081394 None] Delete snapshot completed successfully. Mar 12 21:08:49.030489 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-bb1c6715-4ea0-4af6-b471-21e1722e5732 tempest-VolumesDeleteCascade-350081394 None] Lock "b'cinder-490af884-fda9-48b1-849d-896f13a62567-delete_snapshot'" released by "delete_snapshot" :: held 1.269s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:08:49.051691 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-bb1c6715-4ea0-4af6-b471-21e1722e5732 tempest-VolumesDeleteCascade-350081394 None] Lock "b'cinder-e5e7ac6d-f556-43d2-8a4d-831c83fa6105-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.017s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:08:49.077749 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-bb1c6715-4ea0-4af6-b471-21e1722e5732 tempest-VolumesDeleteCascade-350081394 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:08:49.264919 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f4186469-1f6e-4293-91a5-8a2b691b766f tempest-VolumesBackupsTest-1109530946 None] volume is a clone so cleaning references {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Mar 12 21:08:49.320772 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f4186469-1f6e-4293-91a5-8a2b691b766f tempest-VolumesBackupsTest-1109530946 None] deleting parent snapshot volume-f03f9c6c-6781-4beb-b4e3-e9cab44747d1.clone_snap {{(pid=129531) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Mar 12 21:08:50.023763 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-f4186469-1f6e-4293-91a5-8a2b691b766f tempest-VolumesBackupsTest-1109530946 None] Created reservations ['effcdc38-6e1c-41e1-b2a4-4a75a5abc5ba', '098f9bec-37c9-4be7-a83a-5dbc29f3f1c3', 'e0936a73-7bfe-4541-922b-d671899524c6', 'd28bf01d-dc56-4807-8935-16b7468ca9da'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:08:50.103778 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-bb1c6715-4ea0-4af6-b471-21e1722e5732 tempest-VolumesDeleteCascade-350081394 None] Created reservations ['57e2e00c-730a-4122-adc1-5960670442f8', '0f812890-2494-4e3a-ae9d-5fa4cba0b979', '1d3fba76-3709-49fe-8bd8-f798b33879f7', '3ea04215-1dd0-4762-b9b2-cc8c5bded790'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:08:50.164744 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f4186469-1f6e-4293-91a5-8a2b691b766f tempest-VolumesBackupsTest-1109530946 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:08:50.237166 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f4186469-1f6e-4293-91a5-8a2b691b766f tempest-VolumesBackupsTest-1109530946 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:08:50.324114 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-f4186469-1f6e-4293-91a5-8a2b691b766f tempest-VolumesBackupsTest-1109530946 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:08:50.328959 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-f4186469-1f6e-4293-91a5-8a2b691b766f tempest-VolumesBackupsTest-1109530946 None] Deleted volume successfully. Mar 12 21:08:50.367521 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-f4186469-1f6e-4293-91a5-8a2b691b766f tempest-VolumesBackupsTest-1109530946 None] Lock "b'cinder-f03f9c6c-6781-4beb-b4e3-e9cab44747d1-delete_volume'" released by "delete_volume" :: held 2.285s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:08:50.391311 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-bb1c6715-4ea0-4af6-b471-21e1722e5732 tempest-VolumesDeleteCascade-350081394 None] Delete snapshot completed successfully. Mar 12 21:08:50.397214 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-bb1c6715-4ea0-4af6-b471-21e1722e5732 tempest-VolumesDeleteCascade-350081394 None] Lock "b'cinder-e5e7ac6d-f556-43d2-8a4d-831c83fa6105-delete_snapshot'" released by "delete_snapshot" :: held 1.346s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:08:50.398087 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-bb1c6715-4ea0-4af6-b471-21e1722e5732 tempest-VolumesDeleteCascade-350081394 None] Snapshots deleted, issuing volume delete {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/manager.py:978}} Mar 12 21:08:50.398918 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-bb1c6715-4ea0-4af6-b471-21e1722e5732 tempest-VolumesDeleteCascade-350081394 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:08:50.500285 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-bb1c6715-4ea0-4af6-b471-21e1722e5732 tempest-VolumesDeleteCascade-350081394 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:08:50.500706 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-bb1c6715-4ea0-4af6-b471-21e1722e5732 tempest-VolumesDeleteCascade-350081394 None] Volume volume-36e91f42-e0ec-444d-8b38-4a328463a0aa is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:08:50.511915 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-bb1c6715-4ea0-4af6-b471-21e1722e5732 tempest-VolumesDeleteCascade-350081394 None] deleting rbd volume volume-36e91f42-e0ec-444d-8b38-4a328463a0aa {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:08:51.011223 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-bb1c6715-4ea0-4af6-b471-21e1722e5732 tempest-VolumesDeleteCascade-350081394 None] Created reservations ['4bdcb168-fefa-4d34-87fe-734afd7c8a57', 'b06fff52-7d4a-45fb-b006-d8b823f57604', '1a5bd2eb-c29f-4d1b-aecb-a46123bb97e9', 'c38ff1da-f3be-42a8-ba8e-488c5573757c'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:08:51.100154 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-bb1c6715-4ea0-4af6-b471-21e1722e5732 tempest-VolumesDeleteCascade-350081394 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:08:51.201459 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-bb1c6715-4ea0-4af6-b471-21e1722e5732 tempest-VolumesDeleteCascade-350081394 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:08:51.262899 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-bb1c6715-4ea0-4af6-b471-21e1722e5732 tempest-VolumesDeleteCascade-350081394 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:08:51.264688 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:08:51.265488 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:08:51.348266 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:08:51.420154 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:08:51.426145 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-bb1c6715-4ea0-4af6-b471-21e1722e5732 tempest-VolumesDeleteCascade-350081394 None] Deleted volume successfully. Mar 12 21:08:51.461594 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-bb1c6715-4ea0-4af6-b471-21e1722e5732 tempest-VolumesDeleteCascade-350081394 None] Lock "b'cinder-36e91f42-e0ec-444d-8b38-4a328463a0aa-delete_volume'" released by "delete_volume" :: held 3.834s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:08:56.051202 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-dbe457c1-9c73-4f68-83ba-0897bb3e61ec tempest-GroupsTest-1538447524 None] Group tempest-Group1-1002548244: creating Mar 12 21:08:56.102834 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-dbe457c1-9c73-4f68-83ba-0897bb3e61ec tempest-GroupsTest-1538447524 None] Group tempest-Group1-1002548244: created successfully Mar 12 21:08:56.128705 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-dbe457c1-9c73-4f68-83ba-0897bb3e61ec tempest-GroupsTest-1538447524 None] Create group completed successfully. Mar 12 21:08:57.140804 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-b32b8ab8-1d1a-49c5-b863-6fc415020fcf tempest-VolumesBackupsV39Test-777707830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:08:57.146958 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-b32b8ab8-1d1a-49c5-b863-6fc415020fcf tempest-VolumesBackupsV39Test-777707830 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:08:57.147750 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-b32b8ab8-1d1a-49c5-b863-6fc415020fcf tempest-VolumesBackupsV39Test-777707830 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:08:57.173360 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b32b8ab8-1d1a-49c5-b863-6fc415020fcf tempest-VolumesBackupsV39Test-777707830 None] Flow 'volume_create_manager' (3cfe8624-c817-47dc-8480-496a7253581e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:08:57.183391 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b32b8ab8-1d1a-49c5-b863-6fc415020fcf tempest-VolumesBackupsV39Test-777707830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23bffe9a-cd57-4ebe-8872-8e4d82efe8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:08:57.194998 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-b32b8ab8-1d1a-49c5-b863-6fc415020fcf tempest-VolumesBackupsV39Test-777707830 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:08:57.227055 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b32b8ab8-1d1a-49c5-b863-6fc415020fcf tempest-VolumesBackupsV39Test-777707830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23bffe9a-cd57-4ebe-8872-8e4d82efe8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Volume-653188911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2b938d6a-5fce-41aa-a3d6-f0e32446feff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0576147e4eaf414bbc49a330fd52a7e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:08:57Z,use_quota=True,user_id='5b88500f5cbd458081b2574add4892b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:08:57.236479 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b32b8ab8-1d1a-49c5-b863-6fc415020fcf tempest-VolumesBackupsV39Test-777707830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76cc959a-7b52-4c1a-84fb-31521cdc5679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:08:57.242213 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b32b8ab8-1d1a-49c5-b863-6fc415020fcf tempest-VolumesBackupsV39Test-777707830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76cc959a-7b52-4c1a-84fb-31521cdc5679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:08:57.251020 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b32b8ab8-1d1a-49c5-b863-6fc415020fcf tempest-VolumesBackupsV39Test-777707830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5820f431-2fd1-4ac0-bc82-eb9d77be5c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:08:57.258706 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b32b8ab8-1d1a-49c5-b863-6fc415020fcf tempest-VolumesBackupsV39Test-777707830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5820f431-2fd1-4ac0-bc82-eb9d77be5c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b938d6a-5fce-41aa-a3d6-f0e32446feff', 'volume_name': 'volume-2b938d6a-5fce-41aa-a3d6-f0e32446feff', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:08:57.266721 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b32b8ab8-1d1a-49c5-b863-6fc415020fcf tempest-VolumesBackupsV39Test-777707830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0511b6fb-27bb-4514-8a03-603cdb3f66ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:08:57.272576 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b32b8ab8-1d1a-49c5-b863-6fc415020fcf tempest-VolumesBackupsV39Test-777707830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0511b6fb-27bb-4514-8a03-603cdb3f66ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:08:57.279438 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b32b8ab8-1d1a-49c5-b863-6fc415020fcf tempest-VolumesBackupsV39Test-777707830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2557f2be-6ef8-49cf-8b88-3b24b037955c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:08:57.281017 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-b32b8ab8-1d1a-49c5-b863-6fc415020fcf tempest-VolumesBackupsV39Test-777707830 None] Volume 2b938d6a-5fce-41aa-a3d6-f0e32446feff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b938d6a-5fce-41aa-a3d6-f0e32446feff', 'volume_size': 1} Mar 12 21:08:57.281557 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b32b8ab8-1d1a-49c5-b863-6fc415020fcf tempest-VolumesBackupsV39Test-777707830 None] creating volume 'volume-2b938d6a-5fce-41aa-a3d6-f0e32446feff' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:08:57.283209 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b32b8ab8-1d1a-49c5-b863-6fc415020fcf tempest-VolumesBackupsV39Test-777707830 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:08:57.420445 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b32b8ab8-1d1a-49c5-b863-6fc415020fcf tempest-VolumesBackupsV39Test-777707830 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:08:57.421369 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b32b8ab8-1d1a-49c5-b863-6fc415020fcf tempest-VolumesBackupsV39Test-777707830 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:08:57.429884 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b32b8ab8-1d1a-49c5-b863-6fc415020fcf tempest-VolumesBackupsV39Test-777707830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2557f2be-6ef8-49cf-8b88-3b24b037955c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b938d6a-5fce-41aa-a3d6-f0e32446feff', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:08:57.439296 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b32b8ab8-1d1a-49c5-b863-6fc415020fcf tempest-VolumesBackupsV39Test-777707830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c103bd8-42fa-484b-ba99-19e33f15f3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:08:57.472331 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-b32b8ab8-1d1a-49c5-b863-6fc415020fcf tempest-VolumesBackupsV39Test-777707830 None] Volume volume-2b938d6a-5fce-41aa-a3d6-f0e32446feff (2b938d6a-5fce-41aa-a3d6-f0e32446feff): created successfully Mar 12 21:08:57.478177 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b32b8ab8-1d1a-49c5-b863-6fc415020fcf tempest-VolumesBackupsV39Test-777707830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c103bd8-42fa-484b-ba99-19e33f15f3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:08:57.498583 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b32b8ab8-1d1a-49c5-b863-6fc415020fcf tempest-VolumesBackupsV39Test-777707830 None] Flow 'volume_create_manager' (3cfe8624-c817-47dc-8480-496a7253581e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:08:57.528930 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-3778058f-7a84-4868-8d39-6aa871534f65 tempest-GroupsTest-1538447524 None] Group tempest-Group2-269972115: creating Mar 12 21:08:57.532457 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-b32b8ab8-1d1a-49c5-b863-6fc415020fcf tempest-VolumesBackupsV39Test-777707830 None] Created volume successfully. Mar 12 21:08:57.556081 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-3778058f-7a84-4868-8d39-6aa871534f65 tempest-GroupsTest-1538447524 None] Group tempest-Group2-269972115: created successfully Mar 12 21:08:57.566605 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-3778058f-7a84-4868-8d39-6aa871534f65 tempest-GroupsTest-1538447524 None] Create group completed successfully. Mar 12 21:08:58.430091 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-087464b7-e129-4688-bb47-80586dc06a31 tempest-VolumesBackupsV39Test-777707830 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-03-12T21:08:58Z,data_timestamp=2022-03-12T21:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Backup-1682607007',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=460e2942-9409-42b0-b815-27d08e1c672a,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='0576147e4eaf414bbc49a330fd52a7e3',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='5b88500f5cbd458081b2574add4892b5',volume_id=2b938d6a-5fce-41aa-a3d6-f0e32446feff) Mar 12 21:08:58.431514 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.backup.rpcapi [None req-087464b7-e129-4688-bb47-80586dc06a31 tempest-VolumesBackupsV39Test-777707830 None] continue_backup in rpcapi backup_id 460e2942-9409-42b0-b815-27d08e1c672a {{(pid=129531) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Mar 12 21:08:58.810513 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [None req-087464b7-e129-4688-bb47-80586dc06a31 tempest-VolumesBackupsV39Test-777707830 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 21:08:59.292623 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdd17abc-b6d2-4ea1-ae0f-4e0c80f94fa7 tempest-GroupsTest-1538447524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:08:59.311121 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-fdd17abc-b6d2-4ea1-ae0f-4e0c80f94fa7 tempest-GroupsTest-1538447524 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:08:59.311974 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-fdd17abc-b6d2-4ea1-ae0f-4e0c80f94fa7 tempest-GroupsTest-1538447524 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:08:59.348636 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-fdd17abc-b6d2-4ea1-ae0f-4e0c80f94fa7 tempest-GroupsTest-1538447524 None] Flow 'volume_create_manager' (5da2ed24-8a33-43d2-9e92-b0341f25f72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:08:59.360293 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-fdd17abc-b6d2-4ea1-ae0f-4e0c80f94fa7 tempest-GroupsTest-1538447524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e69aff8-24d9-41c2-bb44-3feaed6f1149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:08:59.371653 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-fdd17abc-b6d2-4ea1-ae0f-4e0c80f94fa7 tempest-GroupsTest-1538447524 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:08:59.395581 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-fdd17abc-b6d2-4ea1-ae0f-4e0c80f94fa7 tempest-GroupsTest-1538447524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e69aff8-24d9-41c2-bb44-3feaed6f1149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1465691378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=68cb95b1-a0f0-4f34-9bfb-debc06012554,host='ncdv-master-1@ceph#ceph',id=65c80072-151a-418c-a9e2-c68cedd3c9bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='574ad0f70f8944b7ab455605c21ee927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:08:59Z,use_quota=True,user_id='ce9e3bb4869544848a83f2c0b1109cac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41d20d6f-0d38-4e37-af92-c61f42bb7bfb),volume_type_id=41d20d6f-0d38-4e37-af92-c61f42bb7bfb)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:08:59.405283 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-fdd17abc-b6d2-4ea1-ae0f-4e0c80f94fa7 tempest-GroupsTest-1538447524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d654b66-a58c-45e4-b9b8-a795cfe2e8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:08:59.415090 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-fdd17abc-b6d2-4ea1-ae0f-4e0c80f94fa7 tempest-GroupsTest-1538447524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d654b66-a58c-45e4-b9b8-a795cfe2e8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:08:59.422809 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-fdd17abc-b6d2-4ea1-ae0f-4e0c80f94fa7 tempest-GroupsTest-1538447524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1675f520-4888-4341-9040-2066ed2bc8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:08:59.429401 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-fdd17abc-b6d2-4ea1-ae0f-4e0c80f94fa7 tempest-GroupsTest-1538447524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1675f520-4888-4341-9040-2066ed2bc8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65c80072-151a-418c-a9e2-c68cedd3c9bc', 'volume_name': 'volume-65c80072-151a-418c-a9e2-c68cedd3c9bc', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:08:59.438452 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-fdd17abc-b6d2-4ea1-ae0f-4e0c80f94fa7 tempest-GroupsTest-1538447524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdd9bf52-9ea6-4d40-90a1-2d643dcc6160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:08:59.445858 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-fdd17abc-b6d2-4ea1-ae0f-4e0c80f94fa7 tempest-GroupsTest-1538447524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdd9bf52-9ea6-4d40-90a1-2d643dcc6160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:08:59.453902 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-fdd17abc-b6d2-4ea1-ae0f-4e0c80f94fa7 tempest-GroupsTest-1538447524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af9cf47-b57e-476a-aebf-462396d555b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:08:59.455568 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-fdd17abc-b6d2-4ea1-ae0f-4e0c80f94fa7 tempest-GroupsTest-1538447524 None] Volume 65c80072-151a-418c-a9e2-c68cedd3c9bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65c80072-151a-418c-a9e2-c68cedd3c9bc', 'volume_size': 1} Mar 12 21:08:59.456196 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-fdd17abc-b6d2-4ea1-ae0f-4e0c80f94fa7 tempest-GroupsTest-1538447524 None] creating volume 'volume-65c80072-151a-418c-a9e2-c68cedd3c9bc' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:08:59.457596 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-fdd17abc-b6d2-4ea1-ae0f-4e0c80f94fa7 tempest-GroupsTest-1538447524 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:08:59.607663 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-fdd17abc-b6d2-4ea1-ae0f-4e0c80f94fa7 tempest-GroupsTest-1538447524 None] extra_specs: {} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:08:59.608362 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-fdd17abc-b6d2-4ea1-ae0f-4e0c80f94fa7 tempest-GroupsTest-1538447524 None] extra_specs: {} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:08:59.616085 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-fdd17abc-b6d2-4ea1-ae0f-4e0c80f94fa7 tempest-GroupsTest-1538447524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af9cf47-b57e-476a-aebf-462396d555b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65c80072-151a-418c-a9e2-c68cedd3c9bc', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:08:59.626778 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-fdd17abc-b6d2-4ea1-ae0f-4e0c80f94fa7 tempest-GroupsTest-1538447524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b75c2d-6d52-4fcf-b3d3-c67ce80ee58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:08:59.656369 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-fdd17abc-b6d2-4ea1-ae0f-4e0c80f94fa7 tempest-GroupsTest-1538447524 None] Volume volume-65c80072-151a-418c-a9e2-c68cedd3c9bc (65c80072-151a-418c-a9e2-c68cedd3c9bc): created successfully Mar 12 21:08:59.664635 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-fdd17abc-b6d2-4ea1-ae0f-4e0c80f94fa7 tempest-GroupsTest-1538447524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b75c2d-6d52-4fcf-b3d3-c67ce80ee58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:08:59.683133 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-fdd17abc-b6d2-4ea1-ae0f-4e0c80f94fa7 tempest-GroupsTest-1538447524 None] Flow 'volume_create_manager' (5da2ed24-8a33-43d2-9e92-b0341f25f72c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:08:59.705543 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-fdd17abc-b6d2-4ea1-ae0f-4e0c80f94fa7 tempest-GroupsTest-1538447524 None] Created volume successfully. Mar 12 21:08:59.973483 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [None req-087464b7-e129-4688-bb47-80586dc06a31 tempest-VolumesBackupsV39Test-777707830 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.163s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 21:08:59.975417 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-087464b7-e129-4688-bb47-80586dc06a31 tempest-VolumesBackupsV39Test-777707830 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2b938d6a-5fce-41aa-a3d6-f0e32446feff', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': '2b938d6a-5fce-41aa-a3d6-f0e32446feff', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 21:08:59.994928 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-087464b7-e129-4688-bb47-80586dc06a31 tempest-VolumesBackupsV39Test-777707830 None] Initialize volume connection completed successfully. Mar 12 21:09:01.102456 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-226afabc-0b7f-4462-b6b8-a420baf7c89a tempest-GroupsTest-1538447524 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:09:01.237548 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-226afabc-0b7f-4462-b6b8-a420baf7c89a tempest-GroupsTest-1538447524 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:09:01.237947 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-226afabc-0b7f-4462-b6b8-a420baf7c89a tempest-GroupsTest-1538447524 None] Volume volume-65c80072-151a-418c-a9e2-c68cedd3c9bc is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:09:01.263076 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-226afabc-0b7f-4462-b6b8-a420baf7c89a tempest-GroupsTest-1538447524 None] deleting rbd volume volume-65c80072-151a-418c-a9e2-c68cedd3c9bc {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:09:01.851167 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-226afabc-0b7f-4462-b6b8-a420baf7c89a tempest-GroupsTest-1538447524 None] Created reservations ['ad6ed6af-ee97-4442-b57e-12325bcb5cdd'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:09:01.889417 ncdv-master-1 cinder-volume[129531]: WARNING cinder.quota [None req-226afabc-0b7f-4462-b6b8-a420baf7c89a tempest-GroupsTest-1538447524 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1337713456 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1337713456, it is now deprecated. Please use the default quota class for default quota. Mar 12 21:09:01.894112 ncdv-master-1 cinder-volume[129531]: WARNING cinder.quota [None req-226afabc-0b7f-4462-b6b8-a420baf7c89a tempest-GroupsTest-1538447524 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1337713456 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1337713456, it is now deprecated. Please use the default quota class for default quota. Mar 12 21:09:01.933571 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-226afabc-0b7f-4462-b6b8-a420baf7c89a tempest-GroupsTest-1538447524 None] Created reservations ['a9970cd2-d1bd-4353-a6d1-633b1ff39343', 'ea13f5e1-1195-41b1-bc64-45d787faca65', '5f94b78a-3215-4d20-988e-0220ad322f24', '9708c3da-b767-4da0-901e-498873775688'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:09:02.100551 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-226afabc-0b7f-4462-b6b8-a420baf7c89a tempest-GroupsTest-1538447524 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:09:02.186489 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-226afabc-0b7f-4462-b6b8-a420baf7c89a tempest-GroupsTest-1538447524 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:09:02.265673 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-226afabc-0b7f-4462-b6b8-a420baf7c89a tempest-GroupsTest-1538447524 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:09:02.277641 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-226afabc-0b7f-4462-b6b8-a420baf7c89a tempest-GroupsTest-1538447524 None] Delete group completed successfully. Mar 12 21:09:02.284986 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-087464b7-e129-4688-bb47-80586dc06a31 tempest-VolumesBackupsV39Test-777707830 None] Terminate volume connection completed successfully. Mar 12 21:09:02.330252 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-087464b7-e129-4688-bb47-80586dc06a31 tempest-VolumesBackupsV39Test-777707830 None] Remove volume export completed successfully. Mar 12 21:09:02.710025 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-de4d4759-a106-41a2-bd1c-7df6bb900a9c tempest-GroupsTest-1538447524 None] Created reservations ['239d310d-79a8-4489-8343-234011e29617'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:09:02.775529 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-de4d4759-a106-41a2-bd1c-7df6bb900a9c tempest-GroupsTest-1538447524 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:09:02.906177 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-de4d4759-a106-41a2-bd1c-7df6bb900a9c tempest-GroupsTest-1538447524 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:09:02.988272 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-de4d4759-a106-41a2-bd1c-7df6bb900a9c tempest-GroupsTest-1538447524 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:09:02.993212 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-de4d4759-a106-41a2-bd1c-7df6bb900a9c tempest-GroupsTest-1538447524 None] Delete group completed successfully. Mar 12 21:09:04.707224 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-8a4de25b-afca-456f-bc6c-65a88a19f06e tempest-GroupsTest-1538447524 None] Group tempest-GroupsTest-Group-1904670988: creating Mar 12 21:09:04.747229 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-8a4de25b-afca-456f-bc6c-65a88a19f06e tempest-GroupsTest-1538447524 None] Group tempest-GroupsTest-Group-1904670988: created successfully Mar 12 21:09:04.844882 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-8a4de25b-afca-456f-bc6c-65a88a19f06e tempest-GroupsTest-1538447524 None] Create group completed successfully. Mar 12 21:09:05.194977 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-6a02c0e8-807b-4fe0-9cd8-d7411b1d31f6 tempest-VolumesBackupsV39Test-777707830 None] Lock "b'cinder-2b938d6a-5fce-41aa-a3d6-f0e32446feff-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:09:05.285845 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-6a02c0e8-807b-4fe0-9cd8-d7411b1d31f6 tempest-VolumesBackupsV39Test-777707830 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:09:06.035700 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-6a02c0e8-807b-4fe0-9cd8-d7411b1d31f6 tempest-VolumesBackupsV39Test-777707830 None] Volume volume-2b938d6a-5fce-41aa-a3d6-f0e32446feff is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:09:06.078816 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-6a02c0e8-807b-4fe0-9cd8-d7411b1d31f6 tempest-VolumesBackupsV39Test-777707830 None] deleting rbd volume volume-2b938d6a-5fce-41aa-a3d6-f0e32446feff {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:09:06.618152 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-6a02c0e8-807b-4fe0-9cd8-d7411b1d31f6 tempest-VolumesBackupsV39Test-777707830 None] Created reservations ['3997e3f1-25b7-42ca-beef-7e691450a839', 'fe6c58d3-9c73-4494-8ff7-035fdac5cb66', '7aa03af0-bf96-42ed-98e0-94e008730369', 'f8aa8421-f0ae-4859-b999-93507e1f6f78'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:09:06.712842 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-f290a4e4-5000-44e0-9032-bd152f7e2a4d tempest-GroupsTest-1538447524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:09:06.719276 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-f290a4e4-5000-44e0-9032-bd152f7e2a4d tempest-GroupsTest-1538447524 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:09:06.720242 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-f290a4e4-5000-44e0-9032-bd152f7e2a4d tempest-GroupsTest-1538447524 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:09:06.780127 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f290a4e4-5000-44e0-9032-bd152f7e2a4d tempest-GroupsTest-1538447524 None] Flow 'volume_create_manager' (463a7397-e38f-4a72-8625-889b58434a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:09:06.802813 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f290a4e4-5000-44e0-9032-bd152f7e2a4d tempest-GroupsTest-1538447524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdf1f6be-899c-48cc-b5a1-dc5ede651fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:06.838733 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-f290a4e4-5000-44e0-9032-bd152f7e2a4d tempest-GroupsTest-1538447524 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:09:06.883925 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f290a4e4-5000-44e0-9032-bd152f7e2a4d tempest-GroupsTest-1538447524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdf1f6be-899c-48cc-b5a1-dc5ede651fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-992606831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4d4e7660-1cb8-413c-91d1-33ad3dd20539,host='ncdv-master-1@ceph#ceph',id=72e18a10-1923-424f-928e-b0bbfc9fe2d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='574ad0f70f8944b7ab455605c21ee927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:09:07Z,use_quota=True,user_id='ce9e3bb4869544848a83f2c0b1109cac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e0c9578-9113-488e-b3ce-44fe3bbc2553),volume_type_id=6e0c9578-9113-488e-b3ce-44fe3bbc2553)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:06.906596 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f290a4e4-5000-44e0-9032-bd152f7e2a4d tempest-GroupsTest-1538447524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc5f29d-05dd-4f7b-8e0f-83b39fc3af6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:06.911840 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f290a4e4-5000-44e0-9032-bd152f7e2a4d tempest-GroupsTest-1538447524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc5f29d-05dd-4f7b-8e0f-83b39fc3af6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:06.924362 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f290a4e4-5000-44e0-9032-bd152f7e2a4d tempest-GroupsTest-1538447524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10593833-d60e-4313-821b-11c6c27b072a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:06.929921 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f290a4e4-5000-44e0-9032-bd152f7e2a4d tempest-GroupsTest-1538447524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10593833-d60e-4313-821b-11c6c27b072a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72e18a10-1923-424f-928e-b0bbfc9fe2d2', 'volume_name': 'volume-72e18a10-1923-424f-928e-b0bbfc9fe2d2', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:06.935761 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f290a4e4-5000-44e0-9032-bd152f7e2a4d tempest-GroupsTest-1538447524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13bffe3f-5614-4a7a-9ccf-f11974348064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:06.947506 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f290a4e4-5000-44e0-9032-bd152f7e2a4d tempest-GroupsTest-1538447524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13bffe3f-5614-4a7a-9ccf-f11974348064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:06.958394 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f290a4e4-5000-44e0-9032-bd152f7e2a4d tempest-GroupsTest-1538447524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8600cdf0-5ef8-4c84-95b4-d300a42e3e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:06.969969 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-f290a4e4-5000-44e0-9032-bd152f7e2a4d tempest-GroupsTest-1538447524 None] Volume 72e18a10-1923-424f-928e-b0bbfc9fe2d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72e18a10-1923-424f-928e-b0bbfc9fe2d2', 'volume_size': 1} Mar 12 21:09:06.970602 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f290a4e4-5000-44e0-9032-bd152f7e2a4d tempest-GroupsTest-1538447524 None] creating volume 'volume-72e18a10-1923-424f-928e-b0bbfc9fe2d2' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:09:06.971880 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f290a4e4-5000-44e0-9032-bd152f7e2a4d tempest-GroupsTest-1538447524 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:09:07.070979 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-6a02c0e8-807b-4fe0-9cd8-d7411b1d31f6 tempest-VolumesBackupsV39Test-777707830 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:09:07.142173 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-6a02c0e8-807b-4fe0-9cd8-d7411b1d31f6 tempest-VolumesBackupsV39Test-777707830 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:09:07.231605 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-6a02c0e8-807b-4fe0-9cd8-d7411b1d31f6 tempest-VolumesBackupsV39Test-777707830 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:09:07.236454 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-6a02c0e8-807b-4fe0-9cd8-d7411b1d31f6 tempest-VolumesBackupsV39Test-777707830 None] Deleted volume successfully. Mar 12 21:09:07.268651 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f290a4e4-5000-44e0-9032-bd152f7e2a4d tempest-GroupsTest-1538447524 None] extra_specs: {} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:09:07.269051 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f290a4e4-5000-44e0-9032-bd152f7e2a4d tempest-GroupsTest-1538447524 None] extra_specs: {} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:09:07.284119 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f290a4e4-5000-44e0-9032-bd152f7e2a4d tempest-GroupsTest-1538447524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8600cdf0-5ef8-4c84-95b4-d300a42e3e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72e18a10-1923-424f-928e-b0bbfc9fe2d2', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:07.294748 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f290a4e4-5000-44e0-9032-bd152f7e2a4d tempest-GroupsTest-1538447524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce201bbe-ad28-4399-bca0-80f6de053e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:07.336276 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-f290a4e4-5000-44e0-9032-bd152f7e2a4d tempest-GroupsTest-1538447524 None] Volume volume-72e18a10-1923-424f-928e-b0bbfc9fe2d2 (72e18a10-1923-424f-928e-b0bbfc9fe2d2): created successfully Mar 12 21:09:07.345453 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f290a4e4-5000-44e0-9032-bd152f7e2a4d tempest-GroupsTest-1538447524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce201bbe-ad28-4399-bca0-80f6de053e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:07.360358 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f290a4e4-5000-44e0-9032-bd152f7e2a4d tempest-GroupsTest-1538447524 None] Flow 'volume_create_manager' (463a7397-e38f-4a72-8625-889b58434a14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:09:07.376363 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-6a02c0e8-807b-4fe0-9cd8-d7411b1d31f6 tempest-VolumesBackupsV39Test-777707830 None] Lock "b'cinder-2b938d6a-5fce-41aa-a3d6-f0e32446feff-delete_volume'" released by "delete_volume" :: held 2.182s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:09:07.388103 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-f290a4e4-5000-44e0-9032-bd152f7e2a4d tempest-GroupsTest-1538447524 None] Created volume successfully. Mar 12 21:09:08.537432 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-6986da66-5e80-4277-b835-ff14b1bdbd04 tempest-GroupsTest-1538447524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:09:08.542070 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-6986da66-5e80-4277-b835-ff14b1bdbd04 tempest-GroupsTest-1538447524 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:09:08.542517 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-6986da66-5e80-4277-b835-ff14b1bdbd04 tempest-GroupsTest-1538447524 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:09:08.599153 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6986da66-5e80-4277-b835-ff14b1bdbd04 tempest-GroupsTest-1538447524 None] Flow 'volume_create_manager' (1eb56f90-bba9-4857-b8ec-154d7495f1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:09:08.644699 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6986da66-5e80-4277-b835-ff14b1bdbd04 tempest-GroupsTest-1538447524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47345002-be66-485b-858c-a9c5e1cff26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:08.665888 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-6986da66-5e80-4277-b835-ff14b1bdbd04 tempest-GroupsTest-1538447524 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:09:08.713532 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6986da66-5e80-4277-b835-ff14b1bdbd04 tempest-GroupsTest-1538447524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47345002-be66-485b-858c-a9c5e1cff26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-1962138728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4d4e7660-1cb8-413c-91d1-33ad3dd20539,host='ncdv-master-1@ceph#ceph',id=1bfa1fc1-80a3-485f-982c-cb1368237b08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='574ad0f70f8944b7ab455605c21ee927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:09:08Z,use_quota=True,user_id='ce9e3bb4869544848a83f2c0b1109cac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e0c9578-9113-488e-b3ce-44fe3bbc2553),volume_type_id=6e0c9578-9113-488e-b3ce-44fe3bbc2553)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:08.738780 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6986da66-5e80-4277-b835-ff14b1bdbd04 tempest-GroupsTest-1538447524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecbd5023-bce1-45df-9a0d-72e0c3e3ca35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:08.760236 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6986da66-5e80-4277-b835-ff14b1bdbd04 tempest-GroupsTest-1538447524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecbd5023-bce1-45df-9a0d-72e0c3e3ca35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:08.775961 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6986da66-5e80-4277-b835-ff14b1bdbd04 tempest-GroupsTest-1538447524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (983fde93-aca1-49fc-be09-f34eba2f52dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:08.846869 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6986da66-5e80-4277-b835-ff14b1bdbd04 tempest-GroupsTest-1538447524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (983fde93-aca1-49fc-be09-f34eba2f52dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bfa1fc1-80a3-485f-982c-cb1368237b08', 'volume_name': 'volume-1bfa1fc1-80a3-485f-982c-cb1368237b08', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:08.883057 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6986da66-5e80-4277-b835-ff14b1bdbd04 tempest-GroupsTest-1538447524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c32ace4-9c34-4462-887d-250022742a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:08.906886 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6986da66-5e80-4277-b835-ff14b1bdbd04 tempest-GroupsTest-1538447524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c32ace4-9c34-4462-887d-250022742a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:08.919677 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6986da66-5e80-4277-b835-ff14b1bdbd04 tempest-GroupsTest-1538447524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (908ae8a6-87bb-4f2c-8e92-0816c19d2f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:08.923156 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-6986da66-5e80-4277-b835-ff14b1bdbd04 tempest-GroupsTest-1538447524 None] Volume 1bfa1fc1-80a3-485f-982c-cb1368237b08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bfa1fc1-80a3-485f-982c-cb1368237b08', 'volume_size': 1} Mar 12 21:09:08.926214 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-6986da66-5e80-4277-b835-ff14b1bdbd04 tempest-GroupsTest-1538447524 None] creating volume 'volume-1bfa1fc1-80a3-485f-982c-cb1368237b08' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:09:08.930678 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-6986da66-5e80-4277-b835-ff14b1bdbd04 tempest-GroupsTest-1538447524 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:09:09.099628 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-6986da66-5e80-4277-b835-ff14b1bdbd04 tempest-GroupsTest-1538447524 None] extra_specs: {} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:09:09.100247 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-6986da66-5e80-4277-b835-ff14b1bdbd04 tempest-GroupsTest-1538447524 None] extra_specs: {} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:09:09.104783 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6986da66-5e80-4277-b835-ff14b1bdbd04 tempest-GroupsTest-1538447524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (908ae8a6-87bb-4f2c-8e92-0816c19d2f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bfa1fc1-80a3-485f-982c-cb1368237b08', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:09.115007 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6986da66-5e80-4277-b835-ff14b1bdbd04 tempest-GroupsTest-1538447524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a461a57f-373b-45c5-8f25-01a20fd57024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:09.132512 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-6986da66-5e80-4277-b835-ff14b1bdbd04 tempest-GroupsTest-1538447524 None] Volume volume-1bfa1fc1-80a3-485f-982c-cb1368237b08 (1bfa1fc1-80a3-485f-982c-cb1368237b08): created successfully Mar 12 21:09:09.153481 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6986da66-5e80-4277-b835-ff14b1bdbd04 tempest-GroupsTest-1538447524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a461a57f-373b-45c5-8f25-01a20fd57024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:09.179036 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6986da66-5e80-4277-b835-ff14b1bdbd04 tempest-GroupsTest-1538447524 None] Flow 'volume_create_manager' (1eb56f90-bba9-4857-b8ec-154d7495f1b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:09:09.198922 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-6986da66-5e80-4277-b835-ff14b1bdbd04 tempest-GroupsTest-1538447524 None] Created volume successfully. Mar 12 21:09:09.983207 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-ee74c3b8-a82d-44ba-b034-967655b40047 tempest-GroupsTest-1538447524 None] Update group completed successfully. Mar 12 21:09:11.649450 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-4afc4ea9-23bb-430a-9676-442099915af4 tempest-GroupsTest-1538447524 None] Update group completed successfully. Mar 12 21:09:13.596879 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c39da97c-fc40-4f88-9d79-5c90a00072df tempest-GroupsTest-1538447524 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:09:13.728672 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c39da97c-fc40-4f88-9d79-5c90a00072df tempest-GroupsTest-1538447524 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:09:13.729532 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c39da97c-fc40-4f88-9d79-5c90a00072df tempest-GroupsTest-1538447524 None] Volume volume-1bfa1fc1-80a3-485f-982c-cb1368237b08 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:09:13.743754 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c39da97c-fc40-4f88-9d79-5c90a00072df tempest-GroupsTest-1538447524 None] deleting rbd volume volume-1bfa1fc1-80a3-485f-982c-cb1368237b08 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:09:14.282976 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c39da97c-fc40-4f88-9d79-5c90a00072df tempest-GroupsTest-1538447524 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:09:14.385114 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c39da97c-fc40-4f88-9d79-5c90a00072df tempest-GroupsTest-1538447524 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:09:14.385530 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c39da97c-fc40-4f88-9d79-5c90a00072df tempest-GroupsTest-1538447524 None] Volume volume-72e18a10-1923-424f-928e-b0bbfc9fe2d2 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:09:14.397846 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c39da97c-fc40-4f88-9d79-5c90a00072df tempest-GroupsTest-1538447524 None] deleting rbd volume volume-72e18a10-1923-424f-928e-b0bbfc9fe2d2 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:09:14.978755 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-c39da97c-fc40-4f88-9d79-5c90a00072df tempest-GroupsTest-1538447524 None] Created reservations ['c5629bed-9e6d-40aa-911d-e2908447b797'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:09:15.002844 ncdv-master-1 cinder-volume[129531]: WARNING cinder.quota [None req-c39da97c-fc40-4f88-9d79-5c90a00072df tempest-GroupsTest-1538447524 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-941354490 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-941354490, it is now deprecated. Please use the default quota class for default quota. Mar 12 21:09:15.003853 ncdv-master-1 cinder-volume[129531]: WARNING cinder.quota [None req-c39da97c-fc40-4f88-9d79-5c90a00072df tempest-GroupsTest-1538447524 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-941354490 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-941354490, it is now deprecated. Please use the default quota class for default quota. Mar 12 21:09:15.023206 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-c39da97c-fc40-4f88-9d79-5c90a00072df tempest-GroupsTest-1538447524 None] Created reservations ['c9961b85-6e9a-4275-b9ae-c49e62938ec3', '2057ccff-a691-417d-b1b8-528ef50e9d9c', '9d10325b-3464-41c6-a294-b7aa1f025bf7', '93d069f4-f626-492f-baef-ff9a05a3d932'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:09:15.180099 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-c39da97c-fc40-4f88-9d79-5c90a00072df tempest-GroupsTest-1538447524 None] Created reservations ['c1a06c7e-22e1-4b2c-95a4-9ea3fd9adc1e', '91299db9-3cc5-4080-8f83-87a9966eb77c', '137475b4-672d-476e-8337-b09e21184c22', 'e63c6c8b-9f1a-4afe-bc2a-82d5e41e74b1'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:09:15.345196 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c39da97c-fc40-4f88-9d79-5c90a00072df tempest-GroupsTest-1538447524 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:09:15.404841 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c39da97c-fc40-4f88-9d79-5c90a00072df tempest-GroupsTest-1538447524 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:09:15.480353 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-c39da97c-fc40-4f88-9d79-5c90a00072df tempest-GroupsTest-1538447524 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:09:15.484877 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-c39da97c-fc40-4f88-9d79-5c90a00072df tempest-GroupsTest-1538447524 None] Delete group completed successfully. Mar 12 21:09:24.696918 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-eff23160-fb32-469a-bb07-98283f4328cc tempest-GroupSnapshotsV319Test-614814183 None] Group tempest-GroupSnapshotsV319Test-Group-1726939478: creating Mar 12 21:09:24.751973 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-eff23160-fb32-469a-bb07-98283f4328cc tempest-GroupSnapshotsV319Test-614814183 None] Group tempest-GroupSnapshotsV319Test-Group-1726939478: created successfully Mar 12 21:09:24.773039 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-eff23160-fb32-469a-bb07-98283f4328cc tempest-GroupSnapshotsV319Test-614814183 None] Create group completed successfully. Mar 12 21:09:25.384739 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-5065bac4-dafe-4fa9-85ff-7197c321e235 tempest-VolumesBackupsAdminTest-1513847769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:09:25.392928 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-5065bac4-dafe-4fa9-85ff-7197c321e235 tempest-VolumesBackupsAdminTest-1513847769 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:09:25.394343 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-5065bac4-dafe-4fa9-85ff-7197c321e235 tempest-VolumesBackupsAdminTest-1513847769 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:09:25.458556 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5065bac4-dafe-4fa9-85ff-7197c321e235 tempest-VolumesBackupsAdminTest-1513847769 None] Flow 'volume_create_manager' (7040821a-cd51-4971-bdd5-d8c3ae44f382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:09:25.471061 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5065bac4-dafe-4fa9-85ff-7197c321e235 tempest-VolumesBackupsAdminTest-1513847769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77b0691a-8c33-48bf-8ed9-bbcdefff03dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:25.495707 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-5065bac4-dafe-4fa9-85ff-7197c321e235 tempest-VolumesBackupsAdminTest-1513847769 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:09:25.528104 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5065bac4-dafe-4fa9-85ff-7197c321e235 tempest-VolumesBackupsAdminTest-1513847769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77b0691a-8c33-48bf-8ed9-bbcdefff03dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-1333090357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=acbf2fdf-7efb-4dc4-8ce1-64607b6441bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76614dd1780d41e99b3db646e59d928c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:09:25Z,use_quota=True,user_id='3d36ef1eff0649179221db760b119396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:25.541601 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5065bac4-dafe-4fa9-85ff-7197c321e235 tempest-VolumesBackupsAdminTest-1513847769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69090354-1335-499b-a512-94a65f38663a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:25.552201 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5065bac4-dafe-4fa9-85ff-7197c321e235 tempest-VolumesBackupsAdminTest-1513847769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69090354-1335-499b-a512-94a65f38663a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:25.571798 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5065bac4-dafe-4fa9-85ff-7197c321e235 tempest-VolumesBackupsAdminTest-1513847769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2609752-a6df-419e-990d-ef0656ac0525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:25.586851 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5065bac4-dafe-4fa9-85ff-7197c321e235 tempest-VolumesBackupsAdminTest-1513847769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2609752-a6df-419e-990d-ef0656ac0525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acbf2fdf-7efb-4dc4-8ce1-64607b6441bf', 'volume_name': 'volume-acbf2fdf-7efb-4dc4-8ce1-64607b6441bf', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:25.596577 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5065bac4-dafe-4fa9-85ff-7197c321e235 tempest-VolumesBackupsAdminTest-1513847769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b9d6f6d-3ac4-4b4c-83b0-a7f6504e0dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:25.609183 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5065bac4-dafe-4fa9-85ff-7197c321e235 tempest-VolumesBackupsAdminTest-1513847769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b9d6f6d-3ac4-4b4c-83b0-a7f6504e0dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:25.619306 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5065bac4-dafe-4fa9-85ff-7197c321e235 tempest-VolumesBackupsAdminTest-1513847769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94e7888f-45b0-4729-a061-d8fb79e569dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:25.622500 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-5065bac4-dafe-4fa9-85ff-7197c321e235 tempest-VolumesBackupsAdminTest-1513847769 None] Volume acbf2fdf-7efb-4dc4-8ce1-64607b6441bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acbf2fdf-7efb-4dc4-8ce1-64607b6441bf', 'volume_size': 1} Mar 12 21:09:25.623023 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-5065bac4-dafe-4fa9-85ff-7197c321e235 tempest-VolumesBackupsAdminTest-1513847769 None] creating volume 'volume-acbf2fdf-7efb-4dc4-8ce1-64607b6441bf' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:09:25.624122 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-5065bac4-dafe-4fa9-85ff-7197c321e235 tempest-VolumesBackupsAdminTest-1513847769 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:09:25.774053 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-5065bac4-dafe-4fa9-85ff-7197c321e235 tempest-VolumesBackupsAdminTest-1513847769 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:09:25.775797 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-5065bac4-dafe-4fa9-85ff-7197c321e235 tempest-VolumesBackupsAdminTest-1513847769 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:09:25.780521 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5065bac4-dafe-4fa9-85ff-7197c321e235 tempest-VolumesBackupsAdminTest-1513847769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94e7888f-45b0-4729-a061-d8fb79e569dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acbf2fdf-7efb-4dc4-8ce1-64607b6441bf', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:25.793082 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5065bac4-dafe-4fa9-85ff-7197c321e235 tempest-VolumesBackupsAdminTest-1513847769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f0cee8a-35cc-4e66-ba9b-e60084cb21f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:25.818199 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-5065bac4-dafe-4fa9-85ff-7197c321e235 tempest-VolumesBackupsAdminTest-1513847769 None] Volume volume-acbf2fdf-7efb-4dc4-8ce1-64607b6441bf (acbf2fdf-7efb-4dc4-8ce1-64607b6441bf): created successfully Mar 12 21:09:25.823039 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5065bac4-dafe-4fa9-85ff-7197c321e235 tempest-VolumesBackupsAdminTest-1513847769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f0cee8a-35cc-4e66-ba9b-e60084cb21f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:25.838444 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5065bac4-dafe-4fa9-85ff-7197c321e235 tempest-VolumesBackupsAdminTest-1513847769 None] Flow 'volume_create_manager' (7040821a-cd51-4971-bdd5-d8c3ae44f382) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:09:25.872881 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-5065bac4-dafe-4fa9-85ff-7197c321e235 tempest-VolumesBackupsAdminTest-1513847769 None] Created volume successfully. Mar 12 21:09:26.638489 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c507927-77cc-44ad-9833-34ad3981a276 tempest-GroupSnapshotsV319Test-614814183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:09:26.661608 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-4c507927-77cc-44ad-9833-34ad3981a276 tempest-GroupSnapshotsV319Test-614814183 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:09:26.662388 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-4c507927-77cc-44ad-9833-34ad3981a276 tempest-GroupSnapshotsV319Test-614814183 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:09:26.786373 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4c507927-77cc-44ad-9833-34ad3981a276 tempest-GroupSnapshotsV319Test-614814183 None] Flow 'volume_create_manager' (a8ed21a0-bf5b-4eae-8aef-de814f66f837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:09:26.812774 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4c507927-77cc-44ad-9833-34ad3981a276 tempest-GroupSnapshotsV319Test-614814183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8fa9892-181d-4a71-98a8-3b953b6207ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:26.858228 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-4c507927-77cc-44ad-9833-34ad3981a276 tempest-GroupSnapshotsV319Test-614814183 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:09:26.926675 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4c507927-77cc-44ad-9833-34ad3981a276 tempest-GroupSnapshotsV319Test-614814183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8fa9892-181d-4a71-98a8-3b953b6207ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsV319Test-Volume-1458045774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=40fc2b1c-5200-4ec8-8bd0-d598ad4c21d6,host='ncdv-master-1@ceph#ceph',id=5d07b6ca-d644-47d1-b5b9-860cf9dd28d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2e7bb54b51e4c2491164b4b92ec01a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:09:27Z,use_quota=True,user_id='2e78a2c7881a410e81ec3511f378e953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa91ca66-6fe7-4f46-9093-d6a429eecfed),volume_type_id=aa91ca66-6fe7-4f46-9093-d6a429eecfed)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:26.940199 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4c507927-77cc-44ad-9833-34ad3981a276 tempest-GroupSnapshotsV319Test-614814183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c79751ae-5b38-4fcc-a7a7-dac229234503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:26.953504 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4c507927-77cc-44ad-9833-34ad3981a276 tempest-GroupSnapshotsV319Test-614814183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c79751ae-5b38-4fcc-a7a7-dac229234503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:26.959510 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4c507927-77cc-44ad-9833-34ad3981a276 tempest-GroupSnapshotsV319Test-614814183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a95b4e25-f83a-42c9-9489-be2d23ddc333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:26.969081 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4c507927-77cc-44ad-9833-34ad3981a276 tempest-GroupSnapshotsV319Test-614814183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a95b4e25-f83a-42c9-9489-be2d23ddc333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d07b6ca-d644-47d1-b5b9-860cf9dd28d5', 'volume_name': 'volume-5d07b6ca-d644-47d1-b5b9-860cf9dd28d5', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:26.974963 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4c507927-77cc-44ad-9833-34ad3981a276 tempest-GroupSnapshotsV319Test-614814183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25cf5d55-e6c7-4590-834f-cad2c3acac3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:26.996242 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4c507927-77cc-44ad-9833-34ad3981a276 tempest-GroupSnapshotsV319Test-614814183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25cf5d55-e6c7-4590-834f-cad2c3acac3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:27.007197 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4c507927-77cc-44ad-9833-34ad3981a276 tempest-GroupSnapshotsV319Test-614814183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef9f90a-84c9-4c67-ab60-c0c2df258c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:27.013106 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-4c507927-77cc-44ad-9833-34ad3981a276 tempest-GroupSnapshotsV319Test-614814183 None] Volume 5d07b6ca-d644-47d1-b5b9-860cf9dd28d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d07b6ca-d644-47d1-b5b9-860cf9dd28d5', 'volume_size': 1} Mar 12 21:09:27.013518 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-4c507927-77cc-44ad-9833-34ad3981a276 tempest-GroupSnapshotsV319Test-614814183 None] creating volume 'volume-5d07b6ca-d644-47d1-b5b9-860cf9dd28d5' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:09:27.022968 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-4c507927-77cc-44ad-9833-34ad3981a276 tempest-GroupSnapshotsV319Test-614814183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:09:27.103964 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-4e13fb3b-5f3a-4795-8289-b25eb64dd623 tempest-VolumesBackupsAdminTest-1513847769 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-03-12T21:09:26Z,data_timestamp=2022-03-12T21:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-971827320',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=e93bc020-d569-4332-8c60-503b12f4d476,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='76614dd1780d41e99b3db646e59d928c',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='3d36ef1eff0649179221db760b119396',volume_id=acbf2fdf-7efb-4dc4-8ce1-64607b6441bf) Mar 12 21:09:27.105722 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.backup.rpcapi [None req-4e13fb3b-5f3a-4795-8289-b25eb64dd623 tempest-VolumesBackupsAdminTest-1513847769 None] continue_backup in rpcapi backup_id e93bc020-d569-4332-8c60-503b12f4d476 {{(pid=129531) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Mar 12 21:09:27.162879 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-4c507927-77cc-44ad-9833-34ad3981a276 tempest-GroupSnapshotsV319Test-614814183 None] extra_specs: {} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:09:27.163275 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-4c507927-77cc-44ad-9833-34ad3981a276 tempest-GroupSnapshotsV319Test-614814183 None] extra_specs: {} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:09:27.167775 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4c507927-77cc-44ad-9833-34ad3981a276 tempest-GroupSnapshotsV319Test-614814183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef9f90a-84c9-4c67-ab60-c0c2df258c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d07b6ca-d644-47d1-b5b9-860cf9dd28d5', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:27.175643 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4c507927-77cc-44ad-9833-34ad3981a276 tempest-GroupSnapshotsV319Test-614814183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74549c5b-de6a-434a-affd-ab1d2a83d27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:27.200525 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-4c507927-77cc-44ad-9833-34ad3981a276 tempest-GroupSnapshotsV319Test-614814183 None] Volume volume-5d07b6ca-d644-47d1-b5b9-860cf9dd28d5 (5d07b6ca-d644-47d1-b5b9-860cf9dd28d5): created successfully Mar 12 21:09:27.211251 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4c507927-77cc-44ad-9833-34ad3981a276 tempest-GroupSnapshotsV319Test-614814183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74549c5b-de6a-434a-affd-ab1d2a83d27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:27.234731 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4c507927-77cc-44ad-9833-34ad3981a276 tempest-GroupSnapshotsV319Test-614814183 None] Flow 'volume_create_manager' (a8ed21a0-bf5b-4eae-8aef-de814f66f837) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:09:27.262091 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-4c507927-77cc-44ad-9833-34ad3981a276 tempest-GroupSnapshotsV319Test-614814183 None] Created volume successfully. Mar 12 21:09:27.564708 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [None req-4e13fb3b-5f3a-4795-8289-b25eb64dd623 tempest-VolumesBackupsAdminTest-1513847769 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 21:09:28.228276 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-530605ea-8cf9-4a1c-beb9-badb78859588 tempest-GroupSnapshotsV319Test-614814183 None] GroupSnapshot 799d1de8-b1b6-480f-9ee5-386aef43c2d1: creating. Mar 12 21:09:28.351589 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-530605ea-8cf9-4a1c-beb9-badb78859588 tempest-GroupSnapshotsV319Test-614814183 None] Group snapshot 799d1de8-b1b6-480f-9ee5-386aef43c2d1: creating. {{(pid=129531) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4076}} Mar 12 21:09:28.419651 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-530605ea-8cf9-4a1c-beb9-badb78859588 tempest-GroupSnapshotsV319Test-614814183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:09:29.137273 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-530605ea-8cf9-4a1c-beb9-badb78859588 tempest-GroupSnapshotsV319Test-614814183 None] group_snapshot 799d1de8-b1b6-480f-9ee5-386aef43c2d1: created successfully Mar 12 21:09:29.793405 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [None req-4e13fb3b-5f3a-4795-8289-b25eb64dd623 tempest-VolumesBackupsAdminTest-1513847769 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.228s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 21:09:29.794868 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-4e13fb3b-5f3a-4795-8289-b25eb64dd623 tempest-VolumesBackupsAdminTest-1513847769 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-acbf2fdf-7efb-4dc4-8ce1-64607b6441bf', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': 'acbf2fdf-7efb-4dc4-8ce1-64607b6441bf', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 21:09:29.861269 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-4e13fb3b-5f3a-4795-8289-b25eb64dd623 tempest-VolumesBackupsAdminTest-1513847769 None] Initialize volume connection completed successfully. Mar 12 21:09:30.186160 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-3dbbbe8b-7109-4549-88ea-fe037727889c tempest-GroupSnapshotsV319Test-614814183 None] group_snapshot 799d1de8-b1b6-480f-9ee5-386aef43c2d1: deleting Mar 12 21:09:30.277720 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-3dbbbe8b-7109-4549-88ea-fe037727889c tempest-GroupSnapshotsV319Test-614814183 None] group_snapshot 799d1de8-b1b6-480f-9ee5-386aef43c2d1: deleting {{(pid=129531) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4251}} Mar 12 21:09:30.345335 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3dbbbe8b-7109-4549-88ea-fe037727889c tempest-GroupSnapshotsV319Test-614814183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:09:31.105116 ncdv-master-1 cinder-volume[129531]: WARNING cinder.quota [None req-3dbbbe8b-7109-4549-88ea-fe037727889c tempest-GroupSnapshotsV319Test-614814183 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-161748762 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-161748762, it is now deprecated. Please use the default quota class for default quota. Mar 12 21:09:31.110549 ncdv-master-1 cinder-volume[129531]: WARNING cinder.quota [None req-3dbbbe8b-7109-4549-88ea-fe037727889c tempest-GroupSnapshotsV319Test-614814183 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-161748762 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-161748762, it is now deprecated. Please use the default quota class for default quota. Mar 12 21:09:31.167627 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-3dbbbe8b-7109-4549-88ea-fe037727889c tempest-GroupSnapshotsV319Test-614814183 None] Created reservations ['cb9f7da5-d709-4639-b6c0-7337b6c92910', '6b4a39c6-8562-4320-9117-3073331bf5e0', '9c270198-4df9-4597-b678-3c9ca751bee4', '45c18c01-9c94-4220-973c-1002f3873e4d'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:09:31.302294 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-3dbbbe8b-7109-4549-88ea-fe037727889c tempest-GroupSnapshotsV319Test-614814183 None] group_snapshot 799d1de8-b1b6-480f-9ee5-386aef43c2d1: deleted successfully Mar 12 21:09:32.261259 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-4e13fb3b-5f3a-4795-8289-b25eb64dd623 tempest-VolumesBackupsAdminTest-1513847769 None] Terminate volume connection completed successfully. Mar 12 21:09:32.301454 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c88a1ff3-73e8-48a5-87d6-ad5650960ea9 tempest-GroupSnapshotsV319Test-614814183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:09:32.489218 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c88a1ff3-73e8-48a5-87d6-ad5650960ea9 tempest-GroupSnapshotsV319Test-614814183 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:09:32.489666 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c88a1ff3-73e8-48a5-87d6-ad5650960ea9 tempest-GroupSnapshotsV319Test-614814183 None] Volume volume-5d07b6ca-d644-47d1-b5b9-860cf9dd28d5 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:09:32.504305 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c88a1ff3-73e8-48a5-87d6-ad5650960ea9 tempest-GroupSnapshotsV319Test-614814183 None] deleting rbd volume volume-5d07b6ca-d644-47d1-b5b9-860cf9dd28d5 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:09:32.517090 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-4e13fb3b-5f3a-4795-8289-b25eb64dd623 tempest-VolumesBackupsAdminTest-1513847769 None] Remove volume export completed successfully. Mar 12 21:09:33.053583 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-c88a1ff3-73e8-48a5-87d6-ad5650960ea9 tempest-GroupSnapshotsV319Test-614814183 None] Created reservations ['c495fd80-805b-47b3-8e5b-b1414f14b8a7'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:09:33.089404 ncdv-master-1 cinder-volume[129531]: WARNING cinder.quota [None req-c88a1ff3-73e8-48a5-87d6-ad5650960ea9 tempest-GroupSnapshotsV319Test-614814183 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-161748762 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-161748762, it is now deprecated. Please use the default quota class for default quota. Mar 12 21:09:33.142016 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-c88a1ff3-73e8-48a5-87d6-ad5650960ea9 tempest-GroupSnapshotsV319Test-614814183 None] Created reservations ['db96502f-912e-4538-9ef2-338122009008', '8205a5f6-5af0-4b63-b0be-2b0753009ace', 'a4481d32-3e42-40dd-a44c-a6980e4b0c6f', 'b9703240-2bcb-4884-ba61-4c5cf73f1587'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:09:33.356220 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c88a1ff3-73e8-48a5-87d6-ad5650960ea9 tempest-GroupSnapshotsV319Test-614814183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:09:33.446325 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c88a1ff3-73e8-48a5-87d6-ad5650960ea9 tempest-GroupSnapshotsV319Test-614814183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:09:33.537966 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-c88a1ff3-73e8-48a5-87d6-ad5650960ea9 tempest-GroupSnapshotsV319Test-614814183 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:09:33.542503 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-c88a1ff3-73e8-48a5-87d6-ad5650960ea9 tempest-GroupSnapshotsV319Test-614814183 None] Delete group completed successfully. Mar 12 21:09:36.039542 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad0d5dcd-5d43-491e-91d8-1b842a91d82f tempest-VolumesBackupsAdminTest-1513847769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:09:36.047438 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-ad0d5dcd-5d43-491e-91d8-1b842a91d82f tempest-VolumesBackupsAdminTest-1513847769 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:09:36.051112 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-ad0d5dcd-5d43-491e-91d8-1b842a91d82f tempest-VolumesBackupsAdminTest-1513847769 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:09:36.116204 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-ad0d5dcd-5d43-491e-91d8-1b842a91d82f tempest-VolumesBackupsAdminTest-1513847769 None] Flow 'volume_create_manager' (f11904aa-f09a-4035-8eda-8d3cce981bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:09:36.131489 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-ad0d5dcd-5d43-491e-91d8-1b842a91d82f tempest-VolumesBackupsAdminTest-1513847769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef49af21-cb8a-4ff8-ae63-dbfb443a9b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:36.147309 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-ad0d5dcd-5d43-491e-91d8-1b842a91d82f tempest-VolumesBackupsAdminTest-1513847769 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:09:36.188629 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-ad0d5dcd-5d43-491e-91d8-1b842a91d82f tempest-VolumesBackupsAdminTest-1513847769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef49af21-cb8a-4ff8-ae63-dbfb443a9b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:09:36Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_e93bc020-d569-4332-8c60-503b12f4d476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ec316201-71b8-4318-b927-930f7fb04d93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76614dd1780d41e99b3db646e59d928c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:09:36Z,use_quota=True,user_id='3d36ef1eff0649179221db760b119396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:36.230374 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-ad0d5dcd-5d43-491e-91d8-1b842a91d82f tempest-VolumesBackupsAdminTest-1513847769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75f93ef9-d2fc-425a-92d7-5d567a9d5b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:36.249572 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-ad0d5dcd-5d43-491e-91d8-1b842a91d82f tempest-VolumesBackupsAdminTest-1513847769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75f93ef9-d2fc-425a-92d7-5d567a9d5b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:36.268438 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-ad0d5dcd-5d43-491e-91d8-1b842a91d82f tempest-VolumesBackupsAdminTest-1513847769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b80da90-c200-4257-b185-f44bc193d241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:36.281728 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-ad0d5dcd-5d43-491e-91d8-1b842a91d82f tempest-VolumesBackupsAdminTest-1513847769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b80da90-c200-4257-b185-f44bc193d241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec316201-71b8-4318-b927-930f7fb04d93', 'volume_name': 'volume-ec316201-71b8-4318-b927-930f7fb04d93', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:36.298201 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-ad0d5dcd-5d43-491e-91d8-1b842a91d82f tempest-VolumesBackupsAdminTest-1513847769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a71d04-f879-415a-b962-669525a2d5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:36.307122 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-ad0d5dcd-5d43-491e-91d8-1b842a91d82f tempest-VolumesBackupsAdminTest-1513847769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a71d04-f879-415a-b962-669525a2d5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:36.320185 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-ad0d5dcd-5d43-491e-91d8-1b842a91d82f tempest-VolumesBackupsAdminTest-1513847769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22fffb66-4111-420f-8651-f9982f7b4eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:36.326995 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-ad0d5dcd-5d43-491e-91d8-1b842a91d82f tempest-VolumesBackupsAdminTest-1513847769 None] Volume ec316201-71b8-4318-b927-930f7fb04d93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec316201-71b8-4318-b927-930f7fb04d93', 'volume_size': 1} Mar 12 21:09:36.327560 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-ad0d5dcd-5d43-491e-91d8-1b842a91d82f tempest-VolumesBackupsAdminTest-1513847769 None] creating volume 'volume-ec316201-71b8-4318-b927-930f7fb04d93' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:09:36.329018 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-ad0d5dcd-5d43-491e-91d8-1b842a91d82f tempest-VolumesBackupsAdminTest-1513847769 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:09:36.454057 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-ad0d5dcd-5d43-491e-91d8-1b842a91d82f tempest-VolumesBackupsAdminTest-1513847769 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:09:36.454440 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-ad0d5dcd-5d43-491e-91d8-1b842a91d82f tempest-VolumesBackupsAdminTest-1513847769 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:09:36.458554 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-ad0d5dcd-5d43-491e-91d8-1b842a91d82f tempest-VolumesBackupsAdminTest-1513847769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22fffb66-4111-420f-8651-f9982f7b4eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec316201-71b8-4318-b927-930f7fb04d93', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:36.463282 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-ad0d5dcd-5d43-491e-91d8-1b842a91d82f tempest-VolumesBackupsAdminTest-1513847769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfbc8b58-fdfa-48d8-896c-7d146c589e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:36.492778 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-ad0d5dcd-5d43-491e-91d8-1b842a91d82f tempest-VolumesBackupsAdminTest-1513847769 None] Volume volume-ec316201-71b8-4318-b927-930f7fb04d93 (ec316201-71b8-4318-b927-930f7fb04d93): created successfully Mar 12 21:09:36.497142 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-ad0d5dcd-5d43-491e-91d8-1b842a91d82f tempest-VolumesBackupsAdminTest-1513847769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfbc8b58-fdfa-48d8-896c-7d146c589e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:36.506247 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-ad0d5dcd-5d43-491e-91d8-1b842a91d82f tempest-VolumesBackupsAdminTest-1513847769 None] Flow 'volume_create_manager' (f11904aa-f09a-4035-8eda-8d3cce981bda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:09:36.519852 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-ad0d5dcd-5d43-491e-91d8-1b842a91d82f tempest-VolumesBackupsAdminTest-1513847769 None] Created volume successfully. Mar 12 21:09:37.391855 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [None req-ad0d5dcd-5d43-491e-91d8-1b842a91d82f tempest-VolumesBackupsAdminTest-1513847769 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 21:09:39.232451 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [None req-ad0d5dcd-5d43-491e-91d8-1b842a91d82f tempest-VolumesBackupsAdminTest-1513847769 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.840s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 21:09:39.233982 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-ad0d5dcd-5d43-491e-91d8-1b842a91d82f tempest-VolumesBackupsAdminTest-1513847769 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ec316201-71b8-4318-b927-930f7fb04d93', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': 'ec316201-71b8-4318-b927-930f7fb04d93', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 21:09:39.258440 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-ad0d5dcd-5d43-491e-91d8-1b842a91d82f tempest-VolumesBackupsAdminTest-1513847769 None] Initialize volume connection completed successfully. Mar 12 21:09:41.210015 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-ad0d5dcd-5d43-491e-91d8-1b842a91d82f tempest-VolumesBackupsAdminTest-1513847769 None] Terminate volume connection completed successfully. Mar 12 21:09:41.252837 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-ad0d5dcd-5d43-491e-91d8-1b842a91d82f tempest-VolumesBackupsAdminTest-1513847769 None] Remove volume export completed successfully. Mar 12 21:09:42.221245 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-a4c63192-19cc-4ef8-8d5f-69223719fe34 tempest-GroupsV320Test-1874924731 None] Group tempest-GroupsV320Test-Group-1147949616: creating Mar 12 21:09:42.271690 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-a4c63192-19cc-4ef8-8d5f-69223719fe34 tempest-GroupsV320Test-1874924731 None] Group tempest-GroupsV320Test-Group-1147949616: created successfully Mar 12 21:09:42.295145 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-a4c63192-19cc-4ef8-8d5f-69223719fe34 tempest-GroupsV320Test-1874924731 None] Create group completed successfully. Mar 12 21:09:42.565088 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-e51c7436-2e8a-4ad6-b87d-1964ee4fd42c tempest-VolumesBackupsAdminTest-1513847769 None] Lock "b'cinder-ec316201-71b8-4318-b927-930f7fb04d93-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:09:42.660295 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-e51c7436-2e8a-4ad6-b87d-1964ee4fd42c tempest-VolumesBackupsAdminTest-1513847769 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:09:43.822324 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-e51c7436-2e8a-4ad6-b87d-1964ee4fd42c tempest-VolumesBackupsAdminTest-1513847769 None] Volume volume-ec316201-71b8-4318-b927-930f7fb04d93 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:09:43.867679 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-e51c7436-2e8a-4ad6-b87d-1964ee4fd42c tempest-VolumesBackupsAdminTest-1513847769 None] deleting rbd volume volume-ec316201-71b8-4318-b927-930f7fb04d93 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:09:44.556770 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-e51c7436-2e8a-4ad6-b87d-1964ee4fd42c tempest-VolumesBackupsAdminTest-1513847769 None] Created reservations ['c3c60429-14c0-45a0-ac70-ed1a67166a8e', '54fa14d9-45c5-4281-92bd-44f0e93ee088', '09c2aa16-2c99-49a5-a941-c8ab2760fa86', '453cd9cf-317a-4888-a206-408dd16570fd'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:09:44.623179 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-ba1594fe-abbe-448a-8029-14bbf01bf8b7 tempest-GroupsV320Test-1874924731 None] Created reservations ['c4db66ee-32dd-4b62-a3d1-67095db36968'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:09:44.652754 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-e51c7436-2e8a-4ad6-b87d-1964ee4fd42c tempest-VolumesBackupsAdminTest-1513847769 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:09:44.785105 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-e51c7436-2e8a-4ad6-b87d-1964ee4fd42c tempest-VolumesBackupsAdminTest-1513847769 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:09:44.860659 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-e51c7436-2e8a-4ad6-b87d-1964ee4fd42c tempest-VolumesBackupsAdminTest-1513847769 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:09:44.873108 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-e51c7436-2e8a-4ad6-b87d-1964ee4fd42c tempest-VolumesBackupsAdminTest-1513847769 None] Deleted volume successfully. Mar 12 21:09:44.963659 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-e51c7436-2e8a-4ad6-b87d-1964ee4fd42c tempest-VolumesBackupsAdminTest-1513847769 None] Lock "b'cinder-ec316201-71b8-4318-b927-930f7fb04d93-delete_volume'" released by "delete_volume" :: held 2.399s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:09:44.995782 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-ba1594fe-abbe-448a-8029-14bbf01bf8b7 tempest-GroupsV320Test-1874924731 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:09:45.126977 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-ba1594fe-abbe-448a-8029-14bbf01bf8b7 tempest-GroupsV320Test-1874924731 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:09:45.213540 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-ba1594fe-abbe-448a-8029-14bbf01bf8b7 tempest-GroupsV320Test-1874924731 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:09:45.224948 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-ba1594fe-abbe-448a-8029-14bbf01bf8b7 tempest-GroupsV320Test-1874924731 None] Delete group completed successfully. Mar 12 21:09:45.830243 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-36080e62-2667-428a-83db-9b968de035a6 tempest-DeleteServersTestJSON-152948620 None] Lock "b'cinder-99013433-1e4a-4016-bd5e-c6bb6e234b6e-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:09:45.931912 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-36080e62-2667-428a-83db-9b968de035a6 tempest-DeleteServersTestJSON-152948620 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:09:46.021121 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-36080e62-2667-428a-83db-9b968de035a6 tempest-DeleteServersTestJSON-152948620 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:09:46.022397 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-36080e62-2667-428a-83db-9b968de035a6 tempest-DeleteServersTestJSON-152948620 None] Volume volume-99013433-1e4a-4016-bd5e-c6bb6e234b6e is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:09:46.037156 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-36080e62-2667-428a-83db-9b968de035a6 tempest-DeleteServersTestJSON-152948620 None] deleting rbd volume volume-99013433-1e4a-4016-bd5e-c6bb6e234b6e {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:09:46.568146 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-36080e62-2667-428a-83db-9b968de035a6 tempest-DeleteServersTestJSON-152948620 None] Created reservations ['e553aecc-ccef-4bb9-ac85-a9246f8a167f', 'd738b6d0-8355-4128-8871-d5ea05c2c5f3', 'd7696fa3-7cf7-4d26-82eb-9b35fd2c51e0', '46fe4acf-bee5-46c0-b67c-08f51678f2cf'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:09:46.676507 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-36080e62-2667-428a-83db-9b968de035a6 tempest-DeleteServersTestJSON-152948620 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:09:46.753830 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-36080e62-2667-428a-83db-9b968de035a6 tempest-DeleteServersTestJSON-152948620 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:09:46.840212 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-36080e62-2667-428a-83db-9b968de035a6 tempest-DeleteServersTestJSON-152948620 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:09:46.863234 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-36080e62-2667-428a-83db-9b968de035a6 tempest-DeleteServersTestJSON-152948620 None] Deleted volume successfully. Mar 12 21:09:46.960165 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbab4c83-50bf-44da-bf36-586c38ca2efe tempest-VolumesBackupsAdminTest-1513847769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:09:46.971135 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-bbab4c83-50bf-44da-bf36-586c38ca2efe tempest-VolumesBackupsAdminTest-1513847769 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:09:46.971719 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-bbab4c83-50bf-44da-bf36-586c38ca2efe tempest-VolumesBackupsAdminTest-1513847769 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:09:46.997086 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-bbab4c83-50bf-44da-bf36-586c38ca2efe tempest-VolumesBackupsAdminTest-1513847769 None] Flow 'volume_create_manager' (c563b7aa-d9c5-4e85-9ac9-fcc427641728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:09:47.005605 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-bbab4c83-50bf-44da-bf36-586c38ca2efe tempest-VolumesBackupsAdminTest-1513847769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db7960d2-8de6-4e54-8389-378815c40d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:47.024240 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-bbab4c83-50bf-44da-bf36-586c38ca2efe tempest-VolumesBackupsAdminTest-1513847769 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:09:47.026179 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-36080e62-2667-428a-83db-9b968de035a6 tempest-DeleteServersTestJSON-152948620 None] Lock "b'cinder-99013433-1e4a-4016-bd5e-c6bb6e234b6e-delete_volume'" released by "delete_volume" :: held 1.196s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:09:47.054749 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-bbab4c83-50bf-44da-bf36-586c38ca2efe tempest-VolumesBackupsAdminTest-1513847769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db7960d2-8de6-4e54-8389-378815c40d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-1202049675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b763224b-f5d9-41ae-9177-904edf177d28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76614dd1780d41e99b3db646e59d928c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:09:47Z,use_quota=True,user_id='3d36ef1eff0649179221db760b119396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:47.069685 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-bbab4c83-50bf-44da-bf36-586c38ca2efe tempest-VolumesBackupsAdminTest-1513847769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5496cda0-a3ef-490d-bfa0-9e091bc24104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:47.084288 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-bbab4c83-50bf-44da-bf36-586c38ca2efe tempest-VolumesBackupsAdminTest-1513847769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5496cda0-a3ef-490d-bfa0-9e091bc24104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:47.096593 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-bbab4c83-50bf-44da-bf36-586c38ca2efe tempest-VolumesBackupsAdminTest-1513847769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f42b357-b486-41b6-bce0-058b1c1e4f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:47.107493 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-bbab4c83-50bf-44da-bf36-586c38ca2efe tempest-VolumesBackupsAdminTest-1513847769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f42b357-b486-41b6-bce0-058b1c1e4f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b763224b-f5d9-41ae-9177-904edf177d28', 'volume_name': 'volume-b763224b-f5d9-41ae-9177-904edf177d28', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:47.126983 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-bbab4c83-50bf-44da-bf36-586c38ca2efe tempest-VolumesBackupsAdminTest-1513847769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be67b0e6-7be6-4e8b-bbd7-4f62a979f724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:47.142485 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-bbab4c83-50bf-44da-bf36-586c38ca2efe tempest-VolumesBackupsAdminTest-1513847769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be67b0e6-7be6-4e8b-bbd7-4f62a979f724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:47.164083 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-bbab4c83-50bf-44da-bf36-586c38ca2efe tempest-VolumesBackupsAdminTest-1513847769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7d7b676-48cb-4c05-b449-b46bdb86a1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:47.166772 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-bbab4c83-50bf-44da-bf36-586c38ca2efe tempest-VolumesBackupsAdminTest-1513847769 None] Volume b763224b-f5d9-41ae-9177-904edf177d28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b763224b-f5d9-41ae-9177-904edf177d28', 'volume_size': 1} Mar 12 21:09:47.167326 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-bbab4c83-50bf-44da-bf36-586c38ca2efe tempest-VolumesBackupsAdminTest-1513847769 None] creating volume 'volume-b763224b-f5d9-41ae-9177-904edf177d28' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:09:47.168651 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-bbab4c83-50bf-44da-bf36-586c38ca2efe tempest-VolumesBackupsAdminTest-1513847769 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:09:47.358673 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-bbab4c83-50bf-44da-bf36-586c38ca2efe tempest-VolumesBackupsAdminTest-1513847769 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:09:47.359120 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-bbab4c83-50bf-44da-bf36-586c38ca2efe tempest-VolumesBackupsAdminTest-1513847769 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:09:47.377813 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-bbab4c83-50bf-44da-bf36-586c38ca2efe tempest-VolumesBackupsAdminTest-1513847769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7d7b676-48cb-4c05-b449-b46bdb86a1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b763224b-f5d9-41ae-9177-904edf177d28', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:47.404693 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-bbab4c83-50bf-44da-bf36-586c38ca2efe tempest-VolumesBackupsAdminTest-1513847769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caed2f82-d2f7-4acb-8c40-e5d5f32eb09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:47.434212 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-bbab4c83-50bf-44da-bf36-586c38ca2efe tempest-VolumesBackupsAdminTest-1513847769 None] Volume volume-b763224b-f5d9-41ae-9177-904edf177d28 (b763224b-f5d9-41ae-9177-904edf177d28): created successfully Mar 12 21:09:47.447315 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-bbab4c83-50bf-44da-bf36-586c38ca2efe tempest-VolumesBackupsAdminTest-1513847769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caed2f82-d2f7-4acb-8c40-e5d5f32eb09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:47.463773 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-bbab4c83-50bf-44da-bf36-586c38ca2efe tempest-VolumesBackupsAdminTest-1513847769 None] Flow 'volume_create_manager' (c563b7aa-d9c5-4e85-9ac9-fcc427641728) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:09:47.479159 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-bbab4c83-50bf-44da-bf36-586c38ca2efe tempest-VolumesBackupsAdminTest-1513847769 None] Created volume successfully. Mar 12 21:09:48.164667 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-891473e1-5cd7-4ea0-99da-919caa69591c tempest-VolumesBackupsAdminTest-1513847769 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-03-12T21:09:47Z,data_timestamp=2022-03-12T21:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-265713057',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=e48f9fbe-d6aa-4178-bee3-d082b456689b,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='76614dd1780d41e99b3db646e59d928c',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='3d36ef1eff0649179221db760b119396',volume_id=b763224b-f5d9-41ae-9177-904edf177d28) Mar 12 21:09:48.168707 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.backup.rpcapi [None req-891473e1-5cd7-4ea0-99da-919caa69591c tempest-VolumesBackupsAdminTest-1513847769 None] continue_backup in rpcapi backup_id e48f9fbe-d6aa-4178-bee3-d082b456689b {{(pid=129531) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Mar 12 21:09:48.510280 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [None req-891473e1-5cd7-4ea0-99da-919caa69591c tempest-VolumesBackupsAdminTest-1513847769 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 21:09:50.416632 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [None req-891473e1-5cd7-4ea0-99da-919caa69591c tempest-VolumesBackupsAdminTest-1513847769 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.906s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 21:09:50.421489 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-891473e1-5cd7-4ea0-99da-919caa69591c tempest-VolumesBackupsAdminTest-1513847769 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b763224b-f5d9-41ae-9177-904edf177d28', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': 'b763224b-f5d9-41ae-9177-904edf177d28', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 21:09:50.443866 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-891473e1-5cd7-4ea0-99da-919caa69591c tempest-VolumesBackupsAdminTest-1513847769 None] Initialize volume connection completed successfully. Mar 12 21:09:51.268299 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:09:51.271777 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:09:51.374689 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:09:51.531931 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:09:52.716365 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-891473e1-5cd7-4ea0-99da-919caa69591c tempest-VolumesBackupsAdminTest-1513847769 None] Terminate volume connection completed successfully. Mar 12 21:09:52.781602 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-891473e1-5cd7-4ea0-99da-919caa69591c tempest-VolumesBackupsAdminTest-1513847769 None] Remove volume export completed successfully. Mar 12 21:09:56.875741 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ea4ecbf-046b-4db6-ae0e-5d33c714b28c tempest-VolumeQuotasNegativeTestJSON-53567383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:09:56.880914 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-2ea4ecbf-046b-4db6-ae0e-5d33c714b28c tempest-VolumeQuotasNegativeTestJSON-53567383 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:09:56.880914 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-2ea4ecbf-046b-4db6-ae0e-5d33c714b28c tempest-VolumeQuotasNegativeTestJSON-53567383 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:09:56.901576 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2ea4ecbf-046b-4db6-ae0e-5d33c714b28c tempest-VolumeQuotasNegativeTestJSON-53567383 None] Flow 'volume_create_manager' (75c512c9-0532-4822-8e72-e4b4e2c8774a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:09:56.909202 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2ea4ecbf-046b-4db6-ae0e-5d33c714b28c tempest-VolumeQuotasNegativeTestJSON-53567383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eef4f5e-de90-4837-9bd3-5bed8438a58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:56.921299 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-2ea4ecbf-046b-4db6-ae0e-5d33c714b28c tempest-VolumeQuotasNegativeTestJSON-53567383 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:09:56.950039 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2ea4ecbf-046b-4db6-ae0e-5d33c714b28c tempest-VolumeQuotasNegativeTestJSON-53567383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eef4f5e-de90-4837-9bd3-5bed8438a58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1550128076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f9527039-e424-40f1-8f43-f0695e3bc556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='257860e956b44b31a900641a5df9a3c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:09:57Z,use_quota=True,user_id='61206af85c5a4e5e867eca3359bfbd2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:56.961406 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2ea4ecbf-046b-4db6-ae0e-5d33c714b28c tempest-VolumeQuotasNegativeTestJSON-53567383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe197bd-22f4-42e9-bf19-5e363cd250ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:56.974447 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2ea4ecbf-046b-4db6-ae0e-5d33c714b28c tempest-VolumeQuotasNegativeTestJSON-53567383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe197bd-22f4-42e9-bf19-5e363cd250ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:56.983235 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2ea4ecbf-046b-4db6-ae0e-5d33c714b28c tempest-VolumeQuotasNegativeTestJSON-53567383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed8970a6-9ee9-40d8-8943-55e0dfb2c68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:56.993062 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2ea4ecbf-046b-4db6-ae0e-5d33c714b28c tempest-VolumeQuotasNegativeTestJSON-53567383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed8970a6-9ee9-40d8-8943-55e0dfb2c68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9527039-e424-40f1-8f43-f0695e3bc556', 'volume_name': 'volume-f9527039-e424-40f1-8f43-f0695e3bc556', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:57.003344 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2ea4ecbf-046b-4db6-ae0e-5d33c714b28c tempest-VolumeQuotasNegativeTestJSON-53567383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b736f67-3ccb-4abf-adda-61271985f509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:57.007542 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2ea4ecbf-046b-4db6-ae0e-5d33c714b28c tempest-VolumeQuotasNegativeTestJSON-53567383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b736f67-3ccb-4abf-adda-61271985f509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:57.027341 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2ea4ecbf-046b-4db6-ae0e-5d33c714b28c tempest-VolumeQuotasNegativeTestJSON-53567383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b8e9fa-5ffe-421f-8116-92f574a4e9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:57.028499 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-2ea4ecbf-046b-4db6-ae0e-5d33c714b28c tempest-VolumeQuotasNegativeTestJSON-53567383 None] Volume f9527039-e424-40f1-8f43-f0695e3bc556: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9527039-e424-40f1-8f43-f0695e3bc556', 'volume_size': 1} Mar 12 21:09:57.028912 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2ea4ecbf-046b-4db6-ae0e-5d33c714b28c tempest-VolumeQuotasNegativeTestJSON-53567383 None] creating volume 'volume-f9527039-e424-40f1-8f43-f0695e3bc556' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:09:57.029995 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2ea4ecbf-046b-4db6-ae0e-5d33c714b28c tempest-VolumeQuotasNegativeTestJSON-53567383 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:09:57.111618 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-649ebee2-ba77-4cdc-aba9-340453ad2a9a tempest-VolumesBackupsAdminTest-1513847769 None] Lock "b'cinder-b763224b-f5d9-41ae-9177-904edf177d28-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:09:57.167981 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-649ebee2-ba77-4cdc-aba9-340453ad2a9a tempest-VolumesBackupsAdminTest-1513847769 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:09:57.504751 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-649ebee2-ba77-4cdc-aba9-340453ad2a9a tempest-VolumesBackupsAdminTest-1513847769 None] Volume volume-b763224b-f5d9-41ae-9177-904edf177d28 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:09:57.552641 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-649ebee2-ba77-4cdc-aba9-340453ad2a9a tempest-VolumesBackupsAdminTest-1513847769 None] deleting rbd volume volume-b763224b-f5d9-41ae-9177-904edf177d28 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:09:57.561934 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2ea4ecbf-046b-4db6-ae0e-5d33c714b28c tempest-VolumeQuotasNegativeTestJSON-53567383 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:09:57.562630 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2ea4ecbf-046b-4db6-ae0e-5d33c714b28c tempest-VolumeQuotasNegativeTestJSON-53567383 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:09:57.568699 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2ea4ecbf-046b-4db6-ae0e-5d33c714b28c tempest-VolumeQuotasNegativeTestJSON-53567383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b8e9fa-5ffe-421f-8116-92f574a4e9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9527039-e424-40f1-8f43-f0695e3bc556', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:57.574245 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2ea4ecbf-046b-4db6-ae0e-5d33c714b28c tempest-VolumeQuotasNegativeTestJSON-53567383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88ba9889-2a58-4802-9d3d-d469057e2a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:09:57.587717 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-2ea4ecbf-046b-4db6-ae0e-5d33c714b28c tempest-VolumeQuotasNegativeTestJSON-53567383 None] Volume volume-f9527039-e424-40f1-8f43-f0695e3bc556 (f9527039-e424-40f1-8f43-f0695e3bc556): created successfully Mar 12 21:09:57.599451 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2ea4ecbf-046b-4db6-ae0e-5d33c714b28c tempest-VolumeQuotasNegativeTestJSON-53567383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88ba9889-2a58-4802-9d3d-d469057e2a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:09:57.613241 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2ea4ecbf-046b-4db6-ae0e-5d33c714b28c tempest-VolumeQuotasNegativeTestJSON-53567383 None] Flow 'volume_create_manager' (75c512c9-0532-4822-8e72-e4b4e2c8774a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:09:57.647983 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-2ea4ecbf-046b-4db6-ae0e-5d33c714b28c tempest-VolumeQuotasNegativeTestJSON-53567383 None] Created volume successfully. Mar 12 21:09:58.128894 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-649ebee2-ba77-4cdc-aba9-340453ad2a9a tempest-VolumesBackupsAdminTest-1513847769 None] Created reservations ['a5e8db60-6cac-4bf8-b5d2-e5145e5a590f', '34b9eca8-7dc8-4de5-b5fa-2b435f6c2d83', 'e90a2564-cbc4-4d8b-8bb4-880e07c0f5f2', '6491a4b1-43ea-4823-9f07-73741e0f0b22'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:09:58.217335 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-649ebee2-ba77-4cdc-aba9-340453ad2a9a tempest-VolumesBackupsAdminTest-1513847769 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:09:58.257802 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-649ebee2-ba77-4cdc-aba9-340453ad2a9a tempest-VolumesBackupsAdminTest-1513847769 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:09:58.373626 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-649ebee2-ba77-4cdc-aba9-340453ad2a9a tempest-VolumesBackupsAdminTest-1513847769 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:09:58.386144 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-649ebee2-ba77-4cdc-aba9-340453ad2a9a tempest-VolumesBackupsAdminTest-1513847769 None] Deleted volume successfully. Mar 12 21:09:58.418652 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-2a123a4b-dfb0-4c27-b2c1-149f83a627d1 tempest-VolumesBackupsAdminTest-1513847769 None] Lock "b'cinder-acbf2fdf-7efb-4dc4-8ce1-64607b6441bf-delete_volume'" acquired by "delete_volume" :: waited 0.040s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:09:58.435719 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-649ebee2-ba77-4cdc-aba9-340453ad2a9a tempest-VolumesBackupsAdminTest-1513847769 None] Lock "b'cinder-b763224b-f5d9-41ae-9177-904edf177d28-delete_volume'" released by "delete_volume" :: held 1.324s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:09:58.512813 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2a123a4b-dfb0-4c27-b2c1-149f83a627d1 tempest-VolumesBackupsAdminTest-1513847769 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:09:59.551697 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2a123a4b-dfb0-4c27-b2c1-149f83a627d1 tempest-VolumesBackupsAdminTest-1513847769 None] Volume volume-acbf2fdf-7efb-4dc4-8ce1-64607b6441bf is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:09:59.597512 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2a123a4b-dfb0-4c27-b2c1-149f83a627d1 tempest-VolumesBackupsAdminTest-1513847769 None] deleting rbd volume volume-acbf2fdf-7efb-4dc4-8ce1-64607b6441bf {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:09:59.631874 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-c7e59e5f-0918-4ec6-b530-98c85590cd82 tempest-VolumeQuotasNegativeTestJSON-53567383 None] Lock "b'cinder-f9527039-e424-40f1-8f43-f0695e3bc556-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:09:59.727549 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c7e59e5f-0918-4ec6-b530-98c85590cd82 tempest-VolumeQuotasNegativeTestJSON-53567383 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:09:59.816782 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c7e59e5f-0918-4ec6-b530-98c85590cd82 tempest-VolumeQuotasNegativeTestJSON-53567383 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:09:59.817315 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c7e59e5f-0918-4ec6-b530-98c85590cd82 tempest-VolumeQuotasNegativeTestJSON-53567383 None] Volume volume-f9527039-e424-40f1-8f43-f0695e3bc556 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:09:59.844482 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c7e59e5f-0918-4ec6-b530-98c85590cd82 tempest-VolumeQuotasNegativeTestJSON-53567383 None] deleting rbd volume volume-f9527039-e424-40f1-8f43-f0695e3bc556 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:10:00.234480 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-2a123a4b-dfb0-4c27-b2c1-149f83a627d1 tempest-VolumesBackupsAdminTest-1513847769 None] Created reservations ['006645ea-0110-4e92-a0fd-47e01078874a', '1fd020fd-0a71-4744-8a14-5dcbe4bcb5cd', '71efcaea-78be-40bd-972e-a7f1d8ded14e', 'a61c873c-ec7c-4088-a0c4-122c5aeca271'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:10:00.366772 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2a123a4b-dfb0-4c27-b2c1-149f83a627d1 tempest-VolumesBackupsAdminTest-1513847769 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:10:00.476452 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2a123a4b-dfb0-4c27-b2c1-149f83a627d1 tempest-VolumesBackupsAdminTest-1513847769 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:10:00.560441 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-2a123a4b-dfb0-4c27-b2c1-149f83a627d1 tempest-VolumesBackupsAdminTest-1513847769 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:10:00.587656 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-2a123a4b-dfb0-4c27-b2c1-149f83a627d1 tempest-VolumesBackupsAdminTest-1513847769 None] Deleted volume successfully. Mar 12 21:10:00.667612 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-2a123a4b-dfb0-4c27-b2c1-149f83a627d1 tempest-VolumesBackupsAdminTest-1513847769 None] Lock "b'cinder-acbf2fdf-7efb-4dc4-8ce1-64607b6441bf-delete_volume'" released by "delete_volume" :: held 2.249s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:10:00.741741 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-c7e59e5f-0918-4ec6-b530-98c85590cd82 tempest-VolumeQuotasNegativeTestJSON-53567383 None] Created reservations ['811ce55f-7217-4968-8dc9-91a9bd6e829e', '48e9a5c3-ce1a-437c-8eac-b1ee1b45f4c1', 'd554f7ff-1d42-43e2-9e99-19e8917f0ec3', '350e18af-75e7-46b9-a0ae-65b86e572f22'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:10:00.845658 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c7e59e5f-0918-4ec6-b530-98c85590cd82 tempest-VolumeQuotasNegativeTestJSON-53567383 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:10:00.898016 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c7e59e5f-0918-4ec6-b530-98c85590cd82 tempest-VolumeQuotasNegativeTestJSON-53567383 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:10:01.006193 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-c7e59e5f-0918-4ec6-b530-98c85590cd82 tempest-VolumeQuotasNegativeTestJSON-53567383 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:10:01.013062 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-c7e59e5f-0918-4ec6-b530-98c85590cd82 tempest-VolumeQuotasNegativeTestJSON-53567383 None] Deleted volume successfully. Mar 12 21:10:01.049078 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-c7e59e5f-0918-4ec6-b530-98c85590cd82 tempest-VolumeQuotasNegativeTestJSON-53567383 None] Lock "b'cinder-f9527039-e424-40f1-8f43-f0695e3bc556-delete_volume'" released by "delete_volume" :: held 1.424s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:10:04.026964 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-40687aa4-a790-4b56-bc6b-44d06044699f tempest-AttachVolumeNegativeTest-2014367252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:10:04.046168 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-40687aa4-a790-4b56-bc6b-44d06044699f tempest-AttachVolumeNegativeTest-2014367252 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:10:04.046624 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-40687aa4-a790-4b56-bc6b-44d06044699f tempest-AttachVolumeNegativeTest-2014367252 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:10:04.121638 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-40687aa4-a790-4b56-bc6b-44d06044699f tempest-AttachVolumeNegativeTest-2014367252 None] Flow 'volume_create_manager' (b7239493-ff00-4da0-bf5d-752744cd8c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:10:04.146032 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-40687aa4-a790-4b56-bc6b-44d06044699f tempest-AttachVolumeNegativeTest-2014367252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d000c4e1-ef82-4151-8896-7abe81a3a637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:04.174037 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-40687aa4-a790-4b56-bc6b-44d06044699f tempest-AttachVolumeNegativeTest-2014367252 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:10:04.224976 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-40687aa4-a790-4b56-bc6b-44d06044699f tempest-AttachVolumeNegativeTest-2014367252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d000c4e1-ef82-4151-8896-7abe81a3a637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1684999185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=89e88497-9559-462f-ad2e-14638295f92b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f427010b06749289b20e8b776a8b8c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:10:04Z,use_quota=True,user_id='f2c8058e4e8d475c9377a065b4018a2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:04.234741 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-40687aa4-a790-4b56-bc6b-44d06044699f tempest-AttachVolumeNegativeTest-2014367252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (751b4405-5d77-44ca-9b88-c09fb5631ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:04.259847 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-40687aa4-a790-4b56-bc6b-44d06044699f tempest-AttachVolumeNegativeTest-2014367252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (751b4405-5d77-44ca-9b88-c09fb5631ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:04.275294 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-40687aa4-a790-4b56-bc6b-44d06044699f tempest-AttachVolumeNegativeTest-2014367252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa2f1b8f-433c-484c-9f68-a16c538feaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:04.280337 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-40687aa4-a790-4b56-bc6b-44d06044699f tempest-AttachVolumeNegativeTest-2014367252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa2f1b8f-433c-484c-9f68-a16c538feaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89e88497-9559-462f-ad2e-14638295f92b', 'volume_name': 'volume-89e88497-9559-462f-ad2e-14638295f92b', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:04.292225 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-40687aa4-a790-4b56-bc6b-44d06044699f tempest-AttachVolumeNegativeTest-2014367252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (295d4ff4-95e8-4ba0-a86c-da7dfce0c1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:04.304433 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-40687aa4-a790-4b56-bc6b-44d06044699f tempest-AttachVolumeNegativeTest-2014367252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (295d4ff4-95e8-4ba0-a86c-da7dfce0c1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:04.321614 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-40687aa4-a790-4b56-bc6b-44d06044699f tempest-AttachVolumeNegativeTest-2014367252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64defe3c-c95b-44fb-960a-3e3470e40965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:04.323133 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-40687aa4-a790-4b56-bc6b-44d06044699f tempest-AttachVolumeNegativeTest-2014367252 None] Volume 89e88497-9559-462f-ad2e-14638295f92b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89e88497-9559-462f-ad2e-14638295f92b', 'volume_size': 1} Mar 12 21:10:04.323734 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-40687aa4-a790-4b56-bc6b-44d06044699f tempest-AttachVolumeNegativeTest-2014367252 None] creating volume 'volume-89e88497-9559-462f-ad2e-14638295f92b' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:10:04.324965 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-40687aa4-a790-4b56-bc6b-44d06044699f tempest-AttachVolumeNegativeTest-2014367252 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:10:04.493130 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-40687aa4-a790-4b56-bc6b-44d06044699f tempest-AttachVolumeNegativeTest-2014367252 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:10:04.493505 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-40687aa4-a790-4b56-bc6b-44d06044699f tempest-AttachVolumeNegativeTest-2014367252 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:10:04.497282 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-40687aa4-a790-4b56-bc6b-44d06044699f tempest-AttachVolumeNegativeTest-2014367252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64defe3c-c95b-44fb-960a-3e3470e40965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89e88497-9559-462f-ad2e-14638295f92b', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:04.502057 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-40687aa4-a790-4b56-bc6b-44d06044699f tempest-AttachVolumeNegativeTest-2014367252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06743665-591a-474f-97c5-9a28a6538dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:04.528366 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-40687aa4-a790-4b56-bc6b-44d06044699f tempest-AttachVolumeNegativeTest-2014367252 None] Volume volume-89e88497-9559-462f-ad2e-14638295f92b (89e88497-9559-462f-ad2e-14638295f92b): created successfully Mar 12 21:10:04.532053 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-40687aa4-a790-4b56-bc6b-44d06044699f tempest-AttachVolumeNegativeTest-2014367252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06743665-591a-474f-97c5-9a28a6538dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:04.538261 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-40687aa4-a790-4b56-bc6b-44d06044699f tempest-AttachVolumeNegativeTest-2014367252 None] Flow 'volume_create_manager' (b7239493-ff00-4da0-bf5d-752744cd8c3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:10:04.567886 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-40687aa4-a790-4b56-bc6b-44d06044699f tempest-AttachVolumeNegativeTest-2014367252 None] Created volume successfully. Mar 12 21:10:07.202286 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-9e0dc6fc-ade6-43ac-801e-c82c8dcd641c req-9ddada16-878e-430a-b90d-06f0f1090020 tempest-AttachVolumeNegativeTest-2014367252 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 21:10:08.670206 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-9e0dc6fc-ade6-43ac-801e-c82c8dcd641c req-9ddada16-878e-430a-b90d-06f0f1090020 tempest-AttachVolumeNegativeTest-2014367252 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.468s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 21:10:08.671744 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-9e0dc6fc-ade6-43ac-801e-c82c8dcd641c req-9ddada16-878e-430a-b90d-06f0f1090020 tempest-AttachVolumeNegativeTest-2014367252 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-89e88497-9559-462f-ad2e-14638295f92b', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': '89e88497-9559-462f-ad2e-14638295f92b', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 21:10:08.724217 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-9e0dc6fc-ade6-43ac-801e-c82c8dcd641c req-9ddada16-878e-430a-b90d-06f0f1090020 tempest-AttachVolumeNegativeTest-2014367252 None] Connection info returned from driver {'name': 'volumes/volume-89e88497-9559-462f-ad2e-14638295f92b', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '89e88497-9559-462f-ad2e-14638295f92b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ad3483a9-fac8-4fa2-a25f-83ad7fd06107'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 21:10:08.873572 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-9e0dc6fc-ade6-43ac-801e-c82c8dcd641c req-9ddada16-878e-430a-b90d-06f0f1090020 tempest-AttachVolumeNegativeTest-2014367252 None] attachment_update completed successfully. Mar 12 21:10:12.154462 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-5738aa60-4b17-48fb-a434-b53c01a9cb4c tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:10:12.159127 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-5738aa60-4b17-48fb-a434-b53c01a9cb4c tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:10:12.160786 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-5738aa60-4b17-48fb-a434-b53c01a9cb4c tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:10:12.203711 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5738aa60-4b17-48fb-a434-b53c01a9cb4c tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] Flow 'volume_create_manager' (7f254197-d7dd-4575-860a-fe6e1261f896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:10:12.220037 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5738aa60-4b17-48fb-a434-b53c01a9cb4c tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da24df9-09d3-4dfd-afb7-128dbdac2493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:12.237484 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-5738aa60-4b17-48fb-a434-b53c01a9cb4c tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:10:12.275942 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5738aa60-4b17-48fb-a434-b53c01a9cb4c tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da24df9-09d3-4dfd-afb7-128dbdac2493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-5231569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b2e05f5a-6192-4f50-9d9d-3642e2ef38a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cde4c6ef94344329b19d00af5873108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:10:12Z,use_quota=True,user_id='503bb2f0c22b4123bf7d5a1e627446ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:12.282177 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5738aa60-4b17-48fb-a434-b53c01a9cb4c tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1457da49-6b81-4576-ad94-97e3e593d9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:12.287270 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5738aa60-4b17-48fb-a434-b53c01a9cb4c tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1457da49-6b81-4576-ad94-97e3e593d9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:12.299038 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5738aa60-4b17-48fb-a434-b53c01a9cb4c tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea683b86-3a6a-4800-ab12-a15fd11d2955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:12.304618 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5738aa60-4b17-48fb-a434-b53c01a9cb4c tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea683b86-3a6a-4800-ab12-a15fd11d2955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2e05f5a-6192-4f50-9d9d-3642e2ef38a5', 'volume_name': 'volume-b2e05f5a-6192-4f50-9d9d-3642e2ef38a5', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:12.310427 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5738aa60-4b17-48fb-a434-b53c01a9cb4c tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77fada6a-90db-458a-8c5d-8b377e1c0bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:12.315965 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5738aa60-4b17-48fb-a434-b53c01a9cb4c tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77fada6a-90db-458a-8c5d-8b377e1c0bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:12.321221 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5738aa60-4b17-48fb-a434-b53c01a9cb4c tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee68d397-d739-47ec-a8bf-28ea11404226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:12.322742 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-5738aa60-4b17-48fb-a434-b53c01a9cb4c tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] Volume b2e05f5a-6192-4f50-9d9d-3642e2ef38a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2e05f5a-6192-4f50-9d9d-3642e2ef38a5', 'volume_size': 1} Mar 12 21:10:12.323332 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-5738aa60-4b17-48fb-a434-b53c01a9cb4c tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] creating volume 'volume-b2e05f5a-6192-4f50-9d9d-3642e2ef38a5' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:10:12.324733 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-5738aa60-4b17-48fb-a434-b53c01a9cb4c tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:10:12.533307 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-5738aa60-4b17-48fb-a434-b53c01a9cb4c tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:10:12.535085 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-5738aa60-4b17-48fb-a434-b53c01a9cb4c tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:10:12.542855 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5738aa60-4b17-48fb-a434-b53c01a9cb4c tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee68d397-d739-47ec-a8bf-28ea11404226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2e05f5a-6192-4f50-9d9d-3642e2ef38a5', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:12.556133 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5738aa60-4b17-48fb-a434-b53c01a9cb4c tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7938d26b-e37a-4c2c-a59c-d1d7c6384d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:12.584339 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-5738aa60-4b17-48fb-a434-b53c01a9cb4c tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] Volume volume-b2e05f5a-6192-4f50-9d9d-3642e2ef38a5 (b2e05f5a-6192-4f50-9d9d-3642e2ef38a5): created successfully Mar 12 21:10:12.600647 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5738aa60-4b17-48fb-a434-b53c01a9cb4c tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7938d26b-e37a-4c2c-a59c-d1d7c6384d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:12.609050 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5738aa60-4b17-48fb-a434-b53c01a9cb4c tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] Flow 'volume_create_manager' (7f254197-d7dd-4575-860a-fe6e1261f896) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:10:12.625195 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-5738aa60-4b17-48fb-a434-b53c01a9cb4c tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] Created volume successfully. Mar 12 21:10:13.674027 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-94d75ec6-16c7-4cfb-ba11-fbc49cae81c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:10:14.378016 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-2f90149b-e1f4-4883-b29e-dd0a38fff527 req-b1e9a14b-6641-4feb-8da6-64b0a4b84906 tempest-AttachVolumeNegativeTest-2014367252 None] Terminate volume connection completed successfully. Mar 12 21:10:14.379507 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-2f90149b-e1f4-4883-b29e-dd0a38fff527 req-b1e9a14b-6641-4feb-8da6-64b0a4b84906 tempest-AttachVolumeNegativeTest-2014367252 None] Deleting attachment ad3483a9-fac8-4fa2-a25f-83ad7fd06107. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 21:10:14.981309 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-94d75ec6-16c7-4cfb-ba11-fbc49cae81c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] Create snapshot completed successfully Mar 12 21:10:16.335071 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-229a66b8-7e58-4627-b54f-5c9c11ab09e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] Lock "b'cinder-17af3bf3-cdcb-43dd-9706-31a5da97a46c-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.023s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:10:16.336507 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-229a66b8-7e58-4627-b54f-5c9c11ab09e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:10:17.089025 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-229a66b8-7e58-4627-b54f-5c9c11ab09e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] Created reservations ['c627854a-0113-4469-84fe-5c790543a123', '32b44b5f-6c7b-4336-9efb-bb4d2b9590e8', 'cbc16201-d92b-42e1-afe2-293324193437', 'e080f16f-0033-44bc-aad3-530d1e3b6efb'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:10:17.190247 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-229a66b8-7e58-4627-b54f-5c9c11ab09e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] Delete snapshot completed successfully. Mar 12 21:10:17.199165 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-229a66b8-7e58-4627-b54f-5c9c11ab09e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] Lock "b'cinder-17af3bf3-cdcb-43dd-9706-31a5da97a46c-delete_snapshot'" released by "delete_snapshot" :: held 0.864s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:10:17.545160 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-a9951f75-8346-4ac1-b7d6-896122d6b819 tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] Lock "b'cinder-b2e05f5a-6192-4f50-9d9d-3642e2ef38a5-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:10:17.623758 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a9951f75-8346-4ac1-b7d6-896122d6b819 tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:10:17.812171 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a9951f75-8346-4ac1-b7d6-896122d6b819 tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:10:17.812885 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a9951f75-8346-4ac1-b7d6-896122d6b819 tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] Volume volume-b2e05f5a-6192-4f50-9d9d-3642e2ef38a5 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:10:17.836273 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a9951f75-8346-4ac1-b7d6-896122d6b819 tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] deleting rbd volume volume-b2e05f5a-6192-4f50-9d9d-3642e2ef38a5 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:10:18.372370 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-a9951f75-8346-4ac1-b7d6-896122d6b819 tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] Created reservations ['8434d11b-cf31-480d-8d01-8c4deea067c6', '979be7a2-10ff-450b-91df-b889828a586b', 'ed7e6003-66f6-4ba9-88e6-d546c51cc0b5', '0706f5f2-6a3f-4002-bbd4-9d6e30b6b255'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:10:18.479304 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a9951f75-8346-4ac1-b7d6-896122d6b819 tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:10:18.585103 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a9951f75-8346-4ac1-b7d6-896122d6b819 tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:10:18.663127 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a9951f75-8346-4ac1-b7d6-896122d6b819 tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:10:18.670242 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-a9951f75-8346-4ac1-b7d6-896122d6b819 tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] Deleted volume successfully. Mar 12 21:10:18.690067 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-a9951f75-8346-4ac1-b7d6-896122d6b819 tempest-VolumeSnapshotQuotasNegativeTestJSON-66529020 None] Lock "b'cinder-b2e05f5a-6192-4f50-9d9d-3642e2ef38a5-delete_volume'" released by "delete_volume" :: held 1.145s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:10:23.195234 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:10:23.200229 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:10:23.201196 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:10:23.223599 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] Flow 'volume_create_manager' (e11ac5ec-07b5-4024-8faf-0e09ef5568d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:10:23.231000 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d49e657-e84d-4297-8b88-179448088352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:23.240449 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:10:23.264934 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d49e657-e84d-4297-8b88-179448088352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1454599385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=33b5d761-3965-4dcf-89b4-d41fc8e26fd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84e4429fb88f43b4b511a4fed7fd2caa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:10:23Z,use_quota=True,user_id='cb5f0a9eb48441c6844afe3d559af06b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:23.277792 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78a6c304-98b4-491b-9855-da6796e448e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:23.280983 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78a6c304-98b4-491b-9855-da6796e448e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:23.287734 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3e6cdb0-a737-4d20-b53d-a511c462df68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:23.437660 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3e6cdb0-a737-4d20-b53d-a511c462df68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '33b5d761-3965-4dcf-89b4-d41fc8e26fd9', 'volume_name': 'volume-33b5d761-3965-4dcf-89b4-d41fc8e26fd9', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:23.444598 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75a2b9f2-65ed-4485-bd01-da59c494abcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:23.450067 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75a2b9f2-65ed-4485-bd01-da59c494abcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:23.457169 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bfd4a5d-7749-4f29-b113-7fc36d19e201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:23.458969 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] Volume 33b5d761-3965-4dcf-89b4-d41fc8e26fd9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-33b5d761-3965-4dcf-89b4-d41fc8e26fd9', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 12 21:10:23.459824 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] Cloning 33b5d761-3965-4dcf-89b4-d41fc8e26fd9 from image 539171db-0bd3-4f16-95fd-a7cd5530137d at location (None, None). {{(pid=129531) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Mar 12 21:10:23.472696 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] Lock "b'cinder-539171db-0bd3-4f16-95fd-a7cd5530137d'" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:10:23.487855 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] Found image-volume cache entry: {'id': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'volume_id': '8d802c7b-bd34-4836-bd5d-90755a167ddc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34), 'last_used': datetime.datetime(2022, 3, 12, 21, 10, 23, 479510)}. {{(pid=129531) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 12 21:10:23.489048 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] Image-volume cache entry image_update_at = 2022-03-12 20:39:34+00:00, requested image updated_at = 2022-03-12 20:39:34+00:00. {{(pid=129531) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 12 21:10:23.489933 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] Found cache entry for image = 539171db-0bd3-4f16-95fd-a7cd5530137d on host ncdv-master-1@ceph#ceph. {{(pid=129531) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Mar 12 21:10:23.507783 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] Lock "b'cinder-539171db-0bd3-4f16-95fd-a7cd5530137d'" released by "_prepare_image_cache_entry" :: held 0.035s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:10:23.510459 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] Attempting to retrieve cache entry for image = 539171db-0bd3-4f16-95fd-a7cd5530137d on host ncdv-master-1@ceph#ceph. {{(pid=129531) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Mar 12 21:10:23.551365 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] Found image-volume cache entry: {'id': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'volume_id': '8d802c7b-bd34-4836-bd5d-90755a167ddc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34), 'last_used': datetime.datetime(2022, 3, 12, 21, 10, 23, 539470)}. {{(pid=129531) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 12 21:10:23.551854 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] Image-volume cache entry image_update_at = 2022-03-12 20:39:34+00:00, requested image updated_at = 2022-03-12 20:39:34+00:00. {{(pid=129531) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 12 21:10:23.552320 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] Creating from source image-volume 8d802c7b-bd34-4836-bd5d-90755a167ddc {{(pid=129531) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Mar 12 21:10:23.567044 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:10:23.700269 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] creating snapshot='volume-33b5d761-3965-4dcf-89b4-d41fc8e26fd9.clone_snap' {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Mar 12 21:10:23.911419 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] cloning 'volume-8d802c7b-bd34-4836-bd5d-90755a167ddc@volume-33b5d761-3965-4dcf-89b4-d41fc8e26fd9.clone_snap' to 'volume-33b5d761-3965-4dcf-89b4-d41fc8e26fd9' {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Mar 12 21:10:24.128654 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] Volume volume-9916cd82-3d9b-466f-a769-cf81bdc743fd.deleted is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:10:24.129738 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:10:24.130147 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:10:24.179691 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] clone created successfully {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Mar 12 21:10:24.180548 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.volume_utils [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] Marking volume 33b5d761-3965-4dcf-89b4-d41fc8e26fd9 as bootable. {{(pid=129531) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 12 21:10:24.202345 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] Copying metadata from image 539171db-0bd3-4f16-95fd-a7cd5530137d to 33b5d761-3965-4dcf-89b4-d41fc8e26fd9. {{(pid=129531) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Mar 12 21:10:24.203246 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] Creating volume glance metadata for volume 33b5d761-3965-4dcf-89b4-d41fc8e26fd9 backed by image 539171db-0bd3-4f16-95fd-a7cd5530137d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129531) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Mar 12 21:10:24.329530 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bfd4a5d-7749-4f29-b113-7fc36d19e201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33b5d761-3965-4dcf-89b4-d41fc8e26fd9', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:24.344318 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85efc918-c405-4612-9bf3-92f16855ec3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:24.379294 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] Volume volume-33b5d761-3965-4dcf-89b4-d41fc8e26fd9 (33b5d761-3965-4dcf-89b4-d41fc8e26fd9): created successfully Mar 12 21:10:24.390450 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85efc918-c405-4612-9bf3-92f16855ec3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:24.404235 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] Flow 'volume_create_manager' (e11ac5ec-07b5-4024-8faf-0e09ef5568d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:10:24.431891 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-4613ec0c-d753-4a70-bf9e-419c6b4b2050 tempest-TaggedBootDevicesTest-378912436 None] Created volume successfully. Mar 12 21:10:25.951125 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-d79fdb39-455f-490a-a2ca-e4c7dabb1ebc tempest-TaggedBootDevicesTest-378912436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:10:25.961048 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-d79fdb39-455f-490a-a2ca-e4c7dabb1ebc tempest-TaggedBootDevicesTest-378912436 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:10:25.972009 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-d79fdb39-455f-490a-a2ca-e4c7dabb1ebc tempest-TaggedBootDevicesTest-378912436 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:10:26.013992 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d79fdb39-455f-490a-a2ca-e4c7dabb1ebc tempest-TaggedBootDevicesTest-378912436 None] Flow 'volume_create_manager' (acc814fe-1854-4562-bea1-30c176a9e85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:10:26.032830 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d79fdb39-455f-490a-a2ca-e4c7dabb1ebc tempest-TaggedBootDevicesTest-378912436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce0226c-9af6-4c4a-bba7-fe489f4ce0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:26.040945 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-d79fdb39-455f-490a-a2ca-e4c7dabb1ebc tempest-TaggedBootDevicesTest-378912436 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:10:26.082458 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d79fdb39-455f-490a-a2ca-e4c7dabb1ebc tempest-TaggedBootDevicesTest-378912436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce0226c-9af6-4c4a-bba7-fe489f4ce0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-2141268527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=519a2fed-2ed7-49b2-973b-b1a48e2e8095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84e4429fb88f43b4b511a4fed7fd2caa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:10:26Z,use_quota=True,user_id='cb5f0a9eb48441c6844afe3d559af06b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:26.096250 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d79fdb39-455f-490a-a2ca-e4c7dabb1ebc tempest-TaggedBootDevicesTest-378912436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a9ca97-3590-4e7c-ba00-eeddf109b212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:26.110618 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d79fdb39-455f-490a-a2ca-e4c7dabb1ebc tempest-TaggedBootDevicesTest-378912436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a9ca97-3590-4e7c-ba00-eeddf109b212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:26.131374 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d79fdb39-455f-490a-a2ca-e4c7dabb1ebc tempest-TaggedBootDevicesTest-378912436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f522bd9-b4b3-48d7-a8d4-95bf6953e6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:26.135887 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d79fdb39-455f-490a-a2ca-e4c7dabb1ebc tempest-TaggedBootDevicesTest-378912436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f522bd9-b4b3-48d7-a8d4-95bf6953e6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '519a2fed-2ed7-49b2-973b-b1a48e2e8095', 'volume_name': 'volume-519a2fed-2ed7-49b2-973b-b1a48e2e8095', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:26.155308 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d79fdb39-455f-490a-a2ca-e4c7dabb1ebc tempest-TaggedBootDevicesTest-378912436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d47d2b92-5ae0-4fd7-a737-e4a88f838cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:26.161309 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d79fdb39-455f-490a-a2ca-e4c7dabb1ebc tempest-TaggedBootDevicesTest-378912436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d47d2b92-5ae0-4fd7-a737-e4a88f838cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:26.182303 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d79fdb39-455f-490a-a2ca-e4c7dabb1ebc tempest-TaggedBootDevicesTest-378912436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e5a9316-d96b-4b19-927b-b9f188154a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:26.182303 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-d79fdb39-455f-490a-a2ca-e4c7dabb1ebc tempest-TaggedBootDevicesTest-378912436 None] Volume 519a2fed-2ed7-49b2-973b-b1a48e2e8095: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-519a2fed-2ed7-49b2-973b-b1a48e2e8095', 'volume_size': 1} Mar 12 21:10:26.182303 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d79fdb39-455f-490a-a2ca-e4c7dabb1ebc tempest-TaggedBootDevicesTest-378912436 None] creating volume 'volume-519a2fed-2ed7-49b2-973b-b1a48e2e8095' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:10:26.186265 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d79fdb39-455f-490a-a2ca-e4c7dabb1ebc tempest-TaggedBootDevicesTest-378912436 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:10:26.329021 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d79fdb39-455f-490a-a2ca-e4c7dabb1ebc tempest-TaggedBootDevicesTest-378912436 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:10:26.329401 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d79fdb39-455f-490a-a2ca-e4c7dabb1ebc tempest-TaggedBootDevicesTest-378912436 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:10:26.334312 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d79fdb39-455f-490a-a2ca-e4c7dabb1ebc tempest-TaggedBootDevicesTest-378912436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e5a9316-d96b-4b19-927b-b9f188154a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-519a2fed-2ed7-49b2-973b-b1a48e2e8095', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:26.341609 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d79fdb39-455f-490a-a2ca-e4c7dabb1ebc tempest-TaggedBootDevicesTest-378912436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (980798f8-7577-42ee-b439-63ccced84911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:26.363352 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-d79fdb39-455f-490a-a2ca-e4c7dabb1ebc tempest-TaggedBootDevicesTest-378912436 None] Volume volume-519a2fed-2ed7-49b2-973b-b1a48e2e8095 (519a2fed-2ed7-49b2-973b-b1a48e2e8095): created successfully Mar 12 21:10:26.367581 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d79fdb39-455f-490a-a2ca-e4c7dabb1ebc tempest-TaggedBootDevicesTest-378912436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (980798f8-7577-42ee-b439-63ccced84911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:26.378958 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d79fdb39-455f-490a-a2ca-e4c7dabb1ebc tempest-TaggedBootDevicesTest-378912436 None] Flow 'volume_create_manager' (acc814fe-1854-4562-bea1-30c176a9e85e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:10:26.395442 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-d79fdb39-455f-490a-a2ca-e4c7dabb1ebc tempest-TaggedBootDevicesTest-378912436 None] Created volume successfully. Mar 12 21:10:27.582008 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-302ee3da-3921-4a10-a13b-ea2cf0c5ee31 tempest-TaggedBootDevicesTest-378912436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:10:27.591091 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-302ee3da-3921-4a10-a13b-ea2cf0c5ee31 tempest-TaggedBootDevicesTest-378912436 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:10:27.592645 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-302ee3da-3921-4a10-a13b-ea2cf0c5ee31 tempest-TaggedBootDevicesTest-378912436 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:10:27.635694 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-302ee3da-3921-4a10-a13b-ea2cf0c5ee31 tempest-TaggedBootDevicesTest-378912436 None] Flow 'volume_create_manager' (6ea133b0-36e1-42ea-ae21-ebe851801917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:10:27.651262 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-302ee3da-3921-4a10-a13b-ea2cf0c5ee31 tempest-TaggedBootDevicesTest-378912436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b6b6584-91fe-4a94-b122-c73b29046008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:27.678636 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-302ee3da-3921-4a10-a13b-ea2cf0c5ee31 tempest-TaggedBootDevicesTest-378912436 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:10:27.710734 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-302ee3da-3921-4a10-a13b-ea2cf0c5ee31 tempest-TaggedBootDevicesTest-378912436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b6b6584-91fe-4a94-b122-c73b29046008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-592414312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=97dcd19d-c778-4d5a-ac7e-e6f2d767dbf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84e4429fb88f43b4b511a4fed7fd2caa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:10:27Z,use_quota=True,user_id='cb5f0a9eb48441c6844afe3d559af06b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:27.734210 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-302ee3da-3921-4a10-a13b-ea2cf0c5ee31 tempest-TaggedBootDevicesTest-378912436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c8edda-61f9-463c-a8c2-fbf75de75a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:27.741610 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-302ee3da-3921-4a10-a13b-ea2cf0c5ee31 tempest-TaggedBootDevicesTest-378912436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c8edda-61f9-463c-a8c2-fbf75de75a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:27.751360 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-302ee3da-3921-4a10-a13b-ea2cf0c5ee31 tempest-TaggedBootDevicesTest-378912436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a0dc41e-5782-4157-8267-22c609e2bdda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:27.760520 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-302ee3da-3921-4a10-a13b-ea2cf0c5ee31 tempest-TaggedBootDevicesTest-378912436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a0dc41e-5782-4157-8267-22c609e2bdda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97dcd19d-c778-4d5a-ac7e-e6f2d767dbf4', 'volume_name': 'volume-97dcd19d-c778-4d5a-ac7e-e6f2d767dbf4', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:27.806272 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-302ee3da-3921-4a10-a13b-ea2cf0c5ee31 tempest-TaggedBootDevicesTest-378912436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c25710e-da87-48a3-a6ef-800998edb7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:27.817340 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-302ee3da-3921-4a10-a13b-ea2cf0c5ee31 tempest-TaggedBootDevicesTest-378912436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c25710e-da87-48a3-a6ef-800998edb7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:27.826630 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-302ee3da-3921-4a10-a13b-ea2cf0c5ee31 tempest-TaggedBootDevicesTest-378912436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8417776b-2099-433c-8520-bf93e2f0ea69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:27.828066 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-302ee3da-3921-4a10-a13b-ea2cf0c5ee31 tempest-TaggedBootDevicesTest-378912436 None] Volume 97dcd19d-c778-4d5a-ac7e-e6f2d767dbf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97dcd19d-c778-4d5a-ac7e-e6f2d767dbf4', 'volume_size': 1} Mar 12 21:10:27.828469 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-302ee3da-3921-4a10-a13b-ea2cf0c5ee31 tempest-TaggedBootDevicesTest-378912436 None] creating volume 'volume-97dcd19d-c778-4d5a-ac7e-e6f2d767dbf4' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:10:27.829959 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-302ee3da-3921-4a10-a13b-ea2cf0c5ee31 tempest-TaggedBootDevicesTest-378912436 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:10:27.969454 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-302ee3da-3921-4a10-a13b-ea2cf0c5ee31 tempest-TaggedBootDevicesTest-378912436 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:10:27.969867 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-302ee3da-3921-4a10-a13b-ea2cf0c5ee31 tempest-TaggedBootDevicesTest-378912436 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:10:27.973890 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-302ee3da-3921-4a10-a13b-ea2cf0c5ee31 tempest-TaggedBootDevicesTest-378912436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8417776b-2099-433c-8520-bf93e2f0ea69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97dcd19d-c778-4d5a-ac7e-e6f2d767dbf4', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:27.987776 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-302ee3da-3921-4a10-a13b-ea2cf0c5ee31 tempest-TaggedBootDevicesTest-378912436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40cf362e-48f1-41e3-87c8-17a262aa8731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:28.008838 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-302ee3da-3921-4a10-a13b-ea2cf0c5ee31 tempest-TaggedBootDevicesTest-378912436 None] Volume volume-97dcd19d-c778-4d5a-ac7e-e6f2d767dbf4 (97dcd19d-c778-4d5a-ac7e-e6f2d767dbf4): created successfully Mar 12 21:10:28.015215 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-302ee3da-3921-4a10-a13b-ea2cf0c5ee31 tempest-TaggedBootDevicesTest-378912436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40cf362e-48f1-41e3-87c8-17a262aa8731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:28.024137 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-302ee3da-3921-4a10-a13b-ea2cf0c5ee31 tempest-TaggedBootDevicesTest-378912436 None] Flow 'volume_create_manager' (6ea133b0-36e1-42ea-ae21-ebe851801917) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:10:28.042026 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-302ee3da-3921-4a10-a13b-ea2cf0c5ee31 tempest-TaggedBootDevicesTest-378912436 None] Created volume successfully. Mar 12 21:10:36.420413 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:10:36.432139 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:10:36.432550 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:10:36.526357 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] Flow 'volume_create_manager' (c2740a3b-26e5-4513-8a85-6b9b9cfe3944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:10:36.541202 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3621e5bb-7782-4a68-8249-31b69630f555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:36.554672 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:10:36.591025 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3621e5bb-7782-4a68-8249-31b69630f555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1056849741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=643c2eaf-0fab-4895-a19a-37e5a1f4dd70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ade70e51654849e1a158111eeed32f6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:10:36Z,use_quota=True,user_id='4afab911e8e845f7863aa5221647f6b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:36.603557 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe3bd0fb-bf84-4934-95f1-e8f3b33168dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:36.609286 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe3bd0fb-bf84-4934-95f1-e8f3b33168dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:36.615924 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31ed7107-d7a1-47a9-bce6-82a35d6b5dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:36.749836 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31ed7107-d7a1-47a9-bce6-82a35d6b5dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '643c2eaf-0fab-4895-a19a-37e5a1f4dd70', 'volume_name': 'volume-643c2eaf-0fab-4895-a19a-37e5a1f4dd70', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:36.764011 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e66eb0a5-0ac5-4a99-965f-ebf5af3b2d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:36.775379 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e66eb0a5-0ac5-4a99-965f-ebf5af3b2d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:36.788505 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0716b19-3276-4457-a14b-aff16ceb5da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:36.793482 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] Volume 643c2eaf-0fab-4895-a19a-37e5a1f4dd70: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-643c2eaf-0fab-4895-a19a-37e5a1f4dd70', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 12 21:10:36.794399 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] Cloning 643c2eaf-0fab-4895-a19a-37e5a1f4dd70 from image 539171db-0bd3-4f16-95fd-a7cd5530137d at location (None, None). {{(pid=129531) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Mar 12 21:10:36.814081 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] Lock "b'cinder-539171db-0bd3-4f16-95fd-a7cd5530137d'" acquired by "_prepare_image_cache_entry" :: waited 0.013s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:10:36.837486 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] Found image-volume cache entry: {'id': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'volume_id': '8d802c7b-bd34-4836-bd5d-90755a167ddc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34), 'last_used': datetime.datetime(2022, 3, 12, 21, 10, 36, 823626)}. {{(pid=129531) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 12 21:10:36.838114 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] Image-volume cache entry image_update_at = 2022-03-12 20:39:34+00:00, requested image updated_at = 2022-03-12 20:39:34+00:00. {{(pid=129531) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 12 21:10:36.839532 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] Found cache entry for image = 539171db-0bd3-4f16-95fd-a7cd5530137d on host ncdv-master-1@ceph#ceph. {{(pid=129531) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Mar 12 21:10:36.849612 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] Lock "b'cinder-539171db-0bd3-4f16-95fd-a7cd5530137d'" released by "_prepare_image_cache_entry" :: held 0.036s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:10:36.851655 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] Attempting to retrieve cache entry for image = 539171db-0bd3-4f16-95fd-a7cd5530137d on host ncdv-master-1@ceph#ceph. {{(pid=129531) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Mar 12 21:10:36.900859 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] Found image-volume cache entry: {'id': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'volume_id': '8d802c7b-bd34-4836-bd5d-90755a167ddc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34), 'last_used': datetime.datetime(2022, 3, 12, 21, 10, 36, 860128)}. {{(pid=129531) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 12 21:10:36.900859 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] Image-volume cache entry image_update_at = 2022-03-12 20:39:34+00:00, requested image updated_at = 2022-03-12 20:39:34+00:00. {{(pid=129531) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 12 21:10:36.900859 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] Creating from source image-volume 8d802c7b-bd34-4836-bd5d-90755a167ddc {{(pid=129531) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Mar 12 21:10:36.927904 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:10:37.107438 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] creating snapshot='volume-643c2eaf-0fab-4895-a19a-37e5a1f4dd70.clone_snap' {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Mar 12 21:10:37.401241 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] cloning 'volume-8d802c7b-bd34-4836-bd5d-90755a167ddc@volume-643c2eaf-0fab-4895-a19a-37e5a1f4dd70.clone_snap' to 'volume-643c2eaf-0fab-4895-a19a-37e5a1f4dd70' {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Mar 12 21:10:37.673488 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] Volume volume-9916cd82-3d9b-466f-a769-cf81bdc743fd.deleted is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:10:37.675240 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:10:37.675625 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:10:37.724629 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] clone created successfully {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Mar 12 21:10:37.725275 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.volume_utils [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] Marking volume 643c2eaf-0fab-4895-a19a-37e5a1f4dd70 as bootable. {{(pid=129531) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 12 21:10:37.736511 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] Copying metadata from image 539171db-0bd3-4f16-95fd-a7cd5530137d to 643c2eaf-0fab-4895-a19a-37e5a1f4dd70. {{(pid=129531) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Mar 12 21:10:37.737308 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] Creating volume glance metadata for volume 643c2eaf-0fab-4895-a19a-37e5a1f4dd70 backed by image 539171db-0bd3-4f16-95fd-a7cd5530137d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129531) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Mar 12 21:10:37.877829 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0716b19-3276-4457-a14b-aff16ceb5da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-643c2eaf-0fab-4895-a19a-37e5a1f4dd70', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:37.884697 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c3fb6fe-a70c-43d8-9ec0-335404af17a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:37.898698 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] Volume volume-643c2eaf-0fab-4895-a19a-37e5a1f4dd70 (643c2eaf-0fab-4895-a19a-37e5a1f4dd70): created successfully Mar 12 21:10:37.905438 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c3fb6fe-a70c-43d8-9ec0-335404af17a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:37.914593 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] Flow 'volume_create_manager' (c2740a3b-26e5-4513-8a85-6b9b9cfe3944) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:10:37.929749 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-b6e1491a-cb40-40b9-95dc-ec14fcd88f37 tempest-VolumesExtendTest-1115404042 None] Created volume successfully. Mar 12 21:10:38.698900 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c832e019-fe35-4b1d-b2a1-7968334061c6 tempest-VolumesExtendTest-1115404042 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:10:38.932335 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c832e019-fe35-4b1d-b2a1-7968334061c6 tempest-VolumesExtendTest-1115404042 None] Extend volume from 1 GB to 2 GB. {{(pid=129531) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1874}} Mar 12 21:10:38.977337 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-c832e019-fe35-4b1d-b2a1-7968334061c6 tempest-VolumesExtendTest-1115404042 None] Extend volume completed successfully. Mar 12 21:10:40.755412 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-6236bde5-c781-4254-94a1-ff0de06197d3 tempest-VolumesExtendTest-1115404042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:10:40.759881 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-6236bde5-c781-4254-94a1-ff0de06197d3 tempest-VolumesExtendTest-1115404042 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:10:40.762281 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-6236bde5-c781-4254-94a1-ff0de06197d3 tempest-VolumesExtendTest-1115404042 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:10:40.807790 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6236bde5-c781-4254-94a1-ff0de06197d3 tempest-VolumesExtendTest-1115404042 None] Flow 'volume_create_manager' (05975fd0-1893-446d-90c4-8f424c7b01f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:10:40.820154 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6236bde5-c781-4254-94a1-ff0de06197d3 tempest-VolumesExtendTest-1115404042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1f17ec3-1c0a-47cf-a77e-1fc576ec9b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:40.831738 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-6236bde5-c781-4254-94a1-ff0de06197d3 tempest-VolumesExtendTest-1115404042 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:10:40.869897 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6236bde5-c781-4254-94a1-ff0de06197d3 tempest-VolumesExtendTest-1115404042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1f17ec3-1c0a-47cf-a77e-1fc576ec9b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-895901169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2431a59d-3ef3-4801-8fcd-e3910f88a4ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ade70e51654849e1a158111eeed32f6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:10:41Z,use_quota=True,user_id='4afab911e8e845f7863aa5221647f6b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:40.887135 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6236bde5-c781-4254-94a1-ff0de06197d3 tempest-VolumesExtendTest-1115404042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21cb2fd9-c22e-4458-86aa-e600fc108d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:40.894955 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6236bde5-c781-4254-94a1-ff0de06197d3 tempest-VolumesExtendTest-1115404042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21cb2fd9-c22e-4458-86aa-e600fc108d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:40.903154 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6236bde5-c781-4254-94a1-ff0de06197d3 tempest-VolumesExtendTest-1115404042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7880c470-8084-4eae-ae4d-15e479b32ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:40.909248 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6236bde5-c781-4254-94a1-ff0de06197d3 tempest-VolumesExtendTest-1115404042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7880c470-8084-4eae-ae4d-15e479b32ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2431a59d-3ef3-4801-8fcd-e3910f88a4ea', 'volume_name': 'volume-2431a59d-3ef3-4801-8fcd-e3910f88a4ea', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:40.915380 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6236bde5-c781-4254-94a1-ff0de06197d3 tempest-VolumesExtendTest-1115404042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4543691c-14dc-4b18-a5c3-1f6f86df5b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:40.920010 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6236bde5-c781-4254-94a1-ff0de06197d3 tempest-VolumesExtendTest-1115404042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4543691c-14dc-4b18-a5c3-1f6f86df5b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:40.935721 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6236bde5-c781-4254-94a1-ff0de06197d3 tempest-VolumesExtendTest-1115404042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26f690c6-56ac-4cf2-a593-bd279470d506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:40.938065 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-6236bde5-c781-4254-94a1-ff0de06197d3 tempest-VolumesExtendTest-1115404042 None] Volume 2431a59d-3ef3-4801-8fcd-e3910f88a4ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2431a59d-3ef3-4801-8fcd-e3910f88a4ea', 'volume_size': 1} Mar 12 21:10:40.938535 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-6236bde5-c781-4254-94a1-ff0de06197d3 tempest-VolumesExtendTest-1115404042 None] creating volume 'volume-2431a59d-3ef3-4801-8fcd-e3910f88a4ea' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:10:40.940371 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-6236bde5-c781-4254-94a1-ff0de06197d3 tempest-VolumesExtendTest-1115404042 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:10:41.004515 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-9e332a62-ed9e-4e82-9a5d-b9cfb087ed4a tempest-GroupsV314Test-109128574 None] Group tempest-GroupsV314Test-Group-32936207: creating Mar 12 21:10:41.030854 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-9e332a62-ed9e-4e82-9a5d-b9cfb087ed4a tempest-GroupsV314Test-109128574 None] Group tempest-GroupsV314Test-Group-32936207: created successfully Mar 12 21:10:41.045659 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-9e332a62-ed9e-4e82-9a5d-b9cfb087ed4a tempest-GroupsV314Test-109128574 None] Create group completed successfully. Mar 12 21:10:41.070269 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-6236bde5-c781-4254-94a1-ff0de06197d3 tempest-VolumesExtendTest-1115404042 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:10:41.072052 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-6236bde5-c781-4254-94a1-ff0de06197d3 tempest-VolumesExtendTest-1115404042 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:10:41.083500 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6236bde5-c781-4254-94a1-ff0de06197d3 tempest-VolumesExtendTest-1115404042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26f690c6-56ac-4cf2-a593-bd279470d506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2431a59d-3ef3-4801-8fcd-e3910f88a4ea', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:41.090794 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6236bde5-c781-4254-94a1-ff0de06197d3 tempest-VolumesExtendTest-1115404042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3460fa9a-802d-4c11-b166-972cc9607fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:41.104165 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-6236bde5-c781-4254-94a1-ff0de06197d3 tempest-VolumesExtendTest-1115404042 None] Volume volume-2431a59d-3ef3-4801-8fcd-e3910f88a4ea (2431a59d-3ef3-4801-8fcd-e3910f88a4ea): created successfully Mar 12 21:10:41.109472 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6236bde5-c781-4254-94a1-ff0de06197d3 tempest-VolumesExtendTest-1115404042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3460fa9a-802d-4c11-b166-972cc9607fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:41.119413 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-6236bde5-c781-4254-94a1-ff0de06197d3 tempest-VolumesExtendTest-1115404042 None] Flow 'volume_create_manager' (05975fd0-1893-446d-90c4-8f424c7b01f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:10:41.130614 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-6236bde5-c781-4254-94a1-ff0de06197d3 tempest-VolumesExtendTest-1115404042 None] Created volume successfully. Mar 12 21:10:42.177147 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-099edf22-d4ff-41b0-bb40-40c08aa395ea tempest-VolumesExtendTest-1115404042 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:10:42.571416 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-099edf22-d4ff-41b0-bb40-40c08aa395ea tempest-VolumesExtendTest-1115404042 None] Create snapshot completed successfully Mar 12 21:10:42.612596 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b463367-e66f-44bb-82cd-c6c1950af09a tempest-GroupsV314Test-109128574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:10:42.616693 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-1b463367-e66f-44bb-82cd-c6c1950af09a tempest-GroupsV314Test-109128574 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:10:42.617200 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-1b463367-e66f-44bb-82cd-c6c1950af09a tempest-GroupsV314Test-109128574 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:10:42.640395 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-1b463367-e66f-44bb-82cd-c6c1950af09a tempest-GroupsV314Test-109128574 None] Flow 'volume_create_manager' (0ed6b75e-1fb4-4333-9da4-455c5b86457d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:10:42.662374 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-1b463367-e66f-44bb-82cd-c6c1950af09a tempest-GroupsV314Test-109128574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81d9f18d-95b5-42c4-ab7f-a28425cb024d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:42.690100 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-1b463367-e66f-44bb-82cd-c6c1950af09a tempest-GroupsV314Test-109128574 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:10:42.724191 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-1b463367-e66f-44bb-82cd-c6c1950af09a tempest-GroupsV314Test-109128574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81d9f18d-95b5-42c4-ab7f-a28425cb024d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsV314Test-Volume-533486071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5eff6d6a-35e4-4fca-8aa9-addf08bdf522,host='ncdv-master-1@ceph#ceph',id=d14ab944-4d54-4192-b6cc-3e81f7a146f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9104c17fba8c4bb0b1189ef4df3dd45a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:10:43Z,use_quota=True,user_id='09e6699f95d44c27a561f5bfd55889b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(77f2b029-164c-47e0-9bcf-b976970e5353),volume_type_id=77f2b029-164c-47e0-9bcf-b976970e5353)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:42.742280 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-1b463367-e66f-44bb-82cd-c6c1950af09a tempest-GroupsV314Test-109128574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72474631-8239-4335-aa08-7f296a090497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:42.752138 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-1b463367-e66f-44bb-82cd-c6c1950af09a tempest-GroupsV314Test-109128574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72474631-8239-4335-aa08-7f296a090497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:42.757737 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-1b463367-e66f-44bb-82cd-c6c1950af09a tempest-GroupsV314Test-109128574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c63b0974-4da3-48a4-8c40-9302ae34cc58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:42.770878 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-1b463367-e66f-44bb-82cd-c6c1950af09a tempest-GroupsV314Test-109128574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c63b0974-4da3-48a4-8c40-9302ae34cc58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd14ab944-4d54-4192-b6cc-3e81f7a146f8', 'volume_name': 'volume-d14ab944-4d54-4192-b6cc-3e81f7a146f8', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:42.787199 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-1b463367-e66f-44bb-82cd-c6c1950af09a tempest-GroupsV314Test-109128574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0a5f1b9-fcf2-4995-9fa0-e7edead38699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:42.791462 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-1b463367-e66f-44bb-82cd-c6c1950af09a tempest-GroupsV314Test-109128574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0a5f1b9-fcf2-4995-9fa0-e7edead38699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:42.803148 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-1b463367-e66f-44bb-82cd-c6c1950af09a tempest-GroupsV314Test-109128574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d64b592e-3cc8-4864-a028-b4a881d40005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:42.804608 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-1b463367-e66f-44bb-82cd-c6c1950af09a tempest-GroupsV314Test-109128574 None] Volume d14ab944-4d54-4192-b6cc-3e81f7a146f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d14ab944-4d54-4192-b6cc-3e81f7a146f8', 'volume_size': 1} Mar 12 21:10:42.805163 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-1b463367-e66f-44bb-82cd-c6c1950af09a tempest-GroupsV314Test-109128574 None] creating volume 'volume-d14ab944-4d54-4192-b6cc-3e81f7a146f8' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:10:42.806629 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-1b463367-e66f-44bb-82cd-c6c1950af09a tempest-GroupsV314Test-109128574 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:10:42.992625 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-1b463367-e66f-44bb-82cd-c6c1950af09a tempest-GroupsV314Test-109128574 None] extra_specs: {} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:10:42.998202 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-1b463367-e66f-44bb-82cd-c6c1950af09a tempest-GroupsV314Test-109128574 None] extra_specs: {} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:10:43.008037 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-1b463367-e66f-44bb-82cd-c6c1950af09a tempest-GroupsV314Test-109128574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d64b592e-3cc8-4864-a028-b4a881d40005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d14ab944-4d54-4192-b6cc-3e81f7a146f8', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:43.013948 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-1b463367-e66f-44bb-82cd-c6c1950af09a tempest-GroupsV314Test-109128574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a407bf-bc40-4ae6-9578-8853da553c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:43.028066 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-1b463367-e66f-44bb-82cd-c6c1950af09a tempest-GroupsV314Test-109128574 None] Volume volume-d14ab944-4d54-4192-b6cc-3e81f7a146f8 (d14ab944-4d54-4192-b6cc-3e81f7a146f8): created successfully Mar 12 21:10:43.056560 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-1b463367-e66f-44bb-82cd-c6c1950af09a tempest-GroupsV314Test-109128574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a407bf-bc40-4ae6-9578-8853da553c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:43.077797 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-1b463367-e66f-44bb-82cd-c6c1950af09a tempest-GroupsV314Test-109128574 None] Flow 'volume_create_manager' (0ed6b75e-1fb4-4333-9da4-455c5b86457d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:10:43.098730 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-1b463367-e66f-44bb-82cd-c6c1950af09a tempest-GroupsV314Test-109128574 None] Created volume successfully. Mar 12 21:10:43.362942 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-aa034e9c-1114-4998-ae57-3cd71900f62a tempest-VolumesExtendTest-1115404042 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:10:43.533179 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-aa034e9c-1114-4998-ae57-3cd71900f62a tempest-VolumesExtendTest-1115404042 None] Extend volume from 1 GB to 2 GB. {{(pid=129531) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1874}} Mar 12 21:10:43.639308 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-aa034e9c-1114-4998-ae57-3cd71900f62a tempest-VolumesExtendTest-1115404042 None] Extend volume completed successfully. Mar 12 21:10:44.707394 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-01a530d5-d157-430f-81f5-f7f9ec2d8554 tempest-GroupsV314Test-109128574 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:10:44.794442 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-01a530d5-d157-430f-81f5-f7f9ec2d8554 tempest-GroupsV314Test-109128574 None] creating snapshot='volume-396816d2-5e64-4ddb-b84a-f1577e9fb0c7.clone_snap' {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Mar 12 21:10:45.525579 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-01a530d5-d157-430f-81f5-f7f9ec2d8554 tempest-GroupsV314Test-109128574 None] cloning 'volume-d14ab944-4d54-4192-b6cc-3e81f7a146f8@volume-396816d2-5e64-4ddb-b84a-f1577e9fb0c7.clone_snap' to 'volume-396816d2-5e64-4ddb-b84a-f1577e9fb0c7' {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Mar 12 21:10:45.543900 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-b0ec1ef8-7f80-4ae7-829e-53cbc203a1d1 tempest-VolumesExtendTest-1115404042 None] Lock "b'cinder-5c42ef15-ab1a-4ef1-a88e-b0113b0f87a6-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:10:45.545651 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b0ec1ef8-7f80-4ae7-829e-53cbc203a1d1 tempest-VolumesExtendTest-1115404042 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:10:45.646925 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-01a530d5-d157-430f-81f5-f7f9ec2d8554 tempest-GroupsV314Test-109128574 None] Volume volume-d14ab944-4d54-4192-b6cc-3e81f7a146f8 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:10:45.655259 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-01a530d5-d157-430f-81f5-f7f9ec2d8554 tempest-GroupsV314Test-109128574 None] extra_specs: {} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:10:45.656645 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-01a530d5-d157-430f-81f5-f7f9ec2d8554 tempest-GroupsV314Test-109128574 None] extra_specs: {} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:10:45.685456 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-01a530d5-d157-430f-81f5-f7f9ec2d8554 tempest-GroupsV314Test-109128574 None] clone created successfully {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Mar 12 21:10:45.744012 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-01a530d5-d157-430f-81f5-f7f9ec2d8554 tempest-GroupsV314Test-109128574 None] Create group from source-group-5eff6d6a-35e4-4fca-8aa9-addf08bdf522 completed successfully. Mar 12 21:10:46.571525 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8f93cb61-da17-4977-9d7e-692ccab71801 tempest-GroupsV314Test-109128574 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:10:46.729245 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8f93cb61-da17-4977-9d7e-692ccab71801 tempest-GroupsV314Test-109128574 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:10:46.745499 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8f93cb61-da17-4977-9d7e-692ccab71801 tempest-GroupsV314Test-109128574 None] deleting rbd volume volume-396816d2-5e64-4ddb-b84a-f1577e9fb0c7 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:10:46.870534 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-b0ec1ef8-7f80-4ae7-829e-53cbc203a1d1 tempest-VolumesExtendTest-1115404042 None] Created reservations ['44f7a62c-d3b8-46f9-be3e-2df945ae93c4', 'aa251f42-d602-4183-b56f-20bb94f9b728', 'b745e6a6-ab05-44dc-b71f-04d63e5fc32f', '29807448-617b-486c-a0a3-f3c3d336a0fa'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:10:46.940868 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-b0ec1ef8-7f80-4ae7-829e-53cbc203a1d1 tempest-VolumesExtendTest-1115404042 None] Delete snapshot completed successfully. Mar 12 21:10:46.946131 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-b0ec1ef8-7f80-4ae7-829e-53cbc203a1d1 tempest-VolumesExtendTest-1115404042 None] Lock "b'cinder-5c42ef15-ab1a-4ef1-a88e-b0113b0f87a6-delete_snapshot'" released by "delete_snapshot" :: held 1.402s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:10:47.144261 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8f93cb61-da17-4977-9d7e-692ccab71801 tempest-GroupsV314Test-109128574 None] volume is a clone so cleaning references {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Mar 12 21:10:47.173431 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8f93cb61-da17-4977-9d7e-692ccab71801 tempest-GroupsV314Test-109128574 None] Volume volume-d14ab944-4d54-4192-b6cc-3e81f7a146f8 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:10:47.174018 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8f93cb61-da17-4977-9d7e-692ccab71801 tempest-GroupsV314Test-109128574 None] deleting parent snapshot volume-396816d2-5e64-4ddb-b84a-f1577e9fb0c7.clone_snap {{(pid=129531) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Mar 12 21:10:47.738299 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-8f93cb61-da17-4977-9d7e-692ccab71801 tempest-GroupsV314Test-109128574 None] Created reservations ['41142011-069b-44a8-9d84-63361c131650'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:10:47.770338 ncdv-master-1 cinder-volume[129531]: WARNING cinder.quota [None req-8f93cb61-da17-4977-9d7e-692ccab71801 tempest-GroupsV314Test-109128574 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-112870111 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-112870111, it is now deprecated. Please use the default quota class for default quota. Mar 12 21:10:47.773143 ncdv-master-1 cinder-volume[129531]: WARNING cinder.quota [None req-8f93cb61-da17-4977-9d7e-692ccab71801 tempest-GroupsV314Test-109128574 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-112870111 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-112870111, it is now deprecated. Please use the default quota class for default quota. Mar 12 21:10:47.808114 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-8f93cb61-da17-4977-9d7e-692ccab71801 tempest-GroupsV314Test-109128574 None] Created reservations ['86bf9c08-8b7e-4bee-b5f9-213cfabf5242', '2447570d-99cd-4615-9cdb-8d11bb466f09', '5fd8f118-5c2f-4398-bd68-0218cde34bd2', 'fc2b4b82-b2df-4ae4-87c9-07b84a4f544c'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:10:48.039043 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8f93cb61-da17-4977-9d7e-692ccab71801 tempest-GroupsV314Test-109128574 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:10:48.168000 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8f93cb61-da17-4977-9d7e-692ccab71801 tempest-GroupsV314Test-109128574 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:10:48.244973 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-8f93cb61-da17-4977-9d7e-692ccab71801 tempest-GroupsV314Test-109128574 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:10:48.265498 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-8f93cb61-da17-4977-9d7e-692ccab71801 tempest-GroupsV314Test-109128574 None] Delete group completed successfully. Mar 12 21:10:48.293719 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-8da43012-553a-4e5d-951d-609f677250eb tempest-VolumesExtendTest-1115404042 None] Lock "b'cinder-2431a59d-3ef3-4801-8fcd-e3910f88a4ea-delete_volume'" acquired by "delete_volume" :: waited 0.040s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:10:48.421509 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8da43012-553a-4e5d-951d-609f677250eb tempest-VolumesExtendTest-1115404042 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:10:48.502499 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8da43012-553a-4e5d-951d-609f677250eb tempest-VolumesExtendTest-1115404042 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:10:48.503115 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8da43012-553a-4e5d-951d-609f677250eb tempest-VolumesExtendTest-1115404042 None] Volume volume-2431a59d-3ef3-4801-8fcd-e3910f88a4ea is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:10:48.515010 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8da43012-553a-4e5d-951d-609f677250eb tempest-VolumesExtendTest-1115404042 None] deleting rbd volume volume-2431a59d-3ef3-4801-8fcd-e3910f88a4ea {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:10:48.923983 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-8da43012-553a-4e5d-951d-609f677250eb tempest-VolumesExtendTest-1115404042 None] Created reservations ['14f3425a-6c16-4658-953d-563eda1c7ba8', '43d2ffda-cc86-43ac-8e26-c898165e3b14', 'b3c5c271-a7e4-421e-8053-8d59e3bab91e', '675fe0de-ffd7-4634-ab78-595a476e1721'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:10:48.980018 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8da43012-553a-4e5d-951d-609f677250eb tempest-VolumesExtendTest-1115404042 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:10:49.042955 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8da43012-553a-4e5d-951d-609f677250eb tempest-VolumesExtendTest-1115404042 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:10:49.093095 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-8da43012-553a-4e5d-951d-609f677250eb tempest-VolumesExtendTest-1115404042 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:10:49.118357 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-8da43012-553a-4e5d-951d-609f677250eb tempest-VolumesExtendTest-1115404042 None] Deleted volume successfully. Mar 12 21:10:49.136745 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-8da43012-553a-4e5d-951d-609f677250eb tempest-VolumesExtendTest-1115404042 None] Lock "b'cinder-2431a59d-3ef3-4801-8fcd-e3910f88a4ea-delete_volume'" released by "delete_volume" :: held 0.845s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:10:49.312778 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-f0be71de-abe1-4399-956d-18f9cd8ae9b7 tempest-VolumesExtendTest-1115404042 None] Lock "b'cinder-643c2eaf-0fab-4895-a19a-37e5a1f4dd70-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:10:49.411169 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f0be71de-abe1-4399-956d-18f9cd8ae9b7 tempest-VolumesExtendTest-1115404042 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:10:49.538654 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f0be71de-abe1-4399-956d-18f9cd8ae9b7 tempest-VolumesExtendTest-1115404042 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:10:49.557468 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f0be71de-abe1-4399-956d-18f9cd8ae9b7 tempest-VolumesExtendTest-1115404042 None] deleting rbd volume volume-643c2eaf-0fab-4895-a19a-37e5a1f4dd70 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:10:49.791602 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-32c7c103-64a6-459c-a34a-75749edb5f86 tempest-GroupsV314Test-109128574 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:10:49.904052 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-32c7c103-64a6-459c-a34a-75749edb5f86 tempest-GroupsV314Test-109128574 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:10:49.904548 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-32c7c103-64a6-459c-a34a-75749edb5f86 tempest-GroupsV314Test-109128574 None] Volume volume-d14ab944-4d54-4192-b6cc-3e81f7a146f8 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:10:49.922945 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-32c7c103-64a6-459c-a34a-75749edb5f86 tempest-GroupsV314Test-109128574 None] deleting rbd volume volume-d14ab944-4d54-4192-b6cc-3e81f7a146f8 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:10:50.087272 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f0be71de-abe1-4399-956d-18f9cd8ae9b7 tempest-VolumesExtendTest-1115404042 None] volume is a clone so cleaning references {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Mar 12 21:10:50.160969 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f0be71de-abe1-4399-956d-18f9cd8ae9b7 tempest-VolumesExtendTest-1115404042 None] deleting parent snapshot volume-643c2eaf-0fab-4895-a19a-37e5a1f4dd70.clone_snap {{(pid=129531) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Mar 12 21:10:50.764936 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-f0be71de-abe1-4399-956d-18f9cd8ae9b7 tempest-VolumesExtendTest-1115404042 None] Created reservations ['9b3767c4-b280-4d13-b5a7-f7a3422ccf86', 'ce301fc6-f766-4ff0-a638-f18c14e9bb8a', 'f9b72b6e-1ebe-4fc3-89bb-78918562d56f', 'a35f2daa-448b-4b66-9591-326e2488142c'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:10:50.799612 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-32c7c103-64a6-459c-a34a-75749edb5f86 tempest-GroupsV314Test-109128574 None] Created reservations ['a75a6e65-fc6e-4030-9015-5618d0c05583'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:10:50.848463 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f0be71de-abe1-4399-956d-18f9cd8ae9b7 tempest-VolumesExtendTest-1115404042 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:10:50.895683 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f0be71de-abe1-4399-956d-18f9cd8ae9b7 tempest-VolumesExtendTest-1115404042 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:10:50.994109 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-f0be71de-abe1-4399-956d-18f9cd8ae9b7 tempest-VolumesExtendTest-1115404042 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:10:51.008068 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-f0be71de-abe1-4399-956d-18f9cd8ae9b7 tempest-VolumesExtendTest-1115404042 None] Deleted volume successfully. Mar 12 21:10:51.019086 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-32c7c103-64a6-459c-a34a-75749edb5f86 tempest-GroupsV314Test-109128574 None] Created reservations ['c8011535-b2c2-4160-9673-b18ea245982f', 'ce7025db-c13b-4505-82d0-4a38580ada32', 'ff1b251d-a25e-48ce-b656-d923c5bbccf1', '8c8a77dc-1a39-4807-8ebb-b91d3da6093c'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:10:51.047529 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-f0be71de-abe1-4399-956d-18f9cd8ae9b7 tempest-VolumesExtendTest-1115404042 None] Lock "b'cinder-643c2eaf-0fab-4895-a19a-37e5a1f4dd70-delete_volume'" released by "delete_volume" :: held 1.736s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:10:51.149161 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-32c7c103-64a6-459c-a34a-75749edb5f86 tempest-GroupsV314Test-109128574 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:10:51.247937 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-32c7c103-64a6-459c-a34a-75749edb5f86 tempest-GroupsV314Test-109128574 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:10:51.309650 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-32c7c103-64a6-459c-a34a-75749edb5f86 tempest-GroupsV314Test-109128574 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:10:51.311740 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:10:51.312555 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:10:51.373116 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:10:51.452269 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:10:51.456990 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-32c7c103-64a6-459c-a34a-75749edb5f86 tempest-GroupsV314Test-109128574 None] Delete group completed successfully. Mar 12 21:10:54.129696 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-2584fbe1-2bf1-428c-9e2d-f899e25943b9 req-88757512-7f5e-4e11-92df-ef7e357d782e tempest-TaggedBootDevicesTest-378912436 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 21:10:54.991480 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-2584fbe1-2bf1-428c-9e2d-f899e25943b9 req-88757512-7f5e-4e11-92df-ef7e357d782e tempest-TaggedBootDevicesTest-378912436 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.861s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 21:10:54.992559 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-2584fbe1-2bf1-428c-9e2d-f899e25943b9 req-88757512-7f5e-4e11-92df-ef7e357d782e tempest-TaggedBootDevicesTest-378912436 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-33b5d761-3965-4dcf-89b4-d41fc8e26fd9', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': '33b5d761-3965-4dcf-89b4-d41fc8e26fd9', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 21:10:55.029292 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-2584fbe1-2bf1-428c-9e2d-f899e25943b9 req-88757512-7f5e-4e11-92df-ef7e357d782e tempest-TaggedBootDevicesTest-378912436 None] Connection info returned from driver {'name': 'volumes/volume-33b5d761-3965-4dcf-89b4-d41fc8e26fd9', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '33b5d761-3965-4dcf-89b4-d41fc8e26fd9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '1ba1b5ce-c3a1-486b-af1c-52cf0b40a72f'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 21:10:55.124673 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-2584fbe1-2bf1-428c-9e2d-f899e25943b9 req-88757512-7f5e-4e11-92df-ef7e357d782e tempest-TaggedBootDevicesTest-378912436 None] attachment_update completed successfully. Mar 12 21:10:55.533595 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-2584fbe1-2bf1-428c-9e2d-f899e25943b9 req-b50f8280-0d52-406c-90aa-d82c3f4efa95 tempest-TaggedBootDevicesTest-378912436 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 21:10:56.393330 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-2584fbe1-2bf1-428c-9e2d-f899e25943b9 req-b50f8280-0d52-406c-90aa-d82c3f4efa95 tempest-TaggedBootDevicesTest-378912436 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.859s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 21:10:56.394631 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-2584fbe1-2bf1-428c-9e2d-f899e25943b9 req-b50f8280-0d52-406c-90aa-d82c3f4efa95 tempest-TaggedBootDevicesTest-378912436 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-519a2fed-2ed7-49b2-973b-b1a48e2e8095', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': '519a2fed-2ed7-49b2-973b-b1a48e2e8095', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 21:10:56.441812 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-2584fbe1-2bf1-428c-9e2d-f899e25943b9 req-b50f8280-0d52-406c-90aa-d82c3f4efa95 tempest-TaggedBootDevicesTest-378912436 None] Connection info returned from driver {'name': 'volumes/volume-519a2fed-2ed7-49b2-973b-b1a48e2e8095', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '519a2fed-2ed7-49b2-973b-b1a48e2e8095', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '62351a8c-ebe2-4a05-9248-c856edce518a'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 21:10:56.500923 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-2584fbe1-2bf1-428c-9e2d-f899e25943b9 req-b50f8280-0d52-406c-90aa-d82c3f4efa95 tempest-TaggedBootDevicesTest-378912436 None] attachment_update completed successfully. Mar 12 21:10:56.859769 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-2584fbe1-2bf1-428c-9e2d-f899e25943b9 req-134862a8-e492-496d-8ad2-b7e111c587a8 tempest-TaggedBootDevicesTest-378912436 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 21:10:57.998644 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-2584fbe1-2bf1-428c-9e2d-f899e25943b9 req-134862a8-e492-496d-8ad2-b7e111c587a8 tempest-TaggedBootDevicesTest-378912436 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.138s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 21:10:58.004798 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-2584fbe1-2bf1-428c-9e2d-f899e25943b9 req-134862a8-e492-496d-8ad2-b7e111c587a8 tempest-TaggedBootDevicesTest-378912436 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-97dcd19d-c778-4d5a-ac7e-e6f2d767dbf4', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': '97dcd19d-c778-4d5a-ac7e-e6f2d767dbf4', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 21:10:58.054347 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-2584fbe1-2bf1-428c-9e2d-f899e25943b9 req-134862a8-e492-496d-8ad2-b7e111c587a8 tempest-TaggedBootDevicesTest-378912436 None] Connection info returned from driver {'name': 'volumes/volume-97dcd19d-c778-4d5a-ac7e-e6f2d767dbf4', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '97dcd19d-c778-4d5a-ac7e-e6f2d767dbf4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '545195ff-a909-442b-b99c-c131b7631e7d'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 21:10:58.191008 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-2584fbe1-2bf1-428c-9e2d-f899e25943b9 req-134862a8-e492-496d-8ad2-b7e111c587a8 tempest-TaggedBootDevicesTest-378912436 None] attachment_update completed successfully. Mar 12 21:10:58.582756 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4fa4f5f-6924-4c21-9dc0-c58dff5c03b6 tempest-VolumesSnapshotTestJSON-1127165440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:10:58.595250 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-f4fa4f5f-6924-4c21-9dc0-c58dff5c03b6 tempest-VolumesSnapshotTestJSON-1127165440 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:10:58.596084 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-f4fa4f5f-6924-4c21-9dc0-c58dff5c03b6 tempest-VolumesSnapshotTestJSON-1127165440 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:10:58.654668 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f4fa4f5f-6924-4c21-9dc0-c58dff5c03b6 tempest-VolumesSnapshotTestJSON-1127165440 None] Flow 'volume_create_manager' (70f5421d-a8f8-40fa-a0cf-7cbdd2fc6652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:10:58.677860 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f4fa4f5f-6924-4c21-9dc0-c58dff5c03b6 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4daa7585-1364-4a52-b2bd-7efd5024a6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:58.689925 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-f4fa4f5f-6924-4c21-9dc0-c58dff5c03b6 tempest-VolumesSnapshotTestJSON-1127165440 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:10:58.738725 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f4fa4f5f-6924-4c21-9dc0-c58dff5c03b6 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4daa7585-1364-4a52-b2bd-7efd5024a6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1052570929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7aa69d6a-de21-48b0-a279-c3e51e53b549,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d30a0195c6334b39a246a88b1f4cc81f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:10:59Z,use_quota=True,user_id='96d0c07fcae34c48b4c0ed61c4cec1c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:58.756933 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f4fa4f5f-6924-4c21-9dc0-c58dff5c03b6 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27d4d63f-4b41-48f2-b82b-b3230abea774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:58.771780 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f4fa4f5f-6924-4c21-9dc0-c58dff5c03b6 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27d4d63f-4b41-48f2-b82b-b3230abea774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:58.784075 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f4fa4f5f-6924-4c21-9dc0-c58dff5c03b6 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0723238-67ea-4e34-a8c2-f0d57555a2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:58.789260 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f4fa4f5f-6924-4c21-9dc0-c58dff5c03b6 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0723238-67ea-4e34-a8c2-f0d57555a2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7aa69d6a-de21-48b0-a279-c3e51e53b549', 'volume_name': 'volume-7aa69d6a-de21-48b0-a279-c3e51e53b549', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:58.795228 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f4fa4f5f-6924-4c21-9dc0-c58dff5c03b6 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1228f66-fce6-4b8a-9727-23ec050915f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:58.802710 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f4fa4f5f-6924-4c21-9dc0-c58dff5c03b6 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1228f66-fce6-4b8a-9727-23ec050915f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:58.810306 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f4fa4f5f-6924-4c21-9dc0-c58dff5c03b6 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47d30c99-a22a-4418-a4a6-2374109a89e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:58.811739 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-f4fa4f5f-6924-4c21-9dc0-c58dff5c03b6 tempest-VolumesSnapshotTestJSON-1127165440 None] Volume 7aa69d6a-de21-48b0-a279-c3e51e53b549: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7aa69d6a-de21-48b0-a279-c3e51e53b549', 'volume_size': 1} Mar 12 21:10:58.812379 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f4fa4f5f-6924-4c21-9dc0-c58dff5c03b6 tempest-VolumesSnapshotTestJSON-1127165440 None] creating volume 'volume-7aa69d6a-de21-48b0-a279-c3e51e53b549' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:10:58.814436 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f4fa4f5f-6924-4c21-9dc0-c58dff5c03b6 tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:10:58.960271 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f4fa4f5f-6924-4c21-9dc0-c58dff5c03b6 tempest-VolumesSnapshotTestJSON-1127165440 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:10:58.961178 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f4fa4f5f-6924-4c21-9dc0-c58dff5c03b6 tempest-VolumesSnapshotTestJSON-1127165440 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:10:58.966210 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f4fa4f5f-6924-4c21-9dc0-c58dff5c03b6 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47d30c99-a22a-4418-a4a6-2374109a89e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7aa69d6a-de21-48b0-a279-c3e51e53b549', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:58.977240 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f4fa4f5f-6924-4c21-9dc0-c58dff5c03b6 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c7a4f66-043b-4b49-8d81-d7cefe5bd521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:10:59.004018 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-f4fa4f5f-6924-4c21-9dc0-c58dff5c03b6 tempest-VolumesSnapshotTestJSON-1127165440 None] Volume volume-7aa69d6a-de21-48b0-a279-c3e51e53b549 (7aa69d6a-de21-48b0-a279-c3e51e53b549): created successfully Mar 12 21:10:59.014133 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f4fa4f5f-6924-4c21-9dc0-c58dff5c03b6 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c7a4f66-043b-4b49-8d81-d7cefe5bd521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:10:59.029675 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-f4fa4f5f-6924-4c21-9dc0-c58dff5c03b6 tempest-VolumesSnapshotTestJSON-1127165440 None] Flow 'volume_create_manager' (70f5421d-a8f8-40fa-a0cf-7cbdd2fc6652) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:10:59.050167 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-f4fa4f5f-6924-4c21-9dc0-c58dff5c03b6 tempest-VolumesSnapshotTestJSON-1127165440 None] Created volume successfully. Mar 12 21:10:59.871040 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-09342b03-0bd5-43d4-9568-ffc2fa514567 tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:00.414028 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-09342b03-0bd5-43d4-9568-ffc2fa514567 tempest-VolumesSnapshotTestJSON-1127165440 None] Create snapshot completed successfully Mar 12 21:11:01.293938 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.driver [None req-f676cf1e-f857-4a13-ba94-ace771b1ca5d tempest-VolumesSnapshotTestJSON-1127165440 None] Creating a new backup for volume volume-7aa69d6a-de21-48b0-a279-c3e51e53b549. {{(pid=129531) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1212}} Mar 12 21:11:01.355354 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f676cf1e-f857-4a13-ba94-ace771b1ca5d tempest-VolumesSnapshotTestJSON-1127165440 None] cloning volumes/volume-7aa69d6a-de21-48b0-a279-c3e51e53b549@snapshot-c2e42604-fc83-4591-a5a0-fc6e27633e22 to volume-aa8bfaab-68ad-47f3-bc65-a53db22c6bc4 {{(pid=129531) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1090}} Mar 12 21:11:01.356332 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f676cf1e-f857-4a13-ba94-ace771b1ca5d tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:01.443621 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f676cf1e-f857-4a13-ba94-ace771b1ca5d tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:01.661021 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f676cf1e-f857-4a13-ba94-ace771b1ca5d tempest-VolumesSnapshotTestJSON-1127165440 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:11:01.661536 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f676cf1e-f857-4a13-ba94-ace771b1ca5d tempest-VolumesSnapshotTestJSON-1127165440 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:11:01.670912 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f676cf1e-f857-4a13-ba94-ace771b1ca5d tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:01.770360 ncdv-master-1 cinder-volume[129531]: WARNING cinder.volume.drivers.rbd [None req-f676cf1e-f857-4a13-ba94-ace771b1ca5d tempest-VolumesSnapshotTestJSON-1127165440 None] Not using v2 clone API, please upgrade to mimic+ and set the OSD minimum client compat version to mimic for better performance, fewer deletion issues Mar 12 21:11:01.815940 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-f676cf1e-f857-4a13-ba94-ace771b1ca5d tempest-VolumesSnapshotTestJSON-1127165440 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-03-12T21:11:01Z,data_timestamp=2022-03-12T21:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Backup-1621937425',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=2f1b3292-256a-4bcd-82e8-5d941cc56f39,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='d30a0195c6334b39a246a88b1f4cc81f',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id='c2e42604-fc83-4591-a5a0-fc6e27633e22',status='creating',temp_snapshot_id=None,temp_volume_id='aa8bfaab-68ad-47f3-bc65-a53db22c6bc4',updated_at=None,user_id='96d0c07fcae34c48b4c0ed61c4cec1c2',volume_id=7aa69d6a-de21-48b0-a279-c3e51e53b549) Mar 12 21:11:01.816962 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.backup.rpcapi [None req-f676cf1e-f857-4a13-ba94-ace771b1ca5d tempest-VolumesSnapshotTestJSON-1127165440 None] continue_backup in rpcapi backup_id 2f1b3292-256a-4bcd-82e8-5d941cc56f39 {{(pid=129531) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Mar 12 21:11:02.071712 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [None req-f676cf1e-f857-4a13-ba94-ace771b1ca5d tempest-VolumesSnapshotTestJSON-1127165440 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 21:11:03.036413 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [None req-f676cf1e-f857-4a13-ba94-ace771b1ca5d tempest-VolumesSnapshotTestJSON-1127165440 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.964s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 21:11:03.037802 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f676cf1e-f857-4a13-ba94-ace771b1ca5d tempest-VolumesSnapshotTestJSON-1127165440 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-aa8bfaab-68ad-47f3-bc65-a53db22c6bc4', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': 'aa8bfaab-68ad-47f3-bc65-a53db22c6bc4', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 21:11:03.062042 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-f676cf1e-f857-4a13-ba94-ace771b1ca5d tempest-VolumesSnapshotTestJSON-1127165440 None] Initialize volume connection completed successfully. Mar 12 21:11:11.539737 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-797c93b6-1b29-47ad-8a1e-3f054a42dcfe tempest-VolumesTransfersTest-1340079509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:11:11.544316 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-797c93b6-1b29-47ad-8a1e-3f054a42dcfe tempest-VolumesTransfersTest-1340079509 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:11:11.545028 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-797c93b6-1b29-47ad-8a1e-3f054a42dcfe tempest-VolumesTransfersTest-1340079509 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:11:11.569322 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-797c93b6-1b29-47ad-8a1e-3f054a42dcfe tempest-VolumesTransfersTest-1340079509 None] Flow 'volume_create_manager' (6e47632b-fb08-482a-8b52-100b726b3963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:11:11.581351 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-797c93b6-1b29-47ad-8a1e-3f054a42dcfe tempest-VolumesTransfersTest-1340079509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9443acd1-9556-4326-afa9-153edf85ea20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:11.588302 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-797c93b6-1b29-47ad-8a1e-3f054a42dcfe tempest-VolumesTransfersTest-1340079509 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:11:11.606489 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-797c93b6-1b29-47ad-8a1e-3f054a42dcfe tempest-VolumesTransfersTest-1340079509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9443acd1-9556-4326-afa9-153edf85ea20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1756655495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=93eafb73-80ee-445f-93e2-ad1cb7540597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='688de693f53a4f93b07a61f4333b0476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:11:11Z,use_quota=True,user_id='dd7510a76c1b44e4ae1efa861069a577',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:11.614486 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-797c93b6-1b29-47ad-8a1e-3f054a42dcfe tempest-VolumesTransfersTest-1340079509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65b5d2fc-69f0-4aa9-b296-98c0cc7ba139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:11.620126 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-797c93b6-1b29-47ad-8a1e-3f054a42dcfe tempest-VolumesTransfersTest-1340079509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65b5d2fc-69f0-4aa9-b296-98c0cc7ba139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:11.627000 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-797c93b6-1b29-47ad-8a1e-3f054a42dcfe tempest-VolumesTransfersTest-1340079509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f0851d3-cbb4-4457-8d2b-5093fe284bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:11.631971 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-797c93b6-1b29-47ad-8a1e-3f054a42dcfe tempest-VolumesTransfersTest-1340079509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f0851d3-cbb4-4457-8d2b-5093fe284bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93eafb73-80ee-445f-93e2-ad1cb7540597', 'volume_name': 'volume-93eafb73-80ee-445f-93e2-ad1cb7540597', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:11.637611 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-797c93b6-1b29-47ad-8a1e-3f054a42dcfe tempest-VolumesTransfersTest-1340079509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e64beb-c7cd-4ba8-9c35-e767d7458b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:11.643682 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-797c93b6-1b29-47ad-8a1e-3f054a42dcfe tempest-VolumesTransfersTest-1340079509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e64beb-c7cd-4ba8-9c35-e767d7458b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:11.651200 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-797c93b6-1b29-47ad-8a1e-3f054a42dcfe tempest-VolumesTransfersTest-1340079509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fef8a60b-c6d4-43da-854a-b74a864e2644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:11.652887 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-797c93b6-1b29-47ad-8a1e-3f054a42dcfe tempest-VolumesTransfersTest-1340079509 None] Volume 93eafb73-80ee-445f-93e2-ad1cb7540597: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93eafb73-80ee-445f-93e2-ad1cb7540597', 'volume_size': 1} Mar 12 21:11:11.654076 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-797c93b6-1b29-47ad-8a1e-3f054a42dcfe tempest-VolumesTransfersTest-1340079509 None] creating volume 'volume-93eafb73-80ee-445f-93e2-ad1cb7540597' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:11:11.655494 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-797c93b6-1b29-47ad-8a1e-3f054a42dcfe tempest-VolumesTransfersTest-1340079509 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:11.783997 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-797c93b6-1b29-47ad-8a1e-3f054a42dcfe tempest-VolumesTransfersTest-1340079509 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:11:11.784366 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-797c93b6-1b29-47ad-8a1e-3f054a42dcfe tempest-VolumesTransfersTest-1340079509 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:11:11.789036 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-797c93b6-1b29-47ad-8a1e-3f054a42dcfe tempest-VolumesTransfersTest-1340079509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fef8a60b-c6d4-43da-854a-b74a864e2644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93eafb73-80ee-445f-93e2-ad1cb7540597', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:11.800229 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-797c93b6-1b29-47ad-8a1e-3f054a42dcfe tempest-VolumesTransfersTest-1340079509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f90c790-4a5e-40c7-be5c-6c8bde1f4888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:11.816576 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-797c93b6-1b29-47ad-8a1e-3f054a42dcfe tempest-VolumesTransfersTest-1340079509 None] Volume volume-93eafb73-80ee-445f-93e2-ad1cb7540597 (93eafb73-80ee-445f-93e2-ad1cb7540597): created successfully Mar 12 21:11:11.832880 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-797c93b6-1b29-47ad-8a1e-3f054a42dcfe tempest-VolumesTransfersTest-1340079509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f90c790-4a5e-40c7-be5c-6c8bde1f4888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:11.840940 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-797c93b6-1b29-47ad-8a1e-3f054a42dcfe tempest-VolumesTransfersTest-1340079509 None] Flow 'volume_create_manager' (6e47632b-fb08-482a-8b52-100b726b3963) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:11:11.872882 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-797c93b6-1b29-47ad-8a1e-3f054a42dcfe tempest-VolumesTransfersTest-1340079509 None] Created volume successfully. Mar 12 21:11:13.575760 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-fb75db20-b000-4104-a749-8da0ac55f63e tempest-VolumesTransfersTest-50007097 None] Transfer volume completed successfully. Mar 12 21:11:14.400020 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-12bb157f-d0ad-4768-ac70-d51d7dd7654d tempest-VolumesTransfersTest-1533521721 None] Lock "b'cinder-93eafb73-80ee-445f-93e2-ad1cb7540597-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:11:14.471200 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-12bb157f-d0ad-4768-ac70-d51d7dd7654d tempest-VolumesTransfersTest-1533521721 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:14.534712 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-12bb157f-d0ad-4768-ac70-d51d7dd7654d tempest-VolumesTransfersTest-1533521721 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:11:14.537004 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-12bb157f-d0ad-4768-ac70-d51d7dd7654d tempest-VolumesTransfersTest-1533521721 None] Volume volume-93eafb73-80ee-445f-93e2-ad1cb7540597 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:11:14.555018 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-12bb157f-d0ad-4768-ac70-d51d7dd7654d tempest-VolumesTransfersTest-1533521721 None] deleting rbd volume volume-93eafb73-80ee-445f-93e2-ad1cb7540597 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:11:15.560568 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-12bb157f-d0ad-4768-ac70-d51d7dd7654d tempest-VolumesTransfersTest-1533521721 None] Created reservations ['74d8aa7c-eb32-4729-823e-78528100b3c1', '8e68337e-a7ec-4c6e-b0fc-f9953bb9ac4c', 'd1101d52-628a-4adc-bc42-3e51ab40c2e5', '835590a0-7605-41b3-9497-9636889a6d39'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:11:15.638678 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-12bb157f-d0ad-4768-ac70-d51d7dd7654d tempest-VolumesTransfersTest-1533521721 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:15.671445 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-12bb157f-d0ad-4768-ac70-d51d7dd7654d tempest-VolumesTransfersTest-1533521721 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:15.763479 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-12bb157f-d0ad-4768-ac70-d51d7dd7654d tempest-VolumesTransfersTest-1533521721 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:11:15.773558 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-12bb157f-d0ad-4768-ac70-d51d7dd7654d tempest-VolumesTransfersTest-1533521721 None] Deleted volume successfully. Mar 12 21:11:15.805216 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-f676cf1e-f857-4a13-ba94-ace771b1ca5d tempest-VolumesSnapshotTestJSON-1127165440 None] Terminate volume connection completed successfully. Mar 12 21:11:15.814392 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-12bb157f-d0ad-4768-ac70-d51d7dd7654d tempest-VolumesTransfersTest-1533521721 None] Lock "b'cinder-93eafb73-80ee-445f-93e2-ad1cb7540597-delete_volume'" released by "delete_volume" :: held 1.414s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:11:15.824304 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-f676cf1e-f857-4a13-ba94-ace771b1ca5d tempest-VolumesSnapshotTestJSON-1127165440 None] Remove volume export completed successfully. Mar 12 21:11:15.864907 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-f676cf1e-f857-4a13-ba94-ace771b1ca5d tempest-VolumesSnapshotTestJSON-1127165440 None] Lock "b'cinder-aa8bfaab-68ad-47f3-bc65-a53db22c6bc4-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:11:15.877987 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f676cf1e-f857-4a13-ba94-ace771b1ca5d tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:15.936915 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f676cf1e-f857-4a13-ba94-ace771b1ca5d tempest-VolumesSnapshotTestJSON-1127165440 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:11:15.943509 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f676cf1e-f857-4a13-ba94-ace771b1ca5d tempest-VolumesSnapshotTestJSON-1127165440 None] deleting rbd volume volume-aa8bfaab-68ad-47f3-bc65-a53db22c6bc4 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:11:16.317653 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-f676cf1e-f857-4a13-ba94-ace771b1ca5d tempest-VolumesSnapshotTestJSON-1127165440 None] Deleted volume successfully. Mar 12 21:11:16.323274 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-f676cf1e-f857-4a13-ba94-ace771b1ca5d tempest-VolumesSnapshotTestJSON-1127165440 None] Lock "b'cinder-aa8bfaab-68ad-47f3-bc65-a53db22c6bc4-delete_volume'" released by "delete_volume" :: held 0.458s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:11:17.215693 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dcc6e56-3e29-4294-90dc-0d839adc8b9c tempest-VolumesTransfersTest-1340079509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:11:17.220481 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-3dcc6e56-3e29-4294-90dc-0d839adc8b9c tempest-VolumesTransfersTest-1340079509 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:11:17.220939 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-3dcc6e56-3e29-4294-90dc-0d839adc8b9c tempest-VolumesTransfersTest-1340079509 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:11:17.242367 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-3dcc6e56-3e29-4294-90dc-0d839adc8b9c tempest-VolumesTransfersTest-1340079509 None] Flow 'volume_create_manager' (0af09f79-eb09-4569-923f-23552769276e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:11:17.250412 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-3dcc6e56-3e29-4294-90dc-0d839adc8b9c tempest-VolumesTransfersTest-1340079509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a61301c4-7efb-4de4-9db9-01b5d5fcdcbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:17.258500 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-3dcc6e56-3e29-4294-90dc-0d839adc8b9c tempest-VolumesTransfersTest-1340079509 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:11:17.279092 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-3dcc6e56-3e29-4294-90dc-0d839adc8b9c tempest-VolumesTransfersTest-1340079509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a61301c4-7efb-4de4-9db9-01b5d5fcdcbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1933534028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9e5ba701-0ee7-4724-9c4d-9779780f48ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='688de693f53a4f93b07a61f4333b0476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:11:17Z,use_quota=True,user_id='dd7510a76c1b44e4ae1efa861069a577',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:17.286162 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-3dcc6e56-3e29-4294-90dc-0d839adc8b9c tempest-VolumesTransfersTest-1340079509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1bd8ea1-2ce7-4916-90a7-1dd3370b18f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:17.291490 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-3dcc6e56-3e29-4294-90dc-0d839adc8b9c tempest-VolumesTransfersTest-1340079509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1bd8ea1-2ce7-4916-90a7-1dd3370b18f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:17.302264 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-3dcc6e56-3e29-4294-90dc-0d839adc8b9c tempest-VolumesTransfersTest-1340079509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b481644-443c-4e56-87ea-a80949c6c28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:17.307281 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-3dcc6e56-3e29-4294-90dc-0d839adc8b9c tempest-VolumesTransfersTest-1340079509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b481644-443c-4e56-87ea-a80949c6c28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e5ba701-0ee7-4724-9c4d-9779780f48ff', 'volume_name': 'volume-9e5ba701-0ee7-4724-9c4d-9779780f48ff', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:17.312874 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-3dcc6e56-3e29-4294-90dc-0d839adc8b9c tempest-VolumesTransfersTest-1340079509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1930000-b1cc-4213-a26d-3b0e21bcc3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:17.317252 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-3dcc6e56-3e29-4294-90dc-0d839adc8b9c tempest-VolumesTransfersTest-1340079509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1930000-b1cc-4213-a26d-3b0e21bcc3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:17.323423 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-3dcc6e56-3e29-4294-90dc-0d839adc8b9c tempest-VolumesTransfersTest-1340079509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c89da85a-6079-4f71-829c-e37898054d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:17.323752 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-3dcc6e56-3e29-4294-90dc-0d839adc8b9c tempest-VolumesTransfersTest-1340079509 None] Volume 9e5ba701-0ee7-4724-9c4d-9779780f48ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e5ba701-0ee7-4724-9c4d-9779780f48ff', 'volume_size': 1} Mar 12 21:11:17.324149 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3dcc6e56-3e29-4294-90dc-0d839adc8b9c tempest-VolumesTransfersTest-1340079509 None] creating volume 'volume-9e5ba701-0ee7-4724-9c4d-9779780f48ff' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:11:17.325199 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3dcc6e56-3e29-4294-90dc-0d839adc8b9c tempest-VolumesTransfersTest-1340079509 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:17.466338 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3dcc6e56-3e29-4294-90dc-0d839adc8b9c tempest-VolumesTransfersTest-1340079509 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:11:17.467005 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3dcc6e56-3e29-4294-90dc-0d839adc8b9c tempest-VolumesTransfersTest-1340079509 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:11:17.473194 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-3dcc6e56-3e29-4294-90dc-0d839adc8b9c tempest-VolumesTransfersTest-1340079509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c89da85a-6079-4f71-829c-e37898054d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e5ba701-0ee7-4724-9c4d-9779780f48ff', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:17.480709 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-3dcc6e56-3e29-4294-90dc-0d839adc8b9c tempest-VolumesTransfersTest-1340079509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f69dfe-574a-4b3d-bda3-cfe263692fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:17.496898 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-3dcc6e56-3e29-4294-90dc-0d839adc8b9c tempest-VolumesTransfersTest-1340079509 None] Volume volume-9e5ba701-0ee7-4724-9c4d-9779780f48ff (9e5ba701-0ee7-4724-9c4d-9779780f48ff): created successfully Mar 12 21:11:17.510824 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-3dcc6e56-3e29-4294-90dc-0d839adc8b9c tempest-VolumesTransfersTest-1340079509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f69dfe-574a-4b3d-bda3-cfe263692fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:17.519938 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-3dcc6e56-3e29-4294-90dc-0d839adc8b9c tempest-VolumesTransfersTest-1340079509 None] Flow 'volume_create_manager' (0af09f79-eb09-4569-923f-23552769276e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:11:17.533558 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-3dcc6e56-3e29-4294-90dc-0d839adc8b9c tempest-VolumesTransfersTest-1340079509 None] Created volume successfully. Mar 12 21:11:18.554979 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-9dc5de49-9648-4c95-b417-ff5a8f19eef9 tempest-VolumesTransfersTest-1533521721 None] Lock "b'cinder-9e5ba701-0ee7-4724-9c4d-9779780f48ff-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:11:18.611007 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9dc5de49-9648-4c95-b417-ff5a8f19eef9 tempest-VolumesTransfersTest-1533521721 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:18.653629 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9dc5de49-9648-4c95-b417-ff5a8f19eef9 tempest-VolumesTransfersTest-1533521721 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:11:18.654100 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9dc5de49-9648-4c95-b417-ff5a8f19eef9 tempest-VolumesTransfersTest-1533521721 None] Volume volume-9e5ba701-0ee7-4724-9c4d-9779780f48ff is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:11:18.661927 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9dc5de49-9648-4c95-b417-ff5a8f19eef9 tempest-VolumesTransfersTest-1533521721 None] deleting rbd volume volume-9e5ba701-0ee7-4724-9c4d-9779780f48ff {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:11:19.037799 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-9dc5de49-9648-4c95-b417-ff5a8f19eef9 tempest-VolumesTransfersTest-1533521721 None] Created reservations ['ba3e528c-362b-4dcb-a3c4-e21782facace', 'cb7406a3-f80b-4c0f-9f3e-6023b253e41c', 'b4348df7-b6d1-4542-9d0b-6ea00cb9d3c8', 'dcdf33c0-e13e-4147-b95b-06a8e9ce5311'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:11:19.103092 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9dc5de49-9648-4c95-b417-ff5a8f19eef9 tempest-VolumesTransfersTest-1533521721 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:19.145903 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9dc5de49-9648-4c95-b417-ff5a8f19eef9 tempest-VolumesTransfersTest-1533521721 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:19.206228 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-9dc5de49-9648-4c95-b417-ff5a8f19eef9 tempest-VolumesTransfersTest-1533521721 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:11:19.210939 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-9dc5de49-9648-4c95-b417-ff5a8f19eef9 tempest-VolumesTransfersTest-1533521721 None] Deleted volume successfully. Mar 12 21:11:19.228631 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-9dc5de49-9648-4c95-b417-ff5a8f19eef9 tempest-VolumesTransfersTest-1533521721 None] Lock "b'cinder-9e5ba701-0ee7-4724-9c4d-9779780f48ff-delete_volume'" released by "delete_volume" :: held 0.674s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:11:24.151762 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-69cf112e-04de-4422-82ad-a769b4d5c3d0 tempest-VolumesSnapshotListTestJSON-1396861935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:11:24.156919 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-69cf112e-04de-4422-82ad-a769b4d5c3d0 tempest-VolumesSnapshotListTestJSON-1396861935 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:11:24.157508 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-69cf112e-04de-4422-82ad-a769b4d5c3d0 tempest-VolumesSnapshotListTestJSON-1396861935 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:11:24.178338 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-69cf112e-04de-4422-82ad-a769b4d5c3d0 tempest-VolumesSnapshotListTestJSON-1396861935 None] Flow 'volume_create_manager' (72cd05a2-4111-4192-847c-d793357d960e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:11:24.185301 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-69cf112e-04de-4422-82ad-a769b4d5c3d0 tempest-VolumesSnapshotListTestJSON-1396861935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (105b3ee5-a0ef-4ddc-b4b7-e4e6636b538e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:24.195144 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-69cf112e-04de-4422-82ad-a769b4d5c3d0 tempest-VolumesSnapshotListTestJSON-1396861935 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:11:24.209803 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-69cf112e-04de-4422-82ad-a769b4d5c3d0 tempest-VolumesSnapshotListTestJSON-1396861935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (105b3ee5-a0ef-4ddc-b4b7-e4e6636b538e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-15092375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3f1425e1-7a42-4386-820c-0e7579ff8255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='477991c886e04296bbf7aefcc0ce9f04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:11:24Z,use_quota=True,user_id='bd5cc4ae417943d1b75d15eb62cd4c51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:24.215231 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-69cf112e-04de-4422-82ad-a769b4d5c3d0 tempest-VolumesSnapshotListTestJSON-1396861935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bb02098-1fd6-4c08-b975-500193d7abcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:24.219425 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-69cf112e-04de-4422-82ad-a769b4d5c3d0 tempest-VolumesSnapshotListTestJSON-1396861935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bb02098-1fd6-4c08-b975-500193d7abcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:24.224868 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-69cf112e-04de-4422-82ad-a769b4d5c3d0 tempest-VolumesSnapshotListTestJSON-1396861935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb03d1f7-c7bf-46f3-ad59-ca1562187bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:24.229154 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-69cf112e-04de-4422-82ad-a769b4d5c3d0 tempest-VolumesSnapshotListTestJSON-1396861935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb03d1f7-c7bf-46f3-ad59-ca1562187bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f1425e1-7a42-4386-820c-0e7579ff8255', 'volume_name': 'volume-3f1425e1-7a42-4386-820c-0e7579ff8255', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:24.234141 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-69cf112e-04de-4422-82ad-a769b4d5c3d0 tempest-VolumesSnapshotListTestJSON-1396861935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (487e26fe-7be0-4e10-92cc-3b74afdad9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:24.238863 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-69cf112e-04de-4422-82ad-a769b4d5c3d0 tempest-VolumesSnapshotListTestJSON-1396861935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (487e26fe-7be0-4e10-92cc-3b74afdad9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:24.244518 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-69cf112e-04de-4422-82ad-a769b4d5c3d0 tempest-VolumesSnapshotListTestJSON-1396861935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b965d6c-f2b5-44d5-a794-3de6b10a342a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:24.245642 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-69cf112e-04de-4422-82ad-a769b4d5c3d0 tempest-VolumesSnapshotListTestJSON-1396861935 None] Volume 3f1425e1-7a42-4386-820c-0e7579ff8255: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f1425e1-7a42-4386-820c-0e7579ff8255', 'volume_size': 1} Mar 12 21:11:24.246053 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-69cf112e-04de-4422-82ad-a769b4d5c3d0 tempest-VolumesSnapshotListTestJSON-1396861935 None] creating volume 'volume-3f1425e1-7a42-4386-820c-0e7579ff8255' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:11:24.247046 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-69cf112e-04de-4422-82ad-a769b4d5c3d0 tempest-VolumesSnapshotListTestJSON-1396861935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:24.314021 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-69cf112e-04de-4422-82ad-a769b4d5c3d0 tempest-VolumesSnapshotListTestJSON-1396861935 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:11:24.314399 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-69cf112e-04de-4422-82ad-a769b4d5c3d0 tempest-VolumesSnapshotListTestJSON-1396861935 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:11:24.318145 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-69cf112e-04de-4422-82ad-a769b4d5c3d0 tempest-VolumesSnapshotListTestJSON-1396861935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b965d6c-f2b5-44d5-a794-3de6b10a342a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f1425e1-7a42-4386-820c-0e7579ff8255', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:24.322870 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-69cf112e-04de-4422-82ad-a769b4d5c3d0 tempest-VolumesSnapshotListTestJSON-1396861935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d948b39d-ced5-4adc-9f78-9cd9a4cd1326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:24.331716 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-69cf112e-04de-4422-82ad-a769b4d5c3d0 tempest-VolumesSnapshotListTestJSON-1396861935 None] Volume volume-3f1425e1-7a42-4386-820c-0e7579ff8255 (3f1425e1-7a42-4386-820c-0e7579ff8255): created successfully Mar 12 21:11:24.335753 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-69cf112e-04de-4422-82ad-a769b4d5c3d0 tempest-VolumesSnapshotListTestJSON-1396861935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d948b39d-ced5-4adc-9f78-9cd9a4cd1326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:24.341518 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-69cf112e-04de-4422-82ad-a769b4d5c3d0 tempest-VolumesSnapshotListTestJSON-1396861935 None] Flow 'volume_create_manager' (72cd05a2-4111-4192-847c-d793357d960e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:11:24.352642 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-69cf112e-04de-4422-82ad-a769b4d5c3d0 tempest-VolumesSnapshotListTestJSON-1396861935 None] Created volume successfully. Mar 12 21:11:25.387940 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c90f96b6-8a2e-42c4-89a0-811c12210d4f tempest-VolumesSnapshotListTestJSON-1396861935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:26.470256 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-c90f96b6-8a2e-42c4-89a0-811c12210d4f tempest-VolumesSnapshotListTestJSON-1396861935 None] Create snapshot completed successfully Mar 12 21:11:26.886176 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-fb49dedf-ff49-47c0-919c-0b02b811b651 tempest-GroupSnapshotsTest-2100980396 None] Group tempest-GroupSnapshotsTest-Group-98805604: creating Mar 12 21:11:26.902129 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-fb49dedf-ff49-47c0-919c-0b02b811b651 tempest-GroupSnapshotsTest-2100980396 None] Group tempest-GroupSnapshotsTest-Group-98805604: created successfully Mar 12 21:11:26.910676 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-fb49dedf-ff49-47c0-919c-0b02b811b651 tempest-GroupSnapshotsTest-2100980396 None] Create group completed successfully. Mar 12 21:11:27.624120 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-632d3cdc-0a71-4945-a567-d792f8407d81 tempest-VolumesSnapshotListTestJSON-1396861935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:28.291965 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-d364881a-5df6-4950-8db1-9c94999fa2ab tempest-GroupSnapshotsTest-2100980396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:11:28.295199 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-d364881a-5df6-4950-8db1-9c94999fa2ab tempest-GroupSnapshotsTest-2100980396 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:11:28.295661 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-d364881a-5df6-4950-8db1-9c94999fa2ab tempest-GroupSnapshotsTest-2100980396 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:11:28.316232 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d364881a-5df6-4950-8db1-9c94999fa2ab tempest-GroupSnapshotsTest-2100980396 None] Flow 'volume_create_manager' (9395f899-9936-4220-b100-de5462c8cc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:11:28.322805 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d364881a-5df6-4950-8db1-9c94999fa2ab tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (350e7d11-30e8-4631-945e-5e0562e98945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:28.329342 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-d364881a-5df6-4950-8db1-9c94999fa2ab tempest-GroupSnapshotsTest-2100980396 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:11:28.344260 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d364881a-5df6-4950-8db1-9c94999fa2ab tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (350e7d11-30e8-4631-945e-5e0562e98945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1737547868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aec48e8d-e49c-4728-8d5d-af1228fb058c,host='ncdv-master-1@ceph#ceph',id=715e5341-e219-4f24-af5c-a0f7232443df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b73eea3c4fa486c963755e203e3ac4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:11:28Z,use_quota=True,user_id='2d556e8989d141c599114fe0fc74717d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(498108f0-d3d6-4aa7-b353-13aa1dab5326),volume_type_id=498108f0-d3d6-4aa7-b353-13aa1dab5326)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:28.349724 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d364881a-5df6-4950-8db1-9c94999fa2ab tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12aea55d-45fe-4907-b32c-f537b7a41990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:28.353941 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d364881a-5df6-4950-8db1-9c94999fa2ab tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12aea55d-45fe-4907-b32c-f537b7a41990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:28.359122 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d364881a-5df6-4950-8db1-9c94999fa2ab tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85e2c264-a01a-4a8a-a588-4db0dc2ef017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:28.363980 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d364881a-5df6-4950-8db1-9c94999fa2ab tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85e2c264-a01a-4a8a-a588-4db0dc2ef017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '715e5341-e219-4f24-af5c-a0f7232443df', 'volume_name': 'volume-715e5341-e219-4f24-af5c-a0f7232443df', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:28.369002 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d364881a-5df6-4950-8db1-9c94999fa2ab tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d0cbce1-5681-449b-85c9-c5a92951dac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:28.372970 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d364881a-5df6-4950-8db1-9c94999fa2ab tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d0cbce1-5681-449b-85c9-c5a92951dac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:28.377760 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d364881a-5df6-4950-8db1-9c94999fa2ab tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7872bb1c-13f8-45cb-b5d3-2345358d735e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:28.378917 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-d364881a-5df6-4950-8db1-9c94999fa2ab tempest-GroupSnapshotsTest-2100980396 None] Volume 715e5341-e219-4f24-af5c-a0f7232443df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-715e5341-e219-4f24-af5c-a0f7232443df', 'volume_size': 1} Mar 12 21:11:28.379307 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d364881a-5df6-4950-8db1-9c94999fa2ab tempest-GroupSnapshotsTest-2100980396 None] creating volume 'volume-715e5341-e219-4f24-af5c-a0f7232443df' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:11:28.380292 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d364881a-5df6-4950-8db1-9c94999fa2ab tempest-GroupSnapshotsTest-2100980396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:28.438170 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d364881a-5df6-4950-8db1-9c94999fa2ab tempest-GroupSnapshotsTest-2100980396 None] extra_specs: {} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:11:28.438575 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d364881a-5df6-4950-8db1-9c94999fa2ab tempest-GroupSnapshotsTest-2100980396 None] extra_specs: {} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:11:28.442932 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d364881a-5df6-4950-8db1-9c94999fa2ab tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7872bb1c-13f8-45cb-b5d3-2345358d735e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-715e5341-e219-4f24-af5c-a0f7232443df', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:28.447826 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d364881a-5df6-4950-8db1-9c94999fa2ab tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d396fad-955a-4efb-9c57-4a94d8615bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:28.457236 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-d364881a-5df6-4950-8db1-9c94999fa2ab tempest-GroupSnapshotsTest-2100980396 None] Volume volume-715e5341-e219-4f24-af5c-a0f7232443df (715e5341-e219-4f24-af5c-a0f7232443df): created successfully Mar 12 21:11:28.460975 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d364881a-5df6-4950-8db1-9c94999fa2ab tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d396fad-955a-4efb-9c57-4a94d8615bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:28.466640 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d364881a-5df6-4950-8db1-9c94999fa2ab tempest-GroupSnapshotsTest-2100980396 None] Flow 'volume_create_manager' (9395f899-9936-4220-b100-de5462c8cc81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:11:28.478839 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-d364881a-5df6-4950-8db1-9c94999fa2ab tempest-GroupSnapshotsTest-2100980396 None] Created volume successfully. Mar 12 21:11:28.509050 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-632d3cdc-0a71-4945-a567-d792f8407d81 tempest-VolumesSnapshotListTestJSON-1396861935 None] Create snapshot completed successfully Mar 12 21:11:28.799461 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-86e06b9f-5ff0-41d9-9483-521154af42e1 tempest-VolumesSnapshotListTestJSON-1396861935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:29.516451 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-5cdc60b3-997e-46d6-80e9-6278db53a9f6 tempest-GroupSnapshotsTest-2100980396 None] GroupSnapshot 1bd40cc2-24be-4aa2-ba5e-30f33031def9: creating. Mar 12 21:11:29.538148 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5cdc60b3-997e-46d6-80e9-6278db53a9f6 tempest-GroupSnapshotsTest-2100980396 None] Group snapshot 1bd40cc2-24be-4aa2-ba5e-30f33031def9: creating. {{(pid=129531) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4076}} Mar 12 21:11:29.569938 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-5cdc60b3-997e-46d6-80e9-6278db53a9f6 tempest-GroupSnapshotsTest-2100980396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:29.637390 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-86e06b9f-5ff0-41d9-9483-521154af42e1 tempest-VolumesSnapshotListTestJSON-1396861935 None] Create snapshot completed successfully Mar 12 21:11:30.515320 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-4638340b-34f2-4803-ad04-714a3d5b08f9 tempest-VolumesSnapshotListTestJSON-1396861935 None] Lock "b'cinder-0e6f6097-57b1-46db-98ab-e29dd2928bde-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:11:30.517746 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-4638340b-34f2-4803-ad04-714a3d5b08f9 tempest-VolumesSnapshotListTestJSON-1396861935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:30.637232 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-5cdc60b3-997e-46d6-80e9-6278db53a9f6 tempest-GroupSnapshotsTest-2100980396 None] group_snapshot 1bd40cc2-24be-4aa2-ba5e-30f33031def9: created successfully Mar 12 21:11:31.614287 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-4638340b-34f2-4803-ad04-714a3d5b08f9 tempest-VolumesSnapshotListTestJSON-1396861935 None] Created reservations ['15166d86-5598-4b76-93ab-2c0caa2c7e4a', '5c70003e-1600-491d-a0a5-feb921ac472a', '2b6d1987-355a-4ad0-81d9-a70a35fce497', 'e51da541-8c51-4c07-a0e2-af591231ab50'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:11:31.665139 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-4638340b-34f2-4803-ad04-714a3d5b08f9 tempest-VolumesSnapshotListTestJSON-1396861935 None] Delete snapshot completed successfully. Mar 12 21:11:31.669636 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-4638340b-34f2-4803-ad04-714a3d5b08f9 tempest-VolumesSnapshotListTestJSON-1396861935 None] Lock "b'cinder-0e6f6097-57b1-46db-98ab-e29dd2928bde-delete_snapshot'" released by "delete_snapshot" :: held 1.154s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:11:32.165514 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d859a24c-525b-4f6d-83ff-92431cc28aff tempest-GroupSnapshotsTest-2100980396 None] cloning volumes/volume-715e5341-e219-4f24-af5c-a0f7232443df@snapshot-0cab8a4a-9616-4d8e-a3df-1a132a64c944 to volume-f0ae4467-afe3-4afe-8948-dc8da7a33d8a {{(pid=129531) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1090}} Mar 12 21:11:32.167971 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d859a24c-525b-4f6d-83ff-92431cc28aff tempest-GroupSnapshotsTest-2100980396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:32.231214 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d859a24c-525b-4f6d-83ff-92431cc28aff tempest-GroupSnapshotsTest-2100980396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:32.284227 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:11:32.290013 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:11:32.290013 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:11:32.309666 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] Flow 'volume_create_manager' (ba128227-d77c-445b-8d18-5403bb8f5e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:11:32.316227 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feea78de-573f-4ff4-a498-b4927eccaf3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:32.323637 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:11:32.341129 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feea78de-573f-4ff4-a498-b4927eccaf3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-863280795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fc07a109-25a4-455a-b16f-7887aa370147,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d30a0195c6334b39a246a88b1f4cc81f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:11:32Z,use_quota=True,user_id='96d0c07fcae34c48b4c0ed61c4cec1c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:32.347691 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (492e506c-808d-4850-a927-1c49fb28ba28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:32.351963 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (492e506c-808d-4850-a927-1c49fb28ba28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:32.357147 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b68e5c-56b8-4f8f-b3ac-959493351ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:32.369122 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d859a24c-525b-4f6d-83ff-92431cc28aff tempest-GroupSnapshotsTest-2100980396 None] extra_specs: {} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:11:32.369495 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d859a24c-525b-4f6d-83ff-92431cc28aff tempest-GroupSnapshotsTest-2100980396 None] extra_specs: {} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:11:32.429524 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-d859a24c-525b-4f6d-83ff-92431cc28aff tempest-GroupSnapshotsTest-2100980396 None] Create group from source-snapshot-1bd40cc2-24be-4aa2-ba5e-30f33031def9 completed successfully. Mar 12 21:11:32.452058 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b68e5c-56b8-4f8f-b3ac-959493351ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fc07a109-25a4-455a-b16f-7887aa370147', 'volume_name': 'volume-fc07a109-25a4-455a-b16f-7887aa370147', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:32.457947 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be267aee-25b3-4d69-8657-a841ade6709e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:32.461949 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be267aee-25b3-4d69-8657-a841ade6709e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:32.466769 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d362c89-99d0-4e6b-b0fc-3c7637471c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:32.467899 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] Volume fc07a109-25a4-455a-b16f-7887aa370147: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fc07a109-25a4-455a-b16f-7887aa370147', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 12 21:11:32.468455 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] Cloning fc07a109-25a4-455a-b16f-7887aa370147 from image 539171db-0bd3-4f16-95fd-a7cd5530137d at location (None, None). {{(pid=129531) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Mar 12 21:11:32.479103 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] Lock "b'cinder-539171db-0bd3-4f16-95fd-a7cd5530137d'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:11:32.488484 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] Found image-volume cache entry: {'id': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'volume_id': '8d802c7b-bd34-4836-bd5d-90755a167ddc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34), 'last_used': datetime.datetime(2022, 3, 12, 21, 11, 32, 483280)}. {{(pid=129531) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 12 21:11:32.489041 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] Image-volume cache entry image_update_at = 2022-03-12 20:39:34+00:00, requested image updated_at = 2022-03-12 20:39:34+00:00. {{(pid=129531) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 12 21:11:32.489570 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] Found cache entry for image = 539171db-0bd3-4f16-95fd-a7cd5530137d on host ncdv-master-1@ceph#ceph. {{(pid=129531) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Mar 12 21:11:32.494540 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] Lock "b'cinder-539171db-0bd3-4f16-95fd-a7cd5530137d'" released by "_prepare_image_cache_entry" :: held 0.015s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:11:32.495462 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] Attempting to retrieve cache entry for image = 539171db-0bd3-4f16-95fd-a7cd5530137d on host ncdv-master-1@ceph#ceph. {{(pid=129531) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Mar 12 21:11:32.501418 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] Found image-volume cache entry: {'id': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'volume_id': '8d802c7b-bd34-4836-bd5d-90755a167ddc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34), 'last_used': datetime.datetime(2022, 3, 12, 21, 11, 32, 498825)}. {{(pid=129531) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 12 21:11:32.503095 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] Image-volume cache entry image_update_at = 2022-03-12 20:39:34+00:00, requested image updated_at = 2022-03-12 20:39:34+00:00. {{(pid=129531) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 12 21:11:32.503619 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] Creating from source image-volume 8d802c7b-bd34-4836-bd5d-90755a167ddc {{(pid=129531) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Mar 12 21:11:32.517988 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:32.570801 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] creating snapshot='volume-fc07a109-25a4-455a-b16f-7887aa370147.clone_snap' {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Mar 12 21:11:33.550967 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] cloning 'volume-8d802c7b-bd34-4836-bd5d-90755a167ddc@volume-fc07a109-25a4-455a-b16f-7887aa370147.clone_snap' to 'volume-fc07a109-25a4-455a-b16f-7887aa370147' {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Mar 12 21:11:33.567874 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-3fe09d8c-9c0c-4d79-a18c-2619e725a978 tempest-VolumesSnapshotListTestJSON-1396861935 None] Lock "b'cinder-acb72e56-3da7-4d5e-aa73-d9ef5b0970e1-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:11:33.569382 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3fe09d8c-9c0c-4d79-a18c-2619e725a978 tempest-VolumesSnapshotListTestJSON-1396861935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:33.662864 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-05c349c7-ae3c-4688-a46e-15ef880755e0 tempest-GroupSnapshotsTest-2100980396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:33.722172 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-05c349c7-ae3c-4688-a46e-15ef880755e0 tempest-GroupSnapshotsTest-2100980396 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:11:33.727869 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-05c349c7-ae3c-4688-a46e-15ef880755e0 tempest-GroupSnapshotsTest-2100980396 None] deleting rbd volume volume-f0ae4467-afe3-4afe-8948-dc8da7a33d8a {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:11:33.773374 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] Volume volume-9916cd82-3d9b-466f-a769-cf81bdc743fd.deleted is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:11:33.782819 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:11:33.783196 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:11:33.822898 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] clone created successfully {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Mar 12 21:11:33.823528 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.volume_utils [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] Marking volume fc07a109-25a4-455a-b16f-7887aa370147 as bootable. {{(pid=129531) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 12 21:11:33.833095 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] Copying metadata from image 539171db-0bd3-4f16-95fd-a7cd5530137d to fc07a109-25a4-455a-b16f-7887aa370147. {{(pid=129531) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Mar 12 21:11:33.833853 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] Creating volume glance metadata for volume fc07a109-25a4-455a-b16f-7887aa370147 backed by image 539171db-0bd3-4f16-95fd-a7cd5530137d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129531) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Mar 12 21:11:33.886835 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d362c89-99d0-4e6b-b0fc-3c7637471c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc07a109-25a4-455a-b16f-7887aa370147', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:33.891770 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab9a19e9-9256-4154-ac7e-ec2771c6ac55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:33.901454 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] Volume volume-fc07a109-25a4-455a-b16f-7887aa370147 (fc07a109-25a4-455a-b16f-7887aa370147): created successfully Mar 12 21:11:33.905330 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab9a19e9-9256-4154-ac7e-ec2771c6ac55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:33.911620 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] Flow 'volume_create_manager' (ba128227-d77c-445b-8d18-5403bb8f5e94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:11:33.920295 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-83acf941-3243-441c-a337-f6bedeb73240 tempest-VolumesSnapshotTestJSON-1127165440 None] Created volume successfully. Mar 12 21:11:34.009283 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-05c349c7-ae3c-4688-a46e-15ef880755e0 tempest-GroupSnapshotsTest-2100980396 None] Created reservations ['a77e9adf-bf40-48a9-8fd6-93b18360d79b'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:11:34.026903 ncdv-master-1 cinder-volume[129531]: WARNING cinder.quota [None req-05c349c7-ae3c-4688-a46e-15ef880755e0 tempest-GroupSnapshotsTest-2100980396 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2013725119 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2013725119, it is now deprecated. Please use the default quota class for default quota. Mar 12 21:11:34.027762 ncdv-master-1 cinder-volume[129531]: WARNING cinder.quota [None req-05c349c7-ae3c-4688-a46e-15ef880755e0 tempest-GroupSnapshotsTest-2100980396 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2013725119 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2013725119, it is now deprecated. Please use the default quota class for default quota. Mar 12 21:11:34.041570 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-05c349c7-ae3c-4688-a46e-15ef880755e0 tempest-GroupSnapshotsTest-2100980396 None] Created reservations ['f640df30-05fa-4f0d-8a3b-25ae39a0db62', 'e4fa4555-a076-435f-987a-2ff0f6e4c5cd', '3f6a4e87-76f3-47f2-b081-18395f99a2c0', '15744efd-e91b-4b10-a86c-716e7513c4ec'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:11:34.124222 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-05c349c7-ae3c-4688-a46e-15ef880755e0 tempest-GroupSnapshotsTest-2100980396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:34.150526 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-05c349c7-ae3c-4688-a46e-15ef880755e0 tempest-GroupSnapshotsTest-2100980396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:34.175571 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-05c349c7-ae3c-4688-a46e-15ef880755e0 tempest-GroupSnapshotsTest-2100980396 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:11:34.179737 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-05c349c7-ae3c-4688-a46e-15ef880755e0 tempest-GroupSnapshotsTest-2100980396 None] Delete group completed successfully. Mar 12 21:11:34.622621 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-3fe09d8c-9c0c-4d79-a18c-2619e725a978 tempest-VolumesSnapshotListTestJSON-1396861935 None] Created reservations ['79f81d4d-a9fa-4d10-84f2-bfefc3ef7891', 'a0402bb3-6a31-4ddd-8032-78cd08f14bfb', '256e057b-6108-4878-b23a-49d1c83ec19f', 'cbc631fc-c348-4a53-9681-dadc683a879d'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:11:34.658022 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-3fe09d8c-9c0c-4d79-a18c-2619e725a978 tempest-VolumesSnapshotListTestJSON-1396861935 None] Delete snapshot completed successfully. Mar 12 21:11:34.662166 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-3fe09d8c-9c0c-4d79-a18c-2619e725a978 tempest-VolumesSnapshotListTestJSON-1396861935 None] Lock "b'cinder-acb72e56-3da7-4d5e-aa73-d9ef5b0970e1-delete_snapshot'" released by "delete_snapshot" :: held 1.094s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:11:34.699179 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-2d50a7ee-e570-4171-b1d7-d8a4ebad93fa req-6b897dbb-8016-45c4-83af-184053b69844 tempest-VolumesSnapshotTestJSON-1127165440 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 21:11:34.797571 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-c9d50fce-5a6a-4793-91bc-247db4ff55fc tempest-VolumesSnapshotListTestJSON-1396861935 None] Lock "b'cinder-741e9739-ec88-4d8f-95cf-de8e3b5a5ce6-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:11:34.800016 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c9d50fce-5a6a-4793-91bc-247db4ff55fc tempest-VolumesSnapshotListTestJSON-1396861935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:34.882169 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-9e65a3b7-4159-4c3f-acdd-d52c4ee8b68f tempest-GroupSnapshotsTest-2100980396 None] group_snapshot 1bd40cc2-24be-4aa2-ba5e-30f33031def9: deleting Mar 12 21:11:34.902056 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9e65a3b7-4159-4c3f-acdd-d52c4ee8b68f tempest-GroupSnapshotsTest-2100980396 None] group_snapshot 1bd40cc2-24be-4aa2-ba5e-30f33031def9: deleting {{(pid=129531) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4251}} Mar 12 21:11:34.925593 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9e65a3b7-4159-4c3f-acdd-d52c4ee8b68f tempest-GroupSnapshotsTest-2100980396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:35.390409 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-2d50a7ee-e570-4171-b1d7-d8a4ebad93fa req-6b897dbb-8016-45c4-83af-184053b69844 tempest-VolumesSnapshotTestJSON-1127165440 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.692s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 21:11:35.391053 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-2d50a7ee-e570-4171-b1d7-d8a4ebad93fa req-6b897dbb-8016-45c4-83af-184053b69844 tempest-VolumesSnapshotTestJSON-1127165440 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-fc07a109-25a4-455a-b16f-7887aa370147', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': 'fc07a109-25a4-455a-b16f-7887aa370147', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 21:11:35.410518 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-2d50a7ee-e570-4171-b1d7-d8a4ebad93fa req-6b897dbb-8016-45c4-83af-184053b69844 tempest-VolumesSnapshotTestJSON-1127165440 None] Connection info returned from driver {'name': 'volumes/volume-fc07a109-25a4-455a-b16f-7887aa370147', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'fc07a109-25a4-455a-b16f-7887aa370147', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e76e1dfa-8102-470e-bd41-2b380b3ef6bb'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 21:11:35.456690 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-2d50a7ee-e570-4171-b1d7-d8a4ebad93fa req-6b897dbb-8016-45c4-83af-184053b69844 tempest-VolumesSnapshotTestJSON-1127165440 None] attachment_update completed successfully. Mar 12 21:11:35.658094 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-c9d50fce-5a6a-4793-91bc-247db4ff55fc tempest-VolumesSnapshotListTestJSON-1396861935 None] Created reservations ['610e74af-38ee-4c31-9ee6-68564bd0f5ef', '1fafca18-7740-47d8-bf4c-d58293ad6dc0', '87fd3e73-4adc-48cd-a3a7-2d2ef86d5ee7', '0bdf8221-c9f8-4e17-9ff7-08f16d64897e'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:11:35.673310 ncdv-master-1 cinder-volume[129531]: WARNING cinder.quota [None req-9e65a3b7-4159-4c3f-acdd-d52c4ee8b68f tempest-GroupSnapshotsTest-2100980396 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2013725119 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2013725119, it is now deprecated. Please use the default quota class for default quota. Mar 12 21:11:35.694022 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-9e65a3b7-4159-4c3f-acdd-d52c4ee8b68f tempest-GroupSnapshotsTest-2100980396 None] Created reservations ['a6e129a5-d05b-4aec-983c-2fc17f0b0512', '541206c7-4058-4a01-9a7d-95bbe78d6714', '0aac629c-cf9f-4371-bf74-9de209f1bffb', '94647830-6167-4766-9b0d-424e21973cff'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:11:35.713922 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-c9d50fce-5a6a-4793-91bc-247db4ff55fc tempest-VolumesSnapshotListTestJSON-1396861935 None] Delete snapshot completed successfully. Mar 12 21:11:35.721271 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-c9d50fce-5a6a-4793-91bc-247db4ff55fc tempest-VolumesSnapshotListTestJSON-1396861935 None] Lock "b'cinder-741e9739-ec88-4d8f-95cf-de8e3b5a5ce6-delete_snapshot'" released by "delete_snapshot" :: held 0.924s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:11:35.742506 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-9e65a3b7-4159-4c3f-acdd-d52c4ee8b68f tempest-GroupSnapshotsTest-2100980396 None] group_snapshot 1bd40cc2-24be-4aa2-ba5e-30f33031def9: deleted successfully Mar 12 21:11:35.896967 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-914e0deb-bdc4-4533-ac51-b9470a6299fe tempest-VolumesSnapshotListTestJSON-1396861935 None] Lock "b'cinder-3f1425e1-7a42-4386-820c-0e7579ff8255-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:11:35.927806 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-914e0deb-bdc4-4533-ac51-b9470a6299fe tempest-VolumesSnapshotListTestJSON-1396861935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:35.965966 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-914e0deb-bdc4-4533-ac51-b9470a6299fe tempest-VolumesSnapshotListTestJSON-1396861935 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:11:35.966452 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-914e0deb-bdc4-4533-ac51-b9470a6299fe tempest-VolumesSnapshotListTestJSON-1396861935 None] Volume volume-3f1425e1-7a42-4386-820c-0e7579ff8255 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:11:35.973381 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-914e0deb-bdc4-4533-ac51-b9470a6299fe tempest-VolumesSnapshotListTestJSON-1396861935 None] deleting rbd volume volume-3f1425e1-7a42-4386-820c-0e7579ff8255 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:11:36.196360 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-914e0deb-bdc4-4533-ac51-b9470a6299fe tempest-VolumesSnapshotListTestJSON-1396861935 None] Created reservations ['738d8943-c2bd-4732-b0f8-fb97f9d440f2', 'a6fcfada-9066-4fa3-8530-fd9ecdb38040', '645d6635-a7e4-4a8c-b30f-8cfad6ade710', '8fb405d0-e754-4db3-be55-7cf7eb010fa9'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:11:36.242628 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-914e0deb-bdc4-4533-ac51-b9470a6299fe tempest-VolumesSnapshotListTestJSON-1396861935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:36.283472 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-914e0deb-bdc4-4533-ac51-b9470a6299fe tempest-VolumesSnapshotListTestJSON-1396861935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:36.323681 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-914e0deb-bdc4-4533-ac51-b9470a6299fe tempest-VolumesSnapshotListTestJSON-1396861935 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:11:36.338594 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-914e0deb-bdc4-4533-ac51-b9470a6299fe tempest-VolumesSnapshotListTestJSON-1396861935 None] Deleted volume successfully. Mar 12 21:11:36.361727 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d8025baa-445e-49f7-892c-59ddd4daafa4 tempest-GroupSnapshotsTest-2100980396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:36.400668 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d8025baa-445e-49f7-892c-59ddd4daafa4 tempest-GroupSnapshotsTest-2100980396 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:11:36.401106 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d8025baa-445e-49f7-892c-59ddd4daafa4 tempest-GroupSnapshotsTest-2100980396 None] Volume volume-715e5341-e219-4f24-af5c-a0f7232443df is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:11:36.409024 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d8025baa-445e-49f7-892c-59ddd4daafa4 tempest-GroupSnapshotsTest-2100980396 None] deleting rbd volume volume-715e5341-e219-4f24-af5c-a0f7232443df {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:11:36.413292 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-914e0deb-bdc4-4533-ac51-b9470a6299fe tempest-VolumesSnapshotListTestJSON-1396861935 None] Lock "b'cinder-3f1425e1-7a42-4386-820c-0e7579ff8255-delete_volume'" released by "delete_volume" :: held 0.516s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:11:36.628916 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-d8025baa-445e-49f7-892c-59ddd4daafa4 tempest-GroupSnapshotsTest-2100980396 None] Created reservations ['8110ed1f-a379-479f-8ee4-6eeb984da685'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:11:36.655046 ncdv-master-1 cinder-volume[129531]: WARNING cinder.db.sqlalchemy.api [None req-d8025baa-445e-49f7-892c-59ddd4daafa4 tempest-GroupSnapshotsTest-2100980396 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2013725119'] Mar 12 21:11:36.658766 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-d8025baa-445e-49f7-892c-59ddd4daafa4 tempest-GroupSnapshotsTest-2100980396 None] Created reservations ['a88c84d0-b6c0-4105-9256-847d55c116d2', '46606a3c-5236-43be-8832-2176511bdde0', 'c7f55e27-c5ad-4c72-afa8-5cba1a5321e4', 'a7d2a900-b4c2-46f6-b2f5-54268c7cfc8f'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:11:36.736962 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d8025baa-445e-49f7-892c-59ddd4daafa4 tempest-GroupSnapshotsTest-2100980396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:36.778412 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d8025baa-445e-49f7-892c-59ddd4daafa4 tempest-GroupSnapshotsTest-2100980396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:36.824518 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-d8025baa-445e-49f7-892c-59ddd4daafa4 tempest-GroupSnapshotsTest-2100980396 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:11:36.831089 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-d8025baa-445e-49f7-892c-59ddd4daafa4 tempest-GroupSnapshotsTest-2100980396 None] Delete group completed successfully. Mar 12 21:11:37.678242 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-f2d63e22-d49e-4606-b57c-9a60cb74ad22 tempest-GroupSnapshotsTest-2100980396 None] Group tempest-GroupSnapshotsTest-Group-1926405818: creating Mar 12 21:11:37.694868 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-f2d63e22-d49e-4606-b57c-9a60cb74ad22 tempest-GroupSnapshotsTest-2100980396 None] Group tempest-GroupSnapshotsTest-Group-1926405818: created successfully Mar 12 21:11:37.706838 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-f2d63e22-d49e-4606-b57c-9a60cb74ad22 tempest-GroupSnapshotsTest-2100980396 None] Create group completed successfully. Mar 12 21:11:38.047244 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-6b0b212a-7a99-4636-aa33-4ddcaeab94c7 tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:39.015730 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb359563-ee2e-47ec-9da9-d32941ff9628 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:11:39.027164 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-cb359563-ee2e-47ec-9da9-d32941ff9628 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:11:39.027627 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-cb359563-ee2e-47ec-9da9-d32941ff9628 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:11:39.066597 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-cb359563-ee2e-47ec-9da9-d32941ff9628 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] Flow 'volume_create_manager' (3c36fff0-62d9-4c5f-a27f-5ba7c51b2fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:11:39.078312 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-cb359563-ee2e-47ec-9da9-d32941ff9628 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac083d09-2a01-41ff-b902-fc9c679a7f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:39.103224 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-cb359563-ee2e-47ec-9da9-d32941ff9628 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:11:39.129343 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-cb359563-ee2e-47ec-9da9-d32941ff9628 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac083d09-2a01-41ff-b902-fc9c679a7f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-124696197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=77c8e867-cab0-423f-8c7a-2487eab8e247,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f61a126f9f0427eac473e6423526fc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:11:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:11:39Z,use_quota=True,user_id='4675b8462d5e4050abddb8ff1fa3cde3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:39.134917 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-cb359563-ee2e-47ec-9da9-d32941ff9628 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f6bdda9-11c7-4bc8-aa7f-8f16950555ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:39.139480 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-cb359563-ee2e-47ec-9da9-d32941ff9628 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f6bdda9-11c7-4bc8-aa7f-8f16950555ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:39.145327 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-cb359563-ee2e-47ec-9da9-d32941ff9628 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a04a9918-0e35-447a-b8ab-1b53f81744cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:39.150479 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-cb359563-ee2e-47ec-9da9-d32941ff9628 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a04a9918-0e35-447a-b8ab-1b53f81744cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77c8e867-cab0-423f-8c7a-2487eab8e247', 'volume_name': 'volume-77c8e867-cab0-423f-8c7a-2487eab8e247', 'volume_size': 2}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:39.156333 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-cb359563-ee2e-47ec-9da9-d32941ff9628 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6acc837a-f77b-4452-87e7-e5d823f4148a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:39.161408 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-cb359563-ee2e-47ec-9da9-d32941ff9628 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6acc837a-f77b-4452-87e7-e5d823f4148a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:39.166351 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-cb359563-ee2e-47ec-9da9-d32941ff9628 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c704ae67-d6e7-405d-9383-4dad1ec4ff33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:39.168100 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-cb359563-ee2e-47ec-9da9-d32941ff9628 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] Volume 77c8e867-cab0-423f-8c7a-2487eab8e247: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77c8e867-cab0-423f-8c7a-2487eab8e247', 'volume_size': 2} Mar 12 21:11:39.168100 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-cb359563-ee2e-47ec-9da9-d32941ff9628 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] creating volume 'volume-77c8e867-cab0-423f-8c7a-2487eab8e247' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:11:39.169034 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-cb359563-ee2e-47ec-9da9-d32941ff9628 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:39.236160 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-cb359563-ee2e-47ec-9da9-d32941ff9628 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:11:39.236540 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-cb359563-ee2e-47ec-9da9-d32941ff9628 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:11:39.240336 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-cb359563-ee2e-47ec-9da9-d32941ff9628 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c704ae67-d6e7-405d-9383-4dad1ec4ff33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77c8e867-cab0-423f-8c7a-2487eab8e247', 'volume_size': 2}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:39.245266 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-cb359563-ee2e-47ec-9da9-d32941ff9628 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ea560ca-5891-46a1-8277-20af76e8cb3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:39.250614 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-983721d1-1039-4846-b97e-d63c869b9ba6 tempest-GroupSnapshotsTest-2100980396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:11:39.253679 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-983721d1-1039-4846-b97e-d63c869b9ba6 tempest-GroupSnapshotsTest-2100980396 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:11:39.254163 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-983721d1-1039-4846-b97e-d63c869b9ba6 tempest-GroupSnapshotsTest-2100980396 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:11:39.273853 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-983721d1-1039-4846-b97e-d63c869b9ba6 tempest-GroupSnapshotsTest-2100980396 None] Flow 'volume_create_manager' (78ead384-3db4-4fec-8190-bb12c593a708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:11:39.280498 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-983721d1-1039-4846-b97e-d63c869b9ba6 tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76d34416-449d-4ecb-bd22-c2bd0155b0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:39.291175 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-983721d1-1039-4846-b97e-d63c869b9ba6 tempest-GroupSnapshotsTest-2100980396 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:11:39.302926 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-cb359563-ee2e-47ec-9da9-d32941ff9628 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] Volume volume-77c8e867-cab0-423f-8c7a-2487eab8e247 (77c8e867-cab0-423f-8c7a-2487eab8e247): created successfully Mar 12 21:11:39.307008 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-cb359563-ee2e-47ec-9da9-d32941ff9628 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ea560ca-5891-46a1-8277-20af76e8cb3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:39.313021 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-cb359563-ee2e-47ec-9da9-d32941ff9628 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] Flow 'volume_create_manager' (3c36fff0-62d9-4c5f-a27f-5ba7c51b2fef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:11:39.323444 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-983721d1-1039-4846-b97e-d63c869b9ba6 tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76d34416-449d-4ecb-bd22-c2bd0155b0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1209948086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c1d86219-cd3c-4779-92d1-8453f55d51c3,host='ncdv-master-1@ceph#ceph',id=e2295eb8-e6dc-4025-bd78-bd9c4b765512,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b73eea3c4fa486c963755e203e3ac4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:11:39Z,use_quota=True,user_id='2d556e8989d141c599114fe0fc74717d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(195cc5a6-39be-4c10-9072-aeb85cadf082),volume_type_id=195cc5a6-39be-4c10-9072-aeb85cadf082)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:39.329474 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-983721d1-1039-4846-b97e-d63c869b9ba6 tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b95839-bbf6-4120-9d4a-f6305bb7da30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:39.333637 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-983721d1-1039-4846-b97e-d63c869b9ba6 tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b95839-bbf6-4120-9d4a-f6305bb7da30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:39.338776 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-983721d1-1039-4846-b97e-d63c869b9ba6 tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fffa566-0ece-40ab-a539-04e762b0f6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:39.344220 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-983721d1-1039-4846-b97e-d63c869b9ba6 tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fffa566-0ece-40ab-a539-04e762b0f6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2295eb8-e6dc-4025-bd78-bd9c4b765512', 'volume_name': 'volume-e2295eb8-e6dc-4025-bd78-bd9c4b765512', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:39.349211 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-983721d1-1039-4846-b97e-d63c869b9ba6 tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06840771-c8da-4e16-817c-94cad4f5ba69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:39.353131 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-983721d1-1039-4846-b97e-d63c869b9ba6 tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06840771-c8da-4e16-817c-94cad4f5ba69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:39.357870 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-983721d1-1039-4846-b97e-d63c869b9ba6 tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b0a8d8-36cb-4297-94b3-a7608aa6c31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:39.359021 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-983721d1-1039-4846-b97e-d63c869b9ba6 tempest-GroupSnapshotsTest-2100980396 None] Volume e2295eb8-e6dc-4025-bd78-bd9c4b765512: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2295eb8-e6dc-4025-bd78-bd9c4b765512', 'volume_size': 1} Mar 12 21:11:39.359408 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-983721d1-1039-4846-b97e-d63c869b9ba6 tempest-GroupSnapshotsTest-2100980396 None] creating volume 'volume-e2295eb8-e6dc-4025-bd78-bd9c4b765512' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:11:39.360405 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-983721d1-1039-4846-b97e-d63c869b9ba6 tempest-GroupSnapshotsTest-2100980396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:39.403830 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-cb359563-ee2e-47ec-9da9-d32941ff9628 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] Created volume successfully. Mar 12 21:11:39.425431 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-983721d1-1039-4846-b97e-d63c869b9ba6 tempest-GroupSnapshotsTest-2100980396 None] extra_specs: {} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:11:39.425846 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-983721d1-1039-4846-b97e-d63c869b9ba6 tempest-GroupSnapshotsTest-2100980396 None] extra_specs: {} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:11:39.430459 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-983721d1-1039-4846-b97e-d63c869b9ba6 tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b0a8d8-36cb-4297-94b3-a7608aa6c31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2295eb8-e6dc-4025-bd78-bd9c4b765512', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:39.435328 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-983721d1-1039-4846-b97e-d63c869b9ba6 tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21bfb43b-e73a-4e04-8d80-b7c9904cf178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:39.440652 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-6b0b212a-7a99-4636-aa33-4ddcaeab94c7 tempest-VolumesSnapshotTestJSON-1127165440 None] Create snapshot completed successfully Mar 12 21:11:39.446673 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-983721d1-1039-4846-b97e-d63c869b9ba6 tempest-GroupSnapshotsTest-2100980396 None] Volume volume-e2295eb8-e6dc-4025-bd78-bd9c4b765512 (e2295eb8-e6dc-4025-bd78-bd9c4b765512): created successfully Mar 12 21:11:39.450683 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-983721d1-1039-4846-b97e-d63c869b9ba6 tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21bfb43b-e73a-4e04-8d80-b7c9904cf178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:39.456731 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-983721d1-1039-4846-b97e-d63c869b9ba6 tempest-GroupSnapshotsTest-2100980396 None] Flow 'volume_create_manager' (78ead384-3db4-4fec-8190-bb12c593a708) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:11:39.466289 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-983721d1-1039-4846-b97e-d63c869b9ba6 tempest-GroupSnapshotsTest-2100980396 None] Created volume successfully. Mar 12 21:11:40.186763 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-04c48a84-9dd9-4dfb-b21c-74bf44cd53c1 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:40.304963 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-721dd699-98b2-4497-9a88-92b3459c0c02 tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:40.581124 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-26c29d24-5cff-4095-a4f3-a4be83eb0160 tempest-GroupSnapshotsTest-2100980396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:11:40.584592 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-26c29d24-5cff-4095-a4f3-a4be83eb0160 tempest-GroupSnapshotsTest-2100980396 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:11:40.585029 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-26c29d24-5cff-4095-a4f3-a4be83eb0160 tempest-GroupSnapshotsTest-2100980396 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:11:40.603814 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-26c29d24-5cff-4095-a4f3-a4be83eb0160 tempest-GroupSnapshotsTest-2100980396 None] Flow 'volume_create_manager' (373b8305-c1de-4c48-a9e2-1b3ef89c76de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:11:40.611545 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-26c29d24-5cff-4095-a4f3-a4be83eb0160 tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17daab81-e8ea-4f36-95ad-c8d46775be7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:40.618004 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-26c29d24-5cff-4095-a4f3-a4be83eb0160 tempest-GroupSnapshotsTest-2100980396 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:11:40.631730 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-26c29d24-5cff-4095-a4f3-a4be83eb0160 tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17daab81-e8ea-4f36-95ad-c8d46775be7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-104849791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c1d86219-cd3c-4779-92d1-8453f55d51c3,host='ncdv-master-1@ceph#ceph',id=c5e6f2d5-e259-4f21-adc3-cfdb1a79b692,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b73eea3c4fa486c963755e203e3ac4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:11:41Z,use_quota=True,user_id='2d556e8989d141c599114fe0fc74717d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(195cc5a6-39be-4c10-9072-aeb85cadf082),volume_type_id=195cc5a6-39be-4c10-9072-aeb85cadf082)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:40.637187 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-26c29d24-5cff-4095-a4f3-a4be83eb0160 tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (243dbb64-7a46-4d32-b864-9f36c69ce6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:40.641335 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-26c29d24-5cff-4095-a4f3-a4be83eb0160 tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (243dbb64-7a46-4d32-b864-9f36c69ce6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:40.646510 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-26c29d24-5cff-4095-a4f3-a4be83eb0160 tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9019901-bf8a-4ebf-9c44-f90ef7109e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:40.650957 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-26c29d24-5cff-4095-a4f3-a4be83eb0160 tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9019901-bf8a-4ebf-9c44-f90ef7109e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5e6f2d5-e259-4f21-adc3-cfdb1a79b692', 'volume_name': 'volume-c5e6f2d5-e259-4f21-adc3-cfdb1a79b692', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:40.656409 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-26c29d24-5cff-4095-a4f3-a4be83eb0160 tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7421f4a6-768b-4d72-8097-7a923daa8838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:40.660420 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-26c29d24-5cff-4095-a4f3-a4be83eb0160 tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7421f4a6-768b-4d72-8097-7a923daa8838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:40.665130 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-26c29d24-5cff-4095-a4f3-a4be83eb0160 tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3543f64d-f6af-4db2-bd9d-6f7043333b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:40.666252 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-26c29d24-5cff-4095-a4f3-a4be83eb0160 tempest-GroupSnapshotsTest-2100980396 None] Volume c5e6f2d5-e259-4f21-adc3-cfdb1a79b692: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5e6f2d5-e259-4f21-adc3-cfdb1a79b692', 'volume_size': 1} Mar 12 21:11:40.666642 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-26c29d24-5cff-4095-a4f3-a4be83eb0160 tempest-GroupSnapshotsTest-2100980396 None] creating volume 'volume-c5e6f2d5-e259-4f21-adc3-cfdb1a79b692' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:11:40.667608 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-26c29d24-5cff-4095-a4f3-a4be83eb0160 tempest-GroupSnapshotsTest-2100980396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:40.715785 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-26c29d24-5cff-4095-a4f3-a4be83eb0160 tempest-GroupSnapshotsTest-2100980396 None] extra_specs: {} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:11:40.716158 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-26c29d24-5cff-4095-a4f3-a4be83eb0160 tempest-GroupSnapshotsTest-2100980396 None] extra_specs: {} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:11:40.720496 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-26c29d24-5cff-4095-a4f3-a4be83eb0160 tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3543f64d-f6af-4db2-bd9d-6f7043333b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5e6f2d5-e259-4f21-adc3-cfdb1a79b692', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:40.725272 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-26c29d24-5cff-4095-a4f3-a4be83eb0160 tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c1352f1-9101-4a02-9235-3955ca084751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:40.734230 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-26c29d24-5cff-4095-a4f3-a4be83eb0160 tempest-GroupSnapshotsTest-2100980396 None] Volume volume-c5e6f2d5-e259-4f21-adc3-cfdb1a79b692 (c5e6f2d5-e259-4f21-adc3-cfdb1a79b692): created successfully Mar 12 21:11:40.737811 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-26c29d24-5cff-4095-a4f3-a4be83eb0160 tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c1352f1-9101-4a02-9235-3955ca084751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:40.743510 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-26c29d24-5cff-4095-a4f3-a4be83eb0160 tempest-GroupSnapshotsTest-2100980396 None] Flow 'volume_create_manager' (373b8305-c1de-4c48-a9e2-1b3ef89c76de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:11:40.750803 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-26c29d24-5cff-4095-a4f3-a4be83eb0160 tempest-GroupSnapshotsTest-2100980396 None] Created volume successfully. Mar 12 21:11:41.087648 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-04c48a84-9dd9-4dfb-b21c-74bf44cd53c1 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] Create snapshot completed successfully Mar 12 21:11:41.109052 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-721dd699-98b2-4497-9a88-92b3459c0c02 tempest-VolumesSnapshotTestJSON-1127165440 None] Create snapshot completed successfully Mar 12 21:11:41.308779 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-9b53f1da-27d4-4260-ad4b-77ac8b5f6bc1 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] Lock "b'cinder-e547d525-6f2e-4bdf-95dd-fe8a81d43018-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:11:41.310784 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9b53f1da-27d4-4260-ad4b-77ac8b5f6bc1 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:41.484764 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-48fdf81e-9b5c-48ee-b5b4-5b41006dcf8d tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:41.717390 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-cab3c800-a2b4-4e9e-abd3-15bf0f436751 tempest-GroupSnapshotsTest-2100980396 None] Update group completed successfully. Mar 12 21:11:42.107628 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-9b53f1da-27d4-4260-ad4b-77ac8b5f6bc1 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] Created reservations ['b9aa2fca-7591-4a10-98b9-0181fa26c068', '83591cd4-d5ba-475e-b96d-112236e89ff5', 'a71378f4-8db7-4bd5-bad5-64401f3522be', '99b3c4dc-77b9-46f0-a03f-eafe99e12938'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:11:42.149188 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-48fdf81e-9b5c-48ee-b5b4-5b41006dcf8d tempest-VolumesSnapshotTestJSON-1127165440 None] Create snapshot completed successfully Mar 12 21:11:42.157597 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-9b53f1da-27d4-4260-ad4b-77ac8b5f6bc1 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] Delete snapshot completed successfully. Mar 12 21:11:42.162064 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-9b53f1da-27d4-4260-ad4b-77ac8b5f6bc1 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] Lock "b'cinder-e547d525-6f2e-4bdf-95dd-fe8a81d43018-delete_snapshot'" released by "delete_snapshot" :: held 0.853s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:11:42.397088 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-21065273-2785-4b46-be4a-97c79d109366 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] Lock "b'cinder-77c8e867-cab0-423f-8c7a-2487eab8e247-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:11:42.428710 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-21065273-2785-4b46-be4a-97c79d109366 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:42.466049 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-21065273-2785-4b46-be4a-97c79d109366 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:11:42.466601 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-21065273-2785-4b46-be4a-97c79d109366 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] Volume volume-77c8e867-cab0-423f-8c7a-2487eab8e247 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:11:42.474823 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-21065273-2785-4b46-be4a-97c79d109366 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] deleting rbd volume volume-77c8e867-cab0-423f-8c7a-2487eab8e247 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:11:42.557415 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-f105c457-d78b-4f48-9ab5-0c03d814a4a4 tempest-VolumesSnapshotTestJSON-1127165440 None] Lock "b'cinder-926cdbd1-0843-4d14-a620-d334a546c42a-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:11:42.559076 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f105c457-d78b-4f48-9ab5-0c03d814a4a4 tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:42.706864 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-21065273-2785-4b46-be4a-97c79d109366 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] Created reservations ['3760f9c0-aa1c-42b2-9325-3bf32702034d', '7c6b634e-8266-41d6-ae0a-7a5a53406b7c', '3331d78e-d7e5-4bd1-bb8e-d5ce850b666b', '2717b691-6b5e-4805-b708-3ee383bcf5ff'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:11:42.747603 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-21065273-2785-4b46-be4a-97c79d109366 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:42.774813 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-21065273-2785-4b46-be4a-97c79d109366 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:42.798672 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-21065273-2785-4b46-be4a-97c79d109366 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:11:42.803009 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-21065273-2785-4b46-be4a-97c79d109366 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] Deleted volume successfully. Mar 12 21:11:42.842672 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-21065273-2785-4b46-be4a-97c79d109366 tempest-VolumesSnapshotNegativeTestJSON-249472262 None] Lock "b'cinder-77c8e867-cab0-423f-8c7a-2487eab8e247-delete_volume'" released by "delete_volume" :: held 0.446s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:11:42.866744 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-b168840f-3dee-4d7e-8a8d-4eb5008c3504 tempest-GroupSnapshotsTest-2100980396 None] Update group completed successfully. Mar 12 21:11:44.008284 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-d361b996-8390-45d1-bff6-e3f87ee6209b tempest-GroupSnapshotsTest-2100980396 None] Update group completed successfully. Mar 12 21:11:45.108775 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-eb664fd9-022e-4dc5-8fc9-fdb16d6a2d6e tempest-GroupSnapshotsTest-2100980396 None] Update group completed successfully. Mar 12 21:11:46.406858 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-9d5cd3c3-1772-480c-9150-1723dc6821c0 tempest-GroupSnapshotsTest-2100980396 None] GroupSnapshot 258ddbd1-3d08-4c35-90e2-5d6c68bd2d92: creating. Mar 12 21:11:46.436506 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9d5cd3c3-1772-480c-9150-1723dc6821c0 tempest-GroupSnapshotsTest-2100980396 None] Group snapshot 258ddbd1-3d08-4c35-90e2-5d6c68bd2d92: creating. {{(pid=129531) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4076}} Mar 12 21:11:46.453534 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9d5cd3c3-1772-480c-9150-1723dc6821c0 tempest-GroupSnapshotsTest-2100980396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:47.346189 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9d5cd3c3-1772-480c-9150-1723dc6821c0 tempest-GroupSnapshotsTest-2100980396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:48.097022 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-9d5cd3c3-1772-480c-9150-1723dc6821c0 tempest-GroupSnapshotsTest-2100980396 None] group_snapshot 258ddbd1-3d08-4c35-90e2-5d6c68bd2d92: created successfully Mar 12 21:11:48.638832 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-ac6cbd48-1143-4a1e-8675-3d43b3aff49c tempest-GroupSnapshotsTest-2100980396 None] group_snapshot 258ddbd1-3d08-4c35-90e2-5d6c68bd2d92: deleting Mar 12 21:11:48.657319 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-ac6cbd48-1143-4a1e-8675-3d43b3aff49c tempest-GroupSnapshotsTest-2100980396 None] group_snapshot 258ddbd1-3d08-4c35-90e2-5d6c68bd2d92: deleting {{(pid=129531) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4251}} Mar 12 21:11:48.674106 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-ac6cbd48-1143-4a1e-8675-3d43b3aff49c tempest-GroupSnapshotsTest-2100980396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:49.343617 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-ac6cbd48-1143-4a1e-8675-3d43b3aff49c tempest-GroupSnapshotsTest-2100980396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:50.388051 ncdv-master-1 cinder-volume[129531]: WARNING cinder.quota [None req-ac6cbd48-1143-4a1e-8675-3d43b3aff49c tempest-GroupSnapshotsTest-2100980396 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1663291269 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1663291269, it is now deprecated. Please use the default quota class for default quota. Mar 12 21:11:50.388852 ncdv-master-1 cinder-volume[129531]: WARNING cinder.quota [None req-ac6cbd48-1143-4a1e-8675-3d43b3aff49c tempest-GroupSnapshotsTest-2100980396 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1663291269 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1663291269, it is now deprecated. Please use the default quota class for default quota. Mar 12 21:11:50.402563 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-ac6cbd48-1143-4a1e-8675-3d43b3aff49c tempest-GroupSnapshotsTest-2100980396 None] Created reservations ['f2d3938d-8cde-4966-81f3-735b2b6f3a24', 'a7a87685-2cf9-4bbb-8f66-db17caba6b05', '919bbe14-8042-40de-918b-a1f826001590', 'cab4f7cd-bcd5-4a37-9a2e-002e8ddf0111'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:11:50.473986 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-ac6cbd48-1143-4a1e-8675-3d43b3aff49c tempest-GroupSnapshotsTest-2100980396 None] Created reservations ['d3106481-e866-4a68-829e-3e41aae015d0', '6d7232e5-0f82-43f5-b4fe-08a850044d48', 'a65c375a-e790-496e-bafc-e7ce6e81f378', 'ee2270ab-cd93-4352-b5c7-9ca5a4a9d8b4'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:11:50.515626 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-ac6cbd48-1143-4a1e-8675-3d43b3aff49c tempest-GroupSnapshotsTest-2100980396 None] group_snapshot 258ddbd1-3d08-4c35-90e2-5d6c68bd2d92: deleted successfully Mar 12 21:11:51.145578 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-323c95b1-8ec9-4ee4-adb0-486add6bc30b tempest-GroupSnapshotsTest-2100980396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:51.186701 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-323c95b1-8ec9-4ee4-adb0-486add6bc30b tempest-GroupSnapshotsTest-2100980396 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:11:51.187127 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-323c95b1-8ec9-4ee4-adb0-486add6bc30b tempest-GroupSnapshotsTest-2100980396 None] Volume volume-c5e6f2d5-e259-4f21-adc3-cfdb1a79b692 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:11:51.192941 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-323c95b1-8ec9-4ee4-adb0-486add6bc30b tempest-GroupSnapshotsTest-2100980396 None] deleting rbd volume volume-c5e6f2d5-e259-4f21-adc3-cfdb1a79b692 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:11:51.308986 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:11:51.310018 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:51.335882 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:51.361584 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:11:51.379984 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-323c95b1-8ec9-4ee4-adb0-486add6bc30b tempest-GroupSnapshotsTest-2100980396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:51.416404 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-323c95b1-8ec9-4ee4-adb0-486add6bc30b tempest-GroupSnapshotsTest-2100980396 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:11:51.417062 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-323c95b1-8ec9-4ee4-adb0-486add6bc30b tempest-GroupSnapshotsTest-2100980396 None] Volume volume-e2295eb8-e6dc-4025-bd78-bd9c4b765512 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:11:51.421468 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-323c95b1-8ec9-4ee4-adb0-486add6bc30b tempest-GroupSnapshotsTest-2100980396 None] deleting rbd volume volume-e2295eb8-e6dc-4025-bd78-bd9c4b765512 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:11:51.663853 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-323c95b1-8ec9-4ee4-adb0-486add6bc30b tempest-GroupSnapshotsTest-2100980396 None] Created reservations ['a79027d4-2b36-4f40-9858-818a2571e3ec'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:11:51.679766 ncdv-master-1 cinder-volume[129531]: WARNING cinder.quota [None req-323c95b1-8ec9-4ee4-adb0-486add6bc30b tempest-GroupSnapshotsTest-2100980396 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1663291269 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1663291269, it is now deprecated. Please use the default quota class for default quota. Mar 12 21:11:51.693220 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-323c95b1-8ec9-4ee4-adb0-486add6bc30b tempest-GroupSnapshotsTest-2100980396 None] Created reservations ['290d9e24-961b-48a8-a2e0-43f5b9325495', '5ca9cc53-06c9-4925-b8fd-98161a8fa909', '05d4d130-66c7-42a3-b212-921f40903d1a', '0a06b075-3cc5-4175-aaa7-c7c353c6e7c1'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:11:51.769545 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-323c95b1-8ec9-4ee4-adb0-486add6bc30b tempest-GroupSnapshotsTest-2100980396 None] Created reservations ['027dd52c-013b-4eca-8c4c-b9caebd797f6', 'b3084fc1-edca-4c84-b2cc-d1c5795f33a0', '31cd1384-a953-4f35-b608-3fa374c9dcc2', 'e03c573f-3c93-4a99-9f74-f2470efa79bf'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:11:51.854703 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-323c95b1-8ec9-4ee4-adb0-486add6bc30b tempest-GroupSnapshotsTest-2100980396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:51.875729 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-323c95b1-8ec9-4ee4-adb0-486add6bc30b tempest-GroupSnapshotsTest-2100980396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:51.899822 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-323c95b1-8ec9-4ee4-adb0-486add6bc30b tempest-GroupSnapshotsTest-2100980396 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:11:51.903701 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-323c95b1-8ec9-4ee4-adb0-486add6bc30b tempest-GroupSnapshotsTest-2100980396 None] Delete group completed successfully. Mar 12 21:11:52.465822 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-aefa3fa7-8d54-4b4c-b74e-3c56e6119580 tempest-GroupSnapshotsTest-2100980396 None] Group tempest-GroupSnapshotsTest-Group-1360199328: creating Mar 12 21:11:52.481279 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-aefa3fa7-8d54-4b4c-b74e-3c56e6119580 tempest-GroupSnapshotsTest-2100980396 None] Group tempest-GroupSnapshotsTest-Group-1360199328: created successfully Mar 12 21:11:52.489740 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-aefa3fa7-8d54-4b4c-b74e-3c56e6119580 tempest-GroupSnapshotsTest-2100980396 None] Create group completed successfully. Mar 12 21:11:53.834563 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-35a2158f-1936-48a6-a441-6571d08de8be tempest-GroupSnapshotsTest-2100980396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:11:53.838228 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-35a2158f-1936-48a6-a441-6571d08de8be tempest-GroupSnapshotsTest-2100980396 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:11:53.838826 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-35a2158f-1936-48a6-a441-6571d08de8be tempest-GroupSnapshotsTest-2100980396 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:11:53.860424 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-35a2158f-1936-48a6-a441-6571d08de8be tempest-GroupSnapshotsTest-2100980396 None] Flow 'volume_create_manager' (e9c010eb-e10c-4266-8291-00a29ebd3828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:11:53.867719 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-35a2158f-1936-48a6-a441-6571d08de8be tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1f3823e-0e10-4ef2-be94-ca58e15fd81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:53.874368 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-35a2158f-1936-48a6-a441-6571d08de8be tempest-GroupSnapshotsTest-2100980396 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:11:53.888675 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-35a2158f-1936-48a6-a441-6571d08de8be tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1f3823e-0e10-4ef2-be94-ca58e15fd81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1667530408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f7bc861d-5933-400a-b8be-69491f296364,host='ncdv-master-1@ceph#ceph',id=ce2ce7b7-d8f1-456c-aca5-c53a18f96146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b73eea3c4fa486c963755e203e3ac4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:11:54Z,use_quota=True,user_id='2d556e8989d141c599114fe0fc74717d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a94de79-09e7-4d30-a529-d451f5e20831),volume_type_id=9a94de79-09e7-4d30-a529-d451f5e20831)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:53.894144 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-35a2158f-1936-48a6-a441-6571d08de8be tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13a88e89-2d93-41a0-bd33-86154c55d6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:53.898393 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-35a2158f-1936-48a6-a441-6571d08de8be tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13a88e89-2d93-41a0-bd33-86154c55d6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:53.903646 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-35a2158f-1936-48a6-a441-6571d08de8be tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a64353d-256d-4808-a9c6-6f1cdcdd4a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:53.908457 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-35a2158f-1936-48a6-a441-6571d08de8be tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a64353d-256d-4808-a9c6-6f1cdcdd4a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce2ce7b7-d8f1-456c-aca5-c53a18f96146', 'volume_name': 'volume-ce2ce7b7-d8f1-456c-aca5-c53a18f96146', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:53.913478 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-35a2158f-1936-48a6-a441-6571d08de8be tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21ccf39f-7e59-43cc-bbfe-ecf7d8b649cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:53.917544 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-35a2158f-1936-48a6-a441-6571d08de8be tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21ccf39f-7e59-43cc-bbfe-ecf7d8b649cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:53.922400 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-35a2158f-1936-48a6-a441-6571d08de8be tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a1de4bb-2b7b-410d-9be7-15a704ea263b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:53.924157 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-35a2158f-1936-48a6-a441-6571d08de8be tempest-GroupSnapshotsTest-2100980396 None] Volume ce2ce7b7-d8f1-456c-aca5-c53a18f96146: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce2ce7b7-d8f1-456c-aca5-c53a18f96146', 'volume_size': 1} Mar 12 21:11:53.924548 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-35a2158f-1936-48a6-a441-6571d08de8be tempest-GroupSnapshotsTest-2100980396 None] creating volume 'volume-ce2ce7b7-d8f1-456c-aca5-c53a18f96146' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:11:53.925558 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-35a2158f-1936-48a6-a441-6571d08de8be tempest-GroupSnapshotsTest-2100980396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:53.995955 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-35a2158f-1936-48a6-a441-6571d08de8be tempest-GroupSnapshotsTest-2100980396 None] extra_specs: {} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:11:53.996429 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-35a2158f-1936-48a6-a441-6571d08de8be tempest-GroupSnapshotsTest-2100980396 None] extra_specs: {} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:11:54.001928 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-35a2158f-1936-48a6-a441-6571d08de8be tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a1de4bb-2b7b-410d-9be7-15a704ea263b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce2ce7b7-d8f1-456c-aca5-c53a18f96146', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:54.007011 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-35a2158f-1936-48a6-a441-6571d08de8be tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec9778f-bc39-435f-a340-fec4592ff72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:11:54.015838 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-35a2158f-1936-48a6-a441-6571d08de8be tempest-GroupSnapshotsTest-2100980396 None] Volume volume-ce2ce7b7-d8f1-456c-aca5-c53a18f96146 (ce2ce7b7-d8f1-456c-aca5-c53a18f96146): created successfully Mar 12 21:11:54.019814 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-35a2158f-1936-48a6-a441-6571d08de8be tempest-GroupSnapshotsTest-2100980396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec9778f-bc39-435f-a340-fec4592ff72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:11:54.025922 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-35a2158f-1936-48a6-a441-6571d08de8be tempest-GroupSnapshotsTest-2100980396 None] Flow 'volume_create_manager' (e9c010eb-e10c-4266-8291-00a29ebd3828) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:11:54.034187 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-35a2158f-1936-48a6-a441-6571d08de8be tempest-GroupSnapshotsTest-2100980396 None] Created volume successfully. Mar 12 21:11:55.035197 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-a548d252-56b6-4b3a-83c1-e6c9512b066d tempest-GroupSnapshotsTest-2100980396 None] GroupSnapshot 0d255805-2a21-4741-97f5-2c7d3a337a01: creating. Mar 12 21:11:55.047609 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-a548d252-56b6-4b3a-83c1-e6c9512b066d tempest-GroupSnapshotsTest-2100980396 None] Group snapshot 0d255805-2a21-4741-97f5-2c7d3a337a01: creating. {{(pid=129531) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4076}} Mar 12 21:11:55.063010 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a548d252-56b6-4b3a-83c1-e6c9512b066d tempest-GroupSnapshotsTest-2100980396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:55.257027 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-a548d252-56b6-4b3a-83c1-e6c9512b066d tempest-GroupSnapshotsTest-2100980396 None] group_snapshot 0d255805-2a21-4741-97f5-2c7d3a337a01: created successfully Mar 12 21:11:56.238016 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-14d5c20b-7d91-4ac3-866d-1840a2e3bd91 tempest-GroupSnapshotsTest-2100980396 None] group_snapshot 0d255805-2a21-4741-97f5-2c7d3a337a01: deleting Mar 12 21:11:56.253628 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-14d5c20b-7d91-4ac3-866d-1840a2e3bd91 tempest-GroupSnapshotsTest-2100980396 None] group_snapshot 0d255805-2a21-4741-97f5-2c7d3a337a01: deleting {{(pid=129531) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4251}} Mar 12 21:11:56.269134 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-14d5c20b-7d91-4ac3-866d-1840a2e3bd91 tempest-GroupSnapshotsTest-2100980396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:57.260113 ncdv-master-1 cinder-volume[129531]: WARNING cinder.quota [None req-14d5c20b-7d91-4ac3-866d-1840a2e3bd91 tempest-GroupSnapshotsTest-2100980396 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-659814953 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-659814953, it is now deprecated. Please use the default quota class for default quota. Mar 12 21:11:57.260930 ncdv-master-1 cinder-volume[129531]: WARNING cinder.quota [None req-14d5c20b-7d91-4ac3-866d-1840a2e3bd91 tempest-GroupSnapshotsTest-2100980396 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-659814953 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-659814953, it is now deprecated. Please use the default quota class for default quota. Mar 12 21:11:57.274451 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-14d5c20b-7d91-4ac3-866d-1840a2e3bd91 tempest-GroupSnapshotsTest-2100980396 None] Created reservations ['614a0cbc-a7bc-4b91-bfbe-6b8494daed0f', '417238b5-6f62-45ce-b94c-b74a7de6f6c9', 'ad174753-c379-4984-b5f5-321b0c2aa9b5', '0f176072-68e8-4fb2-807d-f11c08a456ac'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:11:57.312829 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-14d5c20b-7d91-4ac3-866d-1840a2e3bd91 tempest-GroupSnapshotsTest-2100980396 None] group_snapshot 0d255805-2a21-4741-97f5-2c7d3a337a01: deleted successfully Mar 12 21:11:57.672876 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-02ceef47-257d-407d-9ca7-b6af7a28fa3a tempest-GroupSnapshotsTest-2100980396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:57.714601 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-02ceef47-257d-407d-9ca7-b6af7a28fa3a tempest-GroupSnapshotsTest-2100980396 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:11:57.715106 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-02ceef47-257d-407d-9ca7-b6af7a28fa3a tempest-GroupSnapshotsTest-2100980396 None] Volume volume-ce2ce7b7-d8f1-456c-aca5-c53a18f96146 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:11:57.721877 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-02ceef47-257d-407d-9ca7-b6af7a28fa3a tempest-GroupSnapshotsTest-2100980396 None] deleting rbd volume volume-ce2ce7b7-d8f1-456c-aca5-c53a18f96146 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:11:57.929333 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-02ceef47-257d-407d-9ca7-b6af7a28fa3a tempest-GroupSnapshotsTest-2100980396 None] Created reservations ['2c70fa08-2a29-4e48-95ee-aa158fc55f75'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:11:57.946224 ncdv-master-1 cinder-volume[129531]: WARNING cinder.quota [None req-02ceef47-257d-407d-9ca7-b6af7a28fa3a tempest-GroupSnapshotsTest-2100980396 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-659814953 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-659814953, it is now deprecated. Please use the default quota class for default quota. Mar 12 21:11:57.962321 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-02ceef47-257d-407d-9ca7-b6af7a28fa3a tempest-GroupSnapshotsTest-2100980396 None] Created reservations ['82584b34-9566-4105-82c7-8f4f93233e67', 'bacaac92-65ce-49f7-b900-68bd8799a2f5', '4b8a2e2b-9802-4041-93e2-c9dd48a3bb5e', 'b873ceae-4ec9-4912-96f1-d358a789ed11'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:11:58.037799 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-02ceef47-257d-407d-9ca7-b6af7a28fa3a tempest-GroupSnapshotsTest-2100980396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:58.065221 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-02ceef47-257d-407d-9ca7-b6af7a28fa3a tempest-GroupSnapshotsTest-2100980396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:11:58.089407 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-02ceef47-257d-407d-9ca7-b6af7a28fa3a tempest-GroupSnapshotsTest-2100980396 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:11:58.094151 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-02ceef47-257d-407d-9ca7-b6af7a28fa3a tempest-GroupSnapshotsTest-2100980396 None] Delete group completed successfully. Mar 12 21:12:03.280779 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cedd877-5571-40f8-b70e-726d16c1cce3 tempest-AttachVolumeNegativeTest-2014367252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:12:03.288023 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-9cedd877-5571-40f8-b70e-726d16c1cce3 tempest-AttachVolumeNegativeTest-2014367252 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:12:03.288639 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-9cedd877-5571-40f8-b70e-726d16c1cce3 tempest-AttachVolumeNegativeTest-2014367252 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:12:03.315303 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9cedd877-5571-40f8-b70e-726d16c1cce3 tempest-AttachVolumeNegativeTest-2014367252 None] Flow 'volume_create_manager' (af137377-6c2d-443d-b0d8-cb7735926e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:12:03.324273 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9cedd877-5571-40f8-b70e-726d16c1cce3 tempest-AttachVolumeNegativeTest-2014367252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3dffb77-0434-4730-8215-c9728871d769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:03.332071 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-9cedd877-5571-40f8-b70e-726d16c1cce3 tempest-AttachVolumeNegativeTest-2014367252 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:12:03.351655 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9cedd877-5571-40f8-b70e-726d16c1cce3 tempest-AttachVolumeNegativeTest-2014367252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3dffb77-0434-4730-8215-c9728871d769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-357118448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=bcb70a5a-733c-41a4-9720-36b2f07c886d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f427010b06749289b20e8b776a8b8c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:12:03Z,use_quota=True,user_id='f2c8058e4e8d475c9377a065b4018a2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:03.358416 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9cedd877-5571-40f8-b70e-726d16c1cce3 tempest-AttachVolumeNegativeTest-2014367252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dabf027-c20b-4830-827b-8ddd5a92831c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:03.364477 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9cedd877-5571-40f8-b70e-726d16c1cce3 tempest-AttachVolumeNegativeTest-2014367252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dabf027-c20b-4830-827b-8ddd5a92831c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:03.370451 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9cedd877-5571-40f8-b70e-726d16c1cce3 tempest-AttachVolumeNegativeTest-2014367252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ce20615-11ff-4bca-99d3-56c57bee8ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:03.375659 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9cedd877-5571-40f8-b70e-726d16c1cce3 tempest-AttachVolumeNegativeTest-2014367252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ce20615-11ff-4bca-99d3-56c57bee8ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcb70a5a-733c-41a4-9720-36b2f07c886d', 'volume_name': 'volume-bcb70a5a-733c-41a4-9720-36b2f07c886d', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:03.382512 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9cedd877-5571-40f8-b70e-726d16c1cce3 tempest-AttachVolumeNegativeTest-2014367252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (759110ac-af85-4007-b9d4-6936852eb616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:03.388168 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9cedd877-5571-40f8-b70e-726d16c1cce3 tempest-AttachVolumeNegativeTest-2014367252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (759110ac-af85-4007-b9d4-6936852eb616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:03.394445 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9cedd877-5571-40f8-b70e-726d16c1cce3 tempest-AttachVolumeNegativeTest-2014367252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59d6e89c-95a3-45c7-95c9-7b366156c361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:03.395569 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-9cedd877-5571-40f8-b70e-726d16c1cce3 tempest-AttachVolumeNegativeTest-2014367252 None] Volume bcb70a5a-733c-41a4-9720-36b2f07c886d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcb70a5a-733c-41a4-9720-36b2f07c886d', 'volume_size': 1} Mar 12 21:12:03.396282 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9cedd877-5571-40f8-b70e-726d16c1cce3 tempest-AttachVolumeNegativeTest-2014367252 None] creating volume 'volume-bcb70a5a-733c-41a4-9720-36b2f07c886d' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:12:03.397686 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9cedd877-5571-40f8-b70e-726d16c1cce3 tempest-AttachVolumeNegativeTest-2014367252 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:03.546931 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9cedd877-5571-40f8-b70e-726d16c1cce3 tempest-AttachVolumeNegativeTest-2014367252 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:12:03.547629 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9cedd877-5571-40f8-b70e-726d16c1cce3 tempest-AttachVolumeNegativeTest-2014367252 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:12:03.554244 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9cedd877-5571-40f8-b70e-726d16c1cce3 tempest-AttachVolumeNegativeTest-2014367252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59d6e89c-95a3-45c7-95c9-7b366156c361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcb70a5a-733c-41a4-9720-36b2f07c886d', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:03.560452 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9cedd877-5571-40f8-b70e-726d16c1cce3 tempest-AttachVolumeNegativeTest-2014367252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2de886d-022c-4d24-9fb1-dc83a99d289a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:03.577878 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-9cedd877-5571-40f8-b70e-726d16c1cce3 tempest-AttachVolumeNegativeTest-2014367252 None] Volume volume-bcb70a5a-733c-41a4-9720-36b2f07c886d (bcb70a5a-733c-41a4-9720-36b2f07c886d): created successfully Mar 12 21:12:03.582345 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9cedd877-5571-40f8-b70e-726d16c1cce3 tempest-AttachVolumeNegativeTest-2014367252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2de886d-022c-4d24-9fb1-dc83a99d289a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:03.589220 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9cedd877-5571-40f8-b70e-726d16c1cce3 tempest-AttachVolumeNegativeTest-2014367252 None] Flow 'volume_create_manager' (af137377-6c2d-443d-b0d8-cb7735926e05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:12:03.613201 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-9cedd877-5571-40f8-b70e-726d16c1cce3 tempest-AttachVolumeNegativeTest-2014367252 None] Created volume successfully. Mar 12 21:12:04.883576 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-ea69ee63-bdb7-47d0-aae6-6fb7048a630d req-6bf7b5cb-78a3-446c-adb1-270c8413050e tempest-AttachVolumeNegativeTest-2014367252 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 21:12:05.807438 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-ea69ee63-bdb7-47d0-aae6-6fb7048a630d req-6bf7b5cb-78a3-446c-adb1-270c8413050e tempest-AttachVolumeNegativeTest-2014367252 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.923s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 21:12:05.809209 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-ea69ee63-bdb7-47d0-aae6-6fb7048a630d req-6bf7b5cb-78a3-446c-adb1-270c8413050e tempest-AttachVolumeNegativeTest-2014367252 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-bcb70a5a-733c-41a4-9720-36b2f07c886d', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': 'bcb70a5a-733c-41a4-9720-36b2f07c886d', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 21:12:05.876359 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-ea69ee63-bdb7-47d0-aae6-6fb7048a630d req-6bf7b5cb-78a3-446c-adb1-270c8413050e tempest-AttachVolumeNegativeTest-2014367252 None] Connection info returned from driver {'name': 'volumes/volume-bcb70a5a-733c-41a4-9720-36b2f07c886d', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'bcb70a5a-733c-41a4-9720-36b2f07c886d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7e444238-c871-454d-8f0e-2cd588038fff'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 21:12:05.984569 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-ea69ee63-bdb7-47d0-aae6-6fb7048a630d req-6bf7b5cb-78a3-446c-adb1-270c8413050e tempest-AttachVolumeNegativeTest-2014367252 None] attachment_update completed successfully. Mar 12 21:12:09.001318 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-3111a94c-9ab3-4be6-b4a4-6970080a76e0 req-2f4284bc-3851-4303-b402-08460c78dffc tempest-AttachVolumeNegativeTest-2014367252 None] Terminate volume connection completed successfully. Mar 12 21:12:09.002715 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-3111a94c-9ab3-4be6-b4a4-6970080a76e0 req-2f4284bc-3851-4303-b402-08460c78dffc tempest-AttachVolumeNegativeTest-2014367252 None] Deleting attachment 7e444238-c871-454d-8f0e-2cd588038fff. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 21:12:12.767277 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-f105c457-d78b-4f48-9ab5-0c03d814a4a4 tempest-VolumesSnapshotTestJSON-1127165440 None] Created reservations ['a97eeaa9-963c-4029-b3db-ba6677644fb1', 'd2e6a17d-5f59-4fb6-b225-1c7796b5483e', 'b6de6620-994a-4853-a47f-5fc240f54583', '1c811052-c006-4a88-ab1e-2337ecda8bbc'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:12:12.888462 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-f105c457-d78b-4f48-9ab5-0c03d814a4a4 tempest-VolumesSnapshotTestJSON-1127165440 None] Delete snapshot completed successfully. Mar 12 21:12:12.899203 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-f105c457-d78b-4f48-9ab5-0c03d814a4a4 tempest-VolumesSnapshotTestJSON-1127165440 None] Lock "b'cinder-926cdbd1-0843-4d14-a620-d334a546c42a-delete_snapshot'" released by "delete_snapshot" :: held 30.341s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:12:13.687532 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-727f24db-490f-4327-ae0c-7c94f8c7d60b tempest-VolumesSnapshotTestJSON-1127165440 None] Lock "b'cinder-c591f7e7-c8e5-4d82-9449-d922ceb1197d-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.019s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:12:13.692161 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-727f24db-490f-4327-ae0c-7c94f8c7d60b tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:14.887430 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-c15e33eb-30ab-44f0-8c87-fa776f11fdfd tempest-VolumeTypesTest-98720506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:12:14.891325 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-c15e33eb-30ab-44f0-8c87-fa776f11fdfd tempest-VolumeTypesTest-98720506 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:12:14.891807 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-c15e33eb-30ab-44f0-8c87-fa776f11fdfd tempest-VolumeTypesTest-98720506 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:12:14.916693 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c15e33eb-30ab-44f0-8c87-fa776f11fdfd tempest-VolumeTypesTest-98720506 None] Flow 'volume_create_manager' (9d2f29cf-83b6-4ce9-9418-2e0bacf07085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:12:14.924948 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c15e33eb-30ab-44f0-8c87-fa776f11fdfd tempest-VolumeTypesTest-98720506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69b281d6-22fb-4a18-b5c9-96d7c99f8f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:14.932393 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-c15e33eb-30ab-44f0-8c87-fa776f11fdfd tempest-VolumeTypesTest-98720506 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:12:14.949956 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c15e33eb-30ab-44f0-8c87-fa776f11fdfd tempest-VolumeTypesTest-98720506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69b281d6-22fb-4a18-b5c9-96d7c99f8f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-1331111450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e9bf7e67-bbde-4bf0-8e36-3ce7115f6705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8a2b2e107644df892ea614b7f4ce406',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:12:15Z,use_quota=True,user_id='93191305225f403bb4a8a6d80bb76b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22fd552d-66bf-4a98-94d6-b4fce7d03799),volume_type_id=22fd552d-66bf-4a98-94d6-b4fce7d03799)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:14.959269 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c15e33eb-30ab-44f0-8c87-fa776f11fdfd tempest-VolumeTypesTest-98720506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e8fa4e-efef-4006-99ac-db0bcb2db7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:14.965291 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c15e33eb-30ab-44f0-8c87-fa776f11fdfd tempest-VolumeTypesTest-98720506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e8fa4e-efef-4006-99ac-db0bcb2db7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:14.971836 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c15e33eb-30ab-44f0-8c87-fa776f11fdfd tempest-VolumeTypesTest-98720506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (239fec90-a6f6-4cb3-ab33-cbefbf097ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:14.977332 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c15e33eb-30ab-44f0-8c87-fa776f11fdfd tempest-VolumeTypesTest-98720506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (239fec90-a6f6-4cb3-ab33-cbefbf097ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9bf7e67-bbde-4bf0-8e36-3ce7115f6705', 'volume_name': 'volume-e9bf7e67-bbde-4bf0-8e36-3ce7115f6705', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:14.983222 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c15e33eb-30ab-44f0-8c87-fa776f11fdfd tempest-VolumeTypesTest-98720506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e5cc6e-c3b8-40c6-b10b-9f7cf8f3b13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:14.988714 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c15e33eb-30ab-44f0-8c87-fa776f11fdfd tempest-VolumeTypesTest-98720506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e5cc6e-c3b8-40c6-b10b-9f7cf8f3b13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:14.993362 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c15e33eb-30ab-44f0-8c87-fa776f11fdfd tempest-VolumeTypesTest-98720506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a6c4d21-20fe-4f3a-94e7-2a32b836a9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:14.994490 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-c15e33eb-30ab-44f0-8c87-fa776f11fdfd tempest-VolumeTypesTest-98720506 None] Volume e9bf7e67-bbde-4bf0-8e36-3ce7115f6705: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9bf7e67-bbde-4bf0-8e36-3ce7115f6705', 'volume_size': 1} Mar 12 21:12:14.994882 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c15e33eb-30ab-44f0-8c87-fa776f11fdfd tempest-VolumeTypesTest-98720506 None] creating volume 'volume-e9bf7e67-bbde-4bf0-8e36-3ce7115f6705' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:12:14.996443 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c15e33eb-30ab-44f0-8c87-fa776f11fdfd tempest-VolumeTypesTest-98720506 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:15.093366 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c15e33eb-30ab-44f0-8c87-fa776f11fdfd tempest-VolumeTypesTest-98720506 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:12:15.094140 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c15e33eb-30ab-44f0-8c87-fa776f11fdfd tempest-VolumeTypesTest-98720506 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:12:15.098018 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c15e33eb-30ab-44f0-8c87-fa776f11fdfd tempest-VolumeTypesTest-98720506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a6c4d21-20fe-4f3a-94e7-2a32b836a9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9bf7e67-bbde-4bf0-8e36-3ce7115f6705', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:15.103432 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c15e33eb-30ab-44f0-8c87-fa776f11fdfd tempest-VolumeTypesTest-98720506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f607becf-22bf-4c1f-a0a9-c4eaf54e58c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:15.115068 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-c15e33eb-30ab-44f0-8c87-fa776f11fdfd tempest-VolumeTypesTest-98720506 None] Volume volume-e9bf7e67-bbde-4bf0-8e36-3ce7115f6705 (e9bf7e67-bbde-4bf0-8e36-3ce7115f6705): created successfully Mar 12 21:12:15.119851 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c15e33eb-30ab-44f0-8c87-fa776f11fdfd tempest-VolumeTypesTest-98720506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f607becf-22bf-4c1f-a0a9-c4eaf54e58c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:15.126718 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c15e33eb-30ab-44f0-8c87-fa776f11fdfd tempest-VolumeTypesTest-98720506 None] Flow 'volume_create_manager' (9d2f29cf-83b6-4ce9-9418-2e0bacf07085) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:12:15.137473 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-c15e33eb-30ab-44f0-8c87-fa776f11fdfd tempest-VolumeTypesTest-98720506 None] Created volume successfully. Mar 12 21:12:15.570968 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-8356bb79-05e7-4da3-af66-03362f57c7b3 tempest-AttachVolumeNegativeTest-2014367252 None] Lock "b'cinder-bcb70a5a-733c-41a4-9720-36b2f07c886d-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:12:15.602756 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8356bb79-05e7-4da3-af66-03362f57c7b3 tempest-AttachVolumeNegativeTest-2014367252 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:15.642491 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8356bb79-05e7-4da3-af66-03362f57c7b3 tempest-AttachVolumeNegativeTest-2014367252 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:12:15.642874 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8356bb79-05e7-4da3-af66-03362f57c7b3 tempest-AttachVolumeNegativeTest-2014367252 None] Volume volume-bcb70a5a-733c-41a4-9720-36b2f07c886d is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:12:15.651312 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8356bb79-05e7-4da3-af66-03362f57c7b3 tempest-AttachVolumeNegativeTest-2014367252 None] deleting rbd volume volume-bcb70a5a-733c-41a4-9720-36b2f07c886d {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:12:15.948165 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-8356bb79-05e7-4da3-af66-03362f57c7b3 tempest-AttachVolumeNegativeTest-2014367252 None] Created reservations ['6e15f13b-bbf1-43ed-8553-cd4fd7203a5a', '42190ece-48b3-4be0-9317-c688bc896ac0', '8af3173a-4338-4890-a87b-01b9ead6029b', '59bfe206-fbb5-4bb7-9d91-159c58551962'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:12:16.002625 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8356bb79-05e7-4da3-af66-03362f57c7b3 tempest-AttachVolumeNegativeTest-2014367252 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:16.048891 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8356bb79-05e7-4da3-af66-03362f57c7b3 tempest-AttachVolumeNegativeTest-2014367252 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:16.097441 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-8356bb79-05e7-4da3-af66-03362f57c7b3 tempest-AttachVolumeNegativeTest-2014367252 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:12:16.103087 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-8356bb79-05e7-4da3-af66-03362f57c7b3 tempest-AttachVolumeNegativeTest-2014367252 None] Deleted volume successfully. Mar 12 21:12:16.120228 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-8356bb79-05e7-4da3-af66-03362f57c7b3 tempest-AttachVolumeNegativeTest-2014367252 None] Lock "b'cinder-bcb70a5a-733c-41a4-9720-36b2f07c886d-delete_volume'" released by "delete_volume" :: held 0.549s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:12:16.219197 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b94b71f6-93e5-451e-9cfc-687308e92159 tempest-VolumeTypesTest-98720506 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:16.244532 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b94b71f6-93e5-451e-9cfc-687308e92159 tempest-VolumeTypesTest-98720506 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:16.269231 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-b94b71f6-93e5-451e-9cfc-687308e92159 tempest-VolumeTypesTest-98720506 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:12:16.273583 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-b94b71f6-93e5-451e-9cfc-687308e92159 tempest-VolumeTypesTest-98720506 None] Retype volume completed successfully. Mar 12 21:12:16.796364 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-3329e9d3-1947-43f1-8e0c-d41319f364d1 tempest-AttachVolumeNegativeTest-2014367252 None] Lock "b'cinder-89e88497-9559-462f-ad2e-14638295f92b-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:12:16.846292 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3329e9d3-1947-43f1-8e0c-d41319f364d1 tempest-AttachVolumeNegativeTest-2014367252 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:16.907247 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3329e9d3-1947-43f1-8e0c-d41319f364d1 tempest-AttachVolumeNegativeTest-2014367252 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:12:16.907818 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3329e9d3-1947-43f1-8e0c-d41319f364d1 tempest-AttachVolumeNegativeTest-2014367252 None] Volume volume-89e88497-9559-462f-ad2e-14638295f92b is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:12:16.917271 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3329e9d3-1947-43f1-8e0c-d41319f364d1 tempest-AttachVolumeNegativeTest-2014367252 None] deleting rbd volume volume-89e88497-9559-462f-ad2e-14638295f92b {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:12:17.219448 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-3329e9d3-1947-43f1-8e0c-d41319f364d1 tempest-AttachVolumeNegativeTest-2014367252 None] Created reservations ['22d45d56-2d28-47a4-bc87-42c22d6111e5', '57e550a1-6fa7-46c5-b48d-f36e568409ee', 'da9e3da3-228b-45d0-ae61-5d9a90473243', 'a472b4c8-10d3-4a63-9874-b55cc4786aa5'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:12:17.289695 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3329e9d3-1947-43f1-8e0c-d41319f364d1 tempest-AttachVolumeNegativeTest-2014367252 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:17.344016 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3329e9d3-1947-43f1-8e0c-d41319f364d1 tempest-AttachVolumeNegativeTest-2014367252 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:17.385670 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-3329e9d3-1947-43f1-8e0c-d41319f364d1 tempest-AttachVolumeNegativeTest-2014367252 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:12:17.390459 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-3329e9d3-1947-43f1-8e0c-d41319f364d1 tempest-AttachVolumeNegativeTest-2014367252 None] Deleted volume successfully. Mar 12 21:12:17.413755 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-3329e9d3-1947-43f1-8e0c-d41319f364d1 tempest-AttachVolumeNegativeTest-2014367252 None] Lock "b'cinder-89e88497-9559-462f-ad2e-14638295f92b-delete_volume'" released by "delete_volume" :: held 0.617s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:12:18.251288 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-62df20b6-34d5-44e7-b9f9-5da2f4fe5547 tempest-AttachVolumeNegativeTest-2014367252 None] Lock "b'cinder-ba7d5c32-c844-466a-925a-148040924690-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:12:18.316629 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-62df20b6-34d5-44e7-b9f9-5da2f4fe5547 tempest-AttachVolumeNegativeTest-2014367252 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:18.418113 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-62df20b6-34d5-44e7-b9f9-5da2f4fe5547 tempest-AttachVolumeNegativeTest-2014367252 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:12:18.418804 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-62df20b6-34d5-44e7-b9f9-5da2f4fe5547 tempest-AttachVolumeNegativeTest-2014367252 None] Volume volume-ba7d5c32-c844-466a-925a-148040924690 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:12:18.440849 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-62df20b6-34d5-44e7-b9f9-5da2f4fe5547 tempest-AttachVolumeNegativeTest-2014367252 None] deleting rbd volume volume-ba7d5c32-c844-466a-925a-148040924690 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:12:18.479814 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-6f0c8da3-db8e-42a7-92e9-dd9322fcbf29 tempest-VolumeTypesTest-98720506 None] Lock "b'cinder-e9bf7e67-bbde-4bf0-8e36-3ce7115f6705-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:12:18.543811 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-6f0c8da3-db8e-42a7-92e9-dd9322fcbf29 tempest-VolumeTypesTest-98720506 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:18.638832 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-6f0c8da3-db8e-42a7-92e9-dd9322fcbf29 tempest-VolumeTypesTest-98720506 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:12:18.639724 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-6f0c8da3-db8e-42a7-92e9-dd9322fcbf29 tempest-VolumeTypesTest-98720506 None] Volume volume-e9bf7e67-bbde-4bf0-8e36-3ce7115f6705 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:12:18.649704 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-6f0c8da3-db8e-42a7-92e9-dd9322fcbf29 tempest-VolumeTypesTest-98720506 None] deleting rbd volume volume-e9bf7e67-bbde-4bf0-8e36-3ce7115f6705 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:12:19.075849 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-62df20b6-34d5-44e7-b9f9-5da2f4fe5547 tempest-AttachVolumeNegativeTest-2014367252 None] Created reservations ['ef8f26c5-12a0-4f6d-ba3b-3fb8d7706e02', '30588c1f-8719-4cb7-b101-0e95d13757f5', '9325c32a-b4af-42e8-8b52-f598240b0f0a', 'a3c165df-b455-4f43-8f46-3961a214d56d'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:12:19.155935 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-62df20b6-34d5-44e7-b9f9-5da2f4fe5547 tempest-AttachVolumeNegativeTest-2014367252 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:19.192845 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-62df20b6-34d5-44e7-b9f9-5da2f4fe5547 tempest-AttachVolumeNegativeTest-2014367252 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:19.239261 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-62df20b6-34d5-44e7-b9f9-5da2f4fe5547 tempest-AttachVolumeNegativeTest-2014367252 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:12:19.245666 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-62df20b6-34d5-44e7-b9f9-5da2f4fe5547 tempest-AttachVolumeNegativeTest-2014367252 None] Deleted volume successfully. Mar 12 21:12:19.288224 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-62df20b6-34d5-44e7-b9f9-5da2f4fe5547 tempest-AttachVolumeNegativeTest-2014367252 None] Lock "b'cinder-ba7d5c32-c844-466a-925a-148040924690-delete_volume'" released by "delete_volume" :: held 1.037s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:12:19.304071 ncdv-master-1 cinder-volume[129531]: WARNING cinder.quota [None req-6f0c8da3-db8e-42a7-92e9-dd9322fcbf29 tempest-VolumeTypesTest-98720506 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesTest-volume-type-665837653 is set by the default quota flag: quota_volumes_tempest-VolumeTypesTest-volume-type-665837653, it is now deprecated. Please use the default quota class for default quota. Mar 12 21:12:19.305360 ncdv-master-1 cinder-volume[129531]: WARNING cinder.quota [None req-6f0c8da3-db8e-42a7-92e9-dd9322fcbf29 tempest-VolumeTypesTest-98720506 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesTest-volume-type-665837653 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesTest-volume-type-665837653, it is now deprecated. Please use the default quota class for default quota. Mar 12 21:12:19.326544 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-6f0c8da3-db8e-42a7-92e9-dd9322fcbf29 tempest-VolumeTypesTest-98720506 None] Created reservations ['5e4a0d61-85fc-410b-9362-e14602a9ebec', '77621e44-1ee3-4e6e-bf39-d3e896fc972e', '86f461e3-0b9c-4938-a589-49cfa8b4faa4', 'e5fa0e8c-1788-4014-bc83-16866d2d1d2f'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:12:19.395795 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-6f0c8da3-db8e-42a7-92e9-dd9322fcbf29 tempest-VolumeTypesTest-98720506 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:19.487256 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-6f0c8da3-db8e-42a7-92e9-dd9322fcbf29 tempest-VolumeTypesTest-98720506 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:19.581069 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-6f0c8da3-db8e-42a7-92e9-dd9322fcbf29 tempest-VolumeTypesTest-98720506 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:12:19.586763 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-6f0c8da3-db8e-42a7-92e9-dd9322fcbf29 tempest-VolumeTypesTest-98720506 None] Deleted volume successfully. Mar 12 21:12:19.615517 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-6f0c8da3-db8e-42a7-92e9-dd9322fcbf29 tempest-VolumeTypesTest-98720506 None] Lock "b'cinder-e9bf7e67-bbde-4bf0-8e36-3ce7115f6705-delete_volume'" released by "delete_volume" :: held 1.136s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:12:26.532079 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c400ba6-474e-441f-9518-12c364e54dbe tempest-VolumesListAdminTestJSON-32322877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:12:26.538628 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-5c400ba6-474e-441f-9518-12c364e54dbe tempest-VolumesListAdminTestJSON-32322877 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:12:26.539550 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-5c400ba6-474e-441f-9518-12c364e54dbe tempest-VolumesListAdminTestJSON-32322877 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:12:26.565245 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5c400ba6-474e-441f-9518-12c364e54dbe tempest-VolumesListAdminTestJSON-32322877 None] Flow 'volume_create_manager' (5456de8f-ccd5-4b4c-84c1-b12fa8e0b7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:12:26.573378 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5c400ba6-474e-441f-9518-12c364e54dbe tempest-VolumesListAdminTestJSON-32322877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe3d460-dfb1-4eaa-b592-f58df2775463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:26.582445 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-5c400ba6-474e-441f-9518-12c364e54dbe tempest-VolumesListAdminTestJSON-32322877 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:12:26.603686 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5c400ba6-474e-441f-9518-12c364e54dbe tempest-VolumesListAdminTestJSON-32322877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe3d460-dfb1-4eaa-b592-f58df2775463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-378852243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3a711763-afb5-4c42-9cc8-d6922346a992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abf4bb6d8ae34a13a1891c081a8f28a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:12:26Z,use_quota=True,user_id='d463206bcc864341914c5af746f8ecf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:26.612644 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5c400ba6-474e-441f-9518-12c364e54dbe tempest-VolumesListAdminTestJSON-32322877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceaef523-4c25-47ec-8e81-9e53050ca90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:26.620354 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5c400ba6-474e-441f-9518-12c364e54dbe tempest-VolumesListAdminTestJSON-32322877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceaef523-4c25-47ec-8e81-9e53050ca90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:26.628135 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5c400ba6-474e-441f-9518-12c364e54dbe tempest-VolumesListAdminTestJSON-32322877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d21a33a2-b595-4558-b19f-27594fcdcf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:26.635416 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5c400ba6-474e-441f-9518-12c364e54dbe tempest-VolumesListAdminTestJSON-32322877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d21a33a2-b595-4558-b19f-27594fcdcf72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a711763-afb5-4c42-9cc8-d6922346a992', 'volume_name': 'volume-3a711763-afb5-4c42-9cc8-d6922346a992', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:26.641609 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5c400ba6-474e-441f-9518-12c364e54dbe tempest-VolumesListAdminTestJSON-32322877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca2b0ee5-114f-4ee0-a70c-d7bfdda64bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:26.652898 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5c400ba6-474e-441f-9518-12c364e54dbe tempest-VolumesListAdminTestJSON-32322877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca2b0ee5-114f-4ee0-a70c-d7bfdda64bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:26.663544 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5c400ba6-474e-441f-9518-12c364e54dbe tempest-VolumesListAdminTestJSON-32322877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (447182a8-99f9-42c0-a05d-4bf419706992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:26.665093 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-5c400ba6-474e-441f-9518-12c364e54dbe tempest-VolumesListAdminTestJSON-32322877 None] Volume 3a711763-afb5-4c42-9cc8-d6922346a992: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a711763-afb5-4c42-9cc8-d6922346a992', 'volume_size': 1} Mar 12 21:12:26.665652 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-5c400ba6-474e-441f-9518-12c364e54dbe tempest-VolumesListAdminTestJSON-32322877 None] creating volume 'volume-3a711763-afb5-4c42-9cc8-d6922346a992' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:12:26.666953 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-5c400ba6-474e-441f-9518-12c364e54dbe tempest-VolumesListAdminTestJSON-32322877 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:26.805866 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-5c400ba6-474e-441f-9518-12c364e54dbe tempest-VolumesListAdminTestJSON-32322877 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:12:26.806377 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-5c400ba6-474e-441f-9518-12c364e54dbe tempest-VolumesListAdminTestJSON-32322877 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:12:26.810933 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5c400ba6-474e-441f-9518-12c364e54dbe tempest-VolumesListAdminTestJSON-32322877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (447182a8-99f9-42c0-a05d-4bf419706992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a711763-afb5-4c42-9cc8-d6922346a992', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:26.828268 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5c400ba6-474e-441f-9518-12c364e54dbe tempest-VolumesListAdminTestJSON-32322877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5f38a4e-612e-4631-9bbf-2887d870c6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:26.848595 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-5c400ba6-474e-441f-9518-12c364e54dbe tempest-VolumesListAdminTestJSON-32322877 None] Volume volume-3a711763-afb5-4c42-9cc8-d6922346a992 (3a711763-afb5-4c42-9cc8-d6922346a992): created successfully Mar 12 21:12:26.860154 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5c400ba6-474e-441f-9518-12c364e54dbe tempest-VolumesListAdminTestJSON-32322877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5f38a4e-612e-4631-9bbf-2887d870c6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:26.866724 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5c400ba6-474e-441f-9518-12c364e54dbe tempest-VolumesListAdminTestJSON-32322877 None] Flow 'volume_create_manager' (5456de8f-ccd5-4b4c-84c1-b12fa8e0b7b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:12:26.881511 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-5c400ba6-474e-441f-9518-12c364e54dbe tempest-VolumesListAdminTestJSON-32322877 None] Created volume successfully. Mar 12 21:12:27.983960 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-e708d501-6fcf-46f5-a583-4847d47a255d tempest-VolumesListAdminTestJSON-32322877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:12:27.989288 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-e708d501-6fcf-46f5-a583-4847d47a255d tempest-VolumesListAdminTestJSON-32322877 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:12:27.989828 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-e708d501-6fcf-46f5-a583-4847d47a255d tempest-VolumesListAdminTestJSON-32322877 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:12:28.010496 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e708d501-6fcf-46f5-a583-4847d47a255d tempest-VolumesListAdminTestJSON-32322877 None] Flow 'volume_create_manager' (a6167ca7-5097-4102-a548-cc116aa770b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:12:28.018508 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e708d501-6fcf-46f5-a583-4847d47a255d tempest-VolumesListAdminTestJSON-32322877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc26f593-f89a-47c1-9009-a33090f0706e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:28.026602 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-e708d501-6fcf-46f5-a583-4847d47a255d tempest-VolumesListAdminTestJSON-32322877 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:12:28.041878 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e708d501-6fcf-46f5-a583-4847d47a255d tempest-VolumesListAdminTestJSON-32322877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc26f593-f89a-47c1-9009-a33090f0706e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-991646588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2d98c348-eff7-4c66-9992-3b894725be25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abf4bb6d8ae34a13a1891c081a8f28a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:12:28Z,use_quota=True,user_id='d463206bcc864341914c5af746f8ecf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:28.049195 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e708d501-6fcf-46f5-a583-4847d47a255d tempest-VolumesListAdminTestJSON-32322877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5af899c1-09ad-44e1-a75a-15ed545ae58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:28.053491 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e708d501-6fcf-46f5-a583-4847d47a255d tempest-VolumesListAdminTestJSON-32322877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5af899c1-09ad-44e1-a75a-15ed545ae58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:28.059397 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e708d501-6fcf-46f5-a583-4847d47a255d tempest-VolumesListAdminTestJSON-32322877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (186a4c40-2472-4f1d-8a3a-6c763928dc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:28.065091 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e708d501-6fcf-46f5-a583-4847d47a255d tempest-VolumesListAdminTestJSON-32322877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (186a4c40-2472-4f1d-8a3a-6c763928dc8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d98c348-eff7-4c66-9992-3b894725be25', 'volume_name': 'volume-2d98c348-eff7-4c66-9992-3b894725be25', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:28.070221 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e708d501-6fcf-46f5-a583-4847d47a255d tempest-VolumesListAdminTestJSON-32322877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd026104-4f50-4541-ad46-a24b9157ef8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:28.074365 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e708d501-6fcf-46f5-a583-4847d47a255d tempest-VolumesListAdminTestJSON-32322877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd026104-4f50-4541-ad46-a24b9157ef8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:28.080240 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e708d501-6fcf-46f5-a583-4847d47a255d tempest-VolumesListAdminTestJSON-32322877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (346c4c1e-7de0-487c-95a3-8218ae9c7154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:28.081449 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-e708d501-6fcf-46f5-a583-4847d47a255d tempest-VolumesListAdminTestJSON-32322877 None] Volume 2d98c348-eff7-4c66-9992-3b894725be25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d98c348-eff7-4c66-9992-3b894725be25', 'volume_size': 1} Mar 12 21:12:28.081867 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-e708d501-6fcf-46f5-a583-4847d47a255d tempest-VolumesListAdminTestJSON-32322877 None] creating volume 'volume-2d98c348-eff7-4c66-9992-3b894725be25' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:12:28.082895 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-e708d501-6fcf-46f5-a583-4847d47a255d tempest-VolumesListAdminTestJSON-32322877 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:28.148320 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-e708d501-6fcf-46f5-a583-4847d47a255d tempest-VolumesListAdminTestJSON-32322877 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:12:28.148691 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-e708d501-6fcf-46f5-a583-4847d47a255d tempest-VolumesListAdminTestJSON-32322877 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:12:28.152602 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e708d501-6fcf-46f5-a583-4847d47a255d tempest-VolumesListAdminTestJSON-32322877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (346c4c1e-7de0-487c-95a3-8218ae9c7154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d98c348-eff7-4c66-9992-3b894725be25', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:28.157367 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e708d501-6fcf-46f5-a583-4847d47a255d tempest-VolumesListAdminTestJSON-32322877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bda41d07-9ece-4ff5-a73b-70484ec20f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:28.165901 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-e708d501-6fcf-46f5-a583-4847d47a255d tempest-VolumesListAdminTestJSON-32322877 None] Volume volume-2d98c348-eff7-4c66-9992-3b894725be25 (2d98c348-eff7-4c66-9992-3b894725be25): created successfully Mar 12 21:12:28.169531 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e708d501-6fcf-46f5-a583-4847d47a255d tempest-VolumesListAdminTestJSON-32322877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bda41d07-9ece-4ff5-a73b-70484ec20f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:28.175918 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-e708d501-6fcf-46f5-a583-4847d47a255d tempest-VolumesListAdminTestJSON-32322877 None] Flow 'volume_create_manager' (a6167ca7-5097-4102-a548-cc116aa770b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:12:28.185290 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-e708d501-6fcf-46f5-a583-4847d47a255d tempest-VolumesListAdminTestJSON-32322877 None] Created volume successfully. Mar 12 21:12:29.344792 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6c4f676-1bde-45ce-8feb-38f594079270 tempest-VolumesListAdminTestJSON-32322877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:12:29.348832 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-b6c4f676-1bde-45ce-8feb-38f594079270 tempest-VolumesListAdminTestJSON-32322877 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:12:29.349351 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-b6c4f676-1bde-45ce-8feb-38f594079270 tempest-VolumesListAdminTestJSON-32322877 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:12:29.370279 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b6c4f676-1bde-45ce-8feb-38f594079270 tempest-VolumesListAdminTestJSON-32322877 None] Flow 'volume_create_manager' (3e03bf3d-16a0-414a-8202-bb95769e7031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:12:29.377449 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b6c4f676-1bde-45ce-8feb-38f594079270 tempest-VolumesListAdminTestJSON-32322877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d16e9cb0-0523-4467-8f6d-e04f1a4f2e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:29.384820 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-b6c4f676-1bde-45ce-8feb-38f594079270 tempest-VolumesListAdminTestJSON-32322877 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:12:29.406722 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b6c4f676-1bde-45ce-8feb-38f594079270 tempest-VolumesListAdminTestJSON-32322877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d16e9cb0-0523-4467-8f6d-e04f1a4f2e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1816483147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a56e720c-7d9c-49e8-aafd-6f1c0b133313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abf4bb6d8ae34a13a1891c081a8f28a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:12:29Z,use_quota=True,user_id='d463206bcc864341914c5af746f8ecf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:29.414825 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b6c4f676-1bde-45ce-8feb-38f594079270 tempest-VolumesListAdminTestJSON-32322877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48de269d-cb37-44e0-9c7c-0fd2de94a052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:29.419862 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b6c4f676-1bde-45ce-8feb-38f594079270 tempest-VolumesListAdminTestJSON-32322877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48de269d-cb37-44e0-9c7c-0fd2de94a052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:29.426454 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b6c4f676-1bde-45ce-8feb-38f594079270 tempest-VolumesListAdminTestJSON-32322877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dcfc67b-3501-4b1f-a71d-760cb3ffd4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:29.430884 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b6c4f676-1bde-45ce-8feb-38f594079270 tempest-VolumesListAdminTestJSON-32322877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dcfc67b-3501-4b1f-a71d-760cb3ffd4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a56e720c-7d9c-49e8-aafd-6f1c0b133313', 'volume_name': 'volume-a56e720c-7d9c-49e8-aafd-6f1c0b133313', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:29.435805 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b6c4f676-1bde-45ce-8feb-38f594079270 tempest-VolumesListAdminTestJSON-32322877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b9461d8-392b-44b4-99c8-0d34d8ac74f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:29.439867 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b6c4f676-1bde-45ce-8feb-38f594079270 tempest-VolumesListAdminTestJSON-32322877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b9461d8-392b-44b4-99c8-0d34d8ac74f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:29.444719 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b6c4f676-1bde-45ce-8feb-38f594079270 tempest-VolumesListAdminTestJSON-32322877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4b68166-85b1-47dc-908a-a7ce8c318892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:29.445812 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-b6c4f676-1bde-45ce-8feb-38f594079270 tempest-VolumesListAdminTestJSON-32322877 None] Volume a56e720c-7d9c-49e8-aafd-6f1c0b133313: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a56e720c-7d9c-49e8-aafd-6f1c0b133313', 'volume_size': 1} Mar 12 21:12:29.446203 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b6c4f676-1bde-45ce-8feb-38f594079270 tempest-VolumesListAdminTestJSON-32322877 None] creating volume 'volume-a56e720c-7d9c-49e8-aafd-6f1c0b133313' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:12:29.447192 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b6c4f676-1bde-45ce-8feb-38f594079270 tempest-VolumesListAdminTestJSON-32322877 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:29.503741 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b6c4f676-1bde-45ce-8feb-38f594079270 tempest-VolumesListAdminTestJSON-32322877 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:12:29.504123 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b6c4f676-1bde-45ce-8feb-38f594079270 tempest-VolumesListAdminTestJSON-32322877 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:12:29.508086 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b6c4f676-1bde-45ce-8feb-38f594079270 tempest-VolumesListAdminTestJSON-32322877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4b68166-85b1-47dc-908a-a7ce8c318892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a56e720c-7d9c-49e8-aafd-6f1c0b133313', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:29.512964 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b6c4f676-1bde-45ce-8feb-38f594079270 tempest-VolumesListAdminTestJSON-32322877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0551950d-d846-436f-b4fa-01d6081d6f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:29.523436 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-b6c4f676-1bde-45ce-8feb-38f594079270 tempest-VolumesListAdminTestJSON-32322877 None] Volume volume-a56e720c-7d9c-49e8-aafd-6f1c0b133313 (a56e720c-7d9c-49e8-aafd-6f1c0b133313): created successfully Mar 12 21:12:29.527322 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b6c4f676-1bde-45ce-8feb-38f594079270 tempest-VolumesListAdminTestJSON-32322877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0551950d-d846-436f-b4fa-01d6081d6f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:29.533617 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b6c4f676-1bde-45ce-8feb-38f594079270 tempest-VolumesListAdminTestJSON-32322877 None] Flow 'volume_create_manager' (3e03bf3d-16a0-414a-8202-bb95769e7031) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:12:29.541923 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-b6c4f676-1bde-45ce-8feb-38f594079270 tempest-VolumesListAdminTestJSON-32322877 None] Created volume successfully. Mar 12 21:12:31.101204 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9bc1cfc-9cb5-4ec8-a623-405db8cea31f tempest-VolumesListAdminTestJSON-1482922752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:12:31.105320 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-b9bc1cfc-9cb5-4ec8-a623-405db8cea31f tempest-VolumesListAdminTestJSON-1482922752 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:12:31.105867 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-b9bc1cfc-9cb5-4ec8-a623-405db8cea31f tempest-VolumesListAdminTestJSON-1482922752 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:12:31.126169 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b9bc1cfc-9cb5-4ec8-a623-405db8cea31f tempest-VolumesListAdminTestJSON-1482922752 None] Flow 'volume_create_manager' (0c619bfb-f267-4847-a6e4-d15481d99595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:12:31.132944 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b9bc1cfc-9cb5-4ec8-a623-405db8cea31f tempest-VolumesListAdminTestJSON-1482922752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2cdb184-c338-47a8-84c1-c2e3b90438b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:31.141372 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-b9bc1cfc-9cb5-4ec8-a623-405db8cea31f tempest-VolumesListAdminTestJSON-1482922752 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:12:31.161348 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b9bc1cfc-9cb5-4ec8-a623-405db8cea31f tempest-VolumesListAdminTestJSON-1482922752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2cdb184-c338-47a8-84c1-c2e3b90438b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c7929098-98d4-4277-8efe-de1165bc0c42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21ae6d7983c74a9c84ed88054762ab85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:12:31Z,use_quota=True,user_id='4114506769464890a9171b8b431d899f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:31.167201 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b9bc1cfc-9cb5-4ec8-a623-405db8cea31f tempest-VolumesListAdminTestJSON-1482922752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d857fda-72a8-45e0-b8b4-aafbac76d326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:31.172077 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b9bc1cfc-9cb5-4ec8-a623-405db8cea31f tempest-VolumesListAdminTestJSON-1482922752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d857fda-72a8-45e0-b8b4-aafbac76d326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:31.178267 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b9bc1cfc-9cb5-4ec8-a623-405db8cea31f tempest-VolumesListAdminTestJSON-1482922752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf20f35a-99e7-41d3-bd23-650ac7a10adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:31.182902 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b9bc1cfc-9cb5-4ec8-a623-405db8cea31f tempest-VolumesListAdminTestJSON-1482922752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf20f35a-99e7-41d3-bd23-650ac7a10adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7929098-98d4-4277-8efe-de1165bc0c42', 'volume_name': 'volume-c7929098-98d4-4277-8efe-de1165bc0c42', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:31.188008 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b9bc1cfc-9cb5-4ec8-a623-405db8cea31f tempest-VolumesListAdminTestJSON-1482922752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7787fb9-f9b3-4ad2-a9d8-f00f92d7ff51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:31.192189 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b9bc1cfc-9cb5-4ec8-a623-405db8cea31f tempest-VolumesListAdminTestJSON-1482922752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7787fb9-f9b3-4ad2-a9d8-f00f92d7ff51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:31.197065 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b9bc1cfc-9cb5-4ec8-a623-405db8cea31f tempest-VolumesListAdminTestJSON-1482922752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44ef3a96-62fe-4703-98d6-8ecb4d0c6f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:31.198171 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-b9bc1cfc-9cb5-4ec8-a623-405db8cea31f tempest-VolumesListAdminTestJSON-1482922752 None] Volume c7929098-98d4-4277-8efe-de1165bc0c42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7929098-98d4-4277-8efe-de1165bc0c42', 'volume_size': 1} Mar 12 21:12:31.198563 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b9bc1cfc-9cb5-4ec8-a623-405db8cea31f tempest-VolumesListAdminTestJSON-1482922752 None] creating volume 'volume-c7929098-98d4-4277-8efe-de1165bc0c42' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:12:31.199636 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b9bc1cfc-9cb5-4ec8-a623-405db8cea31f tempest-VolumesListAdminTestJSON-1482922752 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:31.275267 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b9bc1cfc-9cb5-4ec8-a623-405db8cea31f tempest-VolumesListAdminTestJSON-1482922752 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:12:31.276320 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b9bc1cfc-9cb5-4ec8-a623-405db8cea31f tempest-VolumesListAdminTestJSON-1482922752 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:12:31.281640 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b9bc1cfc-9cb5-4ec8-a623-405db8cea31f tempest-VolumesListAdminTestJSON-1482922752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44ef3a96-62fe-4703-98d6-8ecb4d0c6f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7929098-98d4-4277-8efe-de1165bc0c42', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:31.287615 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b9bc1cfc-9cb5-4ec8-a623-405db8cea31f tempest-VolumesListAdminTestJSON-1482922752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a006f3b-feea-4eb6-bff3-c38b2394e8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:31.299630 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-b9bc1cfc-9cb5-4ec8-a623-405db8cea31f tempest-VolumesListAdminTestJSON-1482922752 None] Volume volume-c7929098-98d4-4277-8efe-de1165bc0c42 (c7929098-98d4-4277-8efe-de1165bc0c42): created successfully Mar 12 21:12:31.301612 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b9bc1cfc-9cb5-4ec8-a623-405db8cea31f tempest-VolumesListAdminTestJSON-1482922752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a006f3b-feea-4eb6-bff3-c38b2394e8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:31.308069 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b9bc1cfc-9cb5-4ec8-a623-405db8cea31f tempest-VolumesListAdminTestJSON-1482922752 None] Flow 'volume_create_manager' (0c619bfb-f267-4847-a6e4-d15481d99595) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:12:31.318488 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-b9bc1cfc-9cb5-4ec8-a623-405db8cea31f tempest-VolumesListAdminTestJSON-1482922752 None] Created volume successfully. Mar 12 21:12:32.244624 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-182b5c02-1943-4cbf-896f-e4edd41a5ac5 tempest-VolumesListAdminTestJSON-1482922752 None] Lock "b'cinder-c7929098-98d4-4277-8efe-de1165bc0c42-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:12:32.285483 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-182b5c02-1943-4cbf-896f-e4edd41a5ac5 tempest-VolumesListAdminTestJSON-1482922752 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:32.363699 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-182b5c02-1943-4cbf-896f-e4edd41a5ac5 tempest-VolumesListAdminTestJSON-1482922752 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:12:32.364328 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-182b5c02-1943-4cbf-896f-e4edd41a5ac5 tempest-VolumesListAdminTestJSON-1482922752 None] Volume volume-c7929098-98d4-4277-8efe-de1165bc0c42 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:12:32.372866 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-182b5c02-1943-4cbf-896f-e4edd41a5ac5 tempest-VolumesListAdminTestJSON-1482922752 None] deleting rbd volume volume-c7929098-98d4-4277-8efe-de1165bc0c42 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:12:32.385523 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-102cb5e6-b845-4b0e-b76a-65c9cf986e9b tempest-VolumesListAdminTestJSON-32322877 None] Lock "b'cinder-a56e720c-7d9c-49e8-aafd-6f1c0b133313-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:12:32.426356 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-102cb5e6-b845-4b0e-b76a-65c9cf986e9b tempest-VolumesListAdminTestJSON-32322877 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:32.481565 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-102cb5e6-b845-4b0e-b76a-65c9cf986e9b tempest-VolumesListAdminTestJSON-32322877 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:12:32.482297 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-102cb5e6-b845-4b0e-b76a-65c9cf986e9b tempest-VolumesListAdminTestJSON-32322877 None] Volume volume-a56e720c-7d9c-49e8-aafd-6f1c0b133313 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:12:32.490442 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-102cb5e6-b845-4b0e-b76a-65c9cf986e9b tempest-VolumesListAdminTestJSON-32322877 None] deleting rbd volume volume-a56e720c-7d9c-49e8-aafd-6f1c0b133313 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:12:32.752648 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-182b5c02-1943-4cbf-896f-e4edd41a5ac5 tempest-VolumesListAdminTestJSON-1482922752 None] Created reservations ['db932baa-9998-4722-859a-c965696df0b8', 'e1308a7d-7d90-407d-8ed4-03b7b60ee2a9', '7fed7c2e-8749-4520-85c8-3e1b370765c5', '1987eda8-4210-4386-856d-03dab9d3d192'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:12:32.818172 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-182b5c02-1943-4cbf-896f-e4edd41a5ac5 tempest-VolumesListAdminTestJSON-1482922752 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:32.865234 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-182b5c02-1943-4cbf-896f-e4edd41a5ac5 tempest-VolumesListAdminTestJSON-1482922752 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:32.904522 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-182b5c02-1943-4cbf-896f-e4edd41a5ac5 tempest-VolumesListAdminTestJSON-1482922752 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:12:32.909893 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-182b5c02-1943-4cbf-896f-e4edd41a5ac5 tempest-VolumesListAdminTestJSON-1482922752 None] Deleted volume successfully. Mar 12 21:12:32.928135 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-182b5c02-1943-4cbf-896f-e4edd41a5ac5 tempest-VolumesListAdminTestJSON-1482922752 None] Lock "b'cinder-c7929098-98d4-4277-8efe-de1165bc0c42-delete_volume'" released by "delete_volume" :: held 0.684s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:12:32.956066 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-102cb5e6-b845-4b0e-b76a-65c9cf986e9b tempest-VolumesListAdminTestJSON-32322877 None] Created reservations ['1a27c29c-2b80-418e-b988-1104a5880e67', 'd31647c4-31f6-4101-8cdf-040b7e71335e', '3f4e3f02-f7a0-41d4-a64b-0c56e4583ebd', '33c814ee-6e28-4904-ae22-f54ddc094fb0'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:12:33.004594 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-102cb5e6-b845-4b0e-b76a-65c9cf986e9b tempest-VolumesListAdminTestJSON-32322877 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:33.038066 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-102cb5e6-b845-4b0e-b76a-65c9cf986e9b tempest-VolumesListAdminTestJSON-32322877 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:33.072534 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-102cb5e6-b845-4b0e-b76a-65c9cf986e9b tempest-VolumesListAdminTestJSON-32322877 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:12:33.077024 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-102cb5e6-b845-4b0e-b76a-65c9cf986e9b tempest-VolumesListAdminTestJSON-32322877 None] Deleted volume successfully. Mar 12 21:12:33.093951 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-102cb5e6-b845-4b0e-b76a-65c9cf986e9b tempest-VolumesListAdminTestJSON-32322877 None] Lock "b'cinder-a56e720c-7d9c-49e8-aafd-6f1c0b133313-delete_volume'" released by "delete_volume" :: held 0.708s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:12:33.515030 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-f3700140-d662-46a7-a1a8-379f5ab069f6 tempest-VolumesListAdminTestJSON-32322877 None] Lock "b'cinder-2d98c348-eff7-4c66-9992-3b894725be25-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:12:33.588693 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f3700140-d662-46a7-a1a8-379f5ab069f6 tempest-VolumesListAdminTestJSON-32322877 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:33.669225 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f3700140-d662-46a7-a1a8-379f5ab069f6 tempest-VolumesListAdminTestJSON-32322877 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:12:33.670033 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f3700140-d662-46a7-a1a8-379f5ab069f6 tempest-VolumesListAdminTestJSON-32322877 None] Volume volume-2d98c348-eff7-4c66-9992-3b894725be25 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:12:33.679334 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f3700140-d662-46a7-a1a8-379f5ab069f6 tempest-VolumesListAdminTestJSON-32322877 None] deleting rbd volume volume-2d98c348-eff7-4c66-9992-3b894725be25 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:12:34.015773 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-f3700140-d662-46a7-a1a8-379f5ab069f6 tempest-VolumesListAdminTestJSON-32322877 None] Created reservations ['5e4350ab-4d22-4dd1-aa5d-c8139149ad63', 'a04cf90b-fbd7-4a67-b46f-28adfd86c0be', 'd2e005ce-9956-4b55-9062-d013590c1e17', 'fba8a60f-9f98-46e0-b498-33423e7fa586'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:12:34.080677 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f3700140-d662-46a7-a1a8-379f5ab069f6 tempest-VolumesListAdminTestJSON-32322877 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:34.113901 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f3700140-d662-46a7-a1a8-379f5ab069f6 tempest-VolumesListAdminTestJSON-32322877 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:34.146158 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-f3700140-d662-46a7-a1a8-379f5ab069f6 tempest-VolumesListAdminTestJSON-32322877 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:12:34.150201 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-f3700140-d662-46a7-a1a8-379f5ab069f6 tempest-VolumesListAdminTestJSON-32322877 None] Deleted volume successfully. Mar 12 21:12:34.164404 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-f3700140-d662-46a7-a1a8-379f5ab069f6 tempest-VolumesListAdminTestJSON-32322877 None] Lock "b'cinder-2d98c348-eff7-4c66-9992-3b894725be25-delete_volume'" released by "delete_volume" :: held 0.649s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:12:34.725001 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-9ea56155-02f1-4eb4-8893-65fdf41fb04e tempest-VolumesListAdminTestJSON-32322877 None] Lock "b'cinder-3a711763-afb5-4c42-9cc8-d6922346a992-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:12:34.791715 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9ea56155-02f1-4eb4-8893-65fdf41fb04e tempest-VolumesListAdminTestJSON-32322877 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:34.873351 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9ea56155-02f1-4eb4-8893-65fdf41fb04e tempest-VolumesListAdminTestJSON-32322877 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:12:34.873805 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9ea56155-02f1-4eb4-8893-65fdf41fb04e tempest-VolumesListAdminTestJSON-32322877 None] Volume volume-3a711763-afb5-4c42-9cc8-d6922346a992 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:12:34.881167 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9ea56155-02f1-4eb4-8893-65fdf41fb04e tempest-VolumesListAdminTestJSON-32322877 None] deleting rbd volume volume-3a711763-afb5-4c42-9cc8-d6922346a992 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:12:35.253485 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-9ea56155-02f1-4eb4-8893-65fdf41fb04e tempest-VolumesListAdminTestJSON-32322877 None] Created reservations ['5fcf0070-b514-484f-8cf9-120bc6fc8c7f', 'c8bc6e95-e9dc-4f99-94b3-064691eeaeb9', '724eb9d3-8bb7-4b6f-b001-70b72821f81d', '90892f12-fb83-4512-8b6f-b478b033eb40'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:12:35.307677 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9ea56155-02f1-4eb4-8893-65fdf41fb04e tempest-VolumesListAdminTestJSON-32322877 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:35.338738 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9ea56155-02f1-4eb4-8893-65fdf41fb04e tempest-VolumesListAdminTestJSON-32322877 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:35.373601 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-9ea56155-02f1-4eb4-8893-65fdf41fb04e tempest-VolumesListAdminTestJSON-32322877 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:12:35.382259 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-9ea56155-02f1-4eb4-8893-65fdf41fb04e tempest-VolumesListAdminTestJSON-32322877 None] Deleted volume successfully. Mar 12 21:12:35.396635 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-9ea56155-02f1-4eb4-8893-65fdf41fb04e tempest-VolumesListAdminTestJSON-32322877 None] Lock "b'cinder-3a711763-afb5-4c42-9cc8-d6922346a992-delete_volume'" released by "delete_volume" :: held 0.672s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:12:40.898372 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8b4ffc7-d3e5-4f25-9881-3533128f4053 tempest-VolumesTransfersV355Test-1189875395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:12:40.902409 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-b8b4ffc7-d3e5-4f25-9881-3533128f4053 tempest-VolumesTransfersV355Test-1189875395 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:12:40.902858 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-b8b4ffc7-d3e5-4f25-9881-3533128f4053 tempest-VolumesTransfersV355Test-1189875395 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:12:40.921868 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b8b4ffc7-d3e5-4f25-9881-3533128f4053 tempest-VolumesTransfersV355Test-1189875395 None] Flow 'volume_create_manager' (c22e2c2e-a293-49b4-a90b-2843f19e14d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:12:40.929334 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b8b4ffc7-d3e5-4f25-9881-3533128f4053 tempest-VolumesTransfersV355Test-1189875395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b6b0d29-1892-4503-8195-f0e954d70ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:40.937847 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-b8b4ffc7-d3e5-4f25-9881-3533128f4053 tempest-VolumesTransfersV355Test-1189875395 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:12:40.954538 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b8b4ffc7-d3e5-4f25-9881-3533128f4053 tempest-VolumesTransfersV355Test-1189875395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b6b0d29-1892-4503-8195-f0e954d70ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:12:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-624948887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cb147c58-ece5-4ce2-bf74-eb204fe213d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6969dd5fef0540e79b84593b44a8fdfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:12:41Z,use_quota=True,user_id='5a7478e2cea041d29a539ab939bb0b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:40.960116 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b8b4ffc7-d3e5-4f25-9881-3533128f4053 tempest-VolumesTransfersV355Test-1189875395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff97fdab-d39b-42d9-8abc-5c8851e4930c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:40.964318 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b8b4ffc7-d3e5-4f25-9881-3533128f4053 tempest-VolumesTransfersV355Test-1189875395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff97fdab-d39b-42d9-8abc-5c8851e4930c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:40.969544 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b8b4ffc7-d3e5-4f25-9881-3533128f4053 tempest-VolumesTransfersV355Test-1189875395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a057041f-df11-4e5a-9afb-0ecb9551cf42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:40.974315 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b8b4ffc7-d3e5-4f25-9881-3533128f4053 tempest-VolumesTransfersV355Test-1189875395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a057041f-df11-4e5a-9afb-0ecb9551cf42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb147c58-ece5-4ce2-bf74-eb204fe213d4', 'volume_name': 'volume-cb147c58-ece5-4ce2-bf74-eb204fe213d4', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:40.979733 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b8b4ffc7-d3e5-4f25-9881-3533128f4053 tempest-VolumesTransfersV355Test-1189875395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006f18d9-f2ea-407f-94f3-77dfd80766e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:40.983412 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b8b4ffc7-d3e5-4f25-9881-3533128f4053 tempest-VolumesTransfersV355Test-1189875395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006f18d9-f2ea-407f-94f3-77dfd80766e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:40.988915 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b8b4ffc7-d3e5-4f25-9881-3533128f4053 tempest-VolumesTransfersV355Test-1189875395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c8c5bef-0c1b-4ee1-b90a-5e41b566c120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:40.990008 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-b8b4ffc7-d3e5-4f25-9881-3533128f4053 tempest-VolumesTransfersV355Test-1189875395 None] Volume cb147c58-ece5-4ce2-bf74-eb204fe213d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb147c58-ece5-4ce2-bf74-eb204fe213d4', 'volume_size': 1} Mar 12 21:12:40.990409 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b8b4ffc7-d3e5-4f25-9881-3533128f4053 tempest-VolumesTransfersV355Test-1189875395 None] creating volume 'volume-cb147c58-ece5-4ce2-bf74-eb204fe213d4' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:12:40.991386 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b8b4ffc7-d3e5-4f25-9881-3533128f4053 tempest-VolumesTransfersV355Test-1189875395 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:41.043398 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b8b4ffc7-d3e5-4f25-9881-3533128f4053 tempest-VolumesTransfersV355Test-1189875395 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:12:41.043776 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b8b4ffc7-d3e5-4f25-9881-3533128f4053 tempest-VolumesTransfersV355Test-1189875395 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:12:41.048821 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b8b4ffc7-d3e5-4f25-9881-3533128f4053 tempest-VolumesTransfersV355Test-1189875395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c8c5bef-0c1b-4ee1-b90a-5e41b566c120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb147c58-ece5-4ce2-bf74-eb204fe213d4', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:41.053508 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b8b4ffc7-d3e5-4f25-9881-3533128f4053 tempest-VolumesTransfersV355Test-1189875395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7834520b-97e1-4d18-84e0-33632658c2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:41.062919 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-b8b4ffc7-d3e5-4f25-9881-3533128f4053 tempest-VolumesTransfersV355Test-1189875395 None] Volume volume-cb147c58-ece5-4ce2-bf74-eb204fe213d4 (cb147c58-ece5-4ce2-bf74-eb204fe213d4): created successfully Mar 12 21:12:41.066788 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b8b4ffc7-d3e5-4f25-9881-3533128f4053 tempest-VolumesTransfersV355Test-1189875395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7834520b-97e1-4d18-84e0-33632658c2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:41.072562 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b8b4ffc7-d3e5-4f25-9881-3533128f4053 tempest-VolumesTransfersV355Test-1189875395 None] Flow 'volume_create_manager' (c22e2c2e-a293-49b4-a90b-2843f19e14d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:12:41.081005 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-b8b4ffc7-d3e5-4f25-9881-3533128f4053 tempest-VolumesTransfersV355Test-1189875395 None] Created volume successfully. Mar 12 21:12:42.432707 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-594b3a70-7152-4780-8d0a-8b4f7049b6dd tempest-VolumesTransfersV355Test-375327292 None] Transfer volume completed successfully. Mar 12 21:12:43.016603 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-27d0e523-642a-411b-a464-f6ccd1cf4dd5 tempest-VolumesTransfersV355Test-1945695507 None] Lock "b'cinder-cb147c58-ece5-4ce2-bf74-eb204fe213d4-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:12:43.052071 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-27d0e523-642a-411b-a464-f6ccd1cf4dd5 tempest-VolumesTransfersV355Test-1945695507 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:43.106325 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-27d0e523-642a-411b-a464-f6ccd1cf4dd5 tempest-VolumesTransfersV355Test-1945695507 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:12:43.106787 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-27d0e523-642a-411b-a464-f6ccd1cf4dd5 tempest-VolumesTransfersV355Test-1945695507 None] Volume volume-cb147c58-ece5-4ce2-bf74-eb204fe213d4 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:12:43.118768 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-27d0e523-642a-411b-a464-f6ccd1cf4dd5 tempest-VolumesTransfersV355Test-1945695507 None] deleting rbd volume volume-cb147c58-ece5-4ce2-bf74-eb204fe213d4 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:12:43.449240 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-27d0e523-642a-411b-a464-f6ccd1cf4dd5 tempest-VolumesTransfersV355Test-1945695507 None] Created reservations ['a1a5c7e2-a1ba-477a-8934-77ef270a0281', '863341b3-479b-4758-9285-8c5258c0e46b', '65601643-5cab-4dee-883e-c289f917dd03', 'f87e3f75-0d2c-4b03-b0e0-2795d5867af7'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:12:43.498420 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-27d0e523-642a-411b-a464-f6ccd1cf4dd5 tempest-VolumesTransfersV355Test-1945695507 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:43.542481 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-27d0e523-642a-411b-a464-f6ccd1cf4dd5 tempest-VolumesTransfersV355Test-1945695507 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:43.582243 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-27d0e523-642a-411b-a464-f6ccd1cf4dd5 tempest-VolumesTransfersV355Test-1945695507 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:12:43.587219 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-27d0e523-642a-411b-a464-f6ccd1cf4dd5 tempest-VolumesTransfersV355Test-1945695507 None] Deleted volume successfully. Mar 12 21:12:43.600891 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-27d0e523-642a-411b-a464-f6ccd1cf4dd5 tempest-VolumesTransfersV355Test-1945695507 None] Lock "b'cinder-cb147c58-ece5-4ce2-bf74-eb204fe213d4-delete_volume'" released by "delete_volume" :: held 0.584s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:12:43.961975 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-727f24db-490f-4327-ae0c-7c94f8c7d60b tempest-VolumesSnapshotTestJSON-1127165440 None] Created reservations ['39a46a72-9e32-462f-a393-b3ae9dde346b', 'ce941a2b-996d-4faa-974e-f293924c6cac', '3046b70b-1c50-41fc-b37c-d01b301e6978', '8f5cc3b0-7cd4-4acc-b46e-f10a7fffe1ba'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:12:44.012861 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-727f24db-490f-4327-ae0c-7c94f8c7d60b tempest-VolumesSnapshotTestJSON-1127165440 None] Delete snapshot completed successfully. Mar 12 21:12:44.018476 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-727f24db-490f-4327-ae0c-7c94f8c7d60b tempest-VolumesSnapshotTestJSON-1127165440 None] Lock "b'cinder-c591f7e7-c8e5-4d82-9449-d922ceb1197d-delete_snapshot'" released by "delete_snapshot" :: held 30.331s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:12:44.445023 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-555827bf-4db2-41e0-8032-97d35dd7d193 tempest-VolumesTransfersV355Test-1189875395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:12:44.448723 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-555827bf-4db2-41e0-8032-97d35dd7d193 tempest-VolumesTransfersV355Test-1189875395 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:12:44.449229 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-555827bf-4db2-41e0-8032-97d35dd7d193 tempest-VolumesTransfersV355Test-1189875395 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:12:44.469422 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-555827bf-4db2-41e0-8032-97d35dd7d193 tempest-VolumesTransfersV355Test-1189875395 None] Flow 'volume_create_manager' (ad0fdd94-d1c9-4850-a418-4e193e24167b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:12:44.476964 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-555827bf-4db2-41e0-8032-97d35dd7d193 tempest-VolumesTransfersV355Test-1189875395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5694818d-d337-4a0e-a24d-3710a119d930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:44.484071 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-555827bf-4db2-41e0-8032-97d35dd7d193 tempest-VolumesTransfersV355Test-1189875395 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:12:44.499101 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-555827bf-4db2-41e0-8032-97d35dd7d193 tempest-VolumesTransfersV355Test-1189875395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5694818d-d337-4a0e-a24d-3710a119d930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-532513983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=23a0fc15-9aa1-4f10-8aba-75ed724d926c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6969dd5fef0540e79b84593b44a8fdfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:12:44Z,use_quota=True,user_id='5a7478e2cea041d29a539ab939bb0b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:44.504989 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-555827bf-4db2-41e0-8032-97d35dd7d193 tempest-VolumesTransfersV355Test-1189875395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22987c41-7da9-46b3-afdd-a3f2a9836b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:44.509250 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-555827bf-4db2-41e0-8032-97d35dd7d193 tempest-VolumesTransfersV355Test-1189875395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22987c41-7da9-46b3-afdd-a3f2a9836b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:44.514788 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-555827bf-4db2-41e0-8032-97d35dd7d193 tempest-VolumesTransfersV355Test-1189875395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48c5f72e-74c6-40c7-8fc9-4ccb2a11e613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:44.519930 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-555827bf-4db2-41e0-8032-97d35dd7d193 tempest-VolumesTransfersV355Test-1189875395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48c5f72e-74c6-40c7-8fc9-4ccb2a11e613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23a0fc15-9aa1-4f10-8aba-75ed724d926c', 'volume_name': 'volume-23a0fc15-9aa1-4f10-8aba-75ed724d926c', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:44.524868 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-555827bf-4db2-41e0-8032-97d35dd7d193 tempest-VolumesTransfersV355Test-1189875395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06955070-1296-43b9-a16d-da8755e0249b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:44.529160 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-555827bf-4db2-41e0-8032-97d35dd7d193 tempest-VolumesTransfersV355Test-1189875395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06955070-1296-43b9-a16d-da8755e0249b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:44.534847 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-555827bf-4db2-41e0-8032-97d35dd7d193 tempest-VolumesTransfersV355Test-1189875395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (252cda95-4eac-4609-aea9-a430de01d72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:44.535963 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-555827bf-4db2-41e0-8032-97d35dd7d193 tempest-VolumesTransfersV355Test-1189875395 None] Volume 23a0fc15-9aa1-4f10-8aba-75ed724d926c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23a0fc15-9aa1-4f10-8aba-75ed724d926c', 'volume_size': 1} Mar 12 21:12:44.536351 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-555827bf-4db2-41e0-8032-97d35dd7d193 tempest-VolumesTransfersV355Test-1189875395 None] creating volume 'volume-23a0fc15-9aa1-4f10-8aba-75ed724d926c' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:12:44.537344 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-555827bf-4db2-41e0-8032-97d35dd7d193 tempest-VolumesTransfersV355Test-1189875395 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:44.595364 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-555827bf-4db2-41e0-8032-97d35dd7d193 tempest-VolumesTransfersV355Test-1189875395 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:12:44.596334 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-555827bf-4db2-41e0-8032-97d35dd7d193 tempest-VolumesTransfersV355Test-1189875395 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:12:44.600188 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-555827bf-4db2-41e0-8032-97d35dd7d193 tempest-VolumesTransfersV355Test-1189875395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (252cda95-4eac-4609-aea9-a430de01d72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23a0fc15-9aa1-4f10-8aba-75ed724d926c', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:44.604982 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-555827bf-4db2-41e0-8032-97d35dd7d193 tempest-VolumesTransfersV355Test-1189875395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f492681-f031-49cf-8358-e31f0177fd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:44.614668 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-555827bf-4db2-41e0-8032-97d35dd7d193 tempest-VolumesTransfersV355Test-1189875395 None] Volume volume-23a0fc15-9aa1-4f10-8aba-75ed724d926c (23a0fc15-9aa1-4f10-8aba-75ed724d926c): created successfully Mar 12 21:12:44.618636 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-555827bf-4db2-41e0-8032-97d35dd7d193 tempest-VolumesTransfersV355Test-1189875395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f492681-f031-49cf-8358-e31f0177fd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:44.624327 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-555827bf-4db2-41e0-8032-97d35dd7d193 tempest-VolumesTransfersV355Test-1189875395 None] Flow 'volume_create_manager' (ad0fdd94-d1c9-4850-a418-4e193e24167b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:12:44.632496 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-555827bf-4db2-41e0-8032-97d35dd7d193 tempest-VolumesTransfersV355Test-1189875395 None] Created volume successfully. Mar 12 21:12:45.039106 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-98370e32-b903-4e76-8313-9203f16dbf66 tempest-VolumesSnapshotTestJSON-1127165440 None] Lock "b'cinder-88097469-8b39-49d7-906e-8540ba31b9d2-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.016s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:12:45.041181 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-98370e32-b903-4e76-8313-9203f16dbf66 tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:45.747500 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-20f35cb2-b9ad-4667-b275-38a224268799 tempest-VolumesTransfersV355Test-1945695507 None] Lock "b'cinder-23a0fc15-9aa1-4f10-8aba-75ed724d926c-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:12:45.777062 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-20f35cb2-b9ad-4667-b275-38a224268799 tempest-VolumesTransfersV355Test-1945695507 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:45.842545 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-20f35cb2-b9ad-4667-b275-38a224268799 tempest-VolumesTransfersV355Test-1945695507 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:12:45.842933 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-20f35cb2-b9ad-4667-b275-38a224268799 tempest-VolumesTransfersV355Test-1945695507 None] Volume volume-23a0fc15-9aa1-4f10-8aba-75ed724d926c is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:12:45.852293 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-20f35cb2-b9ad-4667-b275-38a224268799 tempest-VolumesTransfersV355Test-1945695507 None] deleting rbd volume volume-23a0fc15-9aa1-4f10-8aba-75ed724d926c {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:12:46.206159 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-20f35cb2-b9ad-4667-b275-38a224268799 tempest-VolumesTransfersV355Test-1945695507 None] Created reservations ['05a23ec8-3c69-4206-91e7-3030877cd3bd', '831db6f3-780c-4ee2-9587-c2bfe535ffe2', '5e3465e9-a169-469d-ab63-516676f05602', 'cb466c80-8dd2-4aa2-8cdc-3b61b1ee854c'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:12:46.270440 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-20f35cb2-b9ad-4667-b275-38a224268799 tempest-VolumesTransfersV355Test-1945695507 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:46.299723 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-20f35cb2-b9ad-4667-b275-38a224268799 tempest-VolumesTransfersV355Test-1945695507 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:46.329026 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-20f35cb2-b9ad-4667-b275-38a224268799 tempest-VolumesTransfersV355Test-1945695507 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:12:46.333690 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-20f35cb2-b9ad-4667-b275-38a224268799 tempest-VolumesTransfersV355Test-1945695507 None] Deleted volume successfully. Mar 12 21:12:46.345829 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-20f35cb2-b9ad-4667-b275-38a224268799 tempest-VolumesTransfersV355Test-1945695507 None] Lock "b'cinder-23a0fc15-9aa1-4f10-8aba-75ed724d926c-delete_volume'" released by "delete_volume" :: held 0.598s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:12:51.307896 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:12:51.309834 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:51.347338 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:51.387733 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:12:51.555353 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d45d753-1b39-4096-8452-7f685e945525 tempest-VolumesActionsTest-192579851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:12:51.559699 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-0d45d753-1b39-4096-8452-7f685e945525 tempest-VolumesActionsTest-192579851 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:12:51.560147 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-0d45d753-1b39-4096-8452-7f685e945525 tempest-VolumesActionsTest-192579851 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:12:51.582945 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0d45d753-1b39-4096-8452-7f685e945525 tempest-VolumesActionsTest-192579851 None] Flow 'volume_create_manager' (d18e301b-30a6-4a7b-b4d6-c099aed682c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:12:51.590016 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0d45d753-1b39-4096-8452-7f685e945525 tempest-VolumesActionsTest-192579851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12c50ece-6e60-4eca-92bc-bac6651451db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:51.598123 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-0d45d753-1b39-4096-8452-7f685e945525 tempest-VolumesActionsTest-192579851 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:12:51.613383 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0d45d753-1b39-4096-8452-7f685e945525 tempest-VolumesActionsTest-192579851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12c50ece-6e60-4eca-92bc-bac6651451db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1921977178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=27688eee-468c-4ccf-b11e-9c82fbcbd42d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5723877279b461baac745c825906ba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:12:52Z,use_quota=True,user_id='0cbb67154fb040359bf0c5460995d665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:51.619968 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0d45d753-1b39-4096-8452-7f685e945525 tempest-VolumesActionsTest-192579851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (122f15a0-976f-407c-ad74-c0b4fc1b24a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:51.624448 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0d45d753-1b39-4096-8452-7f685e945525 tempest-VolumesActionsTest-192579851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (122f15a0-976f-407c-ad74-c0b4fc1b24a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:51.630305 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0d45d753-1b39-4096-8452-7f685e945525 tempest-VolumesActionsTest-192579851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c04f359-7367-4e24-a556-b81e3dc1c74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:51.634723 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0d45d753-1b39-4096-8452-7f685e945525 tempest-VolumesActionsTest-192579851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c04f359-7367-4e24-a556-b81e3dc1c74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27688eee-468c-4ccf-b11e-9c82fbcbd42d', 'volume_name': 'volume-27688eee-468c-4ccf-b11e-9c82fbcbd42d', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:51.639918 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0d45d753-1b39-4096-8452-7f685e945525 tempest-VolumesActionsTest-192579851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc70c479-d1d4-4ba9-a6e9-c997f8be162c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:51.644755 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0d45d753-1b39-4096-8452-7f685e945525 tempest-VolumesActionsTest-192579851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc70c479-d1d4-4ba9-a6e9-c997f8be162c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:51.649967 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0d45d753-1b39-4096-8452-7f685e945525 tempest-VolumesActionsTest-192579851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ebb4373-450a-471f-a4e9-ff02dd13205c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:51.651687 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-0d45d753-1b39-4096-8452-7f685e945525 tempest-VolumesActionsTest-192579851 None] Volume 27688eee-468c-4ccf-b11e-9c82fbcbd42d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27688eee-468c-4ccf-b11e-9c82fbcbd42d', 'volume_size': 1} Mar 12 21:12:51.652254 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-0d45d753-1b39-4096-8452-7f685e945525 tempest-VolumesActionsTest-192579851 None] creating volume 'volume-27688eee-468c-4ccf-b11e-9c82fbcbd42d' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:12:51.653279 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-0d45d753-1b39-4096-8452-7f685e945525 tempest-VolumesActionsTest-192579851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:12:51.736969 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-0d45d753-1b39-4096-8452-7f685e945525 tempest-VolumesActionsTest-192579851 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:12:51.737521 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-0d45d753-1b39-4096-8452-7f685e945525 tempest-VolumesActionsTest-192579851 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:12:51.742029 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0d45d753-1b39-4096-8452-7f685e945525 tempest-VolumesActionsTest-192579851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ebb4373-450a-471f-a4e9-ff02dd13205c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27688eee-468c-4ccf-b11e-9c82fbcbd42d', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:51.748045 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0d45d753-1b39-4096-8452-7f685e945525 tempest-VolumesActionsTest-192579851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ea71459-3988-43fd-8217-eccd2085d110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:12:51.759794 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-0d45d753-1b39-4096-8452-7f685e945525 tempest-VolumesActionsTest-192579851 None] Volume volume-27688eee-468c-4ccf-b11e-9c82fbcbd42d (27688eee-468c-4ccf-b11e-9c82fbcbd42d): created successfully Mar 12 21:12:51.764609 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0d45d753-1b39-4096-8452-7f685e945525 tempest-VolumesActionsTest-192579851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ea71459-3988-43fd-8217-eccd2085d110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:12:51.771568 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0d45d753-1b39-4096-8452-7f685e945525 tempest-VolumesActionsTest-192579851 None] Flow 'volume_create_manager' (d18e301b-30a6-4a7b-b4d6-c099aed682c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:12:51.780652 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-0d45d753-1b39-4096-8452-7f685e945525 tempest-VolumesActionsTest-192579851 None] Created volume successfully. Mar 12 21:13:05.832723 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-cf01c364-5de0-4415-a1c1-341251a2173f tempest-VolumesActionsTest-192579851 None] Lock "b'cinder-27688eee-468c-4ccf-b11e-9c82fbcbd42d'" acquired by "attach_volume" :: waited 0.010s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:13:05.882607 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-cf01c364-5de0-4415-a1c1-341251a2173f tempest-VolumesActionsTest-192579851 None] Attaching volume 27688eee-468c-4ccf-b11e-9c82fbcbd42d to instance 5289dfa1-67a8-48f5-8724-dff16e81e4db at mountpoint /dev/sdb on host None. Mar 12 21:13:05.909652 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-cf01c364-5de0-4415-a1c1-341251a2173f tempest-VolumesActionsTest-192579851 None] Attach volume completed successfully. Mar 12 21:13:05.914002 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-cf01c364-5de0-4415-a1c1-341251a2173f tempest-VolumesActionsTest-192579851 None] Lock "b'cinder-27688eee-468c-4ccf-b11e-9c82fbcbd42d'" released by "attach_volume" :: held 0.082s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:13:06.022811 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-1b633c29-0284-4905-a59f-2a73f0d6727d tempest-VolumesActionsTest-192579851 None] Lock "b'cinder-27688eee-468c-4ccf-b11e-9c82fbcbd42d-detach_volume'" acquired by "detach_volume" :: waited 0.009s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:13:06.023309 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-1b633c29-0284-4905-a59f-2a73f0d6727d tempest-VolumesActionsTest-192579851 None] Detaching volume 27688eee-468c-4ccf-b11e-9c82fbcbd42d from instance 5289dfa1-67a8-48f5-8724-dff16e81e4db. Mar 12 21:13:06.064707 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-1b633c29-0284-4905-a59f-2a73f0d6727d tempest-VolumesActionsTest-192579851 None] Detach volume completed successfully. Mar 12 21:13:06.070110 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-1b633c29-0284-4905-a59f-2a73f0d6727d tempest-VolumesActionsTest-192579851 None] Lock "b'cinder-27688eee-468c-4ccf-b11e-9c82fbcbd42d-detach_volume'" released by "detach_volume" :: held 0.047s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:13:15.212292 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-98370e32-b903-4e76-8313-9203f16dbf66 tempest-VolumesSnapshotTestJSON-1127165440 None] Created reservations ['c847851e-c0ee-4e6f-aedd-3811e536e1ce', 'c5252cd2-d979-4ce1-9e6f-633c13471744', 'a8735f8c-ac45-4b9b-ab72-d22f8dda9da1', '3cf947cb-19ab-434d-b1fd-7aefc8d1c0cd'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:13:15.253100 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-98370e32-b903-4e76-8313-9203f16dbf66 tempest-VolumesSnapshotTestJSON-1127165440 None] Delete snapshot completed successfully. Mar 12 21:13:15.258342 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-98370e32-b903-4e76-8313-9203f16dbf66 tempest-VolumesSnapshotTestJSON-1127165440 None] Lock "b'cinder-88097469-8b39-49d7-906e-8540ba31b9d2-delete_snapshot'" released by "delete_snapshot" :: held 30.219s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:13:16.890906 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-1ea034e1-4b27-4bdb-84a7-51b735040d72 req-709943f8-995f-4891-892b-15c17cc19928 tempest-VolumesSnapshotTestJSON-1127165440 None] Terminate volume connection completed successfully. Mar 12 21:13:16.892519 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-1ea034e1-4b27-4bdb-84a7-51b735040d72 req-709943f8-995f-4891-892b-15c17cc19928 tempest-VolumesSnapshotTestJSON-1127165440 None] Deleting attachment e76e1dfa-8102-470e-bd41-2b380b3ef6bb. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 21:13:21.755567 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-900cfdd7-bf4c-4701-9818-ec16616d0474 tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:13:22.445087 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-900cfdd7-bf4c-4701-9818-ec16616d0474 tempest-VolumesSnapshotTestJSON-1127165440 None] Create snapshot completed successfully Mar 12 21:13:22.773105 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-0c945247-b6f9-4ebd-88e4-5540e460cf8e tempest-VolumesActionsTest-192579851 None] Lock "b'cinder-27688eee-468c-4ccf-b11e-9c82fbcbd42d'" acquired by "attach_volume" :: waited 0.009s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:13:22.828870 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-0c945247-b6f9-4ebd-88e4-5540e460cf8e tempest-VolumesActionsTest-192579851 None] Attaching volume 27688eee-468c-4ccf-b11e-9c82fbcbd42d to instance 094c8994-a412-4b04-bf27-848bb1d10327 at mountpoint /dev/sdb on host None. Mar 12 21:13:22.865181 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-0c945247-b6f9-4ebd-88e4-5540e460cf8e tempest-VolumesActionsTest-192579851 None] Attach volume completed successfully. Mar 12 21:13:22.871910 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-0c945247-b6f9-4ebd-88e4-5540e460cf8e tempest-VolumesActionsTest-192579851 None] Lock "b'cinder-27688eee-468c-4ccf-b11e-9c82fbcbd42d'" released by "attach_volume" :: held 0.098s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:13:22.952565 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-18899f66-b9de-425e-94d9-00b6915e44a1 tempest-VolumesSnapshotTestJSON-1127165440 None] Lock "b'cinder-5c4eaaaa-3523-4a69-84c6-8ae8d4c0607e-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.016s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:13:22.954500 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-18899f66-b9de-425e-94d9-00b6915e44a1 tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:13:23.161350 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-f6b14fb4-ea15-49ca-831a-5ad26095fc13 tempest-VolumesActionsTest-192579851 None] Lock "b'cinder-27688eee-468c-4ccf-b11e-9c82fbcbd42d-detach_volume'" acquired by "detach_volume" :: waited 0.028s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:13:23.161857 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-f6b14fb4-ea15-49ca-831a-5ad26095fc13 tempest-VolumesActionsTest-192579851 None] Detaching volume 27688eee-468c-4ccf-b11e-9c82fbcbd42d from instance 094c8994-a412-4b04-bf27-848bb1d10327. Mar 12 21:13:23.240275 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-f6b14fb4-ea15-49ca-831a-5ad26095fc13 tempest-VolumesActionsTest-192579851 None] Detach volume completed successfully. Mar 12 21:13:23.249839 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-f6b14fb4-ea15-49ca-831a-5ad26095fc13 tempest-VolumesActionsTest-192579851 None] Lock "b'cinder-27688eee-468c-4ccf-b11e-9c82fbcbd42d-detach_volume'" released by "detach_volume" :: held 0.088s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:13:24.160612 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-18899f66-b9de-425e-94d9-00b6915e44a1 tempest-VolumesSnapshotTestJSON-1127165440 None] Created reservations ['6b134f0d-5c2f-4f55-9366-0f8d70c2ae07', '128660fd-5e23-4cc2-bd87-936f8e0131ec', '59010df5-866e-4ff8-87e5-9a61d71c571b', 'bdf83e21-6381-4ba4-b802-37c789ef7868'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:13:24.194623 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-18899f66-b9de-425e-94d9-00b6915e44a1 tempest-VolumesSnapshotTestJSON-1127165440 None] Delete snapshot completed successfully. Mar 12 21:13:24.199995 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-18899f66-b9de-425e-94d9-00b6915e44a1 tempest-VolumesSnapshotTestJSON-1127165440 None] Lock "b'cinder-5c4eaaaa-3523-4a69-84c6-8ae8d4c0607e-delete_snapshot'" released by "delete_snapshot" :: held 1.248s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:13:25.314185 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d9fbf64a-ce67-40b9-9fbc-6c3450ebe530 tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:13:26.501394 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-d9fbf64a-ce67-40b9-9fbc-6c3450ebe530 tempest-VolumesSnapshotTestJSON-1127165440 None] Create snapshot completed successfully Mar 12 21:13:27.435160 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [None req-fa111658-d837-4cc0-9f92-d9a49675ce3a tempest-VolumesActionsTest-192579851 None] Running cmd (subprocess): rbd export --pool volumes volume-27688eee-468c-4ccf-b11e-9c82fbcbd42d /opt/stack/data/cinder/conversion/volume-27688eee-468c-4ccf-b11e-9c82fbcbd42d-a3ef65ce-b7f5-4910-a258-170c25b1f372 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 21:13:28.317802 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [None req-fa111658-d837-4cc0-9f92-d9a49675ce3a tempest-VolumesActionsTest-192579851 None] CMD "rbd export --pool volumes volume-27688eee-468c-4ccf-b11e-9c82fbcbd42d /opt/stack/data/cinder/conversion/volume-27688eee-468c-4ccf-b11e-9c82fbcbd42d-a3ef65ce-b7f5-4910-a258-170c25b1f372 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.882s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 21:13:28.330573 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.image_utils [None req-fa111658-d837-4cc0-9f92-d9a49675ce3a tempest-VolumesActionsTest-192579851 None] a3ef65ce-b7f5-4910-a258-170c25b1f372 was raw, no need to convert to raw {{(pid=129531) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:815}} Mar 12 21:13:45.509094 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-3adc30b5-dd11-4bf4-b49f-8948d96bf3bb req-d91d6f6b-7931-4d66-882a-c3b642ca6409 tempest-VolumesSnapshotTestJSON-1127165440 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 21:13:46.781837 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-3adc30b5-dd11-4bf4-b49f-8948d96bf3bb req-d91d6f6b-7931-4d66-882a-c3b642ca6409 tempest-VolumesSnapshotTestJSON-1127165440 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.272s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 21:13:46.782724 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-3adc30b5-dd11-4bf4-b49f-8948d96bf3bb req-d91d6f6b-7931-4d66-882a-c3b642ca6409 tempest-VolumesSnapshotTestJSON-1127165440 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7aa69d6a-de21-48b0-a279-c3e51e53b549', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': '7aa69d6a-de21-48b0-a279-c3e51e53b549', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 21:13:46.810925 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-3adc30b5-dd11-4bf4-b49f-8948d96bf3bb req-d91d6f6b-7931-4d66-882a-c3b642ca6409 tempest-VolumesSnapshotTestJSON-1127165440 None] Connection info returned from driver {'name': 'volumes/volume-7aa69d6a-de21-48b0-a279-c3e51e53b549', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7aa69d6a-de21-48b0-a279-c3e51e53b549', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c659bedf-5d4c-4a6a-ae23-27c64549ef5b'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 21:13:46.890596 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-3adc30b5-dd11-4bf4-b49f-8948d96bf3bb req-d91d6f6b-7931-4d66-882a-c3b642ca6409 tempest-VolumesSnapshotTestJSON-1127165440 None] attachment_update completed successfully. Mar 12 21:13:49.019920 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-739f0880-0147-48a5-98c5-a25f8ce88864 tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:13:49.534326 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-739f0880-0147-48a5-98c5-a25f8ce88864 tempest-VolumesSnapshotTestJSON-1127165440 None] Create snapshot completed successfully Mar 12 21:13:50.408439 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-08907362-f297-415e-9082-4406e2b475e5 tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:13:51.304289 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:13:51.305954 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:13:51.377689 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:13:51.439998 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:13:51.724578 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-08907362-f297-415e-9082-4406e2b475e5 tempest-VolumesSnapshotTestJSON-1127165440 None] Create snapshot completed successfully Mar 12 21:13:52.603310 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-a47bed14-886b-4e0a-b9a6-8077ebc7d008 tempest-VolumesSnapshotTestJSON-1127165440 None] Lock "b'cinder-a30fc796-65b8-4257-ac31-5803972c0d41-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:13:52.605567 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a47bed14-886b-4e0a-b9a6-8077ebc7d008 tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:13:55.583728 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-fa111658-d837-4cc0-9f92-d9a49675ce3a tempest-VolumesActionsTest-192579851 None] Uploaded volume to glance image-id: a3ef65ce-b7f5-4910-a258-170c25b1f372. {{(pid=129531) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1745}} Mar 12 21:13:55.602157 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-fa111658-d837-4cc0-9f92-d9a49675ce3a tempest-VolumesActionsTest-192579851 None] Copy volume to image completed successfully. Mar 12 21:13:57.219645 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-223d6823-21b9-4ec3-ae1a-3e6355383389 tempest-VolumesActionsTest-192579851 None] Lock "b'cinder-27688eee-468c-4ccf-b11e-9c82fbcbd42d-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:13:57.259992 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-223d6823-21b9-4ec3-ae1a-3e6355383389 tempest-VolumesActionsTest-192579851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:13:57.325606 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-223d6823-21b9-4ec3-ae1a-3e6355383389 tempest-VolumesActionsTest-192579851 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:13:57.326176 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-223d6823-21b9-4ec3-ae1a-3e6355383389 tempest-VolumesActionsTest-192579851 None] Volume volume-27688eee-468c-4ccf-b11e-9c82fbcbd42d is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:13:57.334919 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-223d6823-21b9-4ec3-ae1a-3e6355383389 tempest-VolumesActionsTest-192579851 None] deleting rbd volume volume-27688eee-468c-4ccf-b11e-9c82fbcbd42d {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:13:57.746761 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-223d6823-21b9-4ec3-ae1a-3e6355383389 tempest-VolumesActionsTest-192579851 None] Created reservations ['9b16b16e-0628-4c14-98fe-8b1b1b3226a0', 'c1778e98-1031-4582-9ec7-94ffc6fd6c37', 'a5a764bc-1f6e-485f-b0a3-8f4cf1689f3f', '3cbe8baa-e966-4c87-af6f-c927ae688b2b'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:13:57.801794 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-223d6823-21b9-4ec3-ae1a-3e6355383389 tempest-VolumesActionsTest-192579851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:13:57.831923 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-223d6823-21b9-4ec3-ae1a-3e6355383389 tempest-VolumesActionsTest-192579851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:13:57.878857 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-223d6823-21b9-4ec3-ae1a-3e6355383389 tempest-VolumesActionsTest-192579851 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:13:57.885343 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-223d6823-21b9-4ec3-ae1a-3e6355383389 tempest-VolumesActionsTest-192579851 None] Deleted volume successfully. Mar 12 21:13:57.903204 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-223d6823-21b9-4ec3-ae1a-3e6355383389 tempest-VolumesActionsTest-192579851 None] Lock "b'cinder-27688eee-468c-4ccf-b11e-9c82fbcbd42d-delete_volume'" released by "delete_volume" :: held 0.682s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:14:02.728163 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-c219600a-e294-48a4-b0de-65b725fdfa0f tempest-VolumesNegativeTest-134266749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:14:02.731612 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-c219600a-e294-48a4-b0de-65b725fdfa0f tempest-VolumesNegativeTest-134266749 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:14:02.732080 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-c219600a-e294-48a4-b0de-65b725fdfa0f tempest-VolumesNegativeTest-134266749 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:14:02.752873 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c219600a-e294-48a4-b0de-65b725fdfa0f tempest-VolumesNegativeTest-134266749 None] Flow 'volume_create_manager' (269e8fe5-aff5-4b4f-9040-f0cb92149868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:14:02.759485 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c219600a-e294-48a4-b0de-65b725fdfa0f tempest-VolumesNegativeTest-134266749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b763f345-50d9-458a-8df5-7e7cf5d64b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:02.766966 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-c219600a-e294-48a4-b0de-65b725fdfa0f tempest-VolumesNegativeTest-134266749 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:14:02.781449 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c219600a-e294-48a4-b0de-65b725fdfa0f tempest-VolumesNegativeTest-134266749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b763f345-50d9-458a-8df5-7e7cf5d64b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1978140962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=88dfd701-8cc1-4e4f-ab61-ab2ff3deef42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e9f7e3df0b412d9cd07bacc8873fcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:14:03Z,use_quota=True,user_id='d130f87046374d9096555d9df2bdbed7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:02.788383 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c219600a-e294-48a4-b0de-65b725fdfa0f tempest-VolumesNegativeTest-134266749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0450f826-98a3-4783-8f00-ae011139856d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:02.792591 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c219600a-e294-48a4-b0de-65b725fdfa0f tempest-VolumesNegativeTest-134266749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0450f826-98a3-4783-8f00-ae011139856d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:02.797940 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c219600a-e294-48a4-b0de-65b725fdfa0f tempest-VolumesNegativeTest-134266749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae786017-a578-49ea-9cae-80514a2657db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:02.802176 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c219600a-e294-48a4-b0de-65b725fdfa0f tempest-VolumesNegativeTest-134266749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae786017-a578-49ea-9cae-80514a2657db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88dfd701-8cc1-4e4f-ab61-ab2ff3deef42', 'volume_name': 'volume-88dfd701-8cc1-4e4f-ab61-ab2ff3deef42', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:02.807419 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c219600a-e294-48a4-b0de-65b725fdfa0f tempest-VolumesNegativeTest-134266749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615adfb1-985e-4192-a3f4-ad0665f87ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:02.814716 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c219600a-e294-48a4-b0de-65b725fdfa0f tempest-VolumesNegativeTest-134266749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615adfb1-985e-4192-a3f4-ad0665f87ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:02.823805 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c219600a-e294-48a4-b0de-65b725fdfa0f tempest-VolumesNegativeTest-134266749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3c0dd67-ac34-4764-a1ba-2b3418c2e497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:02.825173 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-c219600a-e294-48a4-b0de-65b725fdfa0f tempest-VolumesNegativeTest-134266749 None] Volume 88dfd701-8cc1-4e4f-ab61-ab2ff3deef42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88dfd701-8cc1-4e4f-ab61-ab2ff3deef42', 'volume_size': 1} Mar 12 21:14:02.825573 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c219600a-e294-48a4-b0de-65b725fdfa0f tempest-VolumesNegativeTest-134266749 None] creating volume 'volume-88dfd701-8cc1-4e4f-ab61-ab2ff3deef42' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:14:02.828042 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c219600a-e294-48a4-b0de-65b725fdfa0f tempest-VolumesNegativeTest-134266749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:14:02.903474 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c219600a-e294-48a4-b0de-65b725fdfa0f tempest-VolumesNegativeTest-134266749 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:14:02.903949 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c219600a-e294-48a4-b0de-65b725fdfa0f tempest-VolumesNegativeTest-134266749 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:14:02.910399 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c219600a-e294-48a4-b0de-65b725fdfa0f tempest-VolumesNegativeTest-134266749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3c0dd67-ac34-4764-a1ba-2b3418c2e497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88dfd701-8cc1-4e4f-ab61-ab2ff3deef42', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:02.915252 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c219600a-e294-48a4-b0de-65b725fdfa0f tempest-VolumesNegativeTest-134266749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e463cadf-a185-4134-bcb7-d784d6dc08b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:02.927177 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-c219600a-e294-48a4-b0de-65b725fdfa0f tempest-VolumesNegativeTest-134266749 None] Volume volume-88dfd701-8cc1-4e4f-ab61-ab2ff3deef42 (88dfd701-8cc1-4e4f-ab61-ab2ff3deef42): created successfully Mar 12 21:14:02.931775 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c219600a-e294-48a4-b0de-65b725fdfa0f tempest-VolumesNegativeTest-134266749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e463cadf-a185-4134-bcb7-d784d6dc08b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:02.938569 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c219600a-e294-48a4-b0de-65b725fdfa0f tempest-VolumesNegativeTest-134266749 None] Flow 'volume_create_manager' (269e8fe5-aff5-4b4f-9040-f0cb92149868) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:14:02.947592 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-c219600a-e294-48a4-b0de-65b725fdfa0f tempest-VolumesNegativeTest-134266749 None] Created volume successfully. Mar 12 21:14:20.131933 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-657524b4-e10a-4067-974c-c6d85cab29c6 tempest-VolumesNegativeTest-134266749 None] Lock "b'cinder-88dfd701-8cc1-4e4f-ab61-ab2ff3deef42-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:14:20.197502 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-657524b4-e10a-4067-974c-c6d85cab29c6 tempest-VolumesNegativeTest-134266749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:14:20.263456 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-657524b4-e10a-4067-974c-c6d85cab29c6 tempest-VolumesNegativeTest-134266749 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:14:20.263841 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-657524b4-e10a-4067-974c-c6d85cab29c6 tempest-VolumesNegativeTest-134266749 None] Volume volume-88dfd701-8cc1-4e4f-ab61-ab2ff3deef42 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:14:20.270529 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-657524b4-e10a-4067-974c-c6d85cab29c6 tempest-VolumesNegativeTest-134266749 None] deleting rbd volume volume-88dfd701-8cc1-4e4f-ab61-ab2ff3deef42 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:14:20.571568 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-657524b4-e10a-4067-974c-c6d85cab29c6 tempest-VolumesNegativeTest-134266749 None] Created reservations ['33f47d17-8d4b-4f2a-9584-21df0501794c', 'a422b6ea-cccc-42bd-982f-752b56b688c2', 'da3ddb33-3128-4f8d-b8a9-ed270e0a74c7', '14b4cb9c-52e5-4cc6-9ccf-37f2f6533b3b'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:14:20.637576 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-657524b4-e10a-4067-974c-c6d85cab29c6 tempest-VolumesNegativeTest-134266749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:14:20.697005 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-657524b4-e10a-4067-974c-c6d85cab29c6 tempest-VolumesNegativeTest-134266749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:14:20.747811 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-657524b4-e10a-4067-974c-c6d85cab29c6 tempest-VolumesNegativeTest-134266749 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:14:20.758609 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-657524b4-e10a-4067-974c-c6d85cab29c6 tempest-VolumesNegativeTest-134266749 None] Deleted volume successfully. Mar 12 21:14:20.772473 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-657524b4-e10a-4067-974c-c6d85cab29c6 tempest-VolumesNegativeTest-134266749 None] Lock "b'cinder-88dfd701-8cc1-4e4f-ab61-ab2ff3deef42-delete_volume'" released by "delete_volume" :: held 0.641s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:14:22.831888 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-a47bed14-886b-4e0a-b9a6-8077ebc7d008 tempest-VolumesSnapshotTestJSON-1127165440 None] Created reservations ['04b1d80b-077b-4781-ab63-67d5b3a06cb6', 'e7516374-b7e1-4839-8177-5a0b67640e55', '9c687fc6-7c1e-4b65-9424-e13479426f8d', '71561703-dcfb-4a3b-bb8e-34bac7da5268'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:14:22.893369 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-a47bed14-886b-4e0a-b9a6-8077ebc7d008 tempest-VolumesSnapshotTestJSON-1127165440 None] Delete snapshot completed successfully. Mar 12 21:14:22.901090 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-a47bed14-886b-4e0a-b9a6-8077ebc7d008 tempest-VolumesSnapshotTestJSON-1127165440 None] Lock "b'cinder-a30fc796-65b8-4257-ac31-5803972c0d41-delete_snapshot'" released by "delete_snapshot" :: held 30.298s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:14:23.365311 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-9db6d35f-fd22-4734-a305-fdb5b71a98a9 tempest-VolumeTypesAccessTest-1894358591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:14:23.368535 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-9db6d35f-fd22-4734-a305-fdb5b71a98a9 tempest-VolumeTypesAccessTest-1894358591 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:14:23.368981 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-9db6d35f-fd22-4734-a305-fdb5b71a98a9 tempest-VolumeTypesAccessTest-1894358591 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:14:23.388767 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9db6d35f-fd22-4734-a305-fdb5b71a98a9 tempest-VolumeTypesAccessTest-1894358591 None] Flow 'volume_create_manager' (826186c5-316c-4b74-bfce-6b3bbc2b348e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:14:23.395700 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9db6d35f-fd22-4734-a305-fdb5b71a98a9 tempest-VolumeTypesAccessTest-1894358591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd256d77-2a43-4edf-821e-f542053216ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:23.402229 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-9db6d35f-fd22-4734-a305-fdb5b71a98a9 tempest-VolumeTypesAccessTest-1894358591 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:14:23.415948 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9db6d35f-fd22-4734-a305-fdb5b71a98a9 tempest-VolumeTypesAccessTest-1894358591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd256d77-2a43-4edf-821e-f542053216ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-790826801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2863c75e-900d-402d-a940-86d0ccadbd6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b08f01743c924b02adb2183ed6ab8cad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:14:23Z,use_quota=True,user_id='ca567810f0d3463d8b52cc8812d692bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9474cee-1021-4162-8367-4c0a13607155),volume_type_id=e9474cee-1021-4162-8367-4c0a13607155)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:23.422081 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9db6d35f-fd22-4734-a305-fdb5b71a98a9 tempest-VolumeTypesAccessTest-1894358591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1b57b34-fcc5-4c2e-961f-35f20f2be299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:23.426507 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9db6d35f-fd22-4734-a305-fdb5b71a98a9 tempest-VolumeTypesAccessTest-1894358591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1b57b34-fcc5-4c2e-961f-35f20f2be299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:23.432080 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9db6d35f-fd22-4734-a305-fdb5b71a98a9 tempest-VolumeTypesAccessTest-1894358591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af14e127-1b0c-4a01-84c7-6d1c9d4342cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:23.437347 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9db6d35f-fd22-4734-a305-fdb5b71a98a9 tempest-VolumeTypesAccessTest-1894358591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af14e127-1b0c-4a01-84c7-6d1c9d4342cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2863c75e-900d-402d-a940-86d0ccadbd6a', 'volume_name': 'volume-2863c75e-900d-402d-a940-86d0ccadbd6a', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:23.443161 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9db6d35f-fd22-4734-a305-fdb5b71a98a9 tempest-VolumeTypesAccessTest-1894358591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfcff406-c7e3-4c8c-aa86-642440aeee2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:23.448124 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9db6d35f-fd22-4734-a305-fdb5b71a98a9 tempest-VolumeTypesAccessTest-1894358591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfcff406-c7e3-4c8c-aa86-642440aeee2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:23.456371 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9db6d35f-fd22-4734-a305-fdb5b71a98a9 tempest-VolumeTypesAccessTest-1894358591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d7c9ab2-b4c6-4e27-a827-566de5211a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:23.457931 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-9db6d35f-fd22-4734-a305-fdb5b71a98a9 tempest-VolumeTypesAccessTest-1894358591 None] Volume 2863c75e-900d-402d-a940-86d0ccadbd6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2863c75e-900d-402d-a940-86d0ccadbd6a', 'volume_size': 1} Mar 12 21:14:23.458505 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9db6d35f-fd22-4734-a305-fdb5b71a98a9 tempest-VolumeTypesAccessTest-1894358591 None] creating volume 'volume-2863c75e-900d-402d-a940-86d0ccadbd6a' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:14:23.460157 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9db6d35f-fd22-4734-a305-fdb5b71a98a9 tempest-VolumeTypesAccessTest-1894358591 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:14:23.534748 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9db6d35f-fd22-4734-a305-fdb5b71a98a9 tempest-VolumeTypesAccessTest-1894358591 None] extra_specs: {} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:14:23.535422 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9db6d35f-fd22-4734-a305-fdb5b71a98a9 tempest-VolumeTypesAccessTest-1894358591 None] extra_specs: {} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:14:23.540990 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9db6d35f-fd22-4734-a305-fdb5b71a98a9 tempest-VolumeTypesAccessTest-1894358591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d7c9ab2-b4c6-4e27-a827-566de5211a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2863c75e-900d-402d-a940-86d0ccadbd6a', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:23.546813 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9db6d35f-fd22-4734-a305-fdb5b71a98a9 tempest-VolumeTypesAccessTest-1894358591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a292d9-d166-4b6b-808a-67925dbbe60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:23.559774 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-9db6d35f-fd22-4734-a305-fdb5b71a98a9 tempest-VolumeTypesAccessTest-1894358591 None] Volume volume-2863c75e-900d-402d-a940-86d0ccadbd6a (2863c75e-900d-402d-a940-86d0ccadbd6a): created successfully Mar 12 21:14:23.564763 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9db6d35f-fd22-4734-a305-fdb5b71a98a9 tempest-VolumeTypesAccessTest-1894358591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a292d9-d166-4b6b-808a-67925dbbe60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:23.571891 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9db6d35f-fd22-4734-a305-fdb5b71a98a9 tempest-VolumeTypesAccessTest-1894358591 None] Flow 'volume_create_manager' (826186c5-316c-4b74-bfce-6b3bbc2b348e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:14:23.582721 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-9db6d35f-fd22-4734-a305-fdb5b71a98a9 tempest-VolumeTypesAccessTest-1894358591 None] Created volume successfully. Mar 12 21:14:23.896037 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-08378bd5-be38-4175-8618-ee265d3e8dce tempest-VolumesSnapshotTestJSON-1127165440 None] Lock "b'cinder-22613e67-f638-49df-b899-1b760bb43b29-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:14:23.897657 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-08378bd5-be38-4175-8618-ee265d3e8dce tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:14:24.793624 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-a35e68e7-f1a2-4655-a3c8-3a3cae36fdb5 tempest-VolumeTypesAccessTest-1894358591 None] Lock "b'cinder-2863c75e-900d-402d-a940-86d0ccadbd6a-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:14:24.838929 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a35e68e7-f1a2-4655-a3c8-3a3cae36fdb5 tempest-VolumeTypesAccessTest-1894358591 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:14:24.893335 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a35e68e7-f1a2-4655-a3c8-3a3cae36fdb5 tempest-VolumeTypesAccessTest-1894358591 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:14:24.893753 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a35e68e7-f1a2-4655-a3c8-3a3cae36fdb5 tempest-VolumeTypesAccessTest-1894358591 None] Volume volume-2863c75e-900d-402d-a940-86d0ccadbd6a is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:14:24.901030 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a35e68e7-f1a2-4655-a3c8-3a3cae36fdb5 tempest-VolumeTypesAccessTest-1894358591 None] deleting rbd volume volume-2863c75e-900d-402d-a940-86d0ccadbd6a {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:14:25.129963 ncdv-master-1 cinder-volume[129531]: WARNING cinder.quota [None req-a35e68e7-f1a2-4655-a3c8-3a3cae36fdb5 tempest-VolumeTypesAccessTest-1894358591 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-917786435 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-917786435, it is now deprecated. Please use the default quota class for default quota. Mar 12 21:14:25.130880 ncdv-master-1 cinder-volume[129531]: WARNING cinder.quota [None req-a35e68e7-f1a2-4655-a3c8-3a3cae36fdb5 tempest-VolumeTypesAccessTest-1894358591 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-917786435 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-917786435, it is now deprecated. Please use the default quota class for default quota. Mar 12 21:14:25.146441 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-a35e68e7-f1a2-4655-a3c8-3a3cae36fdb5 tempest-VolumeTypesAccessTest-1894358591 None] Created reservations ['eebaf790-7afd-4db5-a91a-9e978d7df890', '266e158b-97bd-471c-b2e0-96c7acd38c6b', '321c846d-491e-4e7e-8ee9-ecaec9e95341', 'a3893094-811a-4249-8fc2-e6e84d6493f2'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:14:25.205908 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a35e68e7-f1a2-4655-a3c8-3a3cae36fdb5 tempest-VolumeTypesAccessTest-1894358591 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:14:25.261440 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a35e68e7-f1a2-4655-a3c8-3a3cae36fdb5 tempest-VolumeTypesAccessTest-1894358591 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:14:25.315112 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a35e68e7-f1a2-4655-a3c8-3a3cae36fdb5 tempest-VolumeTypesAccessTest-1894358591 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:14:25.322409 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-a35e68e7-f1a2-4655-a3c8-3a3cae36fdb5 tempest-VolumeTypesAccessTest-1894358591 None] Deleted volume successfully. Mar 12 21:14:25.342909 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-a35e68e7-f1a2-4655-a3c8-3a3cae36fdb5 tempest-VolumeTypesAccessTest-1894358591 None] Lock "b'cinder-2863c75e-900d-402d-a940-86d0ccadbd6a-delete_volume'" released by "delete_volume" :: held 0.549s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:14:31.057962 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-8689ef43-7aae-4e21-8303-3fb1695b4a4d tempest-VolumesMetadataTest-1427345173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:14:31.062831 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-8689ef43-7aae-4e21-8303-3fb1695b4a4d tempest-VolumesMetadataTest-1427345173 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:14:31.063485 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-8689ef43-7aae-4e21-8303-3fb1695b4a4d tempest-VolumesMetadataTest-1427345173 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:14:31.085819 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8689ef43-7aae-4e21-8303-3fb1695b4a4d tempest-VolumesMetadataTest-1427345173 None] Flow 'volume_create_manager' (c26ecb49-0d8d-48ab-a766-e69e0bef172e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:14:31.095276 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8689ef43-7aae-4e21-8303-3fb1695b4a4d tempest-VolumesMetadataTest-1427345173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09946de8-5a28-42a5-98f9-41c3996d875d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:31.110754 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-8689ef43-7aae-4e21-8303-3fb1695b4a4d tempest-VolumesMetadataTest-1427345173 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:14:31.130525 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8689ef43-7aae-4e21-8303-3fb1695b4a4d tempest-VolumesMetadataTest-1427345173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09946de8-5a28-42a5-98f9-41c3996d875d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1849514024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e792c658-5b35-48c0-bd68-066d9aa27f9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30311f0c18f440e18c4ee272b584e9e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:14:31Z,use_quota=True,user_id='3bb00ca89073490796bb2766b9422b22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:31.137030 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8689ef43-7aae-4e21-8303-3fb1695b4a4d tempest-VolumesMetadataTest-1427345173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f917e3-4d24-4336-9d3c-303608791b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:31.142743 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8689ef43-7aae-4e21-8303-3fb1695b4a4d tempest-VolumesMetadataTest-1427345173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f917e3-4d24-4336-9d3c-303608791b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:31.151097 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8689ef43-7aae-4e21-8303-3fb1695b4a4d tempest-VolumesMetadataTest-1427345173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe0b6f0c-b113-420f-9077-32d3d3e62c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:31.156675 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8689ef43-7aae-4e21-8303-3fb1695b4a4d tempest-VolumesMetadataTest-1427345173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe0b6f0c-b113-420f-9077-32d3d3e62c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e792c658-5b35-48c0-bd68-066d9aa27f9a', 'volume_name': 'volume-e792c658-5b35-48c0-bd68-066d9aa27f9a', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:31.162976 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8689ef43-7aae-4e21-8303-3fb1695b4a4d tempest-VolumesMetadataTest-1427345173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (602a6d38-815f-4c52-947b-7b8b93778414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:31.167659 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8689ef43-7aae-4e21-8303-3fb1695b4a4d tempest-VolumesMetadataTest-1427345173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (602a6d38-815f-4c52-947b-7b8b93778414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:31.176220 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8689ef43-7aae-4e21-8303-3fb1695b4a4d tempest-VolumesMetadataTest-1427345173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (794e3383-49b3-4336-aa8b-c86393213ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:31.177880 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-8689ef43-7aae-4e21-8303-3fb1695b4a4d tempest-VolumesMetadataTest-1427345173 None] Volume e792c658-5b35-48c0-bd68-066d9aa27f9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e792c658-5b35-48c0-bd68-066d9aa27f9a', 'volume_size': 1} Mar 12 21:14:31.178308 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8689ef43-7aae-4e21-8303-3fb1695b4a4d tempest-VolumesMetadataTest-1427345173 None] creating volume 'volume-e792c658-5b35-48c0-bd68-066d9aa27f9a' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:14:31.179377 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8689ef43-7aae-4e21-8303-3fb1695b4a4d tempest-VolumesMetadataTest-1427345173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:14:31.278463 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8689ef43-7aae-4e21-8303-3fb1695b4a4d tempest-VolumesMetadataTest-1427345173 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:14:31.279637 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8689ef43-7aae-4e21-8303-3fb1695b4a4d tempest-VolumesMetadataTest-1427345173 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:14:31.285187 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8689ef43-7aae-4e21-8303-3fb1695b4a4d tempest-VolumesMetadataTest-1427345173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (794e3383-49b3-4336-aa8b-c86393213ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e792c658-5b35-48c0-bd68-066d9aa27f9a', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:31.290738 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8689ef43-7aae-4e21-8303-3fb1695b4a4d tempest-VolumesMetadataTest-1427345173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7c2fb1a-bcd2-4566-bcc6-7f3dac48cdad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:31.302587 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-8689ef43-7aae-4e21-8303-3fb1695b4a4d tempest-VolumesMetadataTest-1427345173 None] Volume volume-e792c658-5b35-48c0-bd68-066d9aa27f9a (e792c658-5b35-48c0-bd68-066d9aa27f9a): created successfully Mar 12 21:14:31.308977 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8689ef43-7aae-4e21-8303-3fb1695b4a4d tempest-VolumesMetadataTest-1427345173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7c2fb1a-bcd2-4566-bcc6-7f3dac48cdad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:31.315686 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8689ef43-7aae-4e21-8303-3fb1695b4a4d tempest-VolumesMetadataTest-1427345173 None] Flow 'volume_create_manager' (c26ecb49-0d8d-48ab-a766-e69e0bef172e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:14:31.325914 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-8689ef43-7aae-4e21-8303-3fb1695b4a4d tempest-VolumesMetadataTest-1427345173 None] Created volume successfully. Mar 12 21:14:32.935768 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-2be413a7-74c6-4b9e-a209-ff57010313f9 tempest-VolumesMetadataTest-1427345173 None] Lock "b'cinder-e792c658-5b35-48c0-bd68-066d9aa27f9a-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:14:32.997864 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2be413a7-74c6-4b9e-a209-ff57010313f9 tempest-VolumesMetadataTest-1427345173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:14:33.073913 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2be413a7-74c6-4b9e-a209-ff57010313f9 tempest-VolumesMetadataTest-1427345173 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:14:33.074643 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2be413a7-74c6-4b9e-a209-ff57010313f9 tempest-VolumesMetadataTest-1427345173 None] Volume volume-e792c658-5b35-48c0-bd68-066d9aa27f9a is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:14:33.088731 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2be413a7-74c6-4b9e-a209-ff57010313f9 tempest-VolumesMetadataTest-1427345173 None] deleting rbd volume volume-e792c658-5b35-48c0-bd68-066d9aa27f9a {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:14:33.604363 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-2be413a7-74c6-4b9e-a209-ff57010313f9 tempest-VolumesMetadataTest-1427345173 None] Created reservations ['226475c3-e21e-4e1d-961e-f532925aff9d', 'f9262933-1930-4c33-a55f-617ecf4288ee', '5ce82bb9-b97d-45d6-9a1d-c6092bd9e68a', '11bd88bd-bdaf-43ed-9f82-ed18458a427f'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:14:33.675909 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2be413a7-74c6-4b9e-a209-ff57010313f9 tempest-VolumesMetadataTest-1427345173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:14:33.777058 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2be413a7-74c6-4b9e-a209-ff57010313f9 tempest-VolumesMetadataTest-1427345173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:14:33.893358 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-2be413a7-74c6-4b9e-a209-ff57010313f9 tempest-VolumesMetadataTest-1427345173 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:14:33.901531 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-2be413a7-74c6-4b9e-a209-ff57010313f9 tempest-VolumesMetadataTest-1427345173 None] Deleted volume successfully. Mar 12 21:14:33.932058 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-2be413a7-74c6-4b9e-a209-ff57010313f9 tempest-VolumesMetadataTest-1427345173 None] Lock "b'cinder-e792c658-5b35-48c0-bd68-066d9aa27f9a-delete_volume'" released by "delete_volume" :: held 0.996s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:14:37.379753 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f9abf46-c88b-4a40-a9a5-32567afa14a1 tempest-VolumesCloneNegativeTest-91298260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:14:37.384606 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-0f9abf46-c88b-4a40-a9a5-32567afa14a1 tempest-VolumesCloneNegativeTest-91298260 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:14:37.385297 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-0f9abf46-c88b-4a40-a9a5-32567afa14a1 tempest-VolumesCloneNegativeTest-91298260 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:14:37.409393 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0f9abf46-c88b-4a40-a9a5-32567afa14a1 tempest-VolumesCloneNegativeTest-91298260 None] Flow 'volume_create_manager' (bbda5e14-f899-41f1-93dc-d663a43e1cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:14:37.420153 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0f9abf46-c88b-4a40-a9a5-32567afa14a1 tempest-VolumesCloneNegativeTest-91298260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95389a28-d270-4b06-8de6-0e22b42c990c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:37.437151 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-0f9abf46-c88b-4a40-a9a5-32567afa14a1 tempest-VolumesCloneNegativeTest-91298260 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:14:37.477259 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0f9abf46-c88b-4a40-a9a5-32567afa14a1 tempest-VolumesCloneNegativeTest-91298260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95389a28-d270-4b06-8de6-0e22b42c990c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2063367545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e1fcc488-b063-4b8e-85cf-660c59bf3056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38769b6edbd84a50affc8f2e833ad83d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:14:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:14:37Z,use_quota=True,user_id='1f1ea42e67614bb6920b6f056f13dcac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:37.483967 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0f9abf46-c88b-4a40-a9a5-32567afa14a1 tempest-VolumesCloneNegativeTest-91298260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a64d809b-42df-4da4-932e-8c343fe22c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:37.493682 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0f9abf46-c88b-4a40-a9a5-32567afa14a1 tempest-VolumesCloneNegativeTest-91298260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a64d809b-42df-4da4-932e-8c343fe22c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:37.513814 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0f9abf46-c88b-4a40-a9a5-32567afa14a1 tempest-VolumesCloneNegativeTest-91298260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72b4523a-ee40-4271-8ca2-94a81325d05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:37.523303 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0f9abf46-c88b-4a40-a9a5-32567afa14a1 tempest-VolumesCloneNegativeTest-91298260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72b4523a-ee40-4271-8ca2-94a81325d05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1fcc488-b063-4b8e-85cf-660c59bf3056', 'volume_name': 'volume-e1fcc488-b063-4b8e-85cf-660c59bf3056', 'volume_size': 2}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:37.537997 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0f9abf46-c88b-4a40-a9a5-32567afa14a1 tempest-VolumesCloneNegativeTest-91298260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d3d743f-4301-441b-9d60-15f9577b99b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:37.549709 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0f9abf46-c88b-4a40-a9a5-32567afa14a1 tempest-VolumesCloneNegativeTest-91298260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d3d743f-4301-441b-9d60-15f9577b99b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:37.568759 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0f9abf46-c88b-4a40-a9a5-32567afa14a1 tempest-VolumesCloneNegativeTest-91298260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e84980-dc91-4945-9c81-de289630569a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:37.577151 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-0f9abf46-c88b-4a40-a9a5-32567afa14a1 tempest-VolumesCloneNegativeTest-91298260 None] Volume e1fcc488-b063-4b8e-85cf-660c59bf3056: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1fcc488-b063-4b8e-85cf-660c59bf3056', 'volume_size': 2} Mar 12 21:14:37.577551 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-0f9abf46-c88b-4a40-a9a5-32567afa14a1 tempest-VolumesCloneNegativeTest-91298260 None] creating volume 'volume-e1fcc488-b063-4b8e-85cf-660c59bf3056' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:14:37.582199 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-0f9abf46-c88b-4a40-a9a5-32567afa14a1 tempest-VolumesCloneNegativeTest-91298260 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:14:37.715115 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-0f9abf46-c88b-4a40-a9a5-32567afa14a1 tempest-VolumesCloneNegativeTest-91298260 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:14:37.716008 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-0f9abf46-c88b-4a40-a9a5-32567afa14a1 tempest-VolumesCloneNegativeTest-91298260 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:14:37.721638 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0f9abf46-c88b-4a40-a9a5-32567afa14a1 tempest-VolumesCloneNegativeTest-91298260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e84980-dc91-4945-9c81-de289630569a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1fcc488-b063-4b8e-85cf-660c59bf3056', 'volume_size': 2}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:37.732001 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0f9abf46-c88b-4a40-a9a5-32567afa14a1 tempest-VolumesCloneNegativeTest-91298260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b232a32-a04f-4c5b-acaf-520ea743e427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:37.754887 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-0f9abf46-c88b-4a40-a9a5-32567afa14a1 tempest-VolumesCloneNegativeTest-91298260 None] Volume volume-e1fcc488-b063-4b8e-85cf-660c59bf3056 (e1fcc488-b063-4b8e-85cf-660c59bf3056): created successfully Mar 12 21:14:37.764176 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0f9abf46-c88b-4a40-a9a5-32567afa14a1 tempest-VolumesCloneNegativeTest-91298260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b232a32-a04f-4c5b-acaf-520ea743e427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:37.781754 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0f9abf46-c88b-4a40-a9a5-32567afa14a1 tempest-VolumesCloneNegativeTest-91298260 None] Flow 'volume_create_manager' (bbda5e14-f899-41f1-93dc-d663a43e1cb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:14:37.794329 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-0f9abf46-c88b-4a40-a9a5-32567afa14a1 tempest-VolumesCloneNegativeTest-91298260 None] Created volume successfully. Mar 12 21:14:38.659468 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-cc1fa850-06c6-4c24-927a-4ac079144492 tempest-VolumesCloneNegativeTest-91298260 None] Lock "b'cinder-e1fcc488-b063-4b8e-85cf-660c59bf3056-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:14:38.718651 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-cc1fa850-06c6-4c24-927a-4ac079144492 tempest-VolumesCloneNegativeTest-91298260 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:14:38.814890 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-cc1fa850-06c6-4c24-927a-4ac079144492 tempest-VolumesCloneNegativeTest-91298260 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:14:38.815321 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-cc1fa850-06c6-4c24-927a-4ac079144492 tempest-VolumesCloneNegativeTest-91298260 None] Volume volume-e1fcc488-b063-4b8e-85cf-660c59bf3056 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:14:38.826348 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-cc1fa850-06c6-4c24-927a-4ac079144492 tempest-VolumesCloneNegativeTest-91298260 None] deleting rbd volume volume-e1fcc488-b063-4b8e-85cf-660c59bf3056 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:14:39.276737 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-cc1fa850-06c6-4c24-927a-4ac079144492 tempest-VolumesCloneNegativeTest-91298260 None] Created reservations ['91c5444f-9054-4f0b-ab61-47545eacda86', 'f07b8c83-68ee-4831-9984-28ff74d80139', 'b4eb8ac6-0ae2-47f1-b43a-5d49f3ad778a', '881e3e7f-5de6-4b85-be78-b9d2ca0621a2'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:14:39.350520 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-cc1fa850-06c6-4c24-927a-4ac079144492 tempest-VolumesCloneNegativeTest-91298260 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:14:39.410467 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-cc1fa850-06c6-4c24-927a-4ac079144492 tempest-VolumesCloneNegativeTest-91298260 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:14:39.458490 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-cc1fa850-06c6-4c24-927a-4ac079144492 tempest-VolumesCloneNegativeTest-91298260 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:14:39.471644 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-cc1fa850-06c6-4c24-927a-4ac079144492 tempest-VolumesCloneNegativeTest-91298260 None] Deleted volume successfully. Mar 12 21:14:39.487352 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-cc1fa850-06c6-4c24-927a-4ac079144492 tempest-VolumesCloneNegativeTest-91298260 None] Lock "b'cinder-e1fcc488-b063-4b8e-85cf-660c59bf3056-delete_volume'" released by "delete_volume" :: held 0.833s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:14:42.282458 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f4e346d-c988-4b0a-8bbc-e9c12090d554 tempest-VolumesGetTest-1625613573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:14:42.287352 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-8f4e346d-c988-4b0a-8bbc-e9c12090d554 tempest-VolumesGetTest-1625613573 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:14:42.288036 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-8f4e346d-c988-4b0a-8bbc-e9c12090d554 tempest-VolumesGetTest-1625613573 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:14:42.309683 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8f4e346d-c988-4b0a-8bbc-e9c12090d554 tempest-VolumesGetTest-1625613573 None] Flow 'volume_create_manager' (a34bd972-96df-487e-9582-ae4788e00982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:14:42.317975 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8f4e346d-c988-4b0a-8bbc-e9c12090d554 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e512dbda-28bf-40a9-96c3-9bb4e3746353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:42.325347 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-8f4e346d-c988-4b0a-8bbc-e9c12090d554 tempest-VolumesGetTest-1625613573 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:14:42.349147 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8f4e346d-c988-4b0a-8bbc-e9c12090d554 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e512dbda-28bf-40a9-96c3-9bb4e3746353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-886552121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b0ce408a-312e-440d-b99a-6713fa4a9087,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0a55469ab750400ea339e4b5a7c548a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:14:42Z,use_quota=True,user_id='9429a1173f4a46899b53e38eed3a4db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:42.355843 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8f4e346d-c988-4b0a-8bbc-e9c12090d554 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b171f22-42eb-43d6-b67c-b53679327511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:42.361843 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8f4e346d-c988-4b0a-8bbc-e9c12090d554 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b171f22-42eb-43d6-b67c-b53679327511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:42.367984 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8f4e346d-c988-4b0a-8bbc-e9c12090d554 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ca618d9-077e-4a1f-a2e0-0c4df10a0e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:42.373817 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8f4e346d-c988-4b0a-8bbc-e9c12090d554 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ca618d9-077e-4a1f-a2e0-0c4df10a0e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0ce408a-312e-440d-b99a-6713fa4a9087', 'volume_name': 'volume-b0ce408a-312e-440d-b99a-6713fa4a9087', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:42.384859 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8f4e346d-c988-4b0a-8bbc-e9c12090d554 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5feb252f-3675-4048-a2f4-750f01219d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:42.389664 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8f4e346d-c988-4b0a-8bbc-e9c12090d554 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5feb252f-3675-4048-a2f4-750f01219d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:42.395962 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8f4e346d-c988-4b0a-8bbc-e9c12090d554 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bc5b37e-e840-4d3b-b5ae-3cfa74264da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:42.397344 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-8f4e346d-c988-4b0a-8bbc-e9c12090d554 tempest-VolumesGetTest-1625613573 None] Volume b0ce408a-312e-440d-b99a-6713fa4a9087: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0ce408a-312e-440d-b99a-6713fa4a9087', 'volume_size': 1} Mar 12 21:14:42.397932 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8f4e346d-c988-4b0a-8bbc-e9c12090d554 tempest-VolumesGetTest-1625613573 None] creating volume 'volume-b0ce408a-312e-440d-b99a-6713fa4a9087' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:14:42.399335 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8f4e346d-c988-4b0a-8bbc-e9c12090d554 tempest-VolumesGetTest-1625613573 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:14:42.483527 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8f4e346d-c988-4b0a-8bbc-e9c12090d554 tempest-VolumesGetTest-1625613573 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:14:42.483905 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8f4e346d-c988-4b0a-8bbc-e9c12090d554 tempest-VolumesGetTest-1625613573 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:14:42.489701 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8f4e346d-c988-4b0a-8bbc-e9c12090d554 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bc5b37e-e840-4d3b-b5ae-3cfa74264da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0ce408a-312e-440d-b99a-6713fa4a9087', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:42.494625 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8f4e346d-c988-4b0a-8bbc-e9c12090d554 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a331b00-9d87-464b-ba2b-75b8de001136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:42.504570 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-8f4e346d-c988-4b0a-8bbc-e9c12090d554 tempest-VolumesGetTest-1625613573 None] Volume volume-b0ce408a-312e-440d-b99a-6713fa4a9087 (b0ce408a-312e-440d-b99a-6713fa4a9087): created successfully Mar 12 21:14:42.509037 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8f4e346d-c988-4b0a-8bbc-e9c12090d554 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a331b00-9d87-464b-ba2b-75b8de001136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:42.517460 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8f4e346d-c988-4b0a-8bbc-e9c12090d554 tempest-VolumesGetTest-1625613573 None] Flow 'volume_create_manager' (a34bd972-96df-487e-9582-ae4788e00982) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:14:42.532619 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-8f4e346d-c988-4b0a-8bbc-e9c12090d554 tempest-VolumesGetTest-1625613573 None] Created volume successfully. Mar 12 21:14:44.105903 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-403a02c7-a310-47b0-b191-a2eb40bab108 tempest-VolumesGetTest-1625613573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:14:44.111466 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-403a02c7-a310-47b0-b191-a2eb40bab108 tempest-VolumesGetTest-1625613573 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:14:44.112170 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-403a02c7-a310-47b0-b191-a2eb40bab108 tempest-VolumesGetTest-1625613573 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:14:44.160063 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-403a02c7-a310-47b0-b191-a2eb40bab108 tempest-VolumesGetTest-1625613573 None] Flow 'volume_create_manager' (66dc5dd2-c1cb-467b-877c-7677f7cf8f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:14:44.171973 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-403a02c7-a310-47b0-b191-a2eb40bab108 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4b73d60-3e0d-4eb1-9bc8-9571a3cc1a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:44.181554 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-403a02c7-a310-47b0-b191-a2eb40bab108 tempest-VolumesGetTest-1625613573 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:14:44.229462 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-403a02c7-a310-47b0-b191-a2eb40bab108 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4b73d60-3e0d-4eb1-9bc8-9571a3cc1a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:14:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1511136834',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2f7d1b59-bdc4-4d8b-a5b8-c6d754f76cd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a55469ab750400ea339e4b5a7c548a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:14:44Z,use_quota=True,user_id='9429a1173f4a46899b53e38eed3a4db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:44.251189 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-403a02c7-a310-47b0-b191-a2eb40bab108 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (928f04e7-aad4-43f3-b495-79ddf22c8f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:44.256659 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-403a02c7-a310-47b0-b191-a2eb40bab108 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (928f04e7-aad4-43f3-b495-79ddf22c8f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:44.262775 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-403a02c7-a310-47b0-b191-a2eb40bab108 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10f4946d-5b29-4ee3-9329-b23cdbdbd616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:44.268949 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-403a02c7-a310-47b0-b191-a2eb40bab108 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10f4946d-5b29-4ee3-9329-b23cdbdbd616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f7d1b59-bdc4-4d8b-a5b8-c6d754f76cd7', 'volume_name': 'volume-2f7d1b59-bdc4-4d8b-a5b8-c6d754f76cd7', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:44.274686 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-403a02c7-a310-47b0-b191-a2eb40bab108 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (579917e5-e3d5-4dd5-8257-8d167d4ee956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:44.280833 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-403a02c7-a310-47b0-b191-a2eb40bab108 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (579917e5-e3d5-4dd5-8257-8d167d4ee956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:44.287366 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-403a02c7-a310-47b0-b191-a2eb40bab108 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (983177a5-e146-4fc9-aa61-2f1aebd392d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:44.288834 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-403a02c7-a310-47b0-b191-a2eb40bab108 tempest-VolumesGetTest-1625613573 None] Volume 2f7d1b59-bdc4-4d8b-a5b8-c6d754f76cd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f7d1b59-bdc4-4d8b-a5b8-c6d754f76cd7', 'volume_size': 1} Mar 12 21:14:44.289456 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-403a02c7-a310-47b0-b191-a2eb40bab108 tempest-VolumesGetTest-1625613573 None] creating volume 'volume-2f7d1b59-bdc4-4d8b-a5b8-c6d754f76cd7' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:14:44.290950 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-403a02c7-a310-47b0-b191-a2eb40bab108 tempest-VolumesGetTest-1625613573 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:14:44.471369 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-403a02c7-a310-47b0-b191-a2eb40bab108 tempest-VolumesGetTest-1625613573 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:14:44.472010 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-403a02c7-a310-47b0-b191-a2eb40bab108 tempest-VolumesGetTest-1625613573 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:14:44.476277 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-403a02c7-a310-47b0-b191-a2eb40bab108 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (983177a5-e146-4fc9-aa61-2f1aebd392d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f7d1b59-bdc4-4d8b-a5b8-c6d754f76cd7', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:44.488554 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-403a02c7-a310-47b0-b191-a2eb40bab108 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe6ea9a5-87b6-4b46-8b21-e1f4dc55b2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:44.518714 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-403a02c7-a310-47b0-b191-a2eb40bab108 tempest-VolumesGetTest-1625613573 None] Volume volume-2f7d1b59-bdc4-4d8b-a5b8-c6d754f76cd7 (2f7d1b59-bdc4-4d8b-a5b8-c6d754f76cd7): created successfully Mar 12 21:14:44.531861 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-403a02c7-a310-47b0-b191-a2eb40bab108 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe6ea9a5-87b6-4b46-8b21-e1f4dc55b2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:44.563334 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-403a02c7-a310-47b0-b191-a2eb40bab108 tempest-VolumesGetTest-1625613573 None] Flow 'volume_create_manager' (66dc5dd2-c1cb-467b-877c-7677f7cf8f00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:14:44.577295 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-403a02c7-a310-47b0-b191-a2eb40bab108 tempest-VolumesGetTest-1625613573 None] Created volume successfully. Mar 12 21:14:45.194246 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-1d91ba49-4180-4ddb-ac2e-1778faeff443 tempest-VolumesGetTest-1625613573 None] Lock "b'cinder-2f7d1b59-bdc4-4d8b-a5b8-c6d754f76cd7-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:14:45.282129 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-1d91ba49-4180-4ddb-ac2e-1778faeff443 tempest-VolumesGetTest-1625613573 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:14:45.412627 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-1d91ba49-4180-4ddb-ac2e-1778faeff443 tempest-VolumesGetTest-1625613573 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:14:45.413045 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-1d91ba49-4180-4ddb-ac2e-1778faeff443 tempest-VolumesGetTest-1625613573 None] Volume volume-2f7d1b59-bdc4-4d8b-a5b8-c6d754f76cd7 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:14:45.431113 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-1d91ba49-4180-4ddb-ac2e-1778faeff443 tempest-VolumesGetTest-1625613573 None] deleting rbd volume volume-2f7d1b59-bdc4-4d8b-a5b8-c6d754f76cd7 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:14:46.093620 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-1d91ba49-4180-4ddb-ac2e-1778faeff443 tempest-VolumesGetTest-1625613573 None] Created reservations ['40b507eb-bba1-4a8e-94d1-b2634abee0d0', '52601e46-e074-48d6-a580-6f1101fb707a', 'd0433a75-d8a2-47e8-b836-19032c9206ab', '621782ed-446e-44a4-bc63-cf1da820101a'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:14:46.222029 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-1d91ba49-4180-4ddb-ac2e-1778faeff443 tempest-VolumesGetTest-1625613573 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:14:46.345366 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-1d91ba49-4180-4ddb-ac2e-1778faeff443 tempest-VolumesGetTest-1625613573 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:14:46.421228 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-1d91ba49-4180-4ddb-ac2e-1778faeff443 tempest-VolumesGetTest-1625613573 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:14:46.438349 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-1d91ba49-4180-4ddb-ac2e-1778faeff443 tempest-VolumesGetTest-1625613573 None] Deleted volume successfully. Mar 12 21:14:46.471933 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-64bac386-91d4-4f01-9836-967ce2e1db58 tempest-VolumesGetTest-1625613573 None] Lock "b'cinder-b0ce408a-312e-440d-b99a-6713fa4a9087-delete_volume'" acquired by "delete_volume" :: waited 0.042s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:14:46.486637 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-1d91ba49-4180-4ddb-ac2e-1778faeff443 tempest-VolumesGetTest-1625613573 None] Lock "b'cinder-2f7d1b59-bdc4-4d8b-a5b8-c6d754f76cd7-delete_volume'" released by "delete_volume" :: held 1.293s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:14:46.557764 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-64bac386-91d4-4f01-9836-967ce2e1db58 tempest-VolumesGetTest-1625613573 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:14:46.649070 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-64bac386-91d4-4f01-9836-967ce2e1db58 tempest-VolumesGetTest-1625613573 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:14:46.649691 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-64bac386-91d4-4f01-9836-967ce2e1db58 tempest-VolumesGetTest-1625613573 None] Volume volume-b0ce408a-312e-440d-b99a-6713fa4a9087 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:14:46.657900 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-64bac386-91d4-4f01-9836-967ce2e1db58 tempest-VolumesGetTest-1625613573 None] deleting rbd volume volume-b0ce408a-312e-440d-b99a-6713fa4a9087 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:14:47.155413 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-64bac386-91d4-4f01-9836-967ce2e1db58 tempest-VolumesGetTest-1625613573 None] Created reservations ['4fc21404-2e72-4beb-acee-50c8466abf2d', 'fe17ec12-6a2b-4d1b-8e5a-e6f7ad82809c', '29bcd3ce-7bf7-4087-a4c9-dc9661eab1de', '4c91e947-66da-4f7a-9a19-a47c1df8169e'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:14:47.237980 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-64bac386-91d4-4f01-9836-967ce2e1db58 tempest-VolumesGetTest-1625613573 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:14:47.302735 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-64bac386-91d4-4f01-9836-967ce2e1db58 tempest-VolumesGetTest-1625613573 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:14:47.383990 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-64bac386-91d4-4f01-9836-967ce2e1db58 tempest-VolumesGetTest-1625613573 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:14:47.387918 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-64bac386-91d4-4f01-9836-967ce2e1db58 tempest-VolumesGetTest-1625613573 None] Deleted volume successfully. Mar 12 21:14:47.413113 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-64bac386-91d4-4f01-9836-967ce2e1db58 tempest-VolumesGetTest-1625613573 None] Lock "b'cinder-b0ce408a-312e-440d-b99a-6713fa4a9087-delete_volume'" released by "delete_volume" :: held 0.941s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:14:47.960235 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-59cf8ead-8981-428d-818a-c444c4917ea1 tempest-VolumesGetTest-1625613573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:14:47.963352 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-59cf8ead-8981-428d-818a-c444c4917ea1 tempest-VolumesGetTest-1625613573 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:14:47.963789 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-59cf8ead-8981-428d-818a-c444c4917ea1 tempest-VolumesGetTest-1625613573 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:14:47.987835 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-59cf8ead-8981-428d-818a-c444c4917ea1 tempest-VolumesGetTest-1625613573 None] Flow 'volume_create_manager' (b59b7459-e694-4b3f-b7f7-4c506abcb996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:14:47.994391 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-59cf8ead-8981-428d-818a-c444c4917ea1 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9fcf940-0920-4f6d-9cf5-774f37088837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:48.001126 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-59cf8ead-8981-428d-818a-c444c4917ea1 tempest-VolumesGetTest-1625613573 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:14:48.015723 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-59cf8ead-8981-428d-818a-c444c4917ea1 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9fcf940-0920-4f6d-9cf5-774f37088837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1844943939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6a2fb5cc-b90f-4f0d-b2d2-82c0981944c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a55469ab750400ea339e4b5a7c548a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:14:48Z,use_quota=True,user_id='9429a1173f4a46899b53e38eed3a4db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:48.021240 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-59cf8ead-8981-428d-818a-c444c4917ea1 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2018619-c0ba-4980-8c49-c04e84820a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:48.025477 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-59cf8ead-8981-428d-818a-c444c4917ea1 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2018619-c0ba-4980-8c49-c04e84820a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:48.031244 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-59cf8ead-8981-428d-818a-c444c4917ea1 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (993ce1ff-9647-4bd8-9ddf-6ea08710f2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:48.035454 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-59cf8ead-8981-428d-818a-c444c4917ea1 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (993ce1ff-9647-4bd8-9ddf-6ea08710f2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a2fb5cc-b90f-4f0d-b2d2-82c0981944c6', 'volume_name': 'volume-6a2fb5cc-b90f-4f0d-b2d2-82c0981944c6', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:48.040429 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-59cf8ead-8981-428d-818a-c444c4917ea1 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0f714c6-f6cd-469b-9d7f-353bc51ba05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:48.045015 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-59cf8ead-8981-428d-818a-c444c4917ea1 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0f714c6-f6cd-469b-9d7f-353bc51ba05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:48.049797 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-59cf8ead-8981-428d-818a-c444c4917ea1 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (052d9596-e107-4c57-ae23-79c3f5c7fb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:48.051740 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-59cf8ead-8981-428d-818a-c444c4917ea1 tempest-VolumesGetTest-1625613573 None] Volume 6a2fb5cc-b90f-4f0d-b2d2-82c0981944c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a2fb5cc-b90f-4f0d-b2d2-82c0981944c6', 'volume_size': 1} Mar 12 21:14:48.052135 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-59cf8ead-8981-428d-818a-c444c4917ea1 tempest-VolumesGetTest-1625613573 None] creating volume 'volume-6a2fb5cc-b90f-4f0d-b2d2-82c0981944c6' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:14:48.053160 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-59cf8ead-8981-428d-818a-c444c4917ea1 tempest-VolumesGetTest-1625613573 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:14:48.105933 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-59cf8ead-8981-428d-818a-c444c4917ea1 tempest-VolumesGetTest-1625613573 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:14:48.106311 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-59cf8ead-8981-428d-818a-c444c4917ea1 tempest-VolumesGetTest-1625613573 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:14:48.110063 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-59cf8ead-8981-428d-818a-c444c4917ea1 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (052d9596-e107-4c57-ae23-79c3f5c7fb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a2fb5cc-b90f-4f0d-b2d2-82c0981944c6', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:48.114670 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-59cf8ead-8981-428d-818a-c444c4917ea1 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e84ea4-fed1-4873-85ac-0ecf968ce798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:48.123591 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-59cf8ead-8981-428d-818a-c444c4917ea1 tempest-VolumesGetTest-1625613573 None] Volume volume-6a2fb5cc-b90f-4f0d-b2d2-82c0981944c6 (6a2fb5cc-b90f-4f0d-b2d2-82c0981944c6): created successfully Mar 12 21:14:48.127435 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-59cf8ead-8981-428d-818a-c444c4917ea1 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e84ea4-fed1-4873-85ac-0ecf968ce798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:48.133016 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-59cf8ead-8981-428d-818a-c444c4917ea1 tempest-VolumesGetTest-1625613573 None] Flow 'volume_create_manager' (b59b7459-e694-4b3f-b7f7-4c506abcb996) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:14:48.142693 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-59cf8ead-8981-428d-818a-c444c4917ea1 tempest-VolumesGetTest-1625613573 None] Created volume successfully. Mar 12 21:14:49.483960 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-201b8e7f-5d8d-4a53-9ed9-312b8d50739e tempest-VolumesGetTest-1625613573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:14:49.487448 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-201b8e7f-5d8d-4a53-9ed9-312b8d50739e tempest-VolumesGetTest-1625613573 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:14:49.487886 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-201b8e7f-5d8d-4a53-9ed9-312b8d50739e tempest-VolumesGetTest-1625613573 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:14:49.517683 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-201b8e7f-5d8d-4a53-9ed9-312b8d50739e tempest-VolumesGetTest-1625613573 None] Flow 'volume_create_manager' (7bf53969-ed5b-460f-b0d9-30b768c64413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:14:49.524602 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-201b8e7f-5d8d-4a53-9ed9-312b8d50739e tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be7f14f8-b5f0-4979-9de1-ca753c8ed1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:49.531821 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-201b8e7f-5d8d-4a53-9ed9-312b8d50739e tempest-VolumesGetTest-1625613573 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:14:49.546838 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-201b8e7f-5d8d-4a53-9ed9-312b8d50739e tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be7f14f8-b5f0-4979-9de1-ca753c8ed1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1526140528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5075bbd5-b281-460a-ad3a-f905925fb596,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0a55469ab750400ea339e4b5a7c548a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=6a2fb5cc-b90f-4f0d-b2d2-82c0981944c6,status='creating',terminated_at=None,updated_at=2022-03-12T21:14:49Z,use_quota=True,user_id='9429a1173f4a46899b53e38eed3a4db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:49.552654 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-201b8e7f-5d8d-4a53-9ed9-312b8d50739e tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c73d530-03e2-4c6e-9af8-0ebb5232151f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:49.556899 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-201b8e7f-5d8d-4a53-9ed9-312b8d50739e tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c73d530-03e2-4c6e-9af8-0ebb5232151f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:49.562267 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-201b8e7f-5d8d-4a53-9ed9-312b8d50739e tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a5c1a45-3850-4079-8d24-0583dea926bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:49.578030 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-201b8e7f-5d8d-4a53-9ed9-312b8d50739e tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a5c1a45-3850-4079-8d24-0583dea926bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '5075bbd5-b281-460a-ad3a-f905925fb596', 'volume_name': 'volume-5075bbd5-b281-460a-ad3a-f905925fb596', 'volume_size': 1, 'source_volid': '6a2fb5cc-b90f-4f0d-b2d2-82c0981944c6', 'source_volstatus': 'available'}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:49.583155 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-201b8e7f-5d8d-4a53-9ed9-312b8d50739e tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06db8362-b3eb-4c5f-9060-e54743c9dcde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:49.587324 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-201b8e7f-5d8d-4a53-9ed9-312b8d50739e tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06db8362-b3eb-4c5f-9060-e54743c9dcde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:49.592890 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-201b8e7f-5d8d-4a53-9ed9-312b8d50739e tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db5c0024-1b17-4a36-a54a-8faeff85f46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:49.594014 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-201b8e7f-5d8d-4a53-9ed9-312b8d50739e tempest-VolumesGetTest-1625613573 None] Volume 5075bbd5-b281-460a-ad3a-f905925fb596: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-5075bbd5-b281-460a-ad3a-f905925fb596', 'volume_size': 1, 'source_volid': '6a2fb5cc-b90f-4f0d-b2d2-82c0981944c6', 'source_volstatus': 'available'} Mar 12 21:14:49.605540 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-201b8e7f-5d8d-4a53-9ed9-312b8d50739e tempest-VolumesGetTest-1625613573 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:14:49.662732 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-201b8e7f-5d8d-4a53-9ed9-312b8d50739e tempest-VolumesGetTest-1625613573 None] creating snapshot='volume-5075bbd5-b281-460a-ad3a-f905925fb596.clone_snap' {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Mar 12 21:14:50.447266 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-201b8e7f-5d8d-4a53-9ed9-312b8d50739e tempest-VolumesGetTest-1625613573 None] cloning 'volume-6a2fb5cc-b90f-4f0d-b2d2-82c0981944c6@volume-5075bbd5-b281-460a-ad3a-f905925fb596.clone_snap' to 'volume-5075bbd5-b281-460a-ad3a-f905925fb596' {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Mar 12 21:14:50.577387 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-201b8e7f-5d8d-4a53-9ed9-312b8d50739e tempest-VolumesGetTest-1625613573 None] Volume volume-6a2fb5cc-b90f-4f0d-b2d2-82c0981944c6 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:14:50.588165 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-201b8e7f-5d8d-4a53-9ed9-312b8d50739e tempest-VolumesGetTest-1625613573 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:14:50.588569 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-201b8e7f-5d8d-4a53-9ed9-312b8d50739e tempest-VolumesGetTest-1625613573 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:14:50.625330 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-201b8e7f-5d8d-4a53-9ed9-312b8d50739e tempest-VolumesGetTest-1625613573 None] clone created successfully {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Mar 12 21:14:50.630476 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-201b8e7f-5d8d-4a53-9ed9-312b8d50739e tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db5c0024-1b17-4a36-a54a-8faeff85f46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5075bbd5-b281-460a-ad3a-f905925fb596', 'volume_size': 1, 'source_volid': '6a2fb5cc-b90f-4f0d-b2d2-82c0981944c6', 'source_volstatus': 'available'}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:50.635716 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-201b8e7f-5d8d-4a53-9ed9-312b8d50739e tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2760bf7d-4482-4f4c-b109-94513908f002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:50.660523 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-201b8e7f-5d8d-4a53-9ed9-312b8d50739e tempest-VolumesGetTest-1625613573 None] Volume volume-5075bbd5-b281-460a-ad3a-f905925fb596 (5075bbd5-b281-460a-ad3a-f905925fb596): created successfully Mar 12 21:14:50.666289 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-201b8e7f-5d8d-4a53-9ed9-312b8d50739e tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2760bf7d-4482-4f4c-b109-94513908f002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:50.686735 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-201b8e7f-5d8d-4a53-9ed9-312b8d50739e tempest-VolumesGetTest-1625613573 None] Flow 'volume_create_manager' (7bf53969-ed5b-460f-b0d9-30b768c64413) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:14:50.727991 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-201b8e7f-5d8d-4a53-9ed9-312b8d50739e tempest-VolumesGetTest-1625613573 None] Created volume successfully. Mar 12 21:14:51.308406 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:14:51.309172 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:14:51.336693 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:14:51.362394 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:14:52.262958 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-035aae8b-542d-46ca-864f-3d43e98d5e7b tempest-VolumesGetTest-1625613573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:14:52.268517 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-035aae8b-542d-46ca-864f-3d43e98d5e7b tempest-VolumesGetTest-1625613573 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:14:52.269524 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-035aae8b-542d-46ca-864f-3d43e98d5e7b tempest-VolumesGetTest-1625613573 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:14:52.334821 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-035aae8b-542d-46ca-864f-3d43e98d5e7b tempest-VolumesGetTest-1625613573 None] Flow 'volume_create_manager' (9f561b63-7840-480e-99fc-980cdbfe11c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:14:52.342673 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-035aae8b-542d-46ca-864f-3d43e98d5e7b tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0a2dc28-eb55-444a-a7ea-ba278e97203f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:52.349430 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-035aae8b-542d-46ca-864f-3d43e98d5e7b tempest-VolumesGetTest-1625613573 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:14:52.366246 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-035aae8b-542d-46ca-864f-3d43e98d5e7b tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0a2dc28-eb55-444a-a7ea-ba278e97203f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:14:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1224665207',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f91a2b31-f6f2-4f3d-b1bb-fb79844fa526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a55469ab750400ea339e4b5a7c548a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:14:52Z,use_quota=True,user_id='9429a1173f4a46899b53e38eed3a4db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:52.375776 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-035aae8b-542d-46ca-864f-3d43e98d5e7b tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7de7894-7c1c-4f53-b048-4751056221db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:52.380352 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-035aae8b-542d-46ca-864f-3d43e98d5e7b tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7de7894-7c1c-4f53-b048-4751056221db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:52.386213 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-035aae8b-542d-46ca-864f-3d43e98d5e7b tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf77c97-6a12-4422-916a-64f3433a1921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:52.391437 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-035aae8b-542d-46ca-864f-3d43e98d5e7b tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf77c97-6a12-4422-916a-64f3433a1921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f91a2b31-f6f2-4f3d-b1bb-fb79844fa526', 'volume_name': 'volume-f91a2b31-f6f2-4f3d-b1bb-fb79844fa526', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:52.396634 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-035aae8b-542d-46ca-864f-3d43e98d5e7b tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dee82d47-ef0f-47a5-abf5-e1d67151fa76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:52.401684 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-035aae8b-542d-46ca-864f-3d43e98d5e7b tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dee82d47-ef0f-47a5-abf5-e1d67151fa76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:52.406799 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-035aae8b-542d-46ca-864f-3d43e98d5e7b tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d40e412d-e33d-47b6-a2bf-4bf381f20405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:52.407945 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-035aae8b-542d-46ca-864f-3d43e98d5e7b tempest-VolumesGetTest-1625613573 None] Volume f91a2b31-f6f2-4f3d-b1bb-fb79844fa526: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f91a2b31-f6f2-4f3d-b1bb-fb79844fa526', 'volume_size': 1} Mar 12 21:14:52.408343 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-035aae8b-542d-46ca-864f-3d43e98d5e7b tempest-VolumesGetTest-1625613573 None] creating volume 'volume-f91a2b31-f6f2-4f3d-b1bb-fb79844fa526' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:14:52.409365 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-035aae8b-542d-46ca-864f-3d43e98d5e7b tempest-VolumesGetTest-1625613573 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:14:52.503940 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-035aae8b-542d-46ca-864f-3d43e98d5e7b tempest-VolumesGetTest-1625613573 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:14:52.504399 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-035aae8b-542d-46ca-864f-3d43e98d5e7b tempest-VolumesGetTest-1625613573 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:14:52.508688 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-035aae8b-542d-46ca-864f-3d43e98d5e7b tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d40e412d-e33d-47b6-a2bf-4bf381f20405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f91a2b31-f6f2-4f3d-b1bb-fb79844fa526', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:52.515951 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-035aae8b-542d-46ca-864f-3d43e98d5e7b tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44db4237-435d-4cf3-874e-e0989510429f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:52.526101 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-035aae8b-542d-46ca-864f-3d43e98d5e7b tempest-VolumesGetTest-1625613573 None] Volume volume-f91a2b31-f6f2-4f3d-b1bb-fb79844fa526 (f91a2b31-f6f2-4f3d-b1bb-fb79844fa526): created successfully Mar 12 21:14:52.529824 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-035aae8b-542d-46ca-864f-3d43e98d5e7b tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44db4237-435d-4cf3-874e-e0989510429f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:52.535718 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-035aae8b-542d-46ca-864f-3d43e98d5e7b tempest-VolumesGetTest-1625613573 None] Flow 'volume_create_manager' (9f561b63-7840-480e-99fc-980cdbfe11c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:14:52.546000 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-035aae8b-542d-46ca-864f-3d43e98d5e7b tempest-VolumesGetTest-1625613573 None] Created volume successfully. Mar 12 21:14:53.383824 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-8a5d15df-1ca1-416f-a46f-58491ba5f258 tempest-VolumesGetTest-1625613573 None] Lock "b'cinder-f91a2b31-f6f2-4f3d-b1bb-fb79844fa526-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:14:53.476930 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8a5d15df-1ca1-416f-a46f-58491ba5f258 tempest-VolumesGetTest-1625613573 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:14:53.563306 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8a5d15df-1ca1-416f-a46f-58491ba5f258 tempest-VolumesGetTest-1625613573 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:14:53.563829 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8a5d15df-1ca1-416f-a46f-58491ba5f258 tempest-VolumesGetTest-1625613573 None] Volume volume-f91a2b31-f6f2-4f3d-b1bb-fb79844fa526 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:14:53.578348 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8a5d15df-1ca1-416f-a46f-58491ba5f258 tempest-VolumesGetTest-1625613573 None] deleting rbd volume volume-f91a2b31-f6f2-4f3d-b1bb-fb79844fa526 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:14:53.921166 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-8a5d15df-1ca1-416f-a46f-58491ba5f258 tempest-VolumesGetTest-1625613573 None] Created reservations ['fd8e7e4f-1048-4ed3-b76e-14bafde5e8ec', '518b8aef-b358-44d3-b3c0-169019254685', '7863098b-dc0f-4499-91c6-5f304b403118', 'b8ebf861-4725-425d-ab1b-2fc27b235a49'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:14:53.965199 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8a5d15df-1ca1-416f-a46f-58491ba5f258 tempest-VolumesGetTest-1625613573 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:14:53.995478 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8a5d15df-1ca1-416f-a46f-58491ba5f258 tempest-VolumesGetTest-1625613573 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:14:54.062105 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-8a5d15df-1ca1-416f-a46f-58491ba5f258 tempest-VolumesGetTest-1625613573 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:14:54.068934 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-8a5d15df-1ca1-416f-a46f-58491ba5f258 tempest-VolumesGetTest-1625613573 None] Deleted volume successfully. Mar 12 21:14:54.129582 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-8a5d15df-1ca1-416f-a46f-58491ba5f258 tempest-VolumesGetTest-1625613573 None] Lock "b'cinder-f91a2b31-f6f2-4f3d-b1bb-fb79844fa526-delete_volume'" released by "delete_volume" :: held 0.746s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:14:54.183047 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-08378bd5-be38-4175-8618-ee265d3e8dce tempest-VolumesSnapshotTestJSON-1127165440 None] Created reservations ['166b5995-8f75-45e9-b9ed-a304b99747f9', '01501e30-40b5-4ab7-b347-8f804c00ba67', 'b58d818e-298c-466f-bf63-1a3cb5b97d65', '1f37ee51-31d5-428a-89c5-44940469e7a4'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:14:54.243446 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-08378bd5-be38-4175-8618-ee265d3e8dce tempest-VolumesSnapshotTestJSON-1127165440 None] Delete snapshot completed successfully. Mar 12 21:14:54.249665 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-08378bd5-be38-4175-8618-ee265d3e8dce tempest-VolumesSnapshotTestJSON-1127165440 None] Lock "b'cinder-22613e67-f638-49df-b899-1b760bb43b29-delete_snapshot'" released by "delete_snapshot" :: held 30.354s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:14:54.472363 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-a6dec8bc-cac3-4d3a-a2aa-7be3a3d1b36f tempest-VolumesSnapshotTestJSON-1127165440 None] Lock "b'cinder-e4a29494-c992-47c2-a78a-b9faca3d293b-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.028s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:14:54.481530 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a6dec8bc-cac3-4d3a-a2aa-7be3a3d1b36f tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:14:54.626446 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-3f8946b9-774e-4579-be6b-62c108eee1f1 tempest-VolumesGetTest-1625613573 None] Lock "b'cinder-5075bbd5-b281-460a-ad3a-f905925fb596-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:14:54.679527 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3f8946b9-774e-4579-be6b-62c108eee1f1 tempest-VolumesGetTest-1625613573 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:14:54.782173 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3f8946b9-774e-4579-be6b-62c108eee1f1 tempest-VolumesGetTest-1625613573 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:14:54.798997 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3f8946b9-774e-4579-be6b-62c108eee1f1 tempest-VolumesGetTest-1625613573 None] deleting rbd volume volume-5075bbd5-b281-460a-ad3a-f905925fb596 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:14:55.115457 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3f8946b9-774e-4579-be6b-62c108eee1f1 tempest-VolumesGetTest-1625613573 None] volume is a clone so cleaning references {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Mar 12 21:14:55.144540 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3f8946b9-774e-4579-be6b-62c108eee1f1 tempest-VolumesGetTest-1625613573 None] Volume volume-6a2fb5cc-b90f-4f0d-b2d2-82c0981944c6 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:14:55.145056 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3f8946b9-774e-4579-be6b-62c108eee1f1 tempest-VolumesGetTest-1625613573 None] deleting parent snapshot volume-5075bbd5-b281-460a-ad3a-f905925fb596.clone_snap {{(pid=129531) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Mar 12 21:14:56.407428 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-3f8946b9-774e-4579-be6b-62c108eee1f1 tempest-VolumesGetTest-1625613573 None] Created reservations ['5d33d27e-063d-4bc2-9f4c-d7ef6404cc25', '860f1732-4d4e-45b8-960c-d106c41c5531', '5e78fb07-63ec-4275-850e-2ac42e32cfe4', '4ddf4245-930a-4846-9f2b-cde7fc929088'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:14:56.488680 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3f8946b9-774e-4579-be6b-62c108eee1f1 tempest-VolumesGetTest-1625613573 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:14:56.530041 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3f8946b9-774e-4579-be6b-62c108eee1f1 tempest-VolumesGetTest-1625613573 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:14:56.606651 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-3f8946b9-774e-4579-be6b-62c108eee1f1 tempest-VolumesGetTest-1625613573 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:14:56.613905 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-3f8946b9-774e-4579-be6b-62c108eee1f1 tempest-VolumesGetTest-1625613573 None] Deleted volume successfully. Mar 12 21:14:56.632334 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-3f8946b9-774e-4579-be6b-62c108eee1f1 tempest-VolumesGetTest-1625613573 None] Lock "b'cinder-5075bbd5-b281-460a-ad3a-f905925fb596-delete_volume'" released by "delete_volume" :: held 2.006s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:14:57.547012 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:14:57.553569 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:14:57.555029 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:14:57.578602 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] Flow 'volume_create_manager' (cba7e1b6-2264-4752-b879-76bd2815f0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:14:57.586278 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (325fd05f-de3c-4bb3-af41-97c5ee8659ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:57.594469 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:14:57.610933 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (325fd05f-de3c-4bb3-af41-97c5ee8659ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1300958489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=dac02237-e8bd-4ce3-ab18-766509486e08,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0a55469ab750400ea339e4b5a7c548a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:14:58Z,use_quota=True,user_id='9429a1173f4a46899b53e38eed3a4db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:57.617236 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd6c1cc-0cff-4dc9-a779-317c50cbad5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:57.621682 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd6c1cc-0cff-4dc9-a779-317c50cbad5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:57.628099 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (776641f3-a291-4d6b-8bde-f4247b4ac46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:57.738635 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (776641f3-a291-4d6b-8bde-f4247b4ac46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dac02237-e8bd-4ce3-ab18-766509486e08', 'volume_name': 'volume-dac02237-e8bd-4ce3-ab18-766509486e08', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:57.744463 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb380167-60a8-4e08-9a2b-fabda6c6052f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:57.749630 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb380167-60a8-4e08-9a2b-fabda6c6052f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:57.755483 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a14fd4-2081-4e6a-b748-8568e4c669e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:57.756931 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] Volume dac02237-e8bd-4ce3-ab18-766509486e08: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dac02237-e8bd-4ce3-ab18-766509486e08', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 12 21:14:57.757927 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] Cloning dac02237-e8bd-4ce3-ab18-766509486e08 from image 539171db-0bd3-4f16-95fd-a7cd5530137d at location (None, None). {{(pid=129531) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Mar 12 21:14:57.771598 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] Lock "b'cinder-539171db-0bd3-4f16-95fd-a7cd5530137d'" acquired by "_prepare_image_cache_entry" :: waited 0.013s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:14:57.785188 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] Found image-volume cache entry: {'id': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'volume_id': '8d802c7b-bd34-4836-bd5d-90755a167ddc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34), 'last_used': datetime.datetime(2022, 3, 12, 21, 14, 57, 777932)}. {{(pid=129531) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 12 21:14:57.786429 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] Image-volume cache entry image_update_at = 2022-03-12 20:39:34+00:00, requested image updated_at = 2022-03-12 20:39:34+00:00. {{(pid=129531) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 12 21:14:57.787148 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] Found cache entry for image = 539171db-0bd3-4f16-95fd-a7cd5530137d on host ncdv-master-1@ceph#ceph. {{(pid=129531) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Mar 12 21:14:57.793452 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] Lock "b'cinder-539171db-0bd3-4f16-95fd-a7cd5530137d'" released by "_prepare_image_cache_entry" :: held 0.022s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:14:57.795944 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] Attempting to retrieve cache entry for image = 539171db-0bd3-4f16-95fd-a7cd5530137d on host ncdv-master-1@ceph#ceph. {{(pid=129531) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Mar 12 21:14:57.807641 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] Found image-volume cache entry: {'id': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'volume_id': '8d802c7b-bd34-4836-bd5d-90755a167ddc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34), 'last_used': datetime.datetime(2022, 3, 12, 21, 14, 57, 804052)}. {{(pid=129531) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 12 21:14:57.808097 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] Image-volume cache entry image_update_at = 2022-03-12 20:39:34+00:00, requested image updated_at = 2022-03-12 20:39:34+00:00. {{(pid=129531) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 12 21:14:57.810498 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] Creating from source image-volume 8d802c7b-bd34-4836-bd5d-90755a167ddc {{(pid=129531) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Mar 12 21:14:57.827715 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:14:57.935095 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] creating snapshot='volume-dac02237-e8bd-4ce3-ab18-766509486e08.clone_snap' {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Mar 12 21:14:58.277495 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] cloning 'volume-8d802c7b-bd34-4836-bd5d-90755a167ddc@volume-dac02237-e8bd-4ce3-ab18-766509486e08.clone_snap' to 'volume-dac02237-e8bd-4ce3-ab18-766509486e08' {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Mar 12 21:14:58.521646 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] Volume volume-9916cd82-3d9b-466f-a769-cf81bdc743fd.deleted is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:14:58.522755 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:14:58.523115 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:14:58.596426 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] clone created successfully {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Mar 12 21:14:58.597045 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.volume_utils [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] Marking volume dac02237-e8bd-4ce3-ab18-766509486e08 as bootable. {{(pid=129531) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 12 21:14:58.605698 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] Copying metadata from image 539171db-0bd3-4f16-95fd-a7cd5530137d to dac02237-e8bd-4ce3-ab18-766509486e08. {{(pid=129531) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Mar 12 21:14:58.606251 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] Creating volume glance metadata for volume dac02237-e8bd-4ce3-ab18-766509486e08 backed by image 539171db-0bd3-4f16-95fd-a7cd5530137d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129531) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Mar 12 21:14:58.726396 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a14fd4-2081-4e6a-b748-8568e4c669e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dac02237-e8bd-4ce3-ab18-766509486e08', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:58.739452 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a46558b2-1f15-4ba5-8fad-f70b1676ee5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:14:58.756406 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] Volume volume-dac02237-e8bd-4ce3-ab18-766509486e08 (dac02237-e8bd-4ce3-ab18-766509486e08): created successfully Mar 12 21:14:58.760391 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a46558b2-1f15-4ba5-8fad-f70b1676ee5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:14:58.768734 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] Flow 'volume_create_manager' (cba7e1b6-2264-4752-b879-76bd2815f0f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:14:58.782678 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-97445790-f207-4505-ac07-2bf22f84bcf2 tempest-VolumesGetTest-1625613573 None] Created volume successfully. Mar 12 21:14:59.539856 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-d7683ed2-87c5-4539-a7c7-891686682770 req-28868a10-d1df-4483-bcda-4e3cadf1c9fd tempest-TaggedBootDevicesTest-378912436 None] Terminate volume connection completed successfully. Mar 12 21:14:59.541402 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-d7683ed2-87c5-4539-a7c7-891686682770 req-28868a10-d1df-4483-bcda-4e3cadf1c9fd tempest-TaggedBootDevicesTest-378912436 None] Deleting attachment 1ba1b5ce-c3a1-486b-af1c-52cf0b40a72f. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 21:14:59.755559 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-d7683ed2-87c5-4539-a7c7-891686682770 req-06a8bc3b-d291-452b-aaec-c4495b525849 tempest-TaggedBootDevicesTest-378912436 None] Terminate volume connection completed successfully. Mar 12 21:14:59.756682 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-d7683ed2-87c5-4539-a7c7-891686682770 req-06a8bc3b-d291-452b-aaec-c4495b525849 tempest-TaggedBootDevicesTest-378912436 None] Deleting attachment 62351a8c-ebe2-4a05-9248-c856edce518a. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 21:14:59.943372 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-d7683ed2-87c5-4539-a7c7-891686682770 req-6346120b-fc28-46b3-a1c4-b57879bdf017 tempest-TaggedBootDevicesTest-378912436 None] Terminate volume connection completed successfully. Mar 12 21:14:59.943890 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-d7683ed2-87c5-4539-a7c7-891686682770 req-6346120b-fc28-46b3-a1c4-b57879bdf017 tempest-TaggedBootDevicesTest-378912436 None] Deleting attachment 545195ff-a909-442b-b99c-c131b7631e7d. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 21:15:00.574124 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-049f1380-4039-4ea6-9657-4b181b65246b tempest-VolumesGetTest-1625613573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:15:00.580862 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-049f1380-4039-4ea6-9657-4b181b65246b tempest-VolumesGetTest-1625613573 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:15:00.581936 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-049f1380-4039-4ea6-9657-4b181b65246b tempest-VolumesGetTest-1625613573 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:15:00.611763 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-049f1380-4039-4ea6-9657-4b181b65246b tempest-VolumesGetTest-1625613573 None] Flow 'volume_create_manager' (01a69b8e-dadd-44c0-b0b2-108a5670c7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:15:00.621814 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-049f1380-4039-4ea6-9657-4b181b65246b tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dc6926b-d6c7-4a27-aabe-31db196bb3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:00.632621 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-049f1380-4039-4ea6-9657-4b181b65246b tempest-VolumesGetTest-1625613573 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:15:00.650283 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-049f1380-4039-4ea6-9657-4b181b65246b tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dc6926b-d6c7-4a27-aabe-31db196bb3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:15:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-730999405',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1069306c-71cb-43c4-9224-e580aa47b942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a55469ab750400ea339e4b5a7c548a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:15:01Z,use_quota=True,user_id='9429a1173f4a46899b53e38eed3a4db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:00.657212 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-049f1380-4039-4ea6-9657-4b181b65246b tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82fa0c94-d662-4add-8017-8fdf95722368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:00.662002 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-049f1380-4039-4ea6-9657-4b181b65246b tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82fa0c94-d662-4add-8017-8fdf95722368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:00.671007 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-049f1380-4039-4ea6-9657-4b181b65246b tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8901893-9e81-424f-98b8-a2839b717de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:00.679086 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-049f1380-4039-4ea6-9657-4b181b65246b tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8901893-9e81-424f-98b8-a2839b717de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1069306c-71cb-43c4-9224-e580aa47b942', 'volume_name': 'volume-1069306c-71cb-43c4-9224-e580aa47b942', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:00.685415 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-049f1380-4039-4ea6-9657-4b181b65246b tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dc094f6-afe4-4d6e-ba27-9065206f4d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:00.691026 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-049f1380-4039-4ea6-9657-4b181b65246b tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dc094f6-afe4-4d6e-ba27-9065206f4d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:00.697467 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-049f1380-4039-4ea6-9657-4b181b65246b tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac60aa16-d4e9-4c46-8f8f-945972b0776b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:00.698634 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-049f1380-4039-4ea6-9657-4b181b65246b tempest-VolumesGetTest-1625613573 None] Volume 1069306c-71cb-43c4-9224-e580aa47b942: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1069306c-71cb-43c4-9224-e580aa47b942', 'volume_size': 1} Mar 12 21:15:00.699233 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-049f1380-4039-4ea6-9657-4b181b65246b tempest-VolumesGetTest-1625613573 None] creating volume 'volume-1069306c-71cb-43c4-9224-e580aa47b942' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:15:00.701142 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-049f1380-4039-4ea6-9657-4b181b65246b tempest-VolumesGetTest-1625613573 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:00.811156 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-049f1380-4039-4ea6-9657-4b181b65246b tempest-VolumesGetTest-1625613573 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:15:00.811835 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-049f1380-4039-4ea6-9657-4b181b65246b tempest-VolumesGetTest-1625613573 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:15:00.816512 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-049f1380-4039-4ea6-9657-4b181b65246b tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac60aa16-d4e9-4c46-8f8f-945972b0776b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1069306c-71cb-43c4-9224-e580aa47b942', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:00.827621 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-049f1380-4039-4ea6-9657-4b181b65246b tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68418cdc-39dc-4e13-8e44-27657dc87ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:00.842890 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-049f1380-4039-4ea6-9657-4b181b65246b tempest-VolumesGetTest-1625613573 None] Volume volume-1069306c-71cb-43c4-9224-e580aa47b942 (1069306c-71cb-43c4-9224-e580aa47b942): created successfully Mar 12 21:15:00.850111 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-049f1380-4039-4ea6-9657-4b181b65246b tempest-VolumesGetTest-1625613573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68418cdc-39dc-4e13-8e44-27657dc87ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:00.861896 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-049f1380-4039-4ea6-9657-4b181b65246b tempest-VolumesGetTest-1625613573 None] Flow 'volume_create_manager' (01a69b8e-dadd-44c0-b0b2-108a5670c7d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:15:00.873786 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-049f1380-4039-4ea6-9657-4b181b65246b tempest-VolumesGetTest-1625613573 None] Created volume successfully. Mar 12 21:15:01.777334 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-37bf7f5a-8da0-4242-afe6-e1860574b1a0 tempest-VolumesGetTest-1625613573 None] Lock "b'cinder-1069306c-71cb-43c4-9224-e580aa47b942-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:15:01.864355 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-37bf7f5a-8da0-4242-afe6-e1860574b1a0 tempest-VolumesGetTest-1625613573 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:01.942878 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-37bf7f5a-8da0-4242-afe6-e1860574b1a0 tempest-VolumesGetTest-1625613573 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:15:01.943490 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-37bf7f5a-8da0-4242-afe6-e1860574b1a0 tempest-VolumesGetTest-1625613573 None] Volume volume-1069306c-71cb-43c4-9224-e580aa47b942 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:15:01.953797 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-37bf7f5a-8da0-4242-afe6-e1860574b1a0 tempest-VolumesGetTest-1625613573 None] deleting rbd volume volume-1069306c-71cb-43c4-9224-e580aa47b942 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:15:02.307552 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-37bf7f5a-8da0-4242-afe6-e1860574b1a0 tempest-VolumesGetTest-1625613573 None] Created reservations ['90313dad-1080-4223-9484-96b74a6e5905', '92f3ec6a-5b8f-4463-840f-b2236622a703', 'fb69cad6-51cb-4f9a-bd93-09ffb72f1390', '3e37b9f5-94b6-4fc4-b2bc-1e83ee4c0ac2'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:15:02.383538 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-37bf7f5a-8da0-4242-afe6-e1860574b1a0 tempest-VolumesGetTest-1625613573 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:02.434941 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-37bf7f5a-8da0-4242-afe6-e1860574b1a0 tempest-VolumesGetTest-1625613573 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:02.525179 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-37bf7f5a-8da0-4242-afe6-e1860574b1a0 tempest-VolumesGetTest-1625613573 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:15:02.532374 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-37bf7f5a-8da0-4242-afe6-e1860574b1a0 tempest-VolumesGetTest-1625613573 None] Deleted volume successfully. Mar 12 21:15:02.594937 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-37bf7f5a-8da0-4242-afe6-e1860574b1a0 tempest-VolumesGetTest-1625613573 None] Lock "b'cinder-1069306c-71cb-43c4-9224-e580aa47b942-delete_volume'" released by "delete_volume" :: held 0.818s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:15:02.968472 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-37e55737-002c-4f3f-80fa-782f3686950c tempest-VolumesGetTest-1625613573 None] Lock "b'cinder-dac02237-e8bd-4ce3-ab18-766509486e08-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:15:03.019867 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-37e55737-002c-4f3f-80fa-782f3686950c tempest-VolumesGetTest-1625613573 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:03.142425 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-37e55737-002c-4f3f-80fa-782f3686950c tempest-VolumesGetTest-1625613573 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:15:03.160135 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-37e55737-002c-4f3f-80fa-782f3686950c tempest-VolumesGetTest-1625613573 None] deleting rbd volume volume-dac02237-e8bd-4ce3-ab18-766509486e08 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:15:03.524789 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-37e55737-002c-4f3f-80fa-782f3686950c tempest-VolumesGetTest-1625613573 None] volume is a clone so cleaning references {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Mar 12 21:15:03.578124 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-37e55737-002c-4f3f-80fa-782f3686950c tempest-VolumesGetTest-1625613573 None] deleting parent snapshot volume-dac02237-e8bd-4ce3-ab18-766509486e08.clone_snap {{(pid=129531) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Mar 12 21:15:04.616294 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-37e55737-002c-4f3f-80fa-782f3686950c tempest-VolumesGetTest-1625613573 None] Created reservations ['372cac7a-82c4-45aa-aeb1-e6362c0e0ffc', '4c825f64-c67e-4257-ad1c-ffc8c32ca781', '6589284b-be00-4043-8c52-143632e91514', '679eea6d-1392-4f1a-b44b-58b34fc05ea0'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:15:04.697063 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-37e55737-002c-4f3f-80fa-782f3686950c tempest-VolumesGetTest-1625613573 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:04.785884 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-37e55737-002c-4f3f-80fa-782f3686950c tempest-VolumesGetTest-1625613573 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:04.859685 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-37e55737-002c-4f3f-80fa-782f3686950c tempest-VolumesGetTest-1625613573 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:15:04.865971 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-37e55737-002c-4f3f-80fa-782f3686950c tempest-VolumesGetTest-1625613573 None] Deleted volume successfully. Mar 12 21:15:04.909032 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-37e55737-002c-4f3f-80fa-782f3686950c tempest-VolumesGetTest-1625613573 None] Lock "b'cinder-dac02237-e8bd-4ce3-ab18-766509486e08-delete_volume'" released by "delete_volume" :: held 1.940s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:15:05.251564 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-d2e8ba41-7fb1-49c1-9839-9dbaeac5feb3 tempest-VolumesGetTest-1625613573 None] Lock "b'cinder-6a2fb5cc-b90f-4f0d-b2d2-82c0981944c6-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:15:05.342919 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d2e8ba41-7fb1-49c1-9839-9dbaeac5feb3 tempest-VolumesGetTest-1625613573 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:05.412639 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d2e8ba41-7fb1-49c1-9839-9dbaeac5feb3 tempest-VolumesGetTest-1625613573 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:15:05.413350 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d2e8ba41-7fb1-49c1-9839-9dbaeac5feb3 tempest-VolumesGetTest-1625613573 None] Volume volume-6a2fb5cc-b90f-4f0d-b2d2-82c0981944c6 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:15:05.424595 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d2e8ba41-7fb1-49c1-9839-9dbaeac5feb3 tempest-VolumesGetTest-1625613573 None] deleting rbd volume volume-6a2fb5cc-b90f-4f0d-b2d2-82c0981944c6 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:15:05.812515 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-d2e8ba41-7fb1-49c1-9839-9dbaeac5feb3 tempest-VolumesGetTest-1625613573 None] Created reservations ['eb0a833b-eb93-49e5-ac0b-476b4e35426c', '3c98189c-9c69-4e72-bf59-e526b82fbce2', 'bf47b795-a218-419f-ba3f-ed7a304cb60f', '3d06a965-b9db-4099-9c56-5222c5b54a2c'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:15:05.888193 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d2e8ba41-7fb1-49c1-9839-9dbaeac5feb3 tempest-VolumesGetTest-1625613573 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:05.952076 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d2e8ba41-7fb1-49c1-9839-9dbaeac5feb3 tempest-VolumesGetTest-1625613573 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:06.018911 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-d2e8ba41-7fb1-49c1-9839-9dbaeac5feb3 tempest-VolumesGetTest-1625613573 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:15:06.027550 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-d2e8ba41-7fb1-49c1-9839-9dbaeac5feb3 tempest-VolumesGetTest-1625613573 None] Deleted volume successfully. Mar 12 21:15:06.058812 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-d2e8ba41-7fb1-49c1-9839-9dbaeac5feb3 tempest-VolumesGetTest-1625613573 None] Lock "b'cinder-6a2fb5cc-b90f-4f0d-b2d2-82c0981944c6-delete_volume'" released by "delete_volume" :: held 0.807s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:15:07.392696 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-2a9f8838-39cf-44ab-8bef-afe5f24e5977 tempest-TaggedBootDevicesTest-378912436 None] Lock "b'cinder-97dcd19d-c778-4d5a-ac7e-e6f2d767dbf4-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:15:07.465537 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2a9f8838-39cf-44ab-8bef-afe5f24e5977 tempest-TaggedBootDevicesTest-378912436 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:07.552031 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2a9f8838-39cf-44ab-8bef-afe5f24e5977 tempest-TaggedBootDevicesTest-378912436 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:15:07.552653 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2a9f8838-39cf-44ab-8bef-afe5f24e5977 tempest-TaggedBootDevicesTest-378912436 None] Volume volume-97dcd19d-c778-4d5a-ac7e-e6f2d767dbf4 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:15:07.566131 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2a9f8838-39cf-44ab-8bef-afe5f24e5977 tempest-TaggedBootDevicesTest-378912436 None] deleting rbd volume volume-97dcd19d-c778-4d5a-ac7e-e6f2d767dbf4 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:15:08.072387 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-2a9f8838-39cf-44ab-8bef-afe5f24e5977 tempest-TaggedBootDevicesTest-378912436 None] Created reservations ['b298e6e9-bd5d-4ae4-a63f-a5b0e81e7027', '780ce847-b1f2-4399-828d-5fae2c6bcf25', 'b2c5192f-8d3d-4ec0-82a4-d937747d266d', 'a733bf4a-2574-4601-a188-1d979f2e5d1f'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:15:08.172975 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2a9f8838-39cf-44ab-8bef-afe5f24e5977 tempest-TaggedBootDevicesTest-378912436 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:08.264460 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2a9f8838-39cf-44ab-8bef-afe5f24e5977 tempest-TaggedBootDevicesTest-378912436 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:08.321704 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-2a9f8838-39cf-44ab-8bef-afe5f24e5977 tempest-TaggedBootDevicesTest-378912436 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:15:08.335377 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-2a9f8838-39cf-44ab-8bef-afe5f24e5977 tempest-TaggedBootDevicesTest-378912436 None] Deleted volume successfully. Mar 12 21:15:08.355464 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-2a9f8838-39cf-44ab-8bef-afe5f24e5977 tempest-TaggedBootDevicesTest-378912436 None] Lock "b'cinder-97dcd19d-c778-4d5a-ac7e-e6f2d767dbf4-delete_volume'" released by "delete_volume" :: held 0.963s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:15:08.628924 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-2f6148f7-1591-418b-96ee-dc23818551ea tempest-TaggedBootDevicesTest-378912436 None] Lock "b'cinder-519a2fed-2ed7-49b2-973b-b1a48e2e8095-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:15:08.742314 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2f6148f7-1591-418b-96ee-dc23818551ea tempest-TaggedBootDevicesTest-378912436 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:08.852202 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2f6148f7-1591-418b-96ee-dc23818551ea tempest-TaggedBootDevicesTest-378912436 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:15:08.852629 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2f6148f7-1591-418b-96ee-dc23818551ea tempest-TaggedBootDevicesTest-378912436 None] Volume volume-519a2fed-2ed7-49b2-973b-b1a48e2e8095 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:15:08.866403 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2f6148f7-1591-418b-96ee-dc23818551ea tempest-TaggedBootDevicesTest-378912436 None] deleting rbd volume volume-519a2fed-2ed7-49b2-973b-b1a48e2e8095 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:15:09.362819 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-2f6148f7-1591-418b-96ee-dc23818551ea tempest-TaggedBootDevicesTest-378912436 None] Created reservations ['071cdb2e-e264-477f-afa6-c38d5e113686', 'b3678b1f-f3cb-460f-8792-dfd853eb5d99', 'f20ee40a-8447-4047-8457-5dc570a50887', 'fbd9ed51-b1d1-4fde-b328-a88f9cb3da75'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:15:09.458071 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2f6148f7-1591-418b-96ee-dc23818551ea tempest-TaggedBootDevicesTest-378912436 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:09.530616 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2f6148f7-1591-418b-96ee-dc23818551ea tempest-TaggedBootDevicesTest-378912436 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:09.605889 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-2f6148f7-1591-418b-96ee-dc23818551ea tempest-TaggedBootDevicesTest-378912436 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:15:09.611727 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-2f6148f7-1591-418b-96ee-dc23818551ea tempest-TaggedBootDevicesTest-378912436 None] Deleted volume successfully. Mar 12 21:15:09.631611 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-2f6148f7-1591-418b-96ee-dc23818551ea tempest-TaggedBootDevicesTest-378912436 None] Lock "b'cinder-519a2fed-2ed7-49b2-973b-b1a48e2e8095-delete_volume'" released by "delete_volume" :: held 1.003s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:15:09.866475 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-edd47ff3-6811-41a5-a7d6-a4929681eac9 tempest-TaggedBootDevicesTest-378912436 None] Lock "b'cinder-33b5d761-3965-4dcf-89b4-d41fc8e26fd9-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:15:09.912907 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-edd47ff3-6811-41a5-a7d6-a4929681eac9 tempest-TaggedBootDevicesTest-378912436 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:10.017408 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-edd47ff3-6811-41a5-a7d6-a4929681eac9 tempest-TaggedBootDevicesTest-378912436 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:15:10.031902 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-edd47ff3-6811-41a5-a7d6-a4929681eac9 tempest-TaggedBootDevicesTest-378912436 None] deleting rbd volume volume-33b5d761-3965-4dcf-89b4-d41fc8e26fd9 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:15:10.062484 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-c383dffc-26cc-4481-ba0b-74a7d102b32d tempest-VolumesListTestJSON-394897206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:15:10.069283 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-c383dffc-26cc-4481-ba0b-74a7d102b32d tempest-VolumesListTestJSON-394897206 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:15:10.069860 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-c383dffc-26cc-4481-ba0b-74a7d102b32d tempest-VolumesListTestJSON-394897206 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:15:10.092365 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c383dffc-26cc-4481-ba0b-74a7d102b32d tempest-VolumesListTestJSON-394897206 None] Flow 'volume_create_manager' (7891f98e-02d3-4f11-90f5-24a62b3f9387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:15:10.099926 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c383dffc-26cc-4481-ba0b-74a7d102b32d tempest-VolumesListTestJSON-394897206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (219ff451-b6fb-4a4c-9a94-6b7d75d74891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:10.107803 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-c383dffc-26cc-4481-ba0b-74a7d102b32d tempest-VolumesListTestJSON-394897206 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:15:10.134427 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c383dffc-26cc-4481-ba0b-74a7d102b32d tempest-VolumesListTestJSON-394897206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (219ff451-b6fb-4a4c-9a94-6b7d75d74891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1117981566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4573d1c9-d75f-4bae-9370-f4e0786d3ebb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='da216d0613ed426e8350b160fca0e2a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:15:10Z,use_quota=True,user_id='c88f27ec0a7c4517a6d6c146ef4f2ea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:10.141378 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c383dffc-26cc-4481-ba0b-74a7d102b32d tempest-VolumesListTestJSON-394897206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (819a94fd-473e-4ab5-9335-7fab1fce65a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:10.147309 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c383dffc-26cc-4481-ba0b-74a7d102b32d tempest-VolumesListTestJSON-394897206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (819a94fd-473e-4ab5-9335-7fab1fce65a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:10.166064 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c383dffc-26cc-4481-ba0b-74a7d102b32d tempest-VolumesListTestJSON-394897206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6757fd95-331a-47aa-8744-8b3e6b2066a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:10.174496 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c383dffc-26cc-4481-ba0b-74a7d102b32d tempest-VolumesListTestJSON-394897206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6757fd95-331a-47aa-8744-8b3e6b2066a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4573d1c9-d75f-4bae-9370-f4e0786d3ebb', 'volume_name': 'volume-4573d1c9-d75f-4bae-9370-f4e0786d3ebb', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:10.198177 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c383dffc-26cc-4481-ba0b-74a7d102b32d tempest-VolumesListTestJSON-394897206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee9f89ef-c6a5-4f3e-82e0-e8be8628dd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:10.205019 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c383dffc-26cc-4481-ba0b-74a7d102b32d tempest-VolumesListTestJSON-394897206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee9f89ef-c6a5-4f3e-82e0-e8be8628dd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:10.214234 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c383dffc-26cc-4481-ba0b-74a7d102b32d tempest-VolumesListTestJSON-394897206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a7197e-555d-464f-8810-54ffa5efd53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:10.216495 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-c383dffc-26cc-4481-ba0b-74a7d102b32d tempest-VolumesListTestJSON-394897206 None] Volume 4573d1c9-d75f-4bae-9370-f4e0786d3ebb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4573d1c9-d75f-4bae-9370-f4e0786d3ebb', 'volume_size': 1} Mar 12 21:15:10.217079 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c383dffc-26cc-4481-ba0b-74a7d102b32d tempest-VolumesListTestJSON-394897206 None] creating volume 'volume-4573d1c9-d75f-4bae-9370-f4e0786d3ebb' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:15:10.219181 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c383dffc-26cc-4481-ba0b-74a7d102b32d tempest-VolumesListTestJSON-394897206 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:10.357973 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c383dffc-26cc-4481-ba0b-74a7d102b32d tempest-VolumesListTestJSON-394897206 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:15:10.358301 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c383dffc-26cc-4481-ba0b-74a7d102b32d tempest-VolumesListTestJSON-394897206 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:15:10.363331 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c383dffc-26cc-4481-ba0b-74a7d102b32d tempest-VolumesListTestJSON-394897206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a7197e-555d-464f-8810-54ffa5efd53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4573d1c9-d75f-4bae-9370-f4e0786d3ebb', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:10.368194 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c383dffc-26cc-4481-ba0b-74a7d102b32d tempest-VolumesListTestJSON-394897206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83ec657b-1a9b-4d6b-947a-2f30b697281c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:10.380802 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-c383dffc-26cc-4481-ba0b-74a7d102b32d tempest-VolumesListTestJSON-394897206 None] Volume volume-4573d1c9-d75f-4bae-9370-f4e0786d3ebb (4573d1c9-d75f-4bae-9370-f4e0786d3ebb): created successfully Mar 12 21:15:10.386614 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c383dffc-26cc-4481-ba0b-74a7d102b32d tempest-VolumesListTestJSON-394897206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83ec657b-1a9b-4d6b-947a-2f30b697281c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:10.394748 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c383dffc-26cc-4481-ba0b-74a7d102b32d tempest-VolumesListTestJSON-394897206 None] Flow 'volume_create_manager' (7891f98e-02d3-4f11-90f5-24a62b3f9387) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:15:10.408784 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-c383dffc-26cc-4481-ba0b-74a7d102b32d tempest-VolumesListTestJSON-394897206 None] Created volume successfully. Mar 12 21:15:10.436438 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-edd47ff3-6811-41a5-a7d6-a4929681eac9 tempest-TaggedBootDevicesTest-378912436 None] volume is a clone so cleaning references {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Mar 12 21:15:10.483581 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-edd47ff3-6811-41a5-a7d6-a4929681eac9 tempest-TaggedBootDevicesTest-378912436 None] deleting parent snapshot volume-33b5d761-3965-4dcf-89b4-d41fc8e26fd9.clone_snap {{(pid=129531) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Mar 12 21:15:11.602017 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-d358137e-bd53-45fd-b22c-aecbe3c96cc8 tempest-VolumesListTestJSON-394897206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:15:11.605116 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-d358137e-bd53-45fd-b22c-aecbe3c96cc8 tempest-VolumesListTestJSON-394897206 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:15:11.605556 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-d358137e-bd53-45fd-b22c-aecbe3c96cc8 tempest-VolumesListTestJSON-394897206 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:15:11.625682 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d358137e-bd53-45fd-b22c-aecbe3c96cc8 tempest-VolumesListTestJSON-394897206 None] Flow 'volume_create_manager' (99b153df-7fed-44e0-9b6a-88edf7ecaf8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:15:11.632391 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d358137e-bd53-45fd-b22c-aecbe3c96cc8 tempest-VolumesListTestJSON-394897206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95d8a10f-b635-4f04-9362-0b8133fb37aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:11.636622 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-35339c31-7b3f-463b-82bc-7b04c1ed4c19 tempest-TestVolumeBootPattern-1001263199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:15:11.641396 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-35339c31-7b3f-463b-82bc-7b04c1ed4c19 tempest-TestVolumeBootPattern-1001263199 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:15:11.641883 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-35339c31-7b3f-463b-82bc-7b04c1ed4c19 tempest-TestVolumeBootPattern-1001263199 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:15:11.660782 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-35339c31-7b3f-463b-82bc-7b04c1ed4c19 tempest-TestVolumeBootPattern-1001263199 None] Flow 'volume_create_manager' (cb97072d-87c1-4c77-abed-f9ad5086643d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:15:11.667382 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-35339c31-7b3f-463b-82bc-7b04c1ed4c19 tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dca4c8b-fe69-4b68-a573-b3cc2e572704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:11.679231 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-d358137e-bd53-45fd-b22c-aecbe3c96cc8 tempest-VolumesListTestJSON-394897206 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:15:11.681992 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-edd47ff3-6811-41a5-a7d6-a4929681eac9 tempest-TaggedBootDevicesTest-378912436 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:15:11.702619 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d358137e-bd53-45fd-b22c-aecbe3c96cc8 tempest-VolumesListTestJSON-394897206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95d8a10f-b635-4f04-9362-0b8133fb37aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1811701389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8573cf7a-8915-4875-9649-6feed197f31e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='da216d0613ed426e8350b160fca0e2a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:15:11Z,use_quota=True,user_id='c88f27ec0a7c4517a6d6c146ef4f2ea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:11.708094 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d358137e-bd53-45fd-b22c-aecbe3c96cc8 tempest-VolumesListTestJSON-394897206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa5d3bd9-db09-4618-b21b-cf4cbb96b1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:11.712249 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d358137e-bd53-45fd-b22c-aecbe3c96cc8 tempest-VolumesListTestJSON-394897206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa5d3bd9-db09-4618-b21b-cf4cbb96b1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:11.717929 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d358137e-bd53-45fd-b22c-aecbe3c96cc8 tempest-VolumesListTestJSON-394897206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c2b196e-435e-4089-a33b-81224693a9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:11.722163 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d358137e-bd53-45fd-b22c-aecbe3c96cc8 tempest-VolumesListTestJSON-394897206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c2b196e-435e-4089-a33b-81224693a9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8573cf7a-8915-4875-9649-6feed197f31e', 'volume_name': 'volume-8573cf7a-8915-4875-9649-6feed197f31e', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:11.727318 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d358137e-bd53-45fd-b22c-aecbe3c96cc8 tempest-VolumesListTestJSON-394897206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e555e7d8-e9ed-49d3-89d3-fbafa924ddc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:11.731907 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d358137e-bd53-45fd-b22c-aecbe3c96cc8 tempest-VolumesListTestJSON-394897206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e555e7d8-e9ed-49d3-89d3-fbafa924ddc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:11.736804 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d358137e-bd53-45fd-b22c-aecbe3c96cc8 tempest-VolumesListTestJSON-394897206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (759c0601-d7d0-40ab-b1ff-7ce3851ca284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:11.737896 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-d358137e-bd53-45fd-b22c-aecbe3c96cc8 tempest-VolumesListTestJSON-394897206 None] Volume 8573cf7a-8915-4875-9649-6feed197f31e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8573cf7a-8915-4875-9649-6feed197f31e', 'volume_size': 1} Mar 12 21:15:11.738276 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d358137e-bd53-45fd-b22c-aecbe3c96cc8 tempest-VolumesListTestJSON-394897206 None] creating volume 'volume-8573cf7a-8915-4875-9649-6feed197f31e' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:15:11.739245 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d358137e-bd53-45fd-b22c-aecbe3c96cc8 tempest-VolumesListTestJSON-394897206 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:11.771460 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-35339c31-7b3f-463b-82bc-7b04c1ed4c19 tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dca4c8b-fe69-4b68-a573-b3cc2e572704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-708764098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=01f30321-c853-4b84-a900-fbdd71d12e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62f54fe17dd142b4be6d7d09de31d63b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:15:11Z,use_quota=True,user_id='284a1908713c4b74a35a1d3b5cd10e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:11.777583 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-35339c31-7b3f-463b-82bc-7b04c1ed4c19 tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e93e0a6a-8d1d-48d4-9787-a41b47e35c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:11.782822 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-35339c31-7b3f-463b-82bc-7b04c1ed4c19 tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e93e0a6a-8d1d-48d4-9787-a41b47e35c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:11.789089 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-35339c31-7b3f-463b-82bc-7b04c1ed4c19 tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dadfb1ba-c8ee-428c-bf5a-9eb6e74f61a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:11.804194 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d358137e-bd53-45fd-b22c-aecbe3c96cc8 tempest-VolumesListTestJSON-394897206 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:15:11.804633 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d358137e-bd53-45fd-b22c-aecbe3c96cc8 tempest-VolumesListTestJSON-394897206 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:15:11.808524 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d358137e-bd53-45fd-b22c-aecbe3c96cc8 tempest-VolumesListTestJSON-394897206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (759c0601-d7d0-40ab-b1ff-7ce3851ca284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8573cf7a-8915-4875-9649-6feed197f31e', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:11.813360 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d358137e-bd53-45fd-b22c-aecbe3c96cc8 tempest-VolumesListTestJSON-394897206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (396c90c1-2590-47b1-8381-a2b2ebb435d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:11.822344 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-edd47ff3-6811-41a5-a7d6-a4929681eac9 tempest-TaggedBootDevicesTest-378912436 None] Created reservations ['8564dd94-b5b5-42e5-ab8d-a03b35a33d6f', '0602cb95-2e30-462c-b4a2-6aa4fa73709b', '55d7b74c-9cfb-4c14-9348-aa3217a5cd91', 'ab307e63-b729-4c5c-829c-e3011a75826e'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:15:11.826990 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-d358137e-bd53-45fd-b22c-aecbe3c96cc8 tempest-VolumesListTestJSON-394897206 None] Volume volume-8573cf7a-8915-4875-9649-6feed197f31e (8573cf7a-8915-4875-9649-6feed197f31e): created successfully Mar 12 21:15:11.830891 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d358137e-bd53-45fd-b22c-aecbe3c96cc8 tempest-VolumesListTestJSON-394897206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (396c90c1-2590-47b1-8381-a2b2ebb435d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:11.836581 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-d358137e-bd53-45fd-b22c-aecbe3c96cc8 tempest-VolumesListTestJSON-394897206 None] Flow 'volume_create_manager' (99b153df-7fed-44e0-9b6a-88edf7ecaf8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:15:11.858063 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-d358137e-bd53-45fd-b22c-aecbe3c96cc8 tempest-VolumesListTestJSON-394897206 None] Created volume successfully. Mar 12 21:15:11.900553 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-edd47ff3-6811-41a5-a7d6-a4929681eac9 tempest-TaggedBootDevicesTest-378912436 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:11.922269 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-edd47ff3-6811-41a5-a7d6-a4929681eac9 tempest-TaggedBootDevicesTest-378912436 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:11.945156 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-edd47ff3-6811-41a5-a7d6-a4929681eac9 tempest-TaggedBootDevicesTest-378912436 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:15:11.952290 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-35339c31-7b3f-463b-82bc-7b04c1ed4c19 tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dadfb1ba-c8ee-428c-bf5a-9eb6e74f61a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '01f30321-c853-4b84-a900-fbdd71d12e8a', 'volume_name': 'volume-01f30321-c853-4b84-a900-fbdd71d12e8a', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:11.957386 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-35339c31-7b3f-463b-82bc-7b04c1ed4c19 tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f121102-a678-435d-8215-a9d13ffda40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:11.961484 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-35339c31-7b3f-463b-82bc-7b04c1ed4c19 tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f121102-a678-435d-8215-a9d13ffda40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:11.966839 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-35339c31-7b3f-463b-82bc-7b04c1ed4c19 tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (817fc513-30f9-4a5a-a6c1-cc8c2b1012a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:11.967958 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-35339c31-7b3f-463b-82bc-7b04c1ed4c19 tempest-TestVolumeBootPattern-1001263199 None] Volume 01f30321-c853-4b84-a900-fbdd71d12e8a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-01f30321-c853-4b84-a900-fbdd71d12e8a', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 12 21:15:11.968507 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-35339c31-7b3f-463b-82bc-7b04c1ed4c19 tempest-TestVolumeBootPattern-1001263199 None] Cloning 01f30321-c853-4b84-a900-fbdd71d12e8a from image 539171db-0bd3-4f16-95fd-a7cd5530137d at location (None, None). {{(pid=129531) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Mar 12 21:15:11.973419 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-edd47ff3-6811-41a5-a7d6-a4929681eac9 tempest-TaggedBootDevicesTest-378912436 None] Deleted volume successfully. Mar 12 21:15:11.982285 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-35339c31-7b3f-463b-82bc-7b04c1ed4c19 tempest-TestVolumeBootPattern-1001263199 None] Lock "b'cinder-539171db-0bd3-4f16-95fd-a7cd5530137d'" acquired by "_prepare_image_cache_entry" :: waited 0.013s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:15:11.992018 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-edd47ff3-6811-41a5-a7d6-a4929681eac9 tempest-TaggedBootDevicesTest-378912436 None] Lock "b'cinder-33b5d761-3965-4dcf-89b4-d41fc8e26fd9-delete_volume'" released by "delete_volume" :: held 2.126s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:15:11.993850 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-35339c31-7b3f-463b-82bc-7b04c1ed4c19 tempest-TestVolumeBootPattern-1001263199 None] Found image-volume cache entry: {'id': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'volume_id': '8d802c7b-bd34-4836-bd5d-90755a167ddc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34), 'last_used': datetime.datetime(2022, 3, 12, 21, 15, 11, 988054)}. {{(pid=129531) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 12 21:15:11.994278 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-35339c31-7b3f-463b-82bc-7b04c1ed4c19 tempest-TestVolumeBootPattern-1001263199 None] Image-volume cache entry image_update_at = 2022-03-12 20:39:34+00:00, requested image updated_at = 2022-03-12 20:39:34+00:00. {{(pid=129531) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 12 21:15:11.994666 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-35339c31-7b3f-463b-82bc-7b04c1ed4c19 tempest-TestVolumeBootPattern-1001263199 None] Found cache entry for image = 539171db-0bd3-4f16-95fd-a7cd5530137d on host ncdv-master-1@ceph#ceph. {{(pid=129531) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Mar 12 21:15:11.998334 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-35339c31-7b3f-463b-82bc-7b04c1ed4c19 tempest-TestVolumeBootPattern-1001263199 None] Lock "b'cinder-539171db-0bd3-4f16-95fd-a7cd5530137d'" released by "_prepare_image_cache_entry" :: held 0.016s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:15:11.999125 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-35339c31-7b3f-463b-82bc-7b04c1ed4c19 tempest-TestVolumeBootPattern-1001263199 None] Attempting to retrieve cache entry for image = 539171db-0bd3-4f16-95fd-a7cd5530137d on host ncdv-master-1@ceph#ceph. {{(pid=129531) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Mar 12 21:15:12.004360 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-35339c31-7b3f-463b-82bc-7b04c1ed4c19 tempest-TestVolumeBootPattern-1001263199 None] Found image-volume cache entry: {'id': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'volume_id': '8d802c7b-bd34-4836-bd5d-90755a167ddc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34), 'last_used': datetime.datetime(2022, 3, 12, 21, 15, 12, 2253)}. {{(pid=129531) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 12 21:15:12.004765 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-35339c31-7b3f-463b-82bc-7b04c1ed4c19 tempest-TestVolumeBootPattern-1001263199 None] Image-volume cache entry image_update_at = 2022-03-12 20:39:34+00:00, requested image updated_at = 2022-03-12 20:39:34+00:00. {{(pid=129531) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 12 21:15:12.005152 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-35339c31-7b3f-463b-82bc-7b04c1ed4c19 tempest-TestVolumeBootPattern-1001263199 None] Creating from source image-volume 8d802c7b-bd34-4836-bd5d-90755a167ddc {{(pid=129531) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Mar 12 21:15:12.016350 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-35339c31-7b3f-463b-82bc-7b04c1ed4c19 tempest-TestVolumeBootPattern-1001263199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:12.082551 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-35339c31-7b3f-463b-82bc-7b04c1ed4c19 tempest-TestVolumeBootPattern-1001263199 None] creating snapshot='volume-01f30321-c853-4b84-a900-fbdd71d12e8a.clone_snap' {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Mar 12 21:15:12.603975 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-35339c31-7b3f-463b-82bc-7b04c1ed4c19 tempest-TestVolumeBootPattern-1001263199 None] cloning 'volume-8d802c7b-bd34-4836-bd5d-90755a167ddc@volume-01f30321-c853-4b84-a900-fbdd71d12e8a.clone_snap' to 'volume-01f30321-c853-4b84-a900-fbdd71d12e8a' {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Mar 12 21:15:12.842698 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-35339c31-7b3f-463b-82bc-7b04c1ed4c19 tempest-TestVolumeBootPattern-1001263199 None] Volume volume-9916cd82-3d9b-466f-a769-cf81bdc743fd.deleted is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:15:12.844805 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-35339c31-7b3f-463b-82bc-7b04c1ed4c19 tempest-TestVolumeBootPattern-1001263199 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:15:12.845193 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-35339c31-7b3f-463b-82bc-7b04c1ed4c19 tempest-TestVolumeBootPattern-1001263199 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:15:12.892766 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-35339c31-7b3f-463b-82bc-7b04c1ed4c19 tempest-TestVolumeBootPattern-1001263199 None] clone created successfully {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Mar 12 21:15:12.893742 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.volume_utils [None req-35339c31-7b3f-463b-82bc-7b04c1ed4c19 tempest-TestVolumeBootPattern-1001263199 None] Marking volume 01f30321-c853-4b84-a900-fbdd71d12e8a as bootable. {{(pid=129531) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 12 21:15:12.905891 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-35339c31-7b3f-463b-82bc-7b04c1ed4c19 tempest-TestVolumeBootPattern-1001263199 None] Copying metadata from image 539171db-0bd3-4f16-95fd-a7cd5530137d to 01f30321-c853-4b84-a900-fbdd71d12e8a. {{(pid=129531) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Mar 12 21:15:12.906845 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-35339c31-7b3f-463b-82bc-7b04c1ed4c19 tempest-TestVolumeBootPattern-1001263199 None] Creating volume glance metadata for volume 01f30321-c853-4b84-a900-fbdd71d12e8a backed by image 539171db-0bd3-4f16-95fd-a7cd5530137d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129531) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Mar 12 21:15:12.996243 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-35339c31-7b3f-463b-82bc-7b04c1ed4c19 tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (817fc513-30f9-4a5a-a6c1-cc8c2b1012a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01f30321-c853-4b84-a900-fbdd71d12e8a', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:13.002803 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-35339c31-7b3f-463b-82bc-7b04c1ed4c19 tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90318cb8-5f12-40cf-82b1-e924329a364c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:13.027679 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-35339c31-7b3f-463b-82bc-7b04c1ed4c19 tempest-TestVolumeBootPattern-1001263199 None] Volume volume-01f30321-c853-4b84-a900-fbdd71d12e8a (01f30321-c853-4b84-a900-fbdd71d12e8a): created successfully Mar 12 21:15:13.030302 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-35339c31-7b3f-463b-82bc-7b04c1ed4c19 tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90318cb8-5f12-40cf-82b1-e924329a364c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:13.036394 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-35339c31-7b3f-463b-82bc-7b04c1ed4c19 tempest-TestVolumeBootPattern-1001263199 None] Flow 'volume_create_manager' (cb97072d-87c1-4c77-abed-f9ad5086643d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:15:13.043834 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-45389bd7-0066-427e-9854-9255c9b191a6 tempest-VolumesListTestJSON-394897206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:15:13.047289 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-45389bd7-0066-427e-9854-9255c9b191a6 tempest-VolumesListTestJSON-394897206 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:15:13.047572 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-45389bd7-0066-427e-9854-9255c9b191a6 tempest-VolumesListTestJSON-394897206 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:15:13.068399 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-45389bd7-0066-427e-9854-9255c9b191a6 tempest-VolumesListTestJSON-394897206 None] Flow 'volume_create_manager' (37dd256a-ce95-4fdb-82df-77bfd57912cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:15:13.075271 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-45389bd7-0066-427e-9854-9255c9b191a6 tempest-VolumesListTestJSON-394897206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9feccf8d-30f0-4e61-b7a6-c84609b64917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:13.084394 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-45389bd7-0066-427e-9854-9255c9b191a6 tempest-VolumesListTestJSON-394897206 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:15:13.088710 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-35339c31-7b3f-463b-82bc-7b04c1ed4c19 tempest-TestVolumeBootPattern-1001263199 None] Created volume successfully. Mar 12 21:15:13.102079 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-45389bd7-0066-427e-9854-9255c9b191a6 tempest-VolumesListTestJSON-394897206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9feccf8d-30f0-4e61-b7a6-c84609b64917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2087277966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=64606161-4d6c-4926-a67d-1a51b385f934,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='da216d0613ed426e8350b160fca0e2a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:15:13Z,use_quota=True,user_id='c88f27ec0a7c4517a6d6c146ef4f2ea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:13.108061 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-45389bd7-0066-427e-9854-9255c9b191a6 tempest-VolumesListTestJSON-394897206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4e3f86-3730-4374-8019-0e6f08ca86f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:13.112310 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-45389bd7-0066-427e-9854-9255c9b191a6 tempest-VolumesListTestJSON-394897206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4e3f86-3730-4374-8019-0e6f08ca86f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:13.119106 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-45389bd7-0066-427e-9854-9255c9b191a6 tempest-VolumesListTestJSON-394897206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cda5fe2-668b-4dd7-b155-5b31bbcab8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:13.123924 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-45389bd7-0066-427e-9854-9255c9b191a6 tempest-VolumesListTestJSON-394897206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cda5fe2-668b-4dd7-b155-5b31bbcab8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64606161-4d6c-4926-a67d-1a51b385f934', 'volume_name': 'volume-64606161-4d6c-4926-a67d-1a51b385f934', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:13.129166 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-45389bd7-0066-427e-9854-9255c9b191a6 tempest-VolumesListTestJSON-394897206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7f27a9-a13d-437b-96f9-39467c419b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:13.133436 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-45389bd7-0066-427e-9854-9255c9b191a6 tempest-VolumesListTestJSON-394897206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7f27a9-a13d-437b-96f9-39467c419b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:13.138415 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-45389bd7-0066-427e-9854-9255c9b191a6 tempest-VolumesListTestJSON-394897206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e42599e4-2297-4747-8dbd-a8a68c7159a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:13.139541 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-45389bd7-0066-427e-9854-9255c9b191a6 tempest-VolumesListTestJSON-394897206 None] Volume 64606161-4d6c-4926-a67d-1a51b385f934: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64606161-4d6c-4926-a67d-1a51b385f934', 'volume_size': 1} Mar 12 21:15:13.139937 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-45389bd7-0066-427e-9854-9255c9b191a6 tempest-VolumesListTestJSON-394897206 None] creating volume 'volume-64606161-4d6c-4926-a67d-1a51b385f934' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:15:13.141381 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-45389bd7-0066-427e-9854-9255c9b191a6 tempest-VolumesListTestJSON-394897206 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:13.205991 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-45389bd7-0066-427e-9854-9255c9b191a6 tempest-VolumesListTestJSON-394897206 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:15:13.206449 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-45389bd7-0066-427e-9854-9255c9b191a6 tempest-VolumesListTestJSON-394897206 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:15:13.212667 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-45389bd7-0066-427e-9854-9255c9b191a6 tempest-VolumesListTestJSON-394897206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e42599e4-2297-4747-8dbd-a8a68c7159a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64606161-4d6c-4926-a67d-1a51b385f934', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:13.218184 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-45389bd7-0066-427e-9854-9255c9b191a6 tempest-VolumesListTestJSON-394897206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (617333b7-e736-404b-b619-7e610870d26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:13.227632 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-45389bd7-0066-427e-9854-9255c9b191a6 tempest-VolumesListTestJSON-394897206 None] Volume volume-64606161-4d6c-4926-a67d-1a51b385f934 (64606161-4d6c-4926-a67d-1a51b385f934): created successfully Mar 12 21:15:13.232552 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-45389bd7-0066-427e-9854-9255c9b191a6 tempest-VolumesListTestJSON-394897206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (617333b7-e736-404b-b619-7e610870d26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:13.239498 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-45389bd7-0066-427e-9854-9255c9b191a6 tempest-VolumesListTestJSON-394897206 None] Flow 'volume_create_manager' (37dd256a-ce95-4fdb-82df-77bfd57912cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:15:13.248948 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-45389bd7-0066-427e-9854-9255c9b191a6 tempest-VolumesListTestJSON-394897206 None] Created volume successfully. Mar 12 21:15:13.651680 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-db139fa5-30e2-4164-97d7-282437cdd935 tempest-TestVolumeBootPattern-1001263199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:14.785349 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-db139fa5-30e2-4164-97d7-282437cdd935 tempest-TestVolumeBootPattern-1001263199 None] Create snapshot completed successfully Mar 12 21:15:17.341624 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-09f84c52-77f5-4d27-814b-a596e43f1fe8 tempest-VolumesListTestJSON-394897206 None] Lock "b'cinder-64606161-4d6c-4926-a67d-1a51b385f934-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:15:17.391319 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-09f84c52-77f5-4d27-814b-a596e43f1fe8 tempest-VolumesListTestJSON-394897206 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:17.455906 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-09f84c52-77f5-4d27-814b-a596e43f1fe8 tempest-VolumesListTestJSON-394897206 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:15:17.456389 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-09f84c52-77f5-4d27-814b-a596e43f1fe8 tempest-VolumesListTestJSON-394897206 None] Volume volume-64606161-4d6c-4926-a67d-1a51b385f934 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:15:17.461665 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-09f84c52-77f5-4d27-814b-a596e43f1fe8 tempest-VolumesListTestJSON-394897206 None] deleting rbd volume volume-64606161-4d6c-4926-a67d-1a51b385f934 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:15:17.713661 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-09f84c52-77f5-4d27-814b-a596e43f1fe8 tempest-VolumesListTestJSON-394897206 None] Created reservations ['88f78bcf-9fa5-408d-aad9-b6d43a70b38e', '9ff693c3-108c-40ad-acca-1ca1c4a01652', '089554ca-8735-4f9f-928e-642ee3b23359', 'fa5de0f9-f908-4f07-9049-866fd8ddb582'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:15:17.765303 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-09f84c52-77f5-4d27-814b-a596e43f1fe8 tempest-VolumesListTestJSON-394897206 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:17.805845 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-09f84c52-77f5-4d27-814b-a596e43f1fe8 tempest-VolumesListTestJSON-394897206 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:17.841489 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-09f84c52-77f5-4d27-814b-a596e43f1fe8 tempest-VolumesListTestJSON-394897206 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:15:17.847816 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-09f84c52-77f5-4d27-814b-a596e43f1fe8 tempest-VolumesListTestJSON-394897206 None] Deleted volume successfully. Mar 12 21:15:17.868058 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-09f84c52-77f5-4d27-814b-a596e43f1fe8 tempest-VolumesListTestJSON-394897206 None] Lock "b'cinder-64606161-4d6c-4926-a67d-1a51b385f934-delete_volume'" released by "delete_volume" :: held 0.526s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:15:18.549731 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-f296cbc7-cd35-46bb-9255-593425c8ecb4 tempest-VolumesListTestJSON-394897206 None] Lock "b'cinder-8573cf7a-8915-4875-9649-6feed197f31e-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:15:18.635916 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f296cbc7-cd35-46bb-9255-593425c8ecb4 tempest-VolumesListTestJSON-394897206 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:18.720366 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f296cbc7-cd35-46bb-9255-593425c8ecb4 tempest-VolumesListTestJSON-394897206 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:15:18.721274 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f296cbc7-cd35-46bb-9255-593425c8ecb4 tempest-VolumesListTestJSON-394897206 None] Volume volume-8573cf7a-8915-4875-9649-6feed197f31e is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:15:18.735444 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f296cbc7-cd35-46bb-9255-593425c8ecb4 tempest-VolumesListTestJSON-394897206 None] deleting rbd volume volume-8573cf7a-8915-4875-9649-6feed197f31e {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:15:19.080144 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [req-abbde679-de26-474d-b4d5-1d1af09a1d8d req-f71f0323-2ffc-4e19-80c8-d3b25846a318 tempest-TestVolumeBootPattern-1001263199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:15:19.084065 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [req-abbde679-de26-474d-b4d5-1d1af09a1d8d req-f71f0323-2ffc-4e19-80c8-d3b25846a318 tempest-TestVolumeBootPattern-1001263199 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:15:19.084750 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [req-abbde679-de26-474d-b4d5-1d1af09a1d8d req-f71f0323-2ffc-4e19-80c8-d3b25846a318 tempest-TestVolumeBootPattern-1001263199 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:15:19.111094 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-f296cbc7-cd35-46bb-9255-593425c8ecb4 tempest-VolumesListTestJSON-394897206 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:15:19.155870 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-abbde679-de26-474d-b4d5-1d1af09a1d8d req-f71f0323-2ffc-4e19-80c8-d3b25846a318 tempest-TestVolumeBootPattern-1001263199 None] Flow 'volume_create_manager' (5b2e482c-9fa7-4746-8601-8145fa1b11bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:15:19.162624 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-abbde679-de26-474d-b4d5-1d1af09a1d8d req-f71f0323-2ffc-4e19-80c8-d3b25846a318 tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (320728ad-0423-4d97-8fa1-4808fa3b0b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:19.189795 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-abbde679-de26-474d-b4d5-1d1af09a1d8d req-f71f0323-2ffc-4e19-80c8-d3b25846a318 tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (320728ad-0423-4d97-8fa1-4808fa3b0b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:15:19Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=efb4d6d6-65d4-4d28-94b0-b45185ad5513,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62f54fe17dd142b4be6d7d09de31d63b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8218e946-7910-4db9-8525-92d33d1f7a62,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:15:19Z,use_quota=True,user_id='284a1908713c4b74a35a1d3b5cd10e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:19.197401 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-abbde679-de26-474d-b4d5-1d1af09a1d8d req-f71f0323-2ffc-4e19-80c8-d3b25846a318 tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e2e1ff8-e4d5-45af-9538-0028d01a2e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:19.202784 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-abbde679-de26-474d-b4d5-1d1af09a1d8d req-f71f0323-2ffc-4e19-80c8-d3b25846a318 tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e2e1ff8-e4d5-45af-9538-0028d01a2e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:19.209011 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-abbde679-de26-474d-b4d5-1d1af09a1d8d req-f71f0323-2ffc-4e19-80c8-d3b25846a318 tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (482508f5-27e4-4d12-8c64-c5109a0abd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:19.213719 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-abbde679-de26-474d-b4d5-1d1af09a1d8d req-f71f0323-2ffc-4e19-80c8-d3b25846a318 tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (482508f5-27e4-4d12-8c64-c5109a0abd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'efb4d6d6-65d4-4d28-94b0-b45185ad5513', 'volume_name': 'volume-efb4d6d6-65d4-4d28-94b0-b45185ad5513', 'volume_size': 1, 'snapshot_id': '8218e946-7910-4db9-8525-92d33d1f7a62'}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:19.220617 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-abbde679-de26-474d-b4d5-1d1af09a1d8d req-f71f0323-2ffc-4e19-80c8-d3b25846a318 tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3977156e-8121-4aea-a2ca-8787043db232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:19.234821 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-abbde679-de26-474d-b4d5-1d1af09a1d8d req-f71f0323-2ffc-4e19-80c8-d3b25846a318 tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3977156e-8121-4aea-a2ca-8787043db232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:19.241195 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-abbde679-de26-474d-b4d5-1d1af09a1d8d req-f71f0323-2ffc-4e19-80c8-d3b25846a318 tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6fdd6b3-4da9-4d4a-b89f-a7181ae645d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:19.243649 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [req-abbde679-de26-474d-b4d5-1d1af09a1d8d req-f71f0323-2ffc-4e19-80c8-d3b25846a318 tempest-TestVolumeBootPattern-1001263199 None] Volume efb4d6d6-65d4-4d28-94b0-b45185ad5513: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-efb4d6d6-65d4-4d28-94b0-b45185ad5513', 'volume_size': 1, 'snapshot_id': '8218e946-7910-4db9-8525-92d33d1f7a62'} Mar 12 21:15:19.247758 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-f296cbc7-cd35-46bb-9255-593425c8ecb4 tempest-VolumesListTestJSON-394897206 None] Created reservations ['f98b3b69-ab10-4e9d-800f-49465be7b58e', 'e302dbc4-c8c7-4cca-bdfe-9015369d958c', '2082c96a-e525-4fff-98a5-1b4e0df6d30e', '31b5dadd-51e4-403b-a283-24fa55d1c54c'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:15:19.272119 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-abbde679-de26-474d-b4d5-1d1af09a1d8d req-f71f0323-2ffc-4e19-80c8-d3b25846a318 tempest-TestVolumeBootPattern-1001263199 None] cloning volumes/volume-01f30321-c853-4b84-a900-fbdd71d12e8a@snapshot-8218e946-7910-4db9-8525-92d33d1f7a62 to volume-efb4d6d6-65d4-4d28-94b0-b45185ad5513 {{(pid=129531) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1090}} Mar 12 21:15:19.273744 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-abbde679-de26-474d-b4d5-1d1af09a1d8d req-f71f0323-2ffc-4e19-80c8-d3b25846a318 tempest-TestVolumeBootPattern-1001263199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:19.381107 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-abbde679-de26-474d-b4d5-1d1af09a1d8d req-f71f0323-2ffc-4e19-80c8-d3b25846a318 tempest-TestVolumeBootPattern-1001263199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:19.476607 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f296cbc7-cd35-46bb-9255-593425c8ecb4 tempest-VolumesListTestJSON-394897206 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:19.577384 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f296cbc7-cd35-46bb-9255-593425c8ecb4 tempest-VolumesListTestJSON-394897206 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:19.654995 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-f296cbc7-cd35-46bb-9255-593425c8ecb4 tempest-VolumesListTestJSON-394897206 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:15:19.662451 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-f296cbc7-cd35-46bb-9255-593425c8ecb4 tempest-VolumesListTestJSON-394897206 None] Deleted volume successfully. Mar 12 21:15:19.695616 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-abbde679-de26-474d-b4d5-1d1af09a1d8d req-f71f0323-2ffc-4e19-80c8-d3b25846a318 tempest-TestVolumeBootPattern-1001263199 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:15:19.696265 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-abbde679-de26-474d-b4d5-1d1af09a1d8d req-f71f0323-2ffc-4e19-80c8-d3b25846a318 tempest-TestVolumeBootPattern-1001263199 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:15:19.731891 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.volume_utils [req-abbde679-de26-474d-b4d5-1d1af09a1d8d req-f71f0323-2ffc-4e19-80c8-d3b25846a318 tempest-TestVolumeBootPattern-1001263199 None] Marking volume efb4d6d6-65d4-4d28-94b0-b45185ad5513 as bootable. {{(pid=129531) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 12 21:15:19.761646 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [req-abbde679-de26-474d-b4d5-1d1af09a1d8d req-f71f0323-2ffc-4e19-80c8-d3b25846a318 tempest-TestVolumeBootPattern-1001263199 None] Copying metadata from snapshot 8218e946-7910-4db9-8525-92d33d1f7a62 to efb4d6d6-65d4-4d28-94b0-b45185ad5513. {{(pid=129531) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:422}} Mar 12 21:15:19.770351 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-f296cbc7-cd35-46bb-9255-593425c8ecb4 tempest-VolumesListTestJSON-394897206 None] Lock "b'cinder-8573cf7a-8915-4875-9649-6feed197f31e-delete_volume'" released by "delete_volume" :: held 1.221s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:15:19.832284 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-abbde679-de26-474d-b4d5-1d1af09a1d8d req-f71f0323-2ffc-4e19-80c8-d3b25846a318 tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6fdd6b3-4da9-4d4a-b89f-a7181ae645d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efb4d6d6-65d4-4d28-94b0-b45185ad5513', 'volume_size': 1, 'snapshot_id': '8218e946-7910-4db9-8525-92d33d1f7a62'}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:19.832284 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-abbde679-de26-474d-b4d5-1d1af09a1d8d req-f71f0323-2ffc-4e19-80c8-d3b25846a318 tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e25c7345-6c69-4496-b82b-badde31013c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:19.847621 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-f80a8fc7-d474-4e2c-8344-fdbfacc021a8 tempest-VolumesListTestJSON-394897206 None] Lock "b'cinder-4573d1c9-d75f-4bae-9370-f4e0786d3ebb-delete_volume'" acquired by "delete_volume" :: waited 0.031s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:15:19.852023 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [req-abbde679-de26-474d-b4d5-1d1af09a1d8d req-f71f0323-2ffc-4e19-80c8-d3b25846a318 tempest-TestVolumeBootPattern-1001263199 None] Volume volume-efb4d6d6-65d4-4d28-94b0-b45185ad5513 (efb4d6d6-65d4-4d28-94b0-b45185ad5513): created successfully Mar 12 21:15:19.861336 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-abbde679-de26-474d-b4d5-1d1af09a1d8d req-f71f0323-2ffc-4e19-80c8-d3b25846a318 tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e25c7345-6c69-4496-b82b-badde31013c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:19.863750 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-abbde679-de26-474d-b4d5-1d1af09a1d8d req-f71f0323-2ffc-4e19-80c8-d3b25846a318 tempest-TestVolumeBootPattern-1001263199 None] Flow 'volume_create_manager' (5b2e482c-9fa7-4746-8601-8145fa1b11bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:15:19.904298 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-abbde679-de26-474d-b4d5-1d1af09a1d8d req-f71f0323-2ffc-4e19-80c8-d3b25846a318 tempest-TestVolumeBootPattern-1001263199 None] Created volume successfully. Mar 12 21:15:19.912888 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f80a8fc7-d474-4e2c-8344-fdbfacc021a8 tempest-VolumesListTestJSON-394897206 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:19.996135 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f80a8fc7-d474-4e2c-8344-fdbfacc021a8 tempest-VolumesListTestJSON-394897206 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:15:19.997129 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f80a8fc7-d474-4e2c-8344-fdbfacc021a8 tempest-VolumesListTestJSON-394897206 None] Volume volume-4573d1c9-d75f-4bae-9370-f4e0786d3ebb is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:15:20.007594 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f80a8fc7-d474-4e2c-8344-fdbfacc021a8 tempest-VolumesListTestJSON-394897206 None] deleting rbd volume volume-4573d1c9-d75f-4bae-9370-f4e0786d3ebb {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:15:20.481259 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-f80a8fc7-d474-4e2c-8344-fdbfacc021a8 tempest-VolumesListTestJSON-394897206 None] Created reservations ['92b5a1e8-5e49-4876-8eb4-361177eaab3d', '858828c5-cb39-49e8-80dc-97a5eb048c2e', '1ba1b1fe-5077-4523-990f-942ce726b0f1', '5fe0203e-d6ae-492f-ae59-922e494c2d24'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:15:20.543681 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f80a8fc7-d474-4e2c-8344-fdbfacc021a8 tempest-VolumesListTestJSON-394897206 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:20.596369 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-f80a8fc7-d474-4e2c-8344-fdbfacc021a8 tempest-VolumesListTestJSON-394897206 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:20.651392 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-f80a8fc7-d474-4e2c-8344-fdbfacc021a8 tempest-VolumesListTestJSON-394897206 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:15:20.657491 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-f80a8fc7-d474-4e2c-8344-fdbfacc021a8 tempest-VolumesListTestJSON-394897206 None] Deleted volume successfully. Mar 12 21:15:20.672042 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-f80a8fc7-d474-4e2c-8344-fdbfacc021a8 tempest-VolumesListTestJSON-394897206 None] Lock "b'cinder-4573d1c9-d75f-4bae-9370-f4e0786d3ebb-delete_volume'" released by "delete_volume" :: held 0.824s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:15:22.377633 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-abbde679-de26-474d-b4d5-1d1af09a1d8d req-b8a5933e-9e30-4720-a329-3b017690c05f tempest-TestVolumeBootPattern-1001263199 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 21:15:23.080754 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-abbde679-de26-474d-b4d5-1d1af09a1d8d req-b8a5933e-9e30-4720-a329-3b017690c05f tempest-TestVolumeBootPattern-1001263199 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.703s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 21:15:23.081701 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-abbde679-de26-474d-b4d5-1d1af09a1d8d req-b8a5933e-9e30-4720-a329-3b017690c05f tempest-TestVolumeBootPattern-1001263199 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-efb4d6d6-65d4-4d28-94b0-b45185ad5513', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': 'efb4d6d6-65d4-4d28-94b0-b45185ad5513', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 21:15:23.104749 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-abbde679-de26-474d-b4d5-1d1af09a1d8d req-b8a5933e-9e30-4720-a329-3b017690c05f tempest-TestVolumeBootPattern-1001263199 None] Connection info returned from driver {'name': 'volumes/volume-efb4d6d6-65d4-4d28-94b0-b45185ad5513', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'efb4d6d6-65d4-4d28-94b0-b45185ad5513', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3cf2e1aa-3b75-4613-95f1-1cb61de0d9d4'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 21:15:23.156701 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-abbde679-de26-474d-b4d5-1d1af09a1d8d req-b8a5933e-9e30-4720-a329-3b017690c05f tempest-TestVolumeBootPattern-1001263199 None] attachment_update completed successfully. Mar 12 21:15:24.689093 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-a6dec8bc-cac3-4d3a-a2aa-7be3a3d1b36f tempest-VolumesSnapshotTestJSON-1127165440 None] Created reservations ['edb64d0b-c9d0-461b-88b5-f3494ceda135', '05419d92-cd31-41f2-a0ad-e0ff93de06d5', '9001195b-d765-4f1b-8c27-fe9b87ea7c19', 'a6992a0d-b53f-4fac-8100-ec849cce5810'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:15:24.757108 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-a6dec8bc-cac3-4d3a-a2aa-7be3a3d1b36f tempest-VolumesSnapshotTestJSON-1127165440 None] Delete snapshot completed successfully. Mar 12 21:15:24.764222 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-a6dec8bc-cac3-4d3a-a2aa-7be3a3d1b36f tempest-VolumesSnapshotTestJSON-1127165440 None] Lock "b'cinder-e4a29494-c992-47c2-a78a-b9faca3d293b-delete_snapshot'" released by "delete_snapshot" :: held 30.292s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:15:25.725331 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-4dea01e7-ea71-452d-a11e-9b3758f77275 req-7d285f4a-2edd-455d-b14a-51387597d9d4 tempest-VolumesSnapshotTestJSON-1127165440 None] Terminate volume connection completed successfully. Mar 12 21:15:25.725899 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-4dea01e7-ea71-452d-a11e-9b3758f77275 req-7d285f4a-2edd-455d-b14a-51387597d9d4 tempest-VolumesSnapshotTestJSON-1127165440 None] Deleting attachment c659bedf-5d4c-4a6a-ae23-27c64549ef5b. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 21:15:31.325436 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-94daa87c-3ef6-4132-b915-93b950589732 tempest-VolumesSnapshotTestJSON-1127165440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:15:31.335287 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-94daa87c-3ef6-4132-b915-93b950589732 tempest-VolumesSnapshotTestJSON-1127165440 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:15:31.338970 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-94daa87c-3ef6-4132-b915-93b950589732 tempest-VolumesSnapshotTestJSON-1127165440 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:15:31.369496 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-94daa87c-3ef6-4132-b915-93b950589732 tempest-VolumesSnapshotTestJSON-1127165440 None] Flow 'volume_create_manager' (82c29e5c-b48f-4725-b1d9-3125a3efebef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:15:31.386225 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-94daa87c-3ef6-4132-b915-93b950589732 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6aa6b5c-1614-4f02-99cd-bf55a6a9e3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:31.393972 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-94daa87c-3ef6-4132-b915-93b950589732 tempest-VolumesSnapshotTestJSON-1127165440 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:15:31.409156 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-94daa87c-3ef6-4132-b915-93b950589732 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6aa6b5c-1614-4f02-99cd-bf55a6a9e3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-674749969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=89f947d7-aa69-4aff-9e9f-7610afc1f575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d30a0195c6334b39a246a88b1f4cc81f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:15:31Z,use_quota=True,user_id='96d0c07fcae34c48b4c0ed61c4cec1c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:31.415112 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-94daa87c-3ef6-4132-b915-93b950589732 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ec51fbd-4bd0-4528-a95f-66dc5dcceccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:31.420213 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-94daa87c-3ef6-4132-b915-93b950589732 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ec51fbd-4bd0-4528-a95f-66dc5dcceccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:31.426341 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-94daa87c-3ef6-4132-b915-93b950589732 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c6bb99-38b9-4efd-a359-2d5fb11d312d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:31.430816 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-94daa87c-3ef6-4132-b915-93b950589732 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c6bb99-38b9-4efd-a359-2d5fb11d312d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89f947d7-aa69-4aff-9e9f-7610afc1f575', 'volume_name': 'volume-89f947d7-aa69-4aff-9e9f-7610afc1f575', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:31.436674 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-94daa87c-3ef6-4132-b915-93b950589732 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc77b877-8789-480c-9a63-2bec872da920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:31.441758 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-94daa87c-3ef6-4132-b915-93b950589732 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc77b877-8789-480c-9a63-2bec872da920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:31.447465 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-94daa87c-3ef6-4132-b915-93b950589732 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed96783c-7811-4ccf-81dd-dc45f89a661e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:31.450218 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-94daa87c-3ef6-4132-b915-93b950589732 tempest-VolumesSnapshotTestJSON-1127165440 None] Volume 89f947d7-aa69-4aff-9e9f-7610afc1f575: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89f947d7-aa69-4aff-9e9f-7610afc1f575', 'volume_size': 1} Mar 12 21:15:31.451027 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-94daa87c-3ef6-4132-b915-93b950589732 tempest-VolumesSnapshotTestJSON-1127165440 None] creating volume 'volume-89f947d7-aa69-4aff-9e9f-7610afc1f575' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:15:31.452131 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-94daa87c-3ef6-4132-b915-93b950589732 tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:31.593104 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-94daa87c-3ef6-4132-b915-93b950589732 tempest-VolumesSnapshotTestJSON-1127165440 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:15:31.594956 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-94daa87c-3ef6-4132-b915-93b950589732 tempest-VolumesSnapshotTestJSON-1127165440 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:15:31.608763 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-94daa87c-3ef6-4132-b915-93b950589732 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed96783c-7811-4ccf-81dd-dc45f89a661e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89f947d7-aa69-4aff-9e9f-7610afc1f575', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:31.625626 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-94daa87c-3ef6-4132-b915-93b950589732 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92443031-0053-4f1e-aa9e-91f383beeb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:31.644710 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-94daa87c-3ef6-4132-b915-93b950589732 tempest-VolumesSnapshotTestJSON-1127165440 None] Volume volume-89f947d7-aa69-4aff-9e9f-7610afc1f575 (89f947d7-aa69-4aff-9e9f-7610afc1f575): created successfully Mar 12 21:15:31.650823 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-94daa87c-3ef6-4132-b915-93b950589732 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92443031-0053-4f1e-aa9e-91f383beeb73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:31.658112 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-94daa87c-3ef6-4132-b915-93b950589732 tempest-VolumesSnapshotTestJSON-1127165440 None] Flow 'volume_create_manager' (82c29e5c-b48f-4725-b1d9-3125a3efebef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:15:31.670240 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-94daa87c-3ef6-4132-b915-93b950589732 tempest-VolumesSnapshotTestJSON-1127165440 None] Created volume successfully. Mar 12 21:15:32.517389 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-91b45cce-f539-4b7c-acbc-8929042b4204 tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:32.891094 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-91b45cce-f539-4b7c-acbc-8929042b4204 tempest-VolumesSnapshotTestJSON-1127165440 None] Create snapshot completed successfully Mar 12 21:15:33.886786 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-201ad644-6481-40fc-8065-5604b76a36af tempest-VolumesSnapshotTestJSON-1127165440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:15:33.890116 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-201ad644-6481-40fc-8065-5604b76a36af tempest-VolumesSnapshotTestJSON-1127165440 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:15:33.890632 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-201ad644-6481-40fc-8065-5604b76a36af tempest-VolumesSnapshotTestJSON-1127165440 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:15:33.919362 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-201ad644-6481-40fc-8065-5604b76a36af tempest-VolumesSnapshotTestJSON-1127165440 None] Flow 'volume_create_manager' (f3c75ea4-bfb9-4667-8383-e9b4806e76cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:15:33.927449 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-201ad644-6481-40fc-8065-5604b76a36af tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54a02b35-7305-4baa-80a6-92e84f543ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:33.934353 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-201ad644-6481-40fc-8065-5604b76a36af tempest-VolumesSnapshotTestJSON-1127165440 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:15:33.948501 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-201ad644-6481-40fc-8065-5604b76a36af tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54a02b35-7305-4baa-80a6-92e84f543ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1026647311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f789a496-64d2-4a77-b731-5690f33e2e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d30a0195c6334b39a246a88b1f4cc81f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:15:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=4614ccb5-a52a-4ca7-8620-3e3fbaceba89,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:15:34Z,use_quota=True,user_id='96d0c07fcae34c48b4c0ed61c4cec1c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:33.954570 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-201ad644-6481-40fc-8065-5604b76a36af tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bad8003-67c9-453e-a86d-e7a7d7c726c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:33.958851 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-201ad644-6481-40fc-8065-5604b76a36af tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bad8003-67c9-453e-a86d-e7a7d7c726c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:33.964230 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-201ad644-6481-40fc-8065-5604b76a36af tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a2dd374-327d-4ff1-9963-52501cc4c7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:33.969051 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-201ad644-6481-40fc-8065-5604b76a36af tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a2dd374-327d-4ff1-9963-52501cc4c7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f789a496-64d2-4a77-b731-5690f33e2e78', 'volume_name': 'volume-f789a496-64d2-4a77-b731-5690f33e2e78', 'volume_size': 2, 'snapshot_id': '4614ccb5-a52a-4ca7-8620-3e3fbaceba89'}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:33.974035 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-201ad644-6481-40fc-8065-5604b76a36af tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7002881a-6299-4869-af32-01694fdd45e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:33.978363 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-201ad644-6481-40fc-8065-5604b76a36af tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7002881a-6299-4869-af32-01694fdd45e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:33.983958 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-201ad644-6481-40fc-8065-5604b76a36af tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27ecf060-c86b-40d9-8817-61ce19700d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:33.985052 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-201ad644-6481-40fc-8065-5604b76a36af tempest-VolumesSnapshotTestJSON-1127165440 None] Volume f789a496-64d2-4a77-b731-5690f33e2e78: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f789a496-64d2-4a77-b731-5690f33e2e78', 'volume_size': 2, 'snapshot_id': '4614ccb5-a52a-4ca7-8620-3e3fbaceba89'} Mar 12 21:15:34.003228 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-201ad644-6481-40fc-8065-5604b76a36af tempest-VolumesSnapshotTestJSON-1127165440 None] cloning volumes/volume-89f947d7-aa69-4aff-9e9f-7610afc1f575@snapshot-4614ccb5-a52a-4ca7-8620-3e3fbaceba89 to volume-f789a496-64d2-4a77-b731-5690f33e2e78 {{(pid=129531) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1090}} Mar 12 21:15:34.004083 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-201ad644-6481-40fc-8065-5604b76a36af tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:34.041252 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-201ad644-6481-40fc-8065-5604b76a36af tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:34.157300 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-201ad644-6481-40fc-8065-5604b76a36af tempest-VolumesSnapshotTestJSON-1127165440 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:15:34.157614 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-201ad644-6481-40fc-8065-5604b76a36af tempest-VolumesSnapshotTestJSON-1127165440 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:15:34.162238 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-201ad644-6481-40fc-8065-5604b76a36af tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:34.299144 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-201ad644-6481-40fc-8065-5604b76a36af tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27ecf060-c86b-40d9-8817-61ce19700d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f789a496-64d2-4a77-b731-5690f33e2e78', 'volume_size': 2, 'snapshot_id': '4614ccb5-a52a-4ca7-8620-3e3fbaceba89'}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:34.304478 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-201ad644-6481-40fc-8065-5604b76a36af tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae916079-5bf8-4967-bdfa-b916d88512cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:34.332006 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-201ad644-6481-40fc-8065-5604b76a36af tempest-VolumesSnapshotTestJSON-1127165440 None] Volume volume-f789a496-64d2-4a77-b731-5690f33e2e78 (f789a496-64d2-4a77-b731-5690f33e2e78): created successfully Mar 12 21:15:34.339729 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-201ad644-6481-40fc-8065-5604b76a36af tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae916079-5bf8-4967-bdfa-b916d88512cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:34.345423 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-201ad644-6481-40fc-8065-5604b76a36af tempest-VolumesSnapshotTestJSON-1127165440 None] Flow 'volume_create_manager' (f3c75ea4-bfb9-4667-8383-e9b4806e76cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:15:34.360060 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-201ad644-6481-40fc-8065-5604b76a36af tempest-VolumesSnapshotTestJSON-1127165440 None] Created volume successfully. Mar 12 21:15:34.900540 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-89f46735-0c9e-414a-9268-58bbda1d05f3 req-bae8289e-bba8-4f2e-9e98-6163471483a7 tempest-TestVolumeBootPattern-1001263199 None] Terminate volume connection completed successfully. Mar 12 21:15:34.901587 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-89f46735-0c9e-414a-9268-58bbda1d05f3 req-bae8289e-bba8-4f2e-9e98-6163471483a7 tempest-TestVolumeBootPattern-1001263199 None] Deleting attachment 3cf2e1aa-3b75-4613-95f1-1cb61de0d9d4. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 21:15:35.043664 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-a4a80095-5081-446a-a6b2-a054427fd817 tempest-VolumesSnapshotTestJSON-1127165440 None] Lock "b'cinder-f789a496-64d2-4a77-b731-5690f33e2e78-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:15:35.112925 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [req-89f46735-0c9e-414a-9268-58bbda1d05f3 req-2c00870d-1883-4068-8bba-f42fddb7b1d8 tempest-TestVolumeBootPattern-1001263199 None] Lock "b'cinder-efb4d6d6-65d4-4d28-94b0-b45185ad5513-delete_volume'" acquired by "delete_volume" :: waited 0.058s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:15:35.160206 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a4a80095-5081-446a-a6b2-a054427fd817 tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:35.220566 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a4a80095-5081-446a-a6b2-a054427fd817 tempest-VolumesSnapshotTestJSON-1127165440 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:15:35.228725 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a4a80095-5081-446a-a6b2-a054427fd817 tempest-VolumesSnapshotTestJSON-1127165440 None] deleting rbd volume volume-f789a496-64d2-4a77-b731-5690f33e2e78 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:15:35.232704 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-89f46735-0c9e-414a-9268-58bbda1d05f3 req-2c00870d-1883-4068-8bba-f42fddb7b1d8 tempest-TestVolumeBootPattern-1001263199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:35.350085 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-89f46735-0c9e-414a-9268-58bbda1d05f3 req-2c00870d-1883-4068-8bba-f42fddb7b1d8 tempest-TestVolumeBootPattern-1001263199 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:15:35.360720 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-89f46735-0c9e-414a-9268-58bbda1d05f3 req-2c00870d-1883-4068-8bba-f42fddb7b1d8 tempest-TestVolumeBootPattern-1001263199 None] deleting rbd volume volume-efb4d6d6-65d4-4d28-94b0-b45185ad5513 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:15:35.533205 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-a4a80095-5081-446a-a6b2-a054427fd817 tempest-VolumesSnapshotTestJSON-1127165440 None] Created reservations ['8cf94a1c-0ec0-4423-be5b-d2995e7b9dce', 'b7371e94-24b4-4fc1-bb01-27c1fe08a9d3', '1c4d136f-a28e-41ff-aae8-efc1eb6f5333', '90af795d-b914-4fa0-ad36-f9e2ac7d2be3'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:15:35.588542 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a4a80095-5081-446a-a6b2-a054427fd817 tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:35.624451 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a4a80095-5081-446a-a6b2-a054427fd817 tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:35.649940 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a4a80095-5081-446a-a6b2-a054427fd817 tempest-VolumesSnapshotTestJSON-1127165440 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:15:35.663237 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-a4a80095-5081-446a-a6b2-a054427fd817 tempest-VolumesSnapshotTestJSON-1127165440 None] Deleted volume successfully. Mar 12 21:15:35.686609 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-a4a80095-5081-446a-a6b2-a054427fd817 tempest-VolumesSnapshotTestJSON-1127165440 None] Lock "b'cinder-f789a496-64d2-4a77-b731-5690f33e2e78-delete_volume'" released by "delete_volume" :: held 0.643s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:15:35.701539 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [req-89f46735-0c9e-414a-9268-58bbda1d05f3 req-2c00870d-1883-4068-8bba-f42fddb7b1d8 tempest-TestVolumeBootPattern-1001263199 None] Created reservations ['ddf16ddb-f7fe-494e-b925-6a66965c8ce2', '68e241b3-3bec-4441-9c8f-1acab626a663', '756e9bbf-0e00-4af8-904a-16785b886d15', '555966dc-d789-4e53-9762-a90dae37a39f'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:15:35.756026 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-89f46735-0c9e-414a-9268-58bbda1d05f3 req-2c00870d-1883-4068-8bba-f42fddb7b1d8 tempest-TestVolumeBootPattern-1001263199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:35.781858 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-89f46735-0c9e-414a-9268-58bbda1d05f3 req-2c00870d-1883-4068-8bba-f42fddb7b1d8 tempest-TestVolumeBootPattern-1001263199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:35.804053 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [req-89f46735-0c9e-414a-9268-58bbda1d05f3 req-2c00870d-1883-4068-8bba-f42fddb7b1d8 tempest-TestVolumeBootPattern-1001263199 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:15:35.808784 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-89f46735-0c9e-414a-9268-58bbda1d05f3 req-2c00870d-1883-4068-8bba-f42fddb7b1d8 tempest-TestVolumeBootPattern-1001263199 None] Deleted volume successfully. Mar 12 21:15:35.820552 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [req-89f46735-0c9e-414a-9268-58bbda1d05f3 req-2c00870d-1883-4068-8bba-f42fddb7b1d8 tempest-TestVolumeBootPattern-1001263199 None] Lock "b'cinder-efb4d6d6-65d4-4d28-94b0-b45185ad5513-delete_volume'" released by "delete_volume" :: held 0.708s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:15:36.253406 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-65303750-1cf8-46f4-becf-a657d2d4d6fe tempest-TestVolumeBootPattern-1001263199 None] Lock "b'cinder-8218e946-7910-4db9-8525-92d33d1f7a62-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:15:36.254944 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-65303750-1cf8-46f4-becf-a657d2d4d6fe tempest-TestVolumeBootPattern-1001263199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:36.421814 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-833012b0-11ce-46fa-8314-f2002015287a tempest-VolumesSnapshotTestJSON-1127165440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:15:36.425503 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-833012b0-11ce-46fa-8314-f2002015287a tempest-VolumesSnapshotTestJSON-1127165440 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:15:36.426234 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-833012b0-11ce-46fa-8314-f2002015287a tempest-VolumesSnapshotTestJSON-1127165440 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:15:36.446062 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-833012b0-11ce-46fa-8314-f2002015287a tempest-VolumesSnapshotTestJSON-1127165440 None] Flow 'volume_create_manager' (eaa83f18-20fd-4fd4-a927-02c0510ebbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:15:36.452717 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-833012b0-11ce-46fa-8314-f2002015287a tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afaf3d18-1e60-4274-9277-ba133fa5a97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:36.465347 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-833012b0-11ce-46fa-8314-f2002015287a tempest-VolumesSnapshotTestJSON-1127165440 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:15:36.489490 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-833012b0-11ce-46fa-8314-f2002015287a tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afaf3d18-1e60-4274-9277-ba133fa5a97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-576703904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ea5e2be4-6ae5-4af4-a5af-f7cc9b075480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d30a0195c6334b39a246a88b1f4cc81f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:15:36Z,use_quota=True,user_id='96d0c07fcae34c48b4c0ed61c4cec1c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:36.495148 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-833012b0-11ce-46fa-8314-f2002015287a tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edd29232-c18b-4efa-b43d-b681b96aef0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:36.499541 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-833012b0-11ce-46fa-8314-f2002015287a tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edd29232-c18b-4efa-b43d-b681b96aef0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:36.504774 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-833012b0-11ce-46fa-8314-f2002015287a tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d05b4f02-2122-4165-8c46-1cd22599d161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:36.509104 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-833012b0-11ce-46fa-8314-f2002015287a tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d05b4f02-2122-4165-8c46-1cd22599d161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea5e2be4-6ae5-4af4-a5af-f7cc9b075480', 'volume_name': 'volume-ea5e2be4-6ae5-4af4-a5af-f7cc9b075480', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:36.514275 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-833012b0-11ce-46fa-8314-f2002015287a tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd9a839-a07a-469e-86db-eb72e8062286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:36.518588 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-833012b0-11ce-46fa-8314-f2002015287a tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd9a839-a07a-469e-86db-eb72e8062286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:36.523614 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-833012b0-11ce-46fa-8314-f2002015287a tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c3808bd-ee51-4912-bfc0-2214514e6c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:36.524724 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-833012b0-11ce-46fa-8314-f2002015287a tempest-VolumesSnapshotTestJSON-1127165440 None] Volume ea5e2be4-6ae5-4af4-a5af-f7cc9b075480: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea5e2be4-6ae5-4af4-a5af-f7cc9b075480', 'volume_size': 1} Mar 12 21:15:36.525135 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-833012b0-11ce-46fa-8314-f2002015287a tempest-VolumesSnapshotTestJSON-1127165440 None] creating volume 'volume-ea5e2be4-6ae5-4af4-a5af-f7cc9b075480' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:15:36.526188 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-833012b0-11ce-46fa-8314-f2002015287a tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:36.611109 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-833012b0-11ce-46fa-8314-f2002015287a tempest-VolumesSnapshotTestJSON-1127165440 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:15:36.611485 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-833012b0-11ce-46fa-8314-f2002015287a tempest-VolumesSnapshotTestJSON-1127165440 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:15:36.615247 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-833012b0-11ce-46fa-8314-f2002015287a tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c3808bd-ee51-4912-bfc0-2214514e6c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea5e2be4-6ae5-4af4-a5af-f7cc9b075480', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:36.620201 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-833012b0-11ce-46fa-8314-f2002015287a tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65584cd0-4a72-4d02-a275-6e833f89aa01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:36.630385 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-833012b0-11ce-46fa-8314-f2002015287a tempest-VolumesSnapshotTestJSON-1127165440 None] Volume volume-ea5e2be4-6ae5-4af4-a5af-f7cc9b075480 (ea5e2be4-6ae5-4af4-a5af-f7cc9b075480): created successfully Mar 12 21:15:36.634364 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-833012b0-11ce-46fa-8314-f2002015287a tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65584cd0-4a72-4d02-a275-6e833f89aa01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:36.640718 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-833012b0-11ce-46fa-8314-f2002015287a tempest-VolumesSnapshotTestJSON-1127165440 None] Flow 'volume_create_manager' (eaa83f18-20fd-4fd4-a927-02c0510ebbfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:15:36.650524 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-833012b0-11ce-46fa-8314-f2002015287a tempest-VolumesSnapshotTestJSON-1127165440 None] Created volume successfully. Mar 12 21:15:37.428867 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-65303750-1cf8-46f4-becf-a657d2d4d6fe tempest-TestVolumeBootPattern-1001263199 None] Created reservations ['08541482-3676-422b-8f99-fc09faf2ad8b', '34def84b-368c-470b-afd9-6f5becbc168a', '77b0950b-619c-4c1f-8dc1-115a1d38c3fc', '44cf0e47-639d-4cf3-8306-7b3ad222800b'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:15:37.467445 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-65303750-1cf8-46f4-becf-a657d2d4d6fe tempest-TestVolumeBootPattern-1001263199 None] Delete snapshot completed successfully. Mar 12 21:15:37.473734 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-65303750-1cf8-46f4-becf-a657d2d4d6fe tempest-TestVolumeBootPattern-1001263199 None] Lock "b'cinder-8218e946-7910-4db9-8525-92d33d1f7a62-delete_snapshot'" released by "delete_snapshot" :: held 1.220s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:15:37.584855 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-7e7bc495-78d9-463a-91cc-f3466333e780 tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:38.385506 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-4e5331bb-3312-46b4-90e5-f593c459cabb tempest-TestVolumeBootPattern-1001263199 None] Lock "b'cinder-01f30321-c853-4b84-a900-fbdd71d12e8a-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:15:38.420177 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-4e5331bb-3312-46b4-90e5-f593c459cabb tempest-TestVolumeBootPattern-1001263199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:38.498405 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-4e5331bb-3312-46b4-90e5-f593c459cabb tempest-TestVolumeBootPattern-1001263199 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:15:38.504367 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-4e5331bb-3312-46b4-90e5-f593c459cabb tempest-TestVolumeBootPattern-1001263199 None] deleting rbd volume volume-01f30321-c853-4b84-a900-fbdd71d12e8a {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:15:38.526747 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-7e7bc495-78d9-463a-91cc-f3466333e780 tempest-VolumesSnapshotTestJSON-1127165440 None] Create snapshot completed successfully Mar 12 21:15:38.717915 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-4e5331bb-3312-46b4-90e5-f593c459cabb tempest-TestVolumeBootPattern-1001263199 None] volume is a clone so cleaning references {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Mar 12 21:15:38.762018 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-4e5331bb-3312-46b4-90e5-f593c459cabb tempest-TestVolumeBootPattern-1001263199 None] deleting parent snapshot volume-01f30321-c853-4b84-a900-fbdd71d12e8a.clone_snap {{(pid=129531) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Mar 12 21:15:39.466958 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeb770a7-3c64-426c-9324-f82d73fab827 tempest-VolumesSnapshotTestJSON-1127165440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:15:39.479359 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-aeb770a7-3c64-426c-9324-f82d73fab827 tempest-VolumesSnapshotTestJSON-1127165440 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:15:39.480217 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-aeb770a7-3c64-426c-9324-f82d73fab827 tempest-VolumesSnapshotTestJSON-1127165440 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:15:39.518098 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-aeb770a7-3c64-426c-9324-f82d73fab827 tempest-VolumesSnapshotTestJSON-1127165440 None] Flow 'volume_create_manager' (de97d483-3eb1-496d-aed6-03318b2d5a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:15:39.525697 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-aeb770a7-3c64-426c-9324-f82d73fab827 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46bebf3d-bd7a-461f-be29-7ef65d598a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:39.533126 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-4e5331bb-3312-46b4-90e5-f593c459cabb tempest-TestVolumeBootPattern-1001263199 None] Created reservations ['1243f591-2520-4519-a570-a95087672cb4', '8575fbb1-a3d3-419c-9e30-83a8c071941f', '87064362-7f1a-4952-94c7-ae7f27a88a35', '4aef0391-697f-470f-bb67-d8bf3518d191'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:15:39.536324 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-aeb770a7-3c64-426c-9324-f82d73fab827 tempest-VolumesSnapshotTestJSON-1127165440 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:15:39.564113 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-aeb770a7-3c64-426c-9324-f82d73fab827 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46bebf3d-bd7a-461f-be29-7ef65d598a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1517409169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=dccaefca-8ac9-4636-b911-4f4b0ba8a5f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d30a0195c6334b39a246a88b1f4cc81f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6e986ea8-4e11-44d3-baa2-7b83e339bace,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:15:39Z,use_quota=True,user_id='96d0c07fcae34c48b4c0ed61c4cec1c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:39.569916 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-aeb770a7-3c64-426c-9324-f82d73fab827 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (873a9efb-7664-4cb9-942a-35c181e3f8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:39.575139 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-aeb770a7-3c64-426c-9324-f82d73fab827 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (873a9efb-7664-4cb9-942a-35c181e3f8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:39.581483 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-aeb770a7-3c64-426c-9324-f82d73fab827 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fffa6e4-7cee-4dfb-9e4e-84aac14e077f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:39.586264 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-aeb770a7-3c64-426c-9324-f82d73fab827 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fffa6e4-7cee-4dfb-9e4e-84aac14e077f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dccaefca-8ac9-4636-b911-4f4b0ba8a5f1', 'volume_name': 'volume-dccaefca-8ac9-4636-b911-4f4b0ba8a5f1', 'volume_size': 1, 'snapshot_id': '6e986ea8-4e11-44d3-baa2-7b83e339bace'}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:39.591846 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-aeb770a7-3c64-426c-9324-f82d73fab827 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd89a3c9-a83d-4fea-b505-dcf4847ec2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:39.597298 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-aeb770a7-3c64-426c-9324-f82d73fab827 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd89a3c9-a83d-4fea-b505-dcf4847ec2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:39.602490 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-aeb770a7-3c64-426c-9324-f82d73fab827 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21d424b4-61b5-469e-abff-da3b531406b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:39.603612 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-aeb770a7-3c64-426c-9324-f82d73fab827 tempest-VolumesSnapshotTestJSON-1127165440 None] Volume dccaefca-8ac9-4636-b911-4f4b0ba8a5f1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dccaefca-8ac9-4636-b911-4f4b0ba8a5f1', 'volume_size': 1, 'snapshot_id': '6e986ea8-4e11-44d3-baa2-7b83e339bace'} Mar 12 21:15:39.631478 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-aeb770a7-3c64-426c-9324-f82d73fab827 tempest-VolumesSnapshotTestJSON-1127165440 None] cloning volumes/volume-ea5e2be4-6ae5-4af4-a5af-f7cc9b075480@snapshot-6e986ea8-4e11-44d3-baa2-7b83e339bace to volume-dccaefca-8ac9-4636-b911-4f4b0ba8a5f1 {{(pid=129531) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1090}} Mar 12 21:15:39.632620 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-aeb770a7-3c64-426c-9324-f82d73fab827 tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:39.671662 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-aeb770a7-3c64-426c-9324-f82d73fab827 tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:39.723399 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-4e5331bb-3312-46b4-90e5-f593c459cabb tempest-TestVolumeBootPattern-1001263199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:39.762346 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-4e5331bb-3312-46b4-90e5-f593c459cabb tempest-TestVolumeBootPattern-1001263199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:39.804309 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-4e5331bb-3312-46b4-90e5-f593c459cabb tempest-TestVolumeBootPattern-1001263199 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:15:39.810404 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-4e5331bb-3312-46b4-90e5-f593c459cabb tempest-TestVolumeBootPattern-1001263199 None] Deleted volume successfully. Mar 12 21:15:39.818830 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-aeb770a7-3c64-426c-9324-f82d73fab827 tempest-VolumesSnapshotTestJSON-1127165440 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:15:39.819215 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-aeb770a7-3c64-426c-9324-f82d73fab827 tempest-VolumesSnapshotTestJSON-1127165440 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:15:39.842082 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-aeb770a7-3c64-426c-9324-f82d73fab827 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21d424b4-61b5-469e-abff-da3b531406b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dccaefca-8ac9-4636-b911-4f4b0ba8a5f1', 'volume_size': 1, 'snapshot_id': '6e986ea8-4e11-44d3-baa2-7b83e339bace'}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:39.846807 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-aeb770a7-3c64-426c-9324-f82d73fab827 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04f19ebf-a839-4311-8315-2ce50e905aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:39.858428 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-4e5331bb-3312-46b4-90e5-f593c459cabb tempest-TestVolumeBootPattern-1001263199 None] Lock "b'cinder-01f30321-c853-4b84-a900-fbdd71d12e8a-delete_volume'" released by "delete_volume" :: held 1.473s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:15:39.860372 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-aeb770a7-3c64-426c-9324-f82d73fab827 tempest-VolumesSnapshotTestJSON-1127165440 None] Volume volume-dccaefca-8ac9-4636-b911-4f4b0ba8a5f1 (dccaefca-8ac9-4636-b911-4f4b0ba8a5f1): created successfully Mar 12 21:15:39.864297 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-aeb770a7-3c64-426c-9324-f82d73fab827 tempest-VolumesSnapshotTestJSON-1127165440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04f19ebf-a839-4311-8315-2ce50e905aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:39.870068 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-aeb770a7-3c64-426c-9324-f82d73fab827 tempest-VolumesSnapshotTestJSON-1127165440 None] Flow 'volume_create_manager' (de97d483-3eb1-496d-aed6-03318b2d5a97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:15:39.889174 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-aeb770a7-3c64-426c-9324-f82d73fab827 tempest-VolumesSnapshotTestJSON-1127165440 None] Created volume successfully. Mar 12 21:15:40.123668 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-7efd6ce9-d5fa-4edb-a014-2f70f39f7273 tempest-VolumesSnapshotTestJSON-1127165440 None] Lock "b'cinder-dccaefca-8ac9-4636-b911-4f4b0ba8a5f1-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:15:40.174243 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-7efd6ce9-d5fa-4edb-a014-2f70f39f7273 tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:40.261095 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-7efd6ce9-d5fa-4edb-a014-2f70f39f7273 tempest-VolumesSnapshotTestJSON-1127165440 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:15:40.283229 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-7efd6ce9-d5fa-4edb-a014-2f70f39f7273 tempest-VolumesSnapshotTestJSON-1127165440 None] deleting rbd volume volume-dccaefca-8ac9-4636-b911-4f4b0ba8a5f1 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:15:40.780149 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-7efd6ce9-d5fa-4edb-a014-2f70f39f7273 tempest-VolumesSnapshotTestJSON-1127165440 None] Created reservations ['499e153a-2c1f-4484-b1c8-ceda230b39e1', 'cafa6b8e-fe12-4186-a013-13649d67af53', '92892c2d-7628-47ab-aa2b-e65ce996061b', 'e713b055-b65c-4bca-96f2-8c7af5efe25d'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:15:40.883098 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-7efd6ce9-d5fa-4edb-a014-2f70f39f7273 tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:40.963732 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-7efd6ce9-d5fa-4edb-a014-2f70f39f7273 tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:41.031944 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-7efd6ce9-d5fa-4edb-a014-2f70f39f7273 tempest-VolumesSnapshotTestJSON-1127165440 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:15:41.037005 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-7efd6ce9-d5fa-4edb-a014-2f70f39f7273 tempest-VolumesSnapshotTestJSON-1127165440 None] Deleted volume successfully. Mar 12 21:15:41.053035 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-7efd6ce9-d5fa-4edb-a014-2f70f39f7273 tempest-VolumesSnapshotTestJSON-1127165440 None] Lock "b'cinder-dccaefca-8ac9-4636-b911-4f4b0ba8a5f1-delete_volume'" released by "delete_volume" :: held 0.929s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:15:41.389384 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-cf37490c-c83d-4855-935a-406c303383ba tempest-VolumesSnapshotTestJSON-1127165440 None] Lock "b'cinder-6e986ea8-4e11-44d3-baa2-7b83e339bace-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.015s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:15:41.395923 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-cf37490c-c83d-4855-935a-406c303383ba tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:41.532611 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:15:41.545096 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:15:41.547857 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:15:41.603607 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] Flow 'volume_create_manager' (5700fc8c-836a-4007-bed4-c129cd05371e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:15:41.618712 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18d8258e-bdc4-4855-ad49-df31c0eba681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:41.643702 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:15:41.674486 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18d8258e-bdc4-4855-ad49-df31c0eba681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-539851182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c56d924b-a997-4b3b-972a-14b4626e8e2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62f54fe17dd142b4be6d7d09de31d63b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:15:41Z,use_quota=True,user_id='284a1908713c4b74a35a1d3b5cd10e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:41.681708 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2a4f9a-430a-4807-853f-2e0ea94e01a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:41.687637 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2a4f9a-430a-4807-853f-2e0ea94e01a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:41.697949 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e7f2fdf-a6b8-4521-83c3-fa8827db8503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:41.859816 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e7f2fdf-a6b8-4521-83c3-fa8827db8503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c56d924b-a997-4b3b-972a-14b4626e8e2a', 'volume_name': 'volume-c56d924b-a997-4b3b-972a-14b4626e8e2a', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:41.870677 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59787c37-4404-4919-8c49-2194a7f7bf2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:41.876044 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59787c37-4404-4919-8c49-2194a7f7bf2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:41.883971 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab77858-5cc1-48f5-9f2d-fe7ddf2f634f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:41.885669 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] Volume c56d924b-a997-4b3b-972a-14b4626e8e2a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c56d924b-a997-4b3b-972a-14b4626e8e2a', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 12 21:15:41.886560 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] Cloning c56d924b-a997-4b3b-972a-14b4626e8e2a from image 539171db-0bd3-4f16-95fd-a7cd5530137d at location (None, None). {{(pid=129531) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Mar 12 21:15:41.898457 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] Lock "b'cinder-539171db-0bd3-4f16-95fd-a7cd5530137d'" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:15:41.917069 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] Found image-volume cache entry: {'id': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'volume_id': '8d802c7b-bd34-4836-bd5d-90755a167ddc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34), 'last_used': datetime.datetime(2022, 3, 12, 21, 15, 41, 907176)}. {{(pid=129531) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 12 21:15:41.918135 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] Image-volume cache entry image_update_at = 2022-03-12 20:39:34+00:00, requested image updated_at = 2022-03-12 20:39:34+00:00. {{(pid=129531) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 12 21:15:41.918642 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] Found cache entry for image = 539171db-0bd3-4f16-95fd-a7cd5530137d on host ncdv-master-1@ceph#ceph. {{(pid=129531) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Mar 12 21:15:41.923797 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] Lock "b'cinder-539171db-0bd3-4f16-95fd-a7cd5530137d'" released by "_prepare_image_cache_entry" :: held 0.026s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:15:41.924887 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] Attempting to retrieve cache entry for image = 539171db-0bd3-4f16-95fd-a7cd5530137d on host ncdv-master-1@ceph#ceph. {{(pid=129531) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Mar 12 21:15:41.944420 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] Found image-volume cache entry: {'id': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'volume_id': '8d802c7b-bd34-4836-bd5d-90755a167ddc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34), 'last_used': datetime.datetime(2022, 3, 12, 21, 15, 41, 936051)}. {{(pid=129531) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 12 21:15:41.945043 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] Image-volume cache entry image_update_at = 2022-03-12 20:39:34+00:00, requested image updated_at = 2022-03-12 20:39:34+00:00. {{(pid=129531) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 12 21:15:41.945237 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] Creating from source image-volume 8d802c7b-bd34-4836-bd5d-90755a167ddc {{(pid=129531) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Mar 12 21:15:41.959826 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:42.080484 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] creating snapshot='volume-c56d924b-a997-4b3b-972a-14b4626e8e2a.clone_snap' {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Mar 12 21:15:42.542967 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] cloning 'volume-8d802c7b-bd34-4836-bd5d-90755a167ddc@volume-c56d924b-a997-4b3b-972a-14b4626e8e2a.clone_snap' to 'volume-c56d924b-a997-4b3b-972a-14b4626e8e2a' {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Mar 12 21:15:42.720967 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-cf37490c-c83d-4855-935a-406c303383ba tempest-VolumesSnapshotTestJSON-1127165440 None] Created reservations ['c6e0cc4e-cf19-42cd-bca9-7cc23b7d5e25', 'b109d108-6014-4451-a6f3-06e6667a7af3', 'aadbdcc2-d9ab-441a-8493-bd9afd26701b', '74264c5c-6b99-4b2e-a3db-8d1ffcd0afc2'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:15:42.804566 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] Volume volume-9916cd82-3d9b-466f-a769-cf81bdc743fd.deleted is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:15:42.806965 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:15:42.807361 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:15:42.856958 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] clone created successfully {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Mar 12 21:15:42.857978 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.volume_utils [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] Marking volume c56d924b-a997-4b3b-972a-14b4626e8e2a as bootable. {{(pid=129531) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 12 21:15:42.877540 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] Copying metadata from image 539171db-0bd3-4f16-95fd-a7cd5530137d to c56d924b-a997-4b3b-972a-14b4626e8e2a. {{(pid=129531) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Mar 12 21:15:42.878657 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] Creating volume glance metadata for volume c56d924b-a997-4b3b-972a-14b4626e8e2a backed by image 539171db-0bd3-4f16-95fd-a7cd5530137d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129531) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Mar 12 21:15:42.934862 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-cf37490c-c83d-4855-935a-406c303383ba tempest-VolumesSnapshotTestJSON-1127165440 None] Delete snapshot completed successfully. Mar 12 21:15:42.942965 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-cf37490c-c83d-4855-935a-406c303383ba tempest-VolumesSnapshotTestJSON-1127165440 None] Lock "b'cinder-6e986ea8-4e11-44d3-baa2-7b83e339bace-delete_snapshot'" released by "delete_snapshot" :: held 1.554s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:15:42.976852 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab77858-5cc1-48f5-9f2d-fe7ddf2f634f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c56d924b-a997-4b3b-972a-14b4626e8e2a', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:42.982575 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (274efecf-65fb-4ab9-97a1-43a29b17c9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:15:42.991995 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] Volume volume-c56d924b-a997-4b3b-972a-14b4626e8e2a (c56d924b-a997-4b3b-972a-14b4626e8e2a): created successfully Mar 12 21:15:42.997442 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (274efecf-65fb-4ab9-97a1-43a29b17c9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:15:43.004374 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] Flow 'volume_create_manager' (5700fc8c-836a-4007-bed4-c129cd05371e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:15:43.013990 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-57896b15-0ac7-4748-9089-4b6caf87755f tempest-TestVolumeBootPattern-1001263199 None] Created volume successfully. Mar 12 21:15:43.600337 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-fee25b47-9940-47db-a352-b77634d1dfa8 tempest-VolumesSnapshotTestJSON-1127165440 None] Lock "b'cinder-ea5e2be4-6ae5-4af4-a5af-f7cc9b075480-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:15:43.658302 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-fee25b47-9940-47db-a352-b77634d1dfa8 tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:43.718345 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-fee25b47-9940-47db-a352-b77634d1dfa8 tempest-VolumesSnapshotTestJSON-1127165440 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:15:43.719095 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-fee25b47-9940-47db-a352-b77634d1dfa8 tempest-VolumesSnapshotTestJSON-1127165440 None] Volume volume-ea5e2be4-6ae5-4af4-a5af-f7cc9b075480 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:15:43.727567 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-fee25b47-9940-47db-a352-b77634d1dfa8 tempest-VolumesSnapshotTestJSON-1127165440 None] deleting rbd volume volume-ea5e2be4-6ae5-4af4-a5af-f7cc9b075480 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:15:44.017574 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-fee25b47-9940-47db-a352-b77634d1dfa8 tempest-VolumesSnapshotTestJSON-1127165440 None] Created reservations ['ab475f50-3c42-4cdc-aeeb-bb2b08798d0d', 'fced6578-115d-4535-a3b7-5eaa6db09f79', 'f6421d32-db20-4ea1-9226-d20854e20c55', '506b0943-75e6-4d73-99f3-af1ec580140a'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:15:44.078257 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-fee25b47-9940-47db-a352-b77634d1dfa8 tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:44.121901 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-fee25b47-9940-47db-a352-b77634d1dfa8 tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:44.186920 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-fee25b47-9940-47db-a352-b77634d1dfa8 tempest-VolumesSnapshotTestJSON-1127165440 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:15:44.193847 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-fee25b47-9940-47db-a352-b77634d1dfa8 tempest-VolumesSnapshotTestJSON-1127165440 None] Deleted volume successfully. Mar 12 21:15:44.208047 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-fee25b47-9940-47db-a352-b77634d1dfa8 tempest-VolumesSnapshotTestJSON-1127165440 None] Lock "b'cinder-ea5e2be4-6ae5-4af4-a5af-f7cc9b075480-delete_volume'" released by "delete_volume" :: held 0.608s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:15:44.859711 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-8683d7fd-52f1-4d3c-9b8a-ed9d2d7f774d tempest-VolumesSnapshotTestJSON-1127165440 None] Lock "b'cinder-4614ccb5-a52a-4ca7-8620-3e3fbaceba89-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:15:44.860969 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8683d7fd-52f1-4d3c-9b8a-ed9d2d7f774d tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:45.583689 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-8683d7fd-52f1-4d3c-9b8a-ed9d2d7f774d tempest-VolumesSnapshotTestJSON-1127165440 None] Created reservations ['439a1861-61ea-44f5-a1b3-fe5f8678e852', 'e624ff1c-d1e6-448e-a5c5-157337ff8751', '221a5cda-d22a-4634-8a61-2ea57bd9e063', '9eb18ba2-f86d-4052-90df-2d7f79db2fcd'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:15:45.632503 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-8683d7fd-52f1-4d3c-9b8a-ed9d2d7f774d tempest-VolumesSnapshotTestJSON-1127165440 None] Delete snapshot completed successfully. Mar 12 21:15:45.639765 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-8683d7fd-52f1-4d3c-9b8a-ed9d2d7f774d tempest-VolumesSnapshotTestJSON-1127165440 None] Lock "b'cinder-4614ccb5-a52a-4ca7-8620-3e3fbaceba89-delete_snapshot'" released by "delete_snapshot" :: held 0.780s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:15:46.005105 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-d197b765-eb48-40fe-abfa-8eac184cd138 tempest-VolumesSnapshotTestJSON-1127165440 None] Lock "b'cinder-89f947d7-aa69-4aff-9e9f-7610afc1f575-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:15:46.062393 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d197b765-eb48-40fe-abfa-8eac184cd138 tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:46.140966 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d197b765-eb48-40fe-abfa-8eac184cd138 tempest-VolumesSnapshotTestJSON-1127165440 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:15:46.141405 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d197b765-eb48-40fe-abfa-8eac184cd138 tempest-VolumesSnapshotTestJSON-1127165440 None] Volume volume-89f947d7-aa69-4aff-9e9f-7610afc1f575 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:15:46.151238 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d197b765-eb48-40fe-abfa-8eac184cd138 tempest-VolumesSnapshotTestJSON-1127165440 None] deleting rbd volume volume-89f947d7-aa69-4aff-9e9f-7610afc1f575 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:15:46.316552 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-54849bd9-27e3-4ffb-9734-f76da97ee363 req-446ffe2b-4759-45c6-a719-a274dcbd9f81 tempest-TestVolumeBootPattern-1001263199 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 21:15:46.513046 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-d197b765-eb48-40fe-abfa-8eac184cd138 tempest-VolumesSnapshotTestJSON-1127165440 None] Created reservations ['602ec31b-b908-41e8-a350-b61ae792f42e', '0caa3e38-6fb8-4508-8f8c-ab95fcf97ef1', '0a237f3a-ae63-4db9-b89d-d976d3e9da18', '8a1a685c-3313-4388-8286-050787de7f4c'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:15:46.580499 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d197b765-eb48-40fe-abfa-8eac184cd138 tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:46.626568 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d197b765-eb48-40fe-abfa-8eac184cd138 tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:46.690235 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-d197b765-eb48-40fe-abfa-8eac184cd138 tempest-VolumesSnapshotTestJSON-1127165440 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:15:46.699345 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-d197b765-eb48-40fe-abfa-8eac184cd138 tempest-VolumesSnapshotTestJSON-1127165440 None] Deleted volume successfully. Mar 12 21:15:46.720599 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-d197b765-eb48-40fe-abfa-8eac184cd138 tempest-VolumesSnapshotTestJSON-1127165440 None] Lock "b'cinder-89f947d7-aa69-4aff-9e9f-7610afc1f575-delete_volume'" released by "delete_volume" :: held 0.715s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:15:47.070942 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-54849bd9-27e3-4ffb-9734-f76da97ee363 req-446ffe2b-4759-45c6-a719-a274dcbd9f81 tempest-TestVolumeBootPattern-1001263199 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.754s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 21:15:47.071589 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-54849bd9-27e3-4ffb-9734-f76da97ee363 req-446ffe2b-4759-45c6-a719-a274dcbd9f81 tempest-TestVolumeBootPattern-1001263199 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c56d924b-a997-4b3b-972a-14b4626e8e2a', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': 'c56d924b-a997-4b3b-972a-14b4626e8e2a', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 21:15:47.101304 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-54849bd9-27e3-4ffb-9734-f76da97ee363 req-446ffe2b-4759-45c6-a719-a274dcbd9f81 tempest-TestVolumeBootPattern-1001263199 None] Connection info returned from driver {'name': 'volumes/volume-c56d924b-a997-4b3b-972a-14b4626e8e2a', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c56d924b-a997-4b3b-972a-14b4626e8e2a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '2ccb9278-ed36-401e-bc93-0c1a79546e46'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 21:15:47.153620 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-54849bd9-27e3-4ffb-9734-f76da97ee363 req-446ffe2b-4759-45c6-a719-a274dcbd9f81 tempest-TestVolumeBootPattern-1001263199 None] attachment_update completed successfully. Mar 12 21:15:47.343678 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-3ee824bb-d695-47c7-8c21-a2ac5e435ebe tempest-VolumesSnapshotTestJSON-1127165440 None] Lock "b'cinder-fc07a109-25a4-455a-b16f-7887aa370147-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:15:47.389182 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3ee824bb-d695-47c7-8c21-a2ac5e435ebe tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:47.467231 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3ee824bb-d695-47c7-8c21-a2ac5e435ebe tempest-VolumesSnapshotTestJSON-1127165440 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:15:47.478135 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3ee824bb-d695-47c7-8c21-a2ac5e435ebe tempest-VolumesSnapshotTestJSON-1127165440 None] deleting rbd volume volume-fc07a109-25a4-455a-b16f-7887aa370147 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:15:47.657815 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3ee824bb-d695-47c7-8c21-a2ac5e435ebe tempest-VolumesSnapshotTestJSON-1127165440 None] volume is a clone so cleaning references {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Mar 12 21:15:47.691015 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3ee824bb-d695-47c7-8c21-a2ac5e435ebe tempest-VolumesSnapshotTestJSON-1127165440 None] deleting parent snapshot volume-fc07a109-25a4-455a-b16f-7887aa370147.clone_snap {{(pid=129531) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Mar 12 21:15:48.335767 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-3ee824bb-d695-47c7-8c21-a2ac5e435ebe tempest-VolumesSnapshotTestJSON-1127165440 None] Created reservations ['11c3b92c-6c2e-4499-b01d-f2044b94c76c', '7140c11c-86a7-4c0f-b707-a99ca8aa7189', 'e6b869eb-cf84-4a7b-adc0-0fd12a0023d3', 'd433e06e-8531-4243-910f-8c9cfdc9dde8'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:15:48.390315 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3ee824bb-d695-47c7-8c21-a2ac5e435ebe tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:48.440329 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3ee824bb-d695-47c7-8c21-a2ac5e435ebe tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:48.501618 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-3ee824bb-d695-47c7-8c21-a2ac5e435ebe tempest-VolumesSnapshotTestJSON-1127165440 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:15:48.513049 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-3ee824bb-d695-47c7-8c21-a2ac5e435ebe tempest-VolumesSnapshotTestJSON-1127165440 None] Deleted volume successfully. Mar 12 21:15:48.525690 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-c019098f-8017-43fc-8837-8748178f876f tempest-VolumesSnapshotTestJSON-1127165440 None] Lock "b'cinder-c2e42604-fc83-4591-a5a0-fc6e27633e22-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.017s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:15:48.527897 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c019098f-8017-43fc-8837-8748178f876f tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:48.586418 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-3ee824bb-d695-47c7-8c21-a2ac5e435ebe tempest-VolumesSnapshotTestJSON-1127165440 None] Lock "b'cinder-fc07a109-25a4-455a-b16f-7887aa370147-delete_volume'" released by "delete_volume" :: held 1.243s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:15:49.716276 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-c019098f-8017-43fc-8837-8748178f876f tempest-VolumesSnapshotTestJSON-1127165440 None] Created reservations ['e2a5d7b2-6c1b-48df-88a2-d9caf2facd3d', '9297863d-fbad-4bd9-9e43-7d58aa879bd3', 'f8350a0d-b2a6-4805-90a1-07c6033817a7', '9d9e78f9-45bb-4bd0-82f9-938806aa1434'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:15:49.775283 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-c019098f-8017-43fc-8837-8748178f876f tempest-VolumesSnapshotTestJSON-1127165440 None] Delete snapshot completed successfully. Mar 12 21:15:49.782467 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-c019098f-8017-43fc-8837-8748178f876f tempest-VolumesSnapshotTestJSON-1127165440 None] Lock "b'cinder-c2e42604-fc83-4591-a5a0-fc6e27633e22-delete_snapshot'" released by "delete_snapshot" :: held 1.257s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:15:50.673760 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-63354231-75a3-48b7-921a-a2f219600388 tempest-VolumesSnapshotTestJSON-1127165440 None] Lock "b'cinder-7aa69d6a-de21-48b0-a279-c3e51e53b549-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:15:50.732154 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-63354231-75a3-48b7-921a-a2f219600388 tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:50.791890 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-63354231-75a3-48b7-921a-a2f219600388 tempest-VolumesSnapshotTestJSON-1127165440 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:15:50.792554 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-63354231-75a3-48b7-921a-a2f219600388 tempest-VolumesSnapshotTestJSON-1127165440 None] Volume volume-7aa69d6a-de21-48b0-a279-c3e51e53b549 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:15:50.796917 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-63354231-75a3-48b7-921a-a2f219600388 tempest-VolumesSnapshotTestJSON-1127165440 None] deleting rbd volume volume-7aa69d6a-de21-48b0-a279-c3e51e53b549 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:15:51.020153 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-63354231-75a3-48b7-921a-a2f219600388 tempest-VolumesSnapshotTestJSON-1127165440 None] Created reservations ['2f0099e7-346f-439e-ae3b-c70079094e08', 'c2ce7d58-d199-4a76-ac89-40dd9cca4f85', '2bff37be-dd97-458c-a29d-60d2a30f7294', '69c33f08-f4a8-456f-8177-5edfde9a5516'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:15:51.070586 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-63354231-75a3-48b7-921a-a2f219600388 tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:51.094541 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-63354231-75a3-48b7-921a-a2f219600388 tempest-VolumesSnapshotTestJSON-1127165440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:51.131820 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-63354231-75a3-48b7-921a-a2f219600388 tempest-VolumesSnapshotTestJSON-1127165440 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:15:51.136767 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-63354231-75a3-48b7-921a-a2f219600388 tempest-VolumesSnapshotTestJSON-1127165440 None] Deleted volume successfully. Mar 12 21:15:51.148615 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-63354231-75a3-48b7-921a-a2f219600388 tempest-VolumesSnapshotTestJSON-1127165440 None] Lock "b'cinder-7aa69d6a-de21-48b0-a279-c3e51e53b549-delete_volume'" released by "delete_volume" :: held 0.475s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:15:51.308010 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:15:51.308771 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:51.341585 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:51.372039 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:15:59.042371 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-6faf76ee-ffe6-4dd9-a09b-1326b9ca2329 req-f0269912-9f50-43df-a919-62da5db9b6b7 tempest-TestVolumeBootPattern-1001263199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:15:59.719137 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-6faf76ee-ffe6-4dd9-a09b-1326b9ca2329 req-f0269912-9f50-43df-a919-62da5db9b6b7 tempest-TestVolumeBootPattern-1001263199 None] Create snapshot completed successfully Mar 12 21:16:04.369407 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 req-ddd6bc0d-96bc-45d1-9fc2-07697ddf7c8d tempest-TestVolumeBootPattern-1001263199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:16:04.375749 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 req-ddd6bc0d-96bc-45d1-9fc2-07697ddf7c8d tempest-TestVolumeBootPattern-1001263199 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:16:04.377464 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 req-ddd6bc0d-96bc-45d1-9fc2-07697ddf7c8d tempest-TestVolumeBootPattern-1001263199 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:16:04.414569 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 req-ddd6bc0d-96bc-45d1-9fc2-07697ddf7c8d tempest-TestVolumeBootPattern-1001263199 None] Flow 'volume_create_manager' (0eb5680f-ea10-4b92-b1b5-943e93caef74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:16:04.423616 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 req-ddd6bc0d-96bc-45d1-9fc2-07697ddf7c8d tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cbcf48b-4009-4c23-9adc-e9d1ab62b403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:16:04.438697 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 req-ddd6bc0d-96bc-45d1-9fc2-07697ddf7c8d tempest-TestVolumeBootPattern-1001263199 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:16:04.457730 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 req-ddd6bc0d-96bc-45d1-9fc2-07697ddf7c8d tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cbcf48b-4009-4c23-9adc-e9d1ab62b403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:16:04Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4873a929-f5f9-4914-af6d-ed78fe7fafea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62f54fe17dd142b4be6d7d09de31d63b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1bbd1af2-0776-4d46-9083-08ed0c820c68,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:16:04Z,use_quota=True,user_id='284a1908713c4b74a35a1d3b5cd10e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:16:04.466006 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 req-ddd6bc0d-96bc-45d1-9fc2-07697ddf7c8d tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b44eb2f0-5957-4f77-9c59-a6b8d217da1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:16:04.471431 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 req-ddd6bc0d-96bc-45d1-9fc2-07697ddf7c8d tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b44eb2f0-5957-4f77-9c59-a6b8d217da1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:16:04.477518 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 req-ddd6bc0d-96bc-45d1-9fc2-07697ddf7c8d tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78f961c7-766c-4df5-b7e7-82dd1cefae83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:16:04.484723 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 req-ddd6bc0d-96bc-45d1-9fc2-07697ddf7c8d tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78f961c7-766c-4df5-b7e7-82dd1cefae83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4873a929-f5f9-4914-af6d-ed78fe7fafea', 'volume_name': 'volume-4873a929-f5f9-4914-af6d-ed78fe7fafea', 'volume_size': 1, 'snapshot_id': '1bbd1af2-0776-4d46-9083-08ed0c820c68'}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:16:04.492135 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 req-ddd6bc0d-96bc-45d1-9fc2-07697ddf7c8d tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff7aa2e-aba3-47c5-8fd6-c4738fcf9b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:16:04.497826 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 req-ddd6bc0d-96bc-45d1-9fc2-07697ddf7c8d tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff7aa2e-aba3-47c5-8fd6-c4738fcf9b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:16:04.505257 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 req-ddd6bc0d-96bc-45d1-9fc2-07697ddf7c8d tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (267eef7a-9878-4e75-96b1-37d98d434966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:16:04.506919 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 req-ddd6bc0d-96bc-45d1-9fc2-07697ddf7c8d tempest-TestVolumeBootPattern-1001263199 None] Volume 4873a929-f5f9-4914-af6d-ed78fe7fafea: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4873a929-f5f9-4914-af6d-ed78fe7fafea', 'volume_size': 1, 'snapshot_id': '1bbd1af2-0776-4d46-9083-08ed0c820c68'} Mar 12 21:16:04.561866 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 req-ddd6bc0d-96bc-45d1-9fc2-07697ddf7c8d tempest-TestVolumeBootPattern-1001263199 None] cloning volumes/volume-c56d924b-a997-4b3b-972a-14b4626e8e2a@snapshot-1bbd1af2-0776-4d46-9083-08ed0c820c68 to volume-4873a929-f5f9-4914-af6d-ed78fe7fafea {{(pid=129531) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1090}} Mar 12 21:16:04.563338 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 req-ddd6bc0d-96bc-45d1-9fc2-07697ddf7c8d tempest-TestVolumeBootPattern-1001263199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:16:04.689635 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 req-ddd6bc0d-96bc-45d1-9fc2-07697ddf7c8d tempest-TestVolumeBootPattern-1001263199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:16:04.947424 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 req-ddd6bc0d-96bc-45d1-9fc2-07697ddf7c8d tempest-TestVolumeBootPattern-1001263199 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:16:04.950349 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 req-ddd6bc0d-96bc-45d1-9fc2-07697ddf7c8d tempest-TestVolumeBootPattern-1001263199 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:16:04.980129 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.volume_utils [req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 req-ddd6bc0d-96bc-45d1-9fc2-07697ddf7c8d tempest-TestVolumeBootPattern-1001263199 None] Marking volume 4873a929-f5f9-4914-af6d-ed78fe7fafea as bootable. {{(pid=129531) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 12 21:16:04.995939 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 req-ddd6bc0d-96bc-45d1-9fc2-07697ddf7c8d tempest-TestVolumeBootPattern-1001263199 None] Copying metadata from snapshot 1bbd1af2-0776-4d46-9083-08ed0c820c68 to 4873a929-f5f9-4914-af6d-ed78fe7fafea. {{(pid=129531) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:422}} Mar 12 21:16:05.057886 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 req-ddd6bc0d-96bc-45d1-9fc2-07697ddf7c8d tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (267eef7a-9878-4e75-96b1-37d98d434966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4873a929-f5f9-4914-af6d-ed78fe7fafea', 'volume_size': 1, 'snapshot_id': '1bbd1af2-0776-4d46-9083-08ed0c820c68'}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:16:05.065916 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 req-ddd6bc0d-96bc-45d1-9fc2-07697ddf7c8d tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8920a7a0-9369-45d2-affd-8e3008c7c80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:16:05.078446 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 req-ddd6bc0d-96bc-45d1-9fc2-07697ddf7c8d tempest-TestVolumeBootPattern-1001263199 None] Volume volume-4873a929-f5f9-4914-af6d-ed78fe7fafea (4873a929-f5f9-4914-af6d-ed78fe7fafea): created successfully Mar 12 21:16:05.083185 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 req-ddd6bc0d-96bc-45d1-9fc2-07697ddf7c8d tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8920a7a0-9369-45d2-affd-8e3008c7c80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:16:05.093748 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 req-ddd6bc0d-96bc-45d1-9fc2-07697ddf7c8d tempest-TestVolumeBootPattern-1001263199 None] Flow 'volume_create_manager' (0eb5680f-ea10-4b92-b1b5-943e93caef74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:16:05.121675 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 req-ddd6bc0d-96bc-45d1-9fc2-07697ddf7c8d tempest-TestVolumeBootPattern-1001263199 None] Created volume successfully. Mar 12 21:16:07.824165 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 req-08567a9a-39ec-4bb7-a801-d4a6fe80cc93 tempest-TestVolumeBootPattern-1001263199 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 21:16:09.455873 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 req-08567a9a-39ec-4bb7-a801-d4a6fe80cc93 tempest-TestVolumeBootPattern-1001263199 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.631s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 21:16:09.456820 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 req-08567a9a-39ec-4bb7-a801-d4a6fe80cc93 tempest-TestVolumeBootPattern-1001263199 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4873a929-f5f9-4914-af6d-ed78fe7fafea', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': '4873a929-f5f9-4914-af6d-ed78fe7fafea', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 21:16:09.508450 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 req-08567a9a-39ec-4bb7-a801-d4a6fe80cc93 tempest-TestVolumeBootPattern-1001263199 None] Connection info returned from driver {'name': 'volumes/volume-4873a929-f5f9-4914-af6d-ed78fe7fafea', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '4873a929-f5f9-4914-af6d-ed78fe7fafea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'edc593eb-02cf-4990-bc39-f20ebf1669f8'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 21:16:09.578843 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 req-08567a9a-39ec-4bb7-a801-d4a6fe80cc93 tempest-TestVolumeBootPattern-1001263199 None] attachment_update completed successfully. Mar 12 21:16:24.989281 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-622a844c-e1d6-4e0f-b262-865ebd137ba1 req-b98befec-a971-41fd-90e8-9605de4bc9d5 tempest-TestVolumeBootPattern-1001263199 None] Terminate volume connection completed successfully. Mar 12 21:16:24.989958 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-622a844c-e1d6-4e0f-b262-865ebd137ba1 req-b98befec-a971-41fd-90e8-9605de4bc9d5 tempest-TestVolumeBootPattern-1001263199 None] Deleting attachment edc593eb-02cf-4990-bc39-f20ebf1669f8. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 21:16:25.203410 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [req-622a844c-e1d6-4e0f-b262-865ebd137ba1 req-7ad7afcb-f7e9-43c2-b765-0f1f38e2aff8 tempest-TestVolumeBootPattern-1001263199 None] Lock "b'cinder-4873a929-f5f9-4914-af6d-ed78fe7fafea-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:16:25.239454 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-622a844c-e1d6-4e0f-b262-865ebd137ba1 req-7ad7afcb-f7e9-43c2-b765-0f1f38e2aff8 tempest-TestVolumeBootPattern-1001263199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:16:25.367221 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-622a844c-e1d6-4e0f-b262-865ebd137ba1 req-7ad7afcb-f7e9-43c2-b765-0f1f38e2aff8 tempest-TestVolumeBootPattern-1001263199 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:16:25.381570 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-622a844c-e1d6-4e0f-b262-865ebd137ba1 req-7ad7afcb-f7e9-43c2-b765-0f1f38e2aff8 tempest-TestVolumeBootPattern-1001263199 None] deleting rbd volume volume-4873a929-f5f9-4914-af6d-ed78fe7fafea {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:16:25.753891 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [req-622a844c-e1d6-4e0f-b262-865ebd137ba1 req-7ad7afcb-f7e9-43c2-b765-0f1f38e2aff8 tempest-TestVolumeBootPattern-1001263199 None] Created reservations ['8994d451-3ef0-4649-80b2-53cce95d6af4', '78309100-a718-4e95-8e47-7816c4de9904', '9764dcd4-bc39-4572-ba81-e800aa3d30db', '836ece85-d5bd-40e6-9b0a-927e7b962223'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:16:25.811712 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-622a844c-e1d6-4e0f-b262-865ebd137ba1 req-7ad7afcb-f7e9-43c2-b765-0f1f38e2aff8 tempest-TestVolumeBootPattern-1001263199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:16:25.855899 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-622a844c-e1d6-4e0f-b262-865ebd137ba1 req-7ad7afcb-f7e9-43c2-b765-0f1f38e2aff8 tempest-TestVolumeBootPattern-1001263199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:16:25.909650 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [req-622a844c-e1d6-4e0f-b262-865ebd137ba1 req-7ad7afcb-f7e9-43c2-b765-0f1f38e2aff8 tempest-TestVolumeBootPattern-1001263199 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:16:25.918211 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-622a844c-e1d6-4e0f-b262-865ebd137ba1 req-7ad7afcb-f7e9-43c2-b765-0f1f38e2aff8 tempest-TestVolumeBootPattern-1001263199 None] Deleted volume successfully. Mar 12 21:16:25.936293 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [req-622a844c-e1d6-4e0f-b262-865ebd137ba1 req-7ad7afcb-f7e9-43c2-b765-0f1f38e2aff8 tempest-TestVolumeBootPattern-1001263199 None] Lock "b'cinder-4873a929-f5f9-4914-af6d-ed78fe7fafea-delete_volume'" released by "delete_volume" :: held 0.733s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:16:26.542093 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-b2e3691e-55a7-4263-bccc-a10c50bd2b29 tempest-TestVolumeBootPattern-1001263199 None] Lock "b'cinder-1bbd1af2-0776-4d46-9083-08ed0c820c68-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:16:26.544860 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b2e3691e-55a7-4263-bccc-a10c50bd2b29 tempest-TestVolumeBootPattern-1001263199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:16:51.307730 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:16:51.308442 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:16:51.331786 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:16:51.359781 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:16:56.785286 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-b2e3691e-55a7-4263-bccc-a10c50bd2b29 tempest-TestVolumeBootPattern-1001263199 None] Created reservations ['8a40c5c2-cf8f-45c9-b17e-15fe50646e22', '425fbee9-259d-4e24-b4a6-58255418594e', '19dad363-df1e-4c5e-b609-9d1544db9eef', 'f823d3f9-117d-4836-944e-00ba950f1ab1'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:16:56.839118 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-b2e3691e-55a7-4263-bccc-a10c50bd2b29 tempest-TestVolumeBootPattern-1001263199 None] Delete snapshot completed successfully. Mar 12 21:16:56.844835 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-b2e3691e-55a7-4263-bccc-a10c50bd2b29 tempest-TestVolumeBootPattern-1001263199 None] Lock "b'cinder-1bbd1af2-0776-4d46-9083-08ed0c820c68-delete_snapshot'" released by "delete_snapshot" :: held 30.304s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:17:00.156658 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-51329383-2ce1-4867-bced-23c82f3a37e0 req-56db30a4-7227-4b9a-aeda-3464b97775ca tempest-TestVolumeBootPattern-1001263199 None] Terminate volume connection completed successfully. Mar 12 21:17:00.157403 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-51329383-2ce1-4867-bced-23c82f3a37e0 req-56db30a4-7227-4b9a-aeda-3464b97775ca tempest-TestVolumeBootPattern-1001263199 None] Deleting attachment 2ccb9278-ed36-401e-bc93-0c1a79546e46. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 21:17:00.321333 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [req-51329383-2ce1-4867-bced-23c82f3a37e0 req-f38cb6a8-50e9-4a42-98f2-262f70026ecf tempest-TestVolumeBootPattern-1001263199 None] Lock "b'cinder-c56d924b-a997-4b3b-972a-14b4626e8e2a-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:17:00.372977 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-51329383-2ce1-4867-bced-23c82f3a37e0 req-f38cb6a8-50e9-4a42-98f2-262f70026ecf tempest-TestVolumeBootPattern-1001263199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:17:00.510346 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-51329383-2ce1-4867-bced-23c82f3a37e0 req-f38cb6a8-50e9-4a42-98f2-262f70026ecf tempest-TestVolumeBootPattern-1001263199 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:17:00.522583 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-51329383-2ce1-4867-bced-23c82f3a37e0 req-f38cb6a8-50e9-4a42-98f2-262f70026ecf tempest-TestVolumeBootPattern-1001263199 None] deleting rbd volume volume-c56d924b-a997-4b3b-972a-14b4626e8e2a {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:17:00.938527 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-51329383-2ce1-4867-bced-23c82f3a37e0 req-f38cb6a8-50e9-4a42-98f2-262f70026ecf tempest-TestVolumeBootPattern-1001263199 None] volume is a clone so cleaning references {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Mar 12 21:17:00.970985 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-51329383-2ce1-4867-bced-23c82f3a37e0 req-f38cb6a8-50e9-4a42-98f2-262f70026ecf tempest-TestVolumeBootPattern-1001263199 None] deleting parent snapshot volume-c56d924b-a997-4b3b-972a-14b4626e8e2a.clone_snap {{(pid=129531) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Mar 12 21:17:01.439759 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [req-51329383-2ce1-4867-bced-23c82f3a37e0 req-f38cb6a8-50e9-4a42-98f2-262f70026ecf tempest-TestVolumeBootPattern-1001263199 None] Created reservations ['58134d56-5948-4521-a88a-9ba077a049ce', '17036036-5e87-486c-853b-d421d087c75c', '929858d3-1f23-4cc0-8283-ed3874b803c3', 'e6b6b34a-c183-41eb-97c9-76cb14c38b22'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:17:01.483076 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-51329383-2ce1-4867-bced-23c82f3a37e0 req-f38cb6a8-50e9-4a42-98f2-262f70026ecf tempest-TestVolumeBootPattern-1001263199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:17:01.504279 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-51329383-2ce1-4867-bced-23c82f3a37e0 req-f38cb6a8-50e9-4a42-98f2-262f70026ecf tempest-TestVolumeBootPattern-1001263199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:17:01.526607 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [req-51329383-2ce1-4867-bced-23c82f3a37e0 req-f38cb6a8-50e9-4a42-98f2-262f70026ecf tempest-TestVolumeBootPattern-1001263199 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:17:01.531316 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-51329383-2ce1-4867-bced-23c82f3a37e0 req-f38cb6a8-50e9-4a42-98f2-262f70026ecf tempest-TestVolumeBootPattern-1001263199 None] Deleted volume successfully. Mar 12 21:17:01.542688 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [req-51329383-2ce1-4867-bced-23c82f3a37e0 req-f38cb6a8-50e9-4a42-98f2-262f70026ecf tempest-TestVolumeBootPattern-1001263199 None] Lock "b'cinder-c56d924b-a997-4b3b-972a-14b4626e8e2a-delete_volume'" released by "delete_volume" :: held 1.221s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:17:04.190470 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:17:04.190470 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:17:04.190470 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:17:04.207115 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] Flow 'volume_create_manager' (5723b8b6-3d24-40a9-bac1-5214a1f13bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:17:04.213706 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b60ddeda-70d7-416a-88ab-30a5bdbbb045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:17:04.221177 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:17:04.236777 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b60ddeda-70d7-416a-88ab-30a5bdbbb045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1309888922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=feb089af-2825-4985-aa6e-09e75c64231e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62f54fe17dd142b4be6d7d09de31d63b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:17:04Z,use_quota=True,user_id='284a1908713c4b74a35a1d3b5cd10e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:17:04.242214 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (455f0965-ef87-463a-88a3-d41597047e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:17:04.246373 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (455f0965-ef87-463a-88a3-d41597047e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:17:04.251484 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af034841-643a-4d22-8d2b-319c3e9a1c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:17:04.333447 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af034841-643a-4d22-8d2b-319c3e9a1c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'feb089af-2825-4985-aa6e-09e75c64231e', 'volume_name': 'volume-feb089af-2825-4985-aa6e-09e75c64231e', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:17:04.339033 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6355d22b-d8f3-4880-9822-559e7f37e157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:17:04.344775 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6355d22b-d8f3-4880-9822-559e7f37e157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:17:04.350172 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (220f5150-4934-4bec-938e-83ddb6e2af30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:17:04.351588 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] Volume feb089af-2825-4985-aa6e-09e75c64231e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-feb089af-2825-4985-aa6e-09e75c64231e', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 12 21:17:04.352166 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] Cloning feb089af-2825-4985-aa6e-09e75c64231e from image 539171db-0bd3-4f16-95fd-a7cd5530137d at location (None, None). {{(pid=129531) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Mar 12 21:17:04.364413 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] Lock "b'cinder-539171db-0bd3-4f16-95fd-a7cd5530137d'" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:17:04.377618 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] Found image-volume cache entry: {'id': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'volume_id': '8d802c7b-bd34-4836-bd5d-90755a167ddc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34), 'last_used': datetime.datetime(2022, 3, 12, 21, 17, 4, 371134)}. {{(pid=129531) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 12 21:17:04.378108 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] Image-volume cache entry image_update_at = 2022-03-12 20:39:34+00:00, requested image updated_at = 2022-03-12 20:39:34+00:00. {{(pid=129531) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 12 21:17:04.378834 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] Found cache entry for image = 539171db-0bd3-4f16-95fd-a7cd5530137d on host ncdv-master-1@ceph#ceph. {{(pid=129531) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Mar 12 21:17:04.385095 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] Lock "b'cinder-539171db-0bd3-4f16-95fd-a7cd5530137d'" released by "_prepare_image_cache_entry" :: held 0.021s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:17:04.386942 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] Attempting to retrieve cache entry for image = 539171db-0bd3-4f16-95fd-a7cd5530137d on host ncdv-master-1@ceph#ceph. {{(pid=129531) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Mar 12 21:17:04.395041 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] Found image-volume cache entry: {'id': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'volume_id': '8d802c7b-bd34-4836-bd5d-90755a167ddc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34), 'last_used': datetime.datetime(2022, 3, 12, 21, 17, 4, 392588)}. {{(pid=129531) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 12 21:17:04.395553 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] Image-volume cache entry image_update_at = 2022-03-12 20:39:34+00:00, requested image updated_at = 2022-03-12 20:39:34+00:00. {{(pid=129531) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 12 21:17:04.396027 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] Creating from source image-volume 8d802c7b-bd34-4836-bd5d-90755a167ddc {{(pid=129531) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Mar 12 21:17:04.408482 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:17:04.472184 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] creating snapshot='volume-feb089af-2825-4985-aa6e-09e75c64231e.clone_snap' {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Mar 12 21:17:05.422801 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] cloning 'volume-8d802c7b-bd34-4836-bd5d-90755a167ddc@volume-feb089af-2825-4985-aa6e-09e75c64231e.clone_snap' to 'volume-feb089af-2825-4985-aa6e-09e75c64231e' {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Mar 12 21:17:05.541537 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] Volume volume-9916cd82-3d9b-466f-a769-cf81bdc743fd.deleted is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:17:05.543266 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:17:05.543644 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:17:05.559197 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] clone created successfully {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Mar 12 21:17:05.559810 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.volume_utils [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] Marking volume feb089af-2825-4985-aa6e-09e75c64231e as bootable. {{(pid=129531) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 12 21:17:05.567344 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] Copying metadata from image 539171db-0bd3-4f16-95fd-a7cd5530137d to feb089af-2825-4985-aa6e-09e75c64231e. {{(pid=129531) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Mar 12 21:17:05.567838 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] Creating volume glance metadata for volume feb089af-2825-4985-aa6e-09e75c64231e backed by image 539171db-0bd3-4f16-95fd-a7cd5530137d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129531) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Mar 12 21:17:05.619414 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (220f5150-4934-4bec-938e-83ddb6e2af30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feb089af-2825-4985-aa6e-09e75c64231e', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:17:05.624305 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e41befe0-6609-4cc4-beff-fb642cdeb168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:17:05.634093 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] Volume volume-feb089af-2825-4985-aa6e-09e75c64231e (feb089af-2825-4985-aa6e-09e75c64231e): created successfully Mar 12 21:17:05.638133 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e41befe0-6609-4cc4-beff-fb642cdeb168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:17:05.644124 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] Flow 'volume_create_manager' (5723b8b6-3d24-40a9-bac1-5214a1f13bc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:17:05.652877 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-905ececb-23ec-4865-a094-7d22e9f526ba tempest-TestVolumeBootPattern-1001263199 None] Created volume successfully. Mar 12 21:17:08.354018 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-3ed055cd-ab84-4e68-b5bf-3404648b1270 req-7f914a00-cf2a-4c79-977d-c557e2790c2f tempest-TestVolumeBootPattern-1001263199 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 21:17:09.061976 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-3ed055cd-ab84-4e68-b5bf-3404648b1270 req-7f914a00-cf2a-4c79-977d-c557e2790c2f tempest-TestVolumeBootPattern-1001263199 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.708s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 21:17:09.063135 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-3ed055cd-ab84-4e68-b5bf-3404648b1270 req-7f914a00-cf2a-4c79-977d-c557e2790c2f tempest-TestVolumeBootPattern-1001263199 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-feb089af-2825-4985-aa6e-09e75c64231e', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': 'feb089af-2825-4985-aa6e-09e75c64231e', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 21:17:09.089572 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-3ed055cd-ab84-4e68-b5bf-3404648b1270 req-7f914a00-cf2a-4c79-977d-c557e2790c2f tempest-TestVolumeBootPattern-1001263199 None] Connection info returned from driver {'name': 'volumes/volume-feb089af-2825-4985-aa6e-09e75c64231e', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'feb089af-2825-4985-aa6e-09e75c64231e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '2be6a627-7f69-4f4c-86b2-58f884c21c57'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 21:17:09.142385 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-3ed055cd-ab84-4e68-b5bf-3404648b1270 req-7f914a00-cf2a-4c79-977d-c557e2790c2f tempest-TestVolumeBootPattern-1001263199 None] attachment_update completed successfully. Mar 12 21:17:51.305250 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:17:51.308621 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:17:51.368611 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:17:51.442177 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:18:51.309244 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:18:51.310050 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:18:51.336395 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:18:51.373484 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:19:18.621588 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:19:18.625857 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:19:18.626450 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:19:18.649037 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] Flow 'volume_create_manager' (05b2275c-98ca-49ad-b4e1-42f37f00f13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:19:18.659972 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe08926-c697-4eb4-86b6-0caf901b2dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:19:18.667648 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:19:18.683751 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe08926-c697-4eb4-86b6-0caf901b2dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-1700612975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b68846b1-e2e8-4551-9e39-b8fa771ce5ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6a0660e45d4aea9ff4576abd1f0e56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:19:19Z,use_quota=True,user_id='62b74fe4246c415bbb401849ce000f9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:19:18.690386 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fae3de86-4261-47af-8ffe-47f77e77c9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:19:18.694875 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fae3de86-4261-47af-8ffe-47f77e77c9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:19:18.701199 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0555c40-f7d7-4532-b0c5-aecb2e3c3f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:19:18.822949 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0555c40-f7d7-4532-b0c5-aecb2e3c3f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b68846b1-e2e8-4551-9e39-b8fa771ce5ff', 'volume_name': 'volume-b68846b1-e2e8-4551-9e39-b8fa771ce5ff', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:19:18.828722 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a070d60-bfc3-45a7-91ac-8a1b393cb6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:19:18.833466 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a070d60-bfc3-45a7-91ac-8a1b393cb6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:19:18.843028 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9331819-b447-4276-93ee-6c7bd5b1d0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:19:18.844450 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] Volume b68846b1-e2e8-4551-9e39-b8fa771ce5ff: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b68846b1-e2e8-4551-9e39-b8fa771ce5ff', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 12 21:19:18.845054 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] Cloning b68846b1-e2e8-4551-9e39-b8fa771ce5ff from image 539171db-0bd3-4f16-95fd-a7cd5530137d at location (None, None). {{(pid=129531) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Mar 12 21:19:18.856279 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] Lock "b'cinder-539171db-0bd3-4f16-95fd-a7cd5530137d'" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:19:18.879560 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] Found image-volume cache entry: {'id': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'volume_id': '8d802c7b-bd34-4836-bd5d-90755a167ddc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34), 'last_used': datetime.datetime(2022, 3, 12, 21, 19, 18, 869369)}. {{(pid=129531) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 12 21:19:18.880086 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] Image-volume cache entry image_update_at = 2022-03-12 20:39:34+00:00, requested image updated_at = 2022-03-12 20:39:34+00:00. {{(pid=129531) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 12 21:19:18.880650 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] Found cache entry for image = 539171db-0bd3-4f16-95fd-a7cd5530137d on host ncdv-master-1@ceph#ceph. {{(pid=129531) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Mar 12 21:19:18.887857 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-7648b0a0-68c0-4c8a-901b-6d1c0495ae1c tempest-ServersNegativeTestJSON-1340284216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:19:18.892422 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-7648b0a0-68c0-4c8a-901b-6d1c0495ae1c tempest-ServersNegativeTestJSON-1340284216 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:19:18.892868 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-7648b0a0-68c0-4c8a-901b-6d1c0495ae1c tempest-ServersNegativeTestJSON-1340284216 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:19:18.915516 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7648b0a0-68c0-4c8a-901b-6d1c0495ae1c tempest-ServersNegativeTestJSON-1340284216 None] Flow 'volume_create_manager' (292eb3a7-c418-43ed-a824-f4c34463c1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:19:18.923114 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7648b0a0-68c0-4c8a-901b-6d1c0495ae1c tempest-ServersNegativeTestJSON-1340284216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90881d65-e36d-46c5-a65e-a86ffa0b4a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:19:18.926923 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] Lock "b'cinder-539171db-0bd3-4f16-95fd-a7cd5530137d'" released by "_prepare_image_cache_entry" :: held 0.071s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:19:18.927873 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] Attempting to retrieve cache entry for image = 539171db-0bd3-4f16-95fd-a7cd5530137d on host ncdv-master-1@ceph#ceph. {{(pid=129531) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Mar 12 21:19:18.935258 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-7648b0a0-68c0-4c8a-901b-6d1c0495ae1c tempest-ServersNegativeTestJSON-1340284216 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:19:18.958895 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7648b0a0-68c0-4c8a-901b-6d1c0495ae1c tempest-ServersNegativeTestJSON-1340284216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90881d65-e36d-46c5-a65e-a86ffa0b4a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-970704910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=16b7c90c-67e7-449d-9ad4-cbb9873bb77e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13397eac7c854033a2e3c6faa8f8247e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:19:19Z,use_quota=True,user_id='c2d43d7b235048dfbc773e69ae5ff75a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:19:18.959657 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7648b0a0-68c0-4c8a-901b-6d1c0495ae1c tempest-ServersNegativeTestJSON-1340284216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (824f2a62-2f5a-4532-872e-378076a17f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:19:18.964557 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7648b0a0-68c0-4c8a-901b-6d1c0495ae1c tempest-ServersNegativeTestJSON-1340284216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (824f2a62-2f5a-4532-872e-378076a17f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:19:18.973506 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7648b0a0-68c0-4c8a-901b-6d1c0495ae1c tempest-ServersNegativeTestJSON-1340284216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e41fac7-126b-483b-b51c-b01028e4c914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:19:18.978772 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7648b0a0-68c0-4c8a-901b-6d1c0495ae1c tempest-ServersNegativeTestJSON-1340284216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e41fac7-126b-483b-b51c-b01028e4c914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16b7c90c-67e7-449d-9ad4-cbb9873bb77e', 'volume_name': 'volume-16b7c90c-67e7-449d-9ad4-cbb9873bb77e', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:19:18.987327 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7648b0a0-68c0-4c8a-901b-6d1c0495ae1c tempest-ServersNegativeTestJSON-1340284216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51bbe511-b3f7-4eae-90ca-9c4d826a92bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:19:18.989021 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7648b0a0-68c0-4c8a-901b-6d1c0495ae1c tempest-ServersNegativeTestJSON-1340284216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51bbe511-b3f7-4eae-90ca-9c4d826a92bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:19:18.993908 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7648b0a0-68c0-4c8a-901b-6d1c0495ae1c tempest-ServersNegativeTestJSON-1340284216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bda06bb-7a59-4a61-bac7-340bbccc761a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:19:18.995279 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-7648b0a0-68c0-4c8a-901b-6d1c0495ae1c tempest-ServersNegativeTestJSON-1340284216 None] Volume 16b7c90c-67e7-449d-9ad4-cbb9873bb77e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16b7c90c-67e7-449d-9ad4-cbb9873bb77e', 'volume_size': 1} Mar 12 21:19:18.995656 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-7648b0a0-68c0-4c8a-901b-6d1c0495ae1c tempest-ServersNegativeTestJSON-1340284216 None] creating volume 'volume-16b7c90c-67e7-449d-9ad4-cbb9873bb77e' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:19:18.996684 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-7648b0a0-68c0-4c8a-901b-6d1c0495ae1c tempest-ServersNegativeTestJSON-1340284216 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:19:19.047270 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] Found image-volume cache entry: {'id': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'volume_id': '8d802c7b-bd34-4836-bd5d-90755a167ddc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34), 'last_used': datetime.datetime(2022, 3, 12, 21, 19, 19, 42486)}. {{(pid=129531) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 12 21:19:19.048043 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] Image-volume cache entry image_update_at = 2022-03-12 20:39:34+00:00, requested image updated_at = 2022-03-12 20:39:34+00:00. {{(pid=129531) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 12 21:19:19.048713 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] Creating from source image-volume 8d802c7b-bd34-4836-bd5d-90755a167ddc {{(pid=129531) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Mar 12 21:19:19.066671 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:19:19.165807 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] creating snapshot='volume-b68846b1-e2e8-4551-9e39-b8fa771ce5ff.clone_snap' {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Mar 12 21:19:19.723980 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] cloning 'volume-8d802c7b-bd34-4836-bd5d-90755a167ddc@volume-b68846b1-e2e8-4551-9e39-b8fa771ce5ff.clone_snap' to 'volume-b68846b1-e2e8-4551-9e39-b8fa771ce5ff' {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Mar 12 21:19:19.734113 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-7648b0a0-68c0-4c8a-901b-6d1c0495ae1c tempest-ServersNegativeTestJSON-1340284216 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:19:19.735202 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-7648b0a0-68c0-4c8a-901b-6d1c0495ae1c tempest-ServersNegativeTestJSON-1340284216 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:19:19.739721 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7648b0a0-68c0-4c8a-901b-6d1c0495ae1c tempest-ServersNegativeTestJSON-1340284216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bda06bb-7a59-4a61-bac7-340bbccc761a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16b7c90c-67e7-449d-9ad4-cbb9873bb77e', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:19:19.746705 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7648b0a0-68c0-4c8a-901b-6d1c0495ae1c tempest-ServersNegativeTestJSON-1340284216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa1edf28-bde9-4fd1-98be-9dcdde78c74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:19:19.759217 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-7648b0a0-68c0-4c8a-901b-6d1c0495ae1c tempest-ServersNegativeTestJSON-1340284216 None] Volume volume-16b7c90c-67e7-449d-9ad4-cbb9873bb77e (16b7c90c-67e7-449d-9ad4-cbb9873bb77e): created successfully Mar 12 21:19:19.763906 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7648b0a0-68c0-4c8a-901b-6d1c0495ae1c tempest-ServersNegativeTestJSON-1340284216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa1edf28-bde9-4fd1-98be-9dcdde78c74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:19:19.771770 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7648b0a0-68c0-4c8a-901b-6d1c0495ae1c tempest-ServersNegativeTestJSON-1340284216 None] Flow 'volume_create_manager' (292eb3a7-c418-43ed-a824-f4c34463c1dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:19:19.791794 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-7648b0a0-68c0-4c8a-901b-6d1c0495ae1c tempest-ServersNegativeTestJSON-1340284216 None] Created volume successfully. Mar 12 21:19:19.967388 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] Volume volume-9916cd82-3d9b-466f-a769-cf81bdc743fd.deleted is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:19:19.969134 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:19:19.969553 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:19:20.041365 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] clone created successfully {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Mar 12 21:19:20.043995 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.volume_utils [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] Marking volume b68846b1-e2e8-4551-9e39-b8fa771ce5ff as bootable. {{(pid=129531) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 12 21:19:20.060917 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] Copying metadata from image 539171db-0bd3-4f16-95fd-a7cd5530137d to b68846b1-e2e8-4551-9e39-b8fa771ce5ff. {{(pid=129531) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Mar 12 21:19:20.061409 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] Creating volume glance metadata for volume b68846b1-e2e8-4551-9e39-b8fa771ce5ff backed by image 539171db-0bd3-4f16-95fd-a7cd5530137d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129531) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Mar 12 21:19:20.160943 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9331819-b447-4276-93ee-6c7bd5b1d0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b68846b1-e2e8-4551-9e39-b8fa771ce5ff', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:19:20.168000 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaf3bf50-95e4-4fe0-b0bf-4f9ca30916bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:19:20.181005 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] Volume volume-b68846b1-e2e8-4551-9e39-b8fa771ce5ff (b68846b1-e2e8-4551-9e39-b8fa771ce5ff): created successfully Mar 12 21:19:20.186392 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaf3bf50-95e4-4fe0-b0bf-4f9ca30916bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:19:20.198461 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] Flow 'volume_create_manager' (05b2275c-98ca-49ad-b4e1-42f37f00f13f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:19:20.209557 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-9ff1d44e-2231-41d8-bc80-8413822fe6ee tempest-TestVolumeBackupRestore-1490532501 None] Created volume successfully. Mar 12 21:19:21.106131 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1b6acdd-795d-4622-b81e-6bff024f2eec tempest-ServersNegativeTestJSON-1340284216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:19:21.109681 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-c1b6acdd-795d-4622-b81e-6bff024f2eec tempest-ServersNegativeTestJSON-1340284216 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:19:21.110369 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-c1b6acdd-795d-4622-b81e-6bff024f2eec tempest-ServersNegativeTestJSON-1340284216 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:19:21.129860 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c1b6acdd-795d-4622-b81e-6bff024f2eec tempest-ServersNegativeTestJSON-1340284216 None] Flow 'volume_create_manager' (d223bfa7-6595-443e-b782-57936609503e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:19:21.136433 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c1b6acdd-795d-4622-b81e-6bff024f2eec tempest-ServersNegativeTestJSON-1340284216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (391986f8-b7e8-4974-8174-765c6076d9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:19:21.147141 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-c1b6acdd-795d-4622-b81e-6bff024f2eec tempest-ServersNegativeTestJSON-1340284216 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:19:21.170440 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c1b6acdd-795d-4622-b81e-6bff024f2eec tempest-ServersNegativeTestJSON-1340284216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (391986f8-b7e8-4974-8174-765c6076d9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-644268239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9696163c-b46a-4dff-99b8-15ac21e13208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13397eac7c854033a2e3c6faa8f8247e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:19:21Z,use_quota=True,user_id='c2d43d7b235048dfbc773e69ae5ff75a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:19:21.177336 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c1b6acdd-795d-4622-b81e-6bff024f2eec tempest-ServersNegativeTestJSON-1340284216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6a5f3a4-51b3-4f00-bab3-c153b751adb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:19:21.182328 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c1b6acdd-795d-4622-b81e-6bff024f2eec tempest-ServersNegativeTestJSON-1340284216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6a5f3a4-51b3-4f00-bab3-c153b751adb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:19:21.188274 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c1b6acdd-795d-4622-b81e-6bff024f2eec tempest-ServersNegativeTestJSON-1340284216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbb06128-1256-484f-b747-c7ca55ad4525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:19:21.192816 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c1b6acdd-795d-4622-b81e-6bff024f2eec tempest-ServersNegativeTestJSON-1340284216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbb06128-1256-484f-b747-c7ca55ad4525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9696163c-b46a-4dff-99b8-15ac21e13208', 'volume_name': 'volume-9696163c-b46a-4dff-99b8-15ac21e13208', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:19:21.197827 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c1b6acdd-795d-4622-b81e-6bff024f2eec tempest-ServersNegativeTestJSON-1340284216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d5c2b52-33d6-42db-94bc-da47b9cbfb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:19:21.201839 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c1b6acdd-795d-4622-b81e-6bff024f2eec tempest-ServersNegativeTestJSON-1340284216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d5c2b52-33d6-42db-94bc-da47b9cbfb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:19:21.206981 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c1b6acdd-795d-4622-b81e-6bff024f2eec tempest-ServersNegativeTestJSON-1340284216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a23d7c34-de17-4435-a141-21165e3edee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:19:21.208056 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-c1b6acdd-795d-4622-b81e-6bff024f2eec tempest-ServersNegativeTestJSON-1340284216 None] Volume 9696163c-b46a-4dff-99b8-15ac21e13208: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9696163c-b46a-4dff-99b8-15ac21e13208', 'volume_size': 1} Mar 12 21:19:21.208445 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c1b6acdd-795d-4622-b81e-6bff024f2eec tempest-ServersNegativeTestJSON-1340284216 None] creating volume 'volume-9696163c-b46a-4dff-99b8-15ac21e13208' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:19:21.209442 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c1b6acdd-795d-4622-b81e-6bff024f2eec tempest-ServersNegativeTestJSON-1340284216 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:19:21.254552 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-631cfd3f-790f-408d-a264-d886ab852c96 tempest-TestVolumeBackupRestore-1490532501 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-03-12T21:19:20Z,data_timestamp=2022-03-12T21:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=6f2a8acc-32b2-451c-98bb-63cbbae2c432,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='2e6a0660e45d4aea9ff4576abd1f0e56',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='62b74fe4246c415bbb401849ce000f9b',volume_id=b68846b1-e2e8-4551-9e39-b8fa771ce5ff) Mar 12 21:19:21.255380 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.backup.rpcapi [None req-631cfd3f-790f-408d-a264-d886ab852c96 tempest-TestVolumeBackupRestore-1490532501 None] continue_backup in rpcapi backup_id 6f2a8acc-32b2-451c-98bb-63cbbae2c432 {{(pid=129531) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Mar 12 21:19:21.347587 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c1b6acdd-795d-4622-b81e-6bff024f2eec tempest-ServersNegativeTestJSON-1340284216 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:19:21.348086 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c1b6acdd-795d-4622-b81e-6bff024f2eec tempest-ServersNegativeTestJSON-1340284216 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:19:21.356010 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c1b6acdd-795d-4622-b81e-6bff024f2eec tempest-ServersNegativeTestJSON-1340284216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a23d7c34-de17-4435-a141-21165e3edee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9696163c-b46a-4dff-99b8-15ac21e13208', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:19:21.363330 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c1b6acdd-795d-4622-b81e-6bff024f2eec tempest-ServersNegativeTestJSON-1340284216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0733497-e1cd-4c30-99e4-8cf4fe471871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:19:21.376863 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-c1b6acdd-795d-4622-b81e-6bff024f2eec tempest-ServersNegativeTestJSON-1340284216 None] Volume volume-9696163c-b46a-4dff-99b8-15ac21e13208 (9696163c-b46a-4dff-99b8-15ac21e13208): created successfully Mar 12 21:19:21.382131 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c1b6acdd-795d-4622-b81e-6bff024f2eec tempest-ServersNegativeTestJSON-1340284216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0733497-e1cd-4c30-99e4-8cf4fe471871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:19:21.390074 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-c1b6acdd-795d-4622-b81e-6bff024f2eec tempest-ServersNegativeTestJSON-1340284216 None] Flow 'volume_create_manager' (d223bfa7-6595-443e-b782-57936609503e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:19:21.406638 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-c1b6acdd-795d-4622-b81e-6bff024f2eec tempest-ServersNegativeTestJSON-1340284216 None] Created volume successfully. Mar 12 21:19:21.499396 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [None req-631cfd3f-790f-408d-a264-d886ab852c96 tempest-TestVolumeBackupRestore-1490532501 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 21:19:22.242837 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [None req-631cfd3f-790f-408d-a264-d886ab852c96 tempest-TestVolumeBackupRestore-1490532501 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.742s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 21:19:22.243976 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-631cfd3f-790f-408d-a264-d886ab852c96 tempest-TestVolumeBackupRestore-1490532501 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b68846b1-e2e8-4551-9e39-b8fa771ce5ff', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': 'b68846b1-e2e8-4551-9e39-b8fa771ce5ff', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 21:19:22.266467 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-631cfd3f-790f-408d-a264-d886ab852c96 tempest-TestVolumeBackupRestore-1490532501 None] Initialize volume connection completed successfully. Mar 12 21:19:29.737756 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-631cfd3f-790f-408d-a264-d886ab852c96 tempest-TestVolumeBackupRestore-1490532501 None] Terminate volume connection completed successfully. Mar 12 21:19:29.756922 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-631cfd3f-790f-408d-a264-d886ab852c96 tempest-TestVolumeBackupRestore-1490532501 None] Remove volume export completed successfully. Mar 12 21:19:30.845650 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad9dbc4f-fe22-4273-9487-f77e91bbe1f7 tempest-TestVolumeBackupRestore-1490532501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:19:30.856471 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-ad9dbc4f-fe22-4273-9487-f77e91bbe1f7 tempest-TestVolumeBackupRestore-1490532501 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:19:30.860436 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-ad9dbc4f-fe22-4273-9487-f77e91bbe1f7 tempest-TestVolumeBackupRestore-1490532501 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:19:30.880719 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-ad9dbc4f-fe22-4273-9487-f77e91bbe1f7 tempest-TestVolumeBackupRestore-1490532501 None] Flow 'volume_create_manager' (00b30e2d-c5ab-481f-a99f-a5258831ffb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:19:30.888857 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-ad9dbc4f-fe22-4273-9487-f77e91bbe1f7 tempest-TestVolumeBackupRestore-1490532501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eb0c44b-038c-4aed-b96d-cf4344e05a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:19:30.897587 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-ad9dbc4f-fe22-4273-9487-f77e91bbe1f7 tempest-TestVolumeBackupRestore-1490532501 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:19:30.916987 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-ad9dbc4f-fe22-4273-9487-f77e91bbe1f7 tempest-TestVolumeBackupRestore-1490532501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eb0c44b-038c-4aed-b96d-cf4344e05a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:19:31Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_6f2a8acc-32b2-451c-98bb-63cbbae2c432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e5912a2c-aeb4-40f4-a05e-781c6b342f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6a0660e45d4aea9ff4576abd1f0e56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:19:31Z,use_quota=True,user_id='62b74fe4246c415bbb401849ce000f9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:19:30.923336 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-ad9dbc4f-fe22-4273-9487-f77e91bbe1f7 tempest-TestVolumeBackupRestore-1490532501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b7407c2-d8bb-4824-8493-559e94c977d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:19:30.927541 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-ad9dbc4f-fe22-4273-9487-f77e91bbe1f7 tempest-TestVolumeBackupRestore-1490532501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b7407c2-d8bb-4824-8493-559e94c977d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:19:30.932810 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-ad9dbc4f-fe22-4273-9487-f77e91bbe1f7 tempest-TestVolumeBackupRestore-1490532501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a00c0c93-956e-4c51-be86-c4eee23a3f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:19:30.937070 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-ad9dbc4f-fe22-4273-9487-f77e91bbe1f7 tempest-TestVolumeBackupRestore-1490532501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a00c0c93-956e-4c51-be86-c4eee23a3f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5912a2c-aeb4-40f4-a05e-781c6b342f11', 'volume_name': 'volume-e5912a2c-aeb4-40f4-a05e-781c6b342f11', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:19:30.942101 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-ad9dbc4f-fe22-4273-9487-f77e91bbe1f7 tempest-TestVolumeBackupRestore-1490532501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfde6e50-940a-412f-8258-11fc907a2b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:19:30.946314 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-ad9dbc4f-fe22-4273-9487-f77e91bbe1f7 tempest-TestVolumeBackupRestore-1490532501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfde6e50-940a-412f-8258-11fc907a2b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:19:30.951100 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-ad9dbc4f-fe22-4273-9487-f77e91bbe1f7 tempest-TestVolumeBackupRestore-1490532501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d88a39-cd30-418c-a562-5283db50b35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:19:30.952188 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-ad9dbc4f-fe22-4273-9487-f77e91bbe1f7 tempest-TestVolumeBackupRestore-1490532501 None] Volume e5912a2c-aeb4-40f4-a05e-781c6b342f11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5912a2c-aeb4-40f4-a05e-781c6b342f11', 'volume_size': 1} Mar 12 21:19:30.952597 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-ad9dbc4f-fe22-4273-9487-f77e91bbe1f7 tempest-TestVolumeBackupRestore-1490532501 None] creating volume 'volume-e5912a2c-aeb4-40f4-a05e-781c6b342f11' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:19:30.953960 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-ad9dbc4f-fe22-4273-9487-f77e91bbe1f7 tempest-TestVolumeBackupRestore-1490532501 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:19:31.013950 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-ad9dbc4f-fe22-4273-9487-f77e91bbe1f7 tempest-TestVolumeBackupRestore-1490532501 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:19:31.014388 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-ad9dbc4f-fe22-4273-9487-f77e91bbe1f7 tempest-TestVolumeBackupRestore-1490532501 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:19:31.018161 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-ad9dbc4f-fe22-4273-9487-f77e91bbe1f7 tempest-TestVolumeBackupRestore-1490532501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d88a39-cd30-418c-a562-5283db50b35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5912a2c-aeb4-40f4-a05e-781c6b342f11', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:19:31.023499 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-ad9dbc4f-fe22-4273-9487-f77e91bbe1f7 tempest-TestVolumeBackupRestore-1490532501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f7efff5-73dc-4440-9842-a40f8913e190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:19:31.033138 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-ad9dbc4f-fe22-4273-9487-f77e91bbe1f7 tempest-TestVolumeBackupRestore-1490532501 None] Volume volume-e5912a2c-aeb4-40f4-a05e-781c6b342f11 (e5912a2c-aeb4-40f4-a05e-781c6b342f11): created successfully Mar 12 21:19:31.037067 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-ad9dbc4f-fe22-4273-9487-f77e91bbe1f7 tempest-TestVolumeBackupRestore-1490532501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f7efff5-73dc-4440-9842-a40f8913e190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:19:31.042781 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-ad9dbc4f-fe22-4273-9487-f77e91bbe1f7 tempest-TestVolumeBackupRestore-1490532501 None] Flow 'volume_create_manager' (00b30e2d-c5ab-481f-a99f-a5258831ffb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:19:31.053289 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-ad9dbc4f-fe22-4273-9487-f77e91bbe1f7 tempest-TestVolumeBackupRestore-1490532501 None] Created volume successfully. Mar 12 21:19:31.890556 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [None req-ad9dbc4f-fe22-4273-9487-f77e91bbe1f7 tempest-TestVolumeBackupRestore-1490532501 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 21:19:32.528539 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [None req-ad9dbc4f-fe22-4273-9487-f77e91bbe1f7 tempest-TestVolumeBackupRestore-1490532501 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.638s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 21:19:32.529224 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-ad9dbc4f-fe22-4273-9487-f77e91bbe1f7 tempest-TestVolumeBackupRestore-1490532501 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e5912a2c-aeb4-40f4-a05e-781c6b342f11', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': 'e5912a2c-aeb4-40f4-a05e-781c6b342f11', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 21:19:32.544802 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-ad9dbc4f-fe22-4273-9487-f77e91bbe1f7 tempest-TestVolumeBackupRestore-1490532501 None] Initialize volume connection completed successfully. Mar 12 21:19:36.935745 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-ad9dbc4f-fe22-4273-9487-f77e91bbe1f7 tempest-TestVolumeBackupRestore-1490532501 None] Terminate volume connection completed successfully. Mar 12 21:19:36.953011 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-ad9dbc4f-fe22-4273-9487-f77e91bbe1f7 tempest-TestVolumeBackupRestore-1490532501 None] Remove volume export completed successfully. Mar 12 21:19:40.402620 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-f53b5187-d406-4c0d-a700-1dacddd8774e req-1dde6562-0fd9-4fc3-a503-53068108eed2 tempest-TestVolumeBootPattern-1001263199 None] Terminate volume connection completed successfully. Mar 12 21:19:40.403251 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-f53b5187-d406-4c0d-a700-1dacddd8774e req-1dde6562-0fd9-4fc3-a503-53068108eed2 tempest-TestVolumeBootPattern-1001263199 None] Deleting attachment 2be6a627-7f69-4f4c-86b2-58f884c21c57. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 21:19:41.949280 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-9b07d407-3152-4055-b536-887713649d81 req-efeaa8f7-38d9-4ac9-96a3-10d5eea4f7b6 tempest-TestVolumeBackupRestore-1490532501 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 21:19:42.610216 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-9b07d407-3152-4055-b536-887713649d81 req-efeaa8f7-38d9-4ac9-96a3-10d5eea4f7b6 tempest-TestVolumeBackupRestore-1490532501 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.660s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 21:19:42.611052 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-9b07d407-3152-4055-b536-887713649d81 req-efeaa8f7-38d9-4ac9-96a3-10d5eea4f7b6 tempest-TestVolumeBackupRestore-1490532501 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e5912a2c-aeb4-40f4-a05e-781c6b342f11', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': 'e5912a2c-aeb4-40f4-a05e-781c6b342f11', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 21:19:42.642195 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-9b07d407-3152-4055-b536-887713649d81 req-efeaa8f7-38d9-4ac9-96a3-10d5eea4f7b6 tempest-TestVolumeBackupRestore-1490532501 None] Connection info returned from driver {'name': 'volumes/volume-e5912a2c-aeb4-40f4-a05e-781c6b342f11', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e5912a2c-aeb4-40f4-a05e-781c6b342f11', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '786a3c29-9063-44ff-95a7-15566ec1676f'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 21:19:42.724683 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-9b07d407-3152-4055-b536-887713649d81 req-efeaa8f7-38d9-4ac9-96a3-10d5eea4f7b6 tempest-TestVolumeBackupRestore-1490532501 None] attachment_update completed successfully. Mar 12 21:19:43.957408 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-bb0606dd-b58d-4850-9cf7-71f2e5a2d462 req-e325e858-210d-4f1d-b1ce-c5f1475ccf45 tempest-TestVolumeBootPattern-1001263199 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 21:19:44.665150 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-bb0606dd-b58d-4850-9cf7-71f2e5a2d462 req-e325e858-210d-4f1d-b1ce-c5f1475ccf45 tempest-TestVolumeBootPattern-1001263199 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.707s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 21:19:44.665982 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-bb0606dd-b58d-4850-9cf7-71f2e5a2d462 req-e325e858-210d-4f1d-b1ce-c5f1475ccf45 tempest-TestVolumeBootPattern-1001263199 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-feb089af-2825-4985-aa6e-09e75c64231e', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': 'feb089af-2825-4985-aa6e-09e75c64231e', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 21:19:44.702305 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-bb0606dd-b58d-4850-9cf7-71f2e5a2d462 req-e325e858-210d-4f1d-b1ce-c5f1475ccf45 tempest-TestVolumeBootPattern-1001263199 None] Connection info returned from driver {'name': 'volumes/volume-feb089af-2825-4985-aa6e-09e75c64231e', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'feb089af-2825-4985-aa6e-09e75c64231e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '20363558-125a-47fa-8afb-3cc2818fe3cb'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 21:19:44.781646 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-bb0606dd-b58d-4850-9cf7-71f2e5a2d462 req-e325e858-210d-4f1d-b1ce-c5f1475ccf45 tempest-TestVolumeBootPattern-1001263199 None] attachment_update completed successfully. Mar 12 21:19:51.311439 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:19:51.312539 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:19:51.338698 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:19:51.365210 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:20:39.862495 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-ab780e36-4d86-4e84-b32d-7db01767e805 tempest-ServersNegativeTestJSON-1340284216 None] Lock "b'cinder-9696163c-b46a-4dff-99b8-15ac21e13208-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:20:39.900395 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-ab780e36-4d86-4e84-b32d-7db01767e805 tempest-ServersNegativeTestJSON-1340284216 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:20:39.972768 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-ab780e36-4d86-4e84-b32d-7db01767e805 tempest-ServersNegativeTestJSON-1340284216 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:20:39.973258 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-ab780e36-4d86-4e84-b32d-7db01767e805 tempest-ServersNegativeTestJSON-1340284216 None] Volume volume-9696163c-b46a-4dff-99b8-15ac21e13208 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:20:39.986945 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-ab780e36-4d86-4e84-b32d-7db01767e805 tempest-ServersNegativeTestJSON-1340284216 None] deleting rbd volume volume-9696163c-b46a-4dff-99b8-15ac21e13208 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:20:40.193069 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-ab780e36-4d86-4e84-b32d-7db01767e805 tempest-ServersNegativeTestJSON-1340284216 None] Created reservations ['6cb7c0c9-cb99-4ff9-b36b-610f8850784a', '69ae0b9a-79df-492d-83d9-0f5072738701', 'ad0d8cc9-274b-46ec-9f89-50c34de57ea2', '84800d46-d9e1-4cf2-9d1f-2e89a28185f4'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:20:40.246732 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-ab780e36-4d86-4e84-b32d-7db01767e805 tempest-ServersNegativeTestJSON-1340284216 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:20:40.271420 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-ab780e36-4d86-4e84-b32d-7db01767e805 tempest-ServersNegativeTestJSON-1340284216 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:20:40.300979 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-ab780e36-4d86-4e84-b32d-7db01767e805 tempest-ServersNegativeTestJSON-1340284216 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:20:40.305806 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-ab780e36-4d86-4e84-b32d-7db01767e805 tempest-ServersNegativeTestJSON-1340284216 None] Deleted volume successfully. Mar 12 21:20:40.320621 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-ab780e36-4d86-4e84-b32d-7db01767e805 tempest-ServersNegativeTestJSON-1340284216 None] Lock "b'cinder-9696163c-b46a-4dff-99b8-15ac21e13208-delete_volume'" released by "delete_volume" :: held 0.458s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:20:40.983051 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-3905c365-fc93-40bc-b409-ef0a65a5a9db tempest-ServersNegativeTestJSON-1340284216 None] Lock "b'cinder-16b7c90c-67e7-449d-9ad4-cbb9873bb77e-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:20:41.014699 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3905c365-fc93-40bc-b409-ef0a65a5a9db tempest-ServersNegativeTestJSON-1340284216 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:20:41.060591 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3905c365-fc93-40bc-b409-ef0a65a5a9db tempest-ServersNegativeTestJSON-1340284216 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:20:41.061020 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3905c365-fc93-40bc-b409-ef0a65a5a9db tempest-ServersNegativeTestJSON-1340284216 None] Volume volume-16b7c90c-67e7-449d-9ad4-cbb9873bb77e is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:20:41.069555 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3905c365-fc93-40bc-b409-ef0a65a5a9db tempest-ServersNegativeTestJSON-1340284216 None] deleting rbd volume volume-16b7c90c-67e7-449d-9ad4-cbb9873bb77e {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:20:41.328564 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-3905c365-fc93-40bc-b409-ef0a65a5a9db tempest-ServersNegativeTestJSON-1340284216 None] Created reservations ['6e5db894-9867-4ebf-9f25-4731fff7cac9', '47d91f8a-9a98-4e57-9bce-cd8f59da463d', '0c69fefd-ee1f-47e7-8d4b-124146a20073', 'b7a45240-c99b-4d09-8ecc-a8f3c2e90d73'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:20:41.375446 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3905c365-fc93-40bc-b409-ef0a65a5a9db tempest-ServersNegativeTestJSON-1340284216 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:20:41.398196 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3905c365-fc93-40bc-b409-ef0a65a5a9db tempest-ServersNegativeTestJSON-1340284216 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:20:41.426162 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-3905c365-fc93-40bc-b409-ef0a65a5a9db tempest-ServersNegativeTestJSON-1340284216 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:20:41.430530 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-3905c365-fc93-40bc-b409-ef0a65a5a9db tempest-ServersNegativeTestJSON-1340284216 None] Deleted volume successfully. Mar 12 21:20:41.444169 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-3905c365-fc93-40bc-b409-ef0a65a5a9db tempest-ServersNegativeTestJSON-1340284216 None] Lock "b'cinder-16b7c90c-67e7-449d-9ad4-cbb9873bb77e-delete_volume'" released by "delete_volume" :: held 0.461s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:20:47.049807 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-cc64ae76-34f0-418b-bedf-294438e8f695 req-d764726e-7497-4b86-b053-29d31e2b5cda tempest-TestVolumeBackupRestore-1490532501 None] Terminate volume connection completed successfully. Mar 12 21:20:47.050513 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-cc64ae76-34f0-418b-bedf-294438e8f695 req-d764726e-7497-4b86-b053-29d31e2b5cda tempest-TestVolumeBackupRestore-1490532501 None] Deleting attachment 786a3c29-9063-44ff-95a7-15566ec1676f. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 21:20:47.894533 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-d09673b2-b984-4b4c-a599-c4bfa4a65215 tempest-TestVolumeBackupRestore-1490532501 None] Lock "b'cinder-e5912a2c-aeb4-40f4-a05e-781c6b342f11-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:20:47.938231 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d09673b2-b984-4b4c-a599-c4bfa4a65215 tempest-TestVolumeBackupRestore-1490532501 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:20:48.782548 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d09673b2-b984-4b4c-a599-c4bfa4a65215 tempest-TestVolumeBackupRestore-1490532501 None] Volume volume-e5912a2c-aeb4-40f4-a05e-781c6b342f11 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:20:48.812385 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d09673b2-b984-4b4c-a599-c4bfa4a65215 tempest-TestVolumeBackupRestore-1490532501 None] deleting rbd volume volume-e5912a2c-aeb4-40f4-a05e-781c6b342f11 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:20:48.832639 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-a319c1ee-2b55-4123-976f-3dc411303779 tempest-TestVolumeBackupRestore-1490532501 None] Lock "b'cinder-b68846b1-e2e8-4551-9e39-b8fa771ce5ff-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:20:48.874339 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a319c1ee-2b55-4123-976f-3dc411303779 tempest-TestVolumeBackupRestore-1490532501 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:20:49.848772 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a319c1ee-2b55-4123-976f-3dc411303779 tempest-TestVolumeBackupRestore-1490532501 None] deleting rbd volume volume-b68846b1-e2e8-4551-9e39-b8fa771ce5ff {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:20:49.893650 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-d09673b2-b984-4b4c-a599-c4bfa4a65215 tempest-TestVolumeBackupRestore-1490532501 None] Created reservations ['47980c73-1fa5-48c1-acc3-d7fb6454f2ac', 'f8799248-0d22-4379-bfb4-bc8dabb0a7e8', '910c8c98-fdad-4c94-b1fb-82f577ce62cf', 'f192e1d5-23ea-41a0-a433-218ec5d5be49'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:20:49.950591 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d09673b2-b984-4b4c-a599-c4bfa4a65215 tempest-TestVolumeBackupRestore-1490532501 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:20:49.989336 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d09673b2-b984-4b4c-a599-c4bfa4a65215 tempest-TestVolumeBackupRestore-1490532501 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:20:50.027365 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-d09673b2-b984-4b4c-a599-c4bfa4a65215 tempest-TestVolumeBackupRestore-1490532501 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:20:50.038582 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-d09673b2-b984-4b4c-a599-c4bfa4a65215 tempest-TestVolumeBackupRestore-1490532501 None] Deleted volume successfully. Mar 12 21:20:50.056074 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-d09673b2-b984-4b4c-a599-c4bfa4a65215 tempest-TestVolumeBackupRestore-1490532501 None] Lock "b'cinder-e5912a2c-aeb4-40f4-a05e-781c6b342f11-delete_volume'" released by "delete_volume" :: held 2.160s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:20:50.208247 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a319c1ee-2b55-4123-976f-3dc411303779 tempest-TestVolumeBackupRestore-1490532501 None] volume is a clone so cleaning references {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Mar 12 21:20:50.259026 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a319c1ee-2b55-4123-976f-3dc411303779 tempest-TestVolumeBackupRestore-1490532501 None] deleting parent snapshot volume-b68846b1-e2e8-4551-9e39-b8fa771ce5ff.clone_snap {{(pid=129531) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Mar 12 21:20:50.890139 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-a319c1ee-2b55-4123-976f-3dc411303779 tempest-TestVolumeBackupRestore-1490532501 None] Created reservations ['5f486a24-c1da-43b7-a69a-0cd99e908ba2', '4bfebd02-07c9-43a0-86db-a0a3ac8182cc', '150561f5-c248-469d-8d20-d9b50108d08a', '859ac82d-0695-49b3-839b-b94e226f43d9'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:20:50.945444 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a319c1ee-2b55-4123-976f-3dc411303779 tempest-TestVolumeBackupRestore-1490532501 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:20:50.975391 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a319c1ee-2b55-4123-976f-3dc411303779 tempest-TestVolumeBackupRestore-1490532501 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:20:51.007821 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a319c1ee-2b55-4123-976f-3dc411303779 tempest-TestVolumeBackupRestore-1490532501 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:20:51.012791 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-a319c1ee-2b55-4123-976f-3dc411303779 tempest-TestVolumeBackupRestore-1490532501 None] Deleted volume successfully. Mar 12 21:20:51.025045 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-a319c1ee-2b55-4123-976f-3dc411303779 tempest-TestVolumeBackupRestore-1490532501 None] Lock "b'cinder-b68846b1-e2e8-4551-9e39-b8fa771ce5ff-delete_volume'" released by "delete_volume" :: held 2.193s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:20:51.310646 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:20:51.311393 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:20:51.345442 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:20:51.390838 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:21:39.658705 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-d6430115-643b-40b9-b34c-93b8e3435cf2 tempest-TestVolumeBootPattern-1001263199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:21:40.813174 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-d6430115-643b-40b9-b34c-93b8e3435cf2 tempest-TestVolumeBootPattern-1001263199 None] Create snapshot completed successfully Mar 12 21:21:42.092131 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a735669-64f3-4d13-9401-5e499924a992 tempest-TestVolumeBootPattern-1001263199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:21:42.096300 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-0a735669-64f3-4d13-9401-5e499924a992 tempest-TestVolumeBootPattern-1001263199 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:21:42.096842 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-0a735669-64f3-4d13-9401-5e499924a992 tempest-TestVolumeBootPattern-1001263199 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:21:42.126491 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0a735669-64f3-4d13-9401-5e499924a992 tempest-TestVolumeBootPattern-1001263199 None] Flow 'volume_create_manager' (61b91cd7-b621-4156-9868-bb7ff2538c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:21:42.135538 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0a735669-64f3-4d13-9401-5e499924a992 tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbb441e7-54b4-4739-873e-4e2e50212f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:21:42.144243 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-0a735669-64f3-4d13-9401-5e499924a992 tempest-TestVolumeBootPattern-1001263199 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:21:42.161117 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0a735669-64f3-4d13-9401-5e499924a992 tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbb441e7-54b4-4739-873e-4e2e50212f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-249480107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=173c91e0-dfb4-4b99-9b0f-7ae1f06598da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62f54fe17dd142b4be6d7d09de31d63b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0f010416-9985-4dc8-9bea-9f5dbced4850,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:21:42Z,use_quota=True,user_id='284a1908713c4b74a35a1d3b5cd10e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:21:42.166864 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0a735669-64f3-4d13-9401-5e499924a992 tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d50419-b201-4b53-a305-80c5fd4b271f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:21:42.171857 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0a735669-64f3-4d13-9401-5e499924a992 tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d50419-b201-4b53-a305-80c5fd4b271f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:21:42.178025 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0a735669-64f3-4d13-9401-5e499924a992 tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d022c420-e119-4d2c-b629-088f6cfc0483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:21:42.182355 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0a735669-64f3-4d13-9401-5e499924a992 tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d022c420-e119-4d2c-b629-088f6cfc0483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '173c91e0-dfb4-4b99-9b0f-7ae1f06598da', 'volume_name': 'volume-173c91e0-dfb4-4b99-9b0f-7ae1f06598da', 'volume_size': 1, 'snapshot_id': '0f010416-9985-4dc8-9bea-9f5dbced4850'}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:21:42.187952 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0a735669-64f3-4d13-9401-5e499924a992 tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (937adf32-d4d2-48d9-a915-c08d1df0a50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:21:42.192987 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0a735669-64f3-4d13-9401-5e499924a992 tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (937adf32-d4d2-48d9-a915-c08d1df0a50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:21:42.198209 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0a735669-64f3-4d13-9401-5e499924a992 tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53161535-c6de-4416-b77e-569083bd3af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:21:42.199331 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-0a735669-64f3-4d13-9401-5e499924a992 tempest-TestVolumeBootPattern-1001263199 None] Volume 173c91e0-dfb4-4b99-9b0f-7ae1f06598da: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-173c91e0-dfb4-4b99-9b0f-7ae1f06598da', 'volume_size': 1, 'snapshot_id': '0f010416-9985-4dc8-9bea-9f5dbced4850'} Mar 12 21:21:42.221118 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-0a735669-64f3-4d13-9401-5e499924a992 tempest-TestVolumeBootPattern-1001263199 None] cloning volumes/volume-feb089af-2825-4985-aa6e-09e75c64231e@snapshot-0f010416-9985-4dc8-9bea-9f5dbced4850 to volume-173c91e0-dfb4-4b99-9b0f-7ae1f06598da {{(pid=129531) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1090}} Mar 12 21:21:42.221680 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-0a735669-64f3-4d13-9401-5e499924a992 tempest-TestVolumeBootPattern-1001263199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:21:42.298599 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-0a735669-64f3-4d13-9401-5e499924a992 tempest-TestVolumeBootPattern-1001263199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:21:42.471219 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-0a735669-64f3-4d13-9401-5e499924a992 tempest-TestVolumeBootPattern-1001263199 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:21:42.471845 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-0a735669-64f3-4d13-9401-5e499924a992 tempest-TestVolumeBootPattern-1001263199 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:21:42.500176 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.volume_utils [None req-0a735669-64f3-4d13-9401-5e499924a992 tempest-TestVolumeBootPattern-1001263199 None] Marking volume 173c91e0-dfb4-4b99-9b0f-7ae1f06598da as bootable. {{(pid=129531) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 12 21:21:42.508676 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a735669-64f3-4d13-9401-5e499924a992 tempest-TestVolumeBootPattern-1001263199 None] Copying metadata from snapshot 0f010416-9985-4dc8-9bea-9f5dbced4850 to 173c91e0-dfb4-4b99-9b0f-7ae1f06598da. {{(pid=129531) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:422}} Mar 12 21:21:42.545796 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0a735669-64f3-4d13-9401-5e499924a992 tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53161535-c6de-4416-b77e-569083bd3af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-173c91e0-dfb4-4b99-9b0f-7ae1f06598da', 'volume_size': 1, 'snapshot_id': '0f010416-9985-4dc8-9bea-9f5dbced4850'}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:21:42.551258 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0a735669-64f3-4d13-9401-5e499924a992 tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (708531ce-a1ec-4845-933f-9e5a4c39bf6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:21:42.560640 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-0a735669-64f3-4d13-9401-5e499924a992 tempest-TestVolumeBootPattern-1001263199 None] Volume volume-173c91e0-dfb4-4b99-9b0f-7ae1f06598da (173c91e0-dfb4-4b99-9b0f-7ae1f06598da): created successfully Mar 12 21:21:42.564391 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0a735669-64f3-4d13-9401-5e499924a992 tempest-TestVolumeBootPattern-1001263199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (708531ce-a1ec-4845-933f-9e5a4c39bf6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:21:42.570897 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-0a735669-64f3-4d13-9401-5e499924a992 tempest-TestVolumeBootPattern-1001263199 None] Flow 'volume_create_manager' (61b91cd7-b621-4156-9868-bb7ff2538c7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:21:42.584779 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-0a735669-64f3-4d13-9401-5e499924a992 tempest-TestVolumeBootPattern-1001263199 None] Created volume successfully. Mar 12 21:21:45.402278 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-89136318-c3d6-4e95-9045-f2bebdde192c req-84da3edb-5dfc-486e-aa29-a3637644b9a4 tempest-TestVolumeBootPattern-1001263199 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 21:21:46.825208 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-89136318-c3d6-4e95-9045-f2bebdde192c req-84da3edb-5dfc-486e-aa29-a3637644b9a4 tempest-TestVolumeBootPattern-1001263199 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.423s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 21:21:46.825965 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-89136318-c3d6-4e95-9045-f2bebdde192c req-84da3edb-5dfc-486e-aa29-a3637644b9a4 tempest-TestVolumeBootPattern-1001263199 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-173c91e0-dfb4-4b99-9b0f-7ae1f06598da', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': '173c91e0-dfb4-4b99-9b0f-7ae1f06598da', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 21:21:46.859153 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-89136318-c3d6-4e95-9045-f2bebdde192c req-84da3edb-5dfc-486e-aa29-a3637644b9a4 tempest-TestVolumeBootPattern-1001263199 None] Connection info returned from driver {'name': 'volumes/volume-173c91e0-dfb4-4b99-9b0f-7ae1f06598da', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '173c91e0-dfb4-4b99-9b0f-7ae1f06598da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '1da223bb-db52-4689-ac26-b475e76f377f'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 21:21:46.930360 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-89136318-c3d6-4e95-9045-f2bebdde192c req-84da3edb-5dfc-486e-aa29-a3637644b9a4 tempest-TestVolumeBootPattern-1001263199 None] attachment_update completed successfully. Mar 12 21:21:51.311675 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:21:51.312868 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:21:51.344522 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:21:51.384887 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:22:51.310714 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:22:51.311924 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:22:51.386313 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:22:51.500013 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:23:15.212482 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-002dce40-a978-4fb4-ad8f-def698e9c30d tempest-VolumesServicesTestJSON-528880900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:23:15.216400 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-002dce40-a978-4fb4-ad8f-def698e9c30d tempest-VolumesServicesTestJSON-528880900 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:23:15.216894 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-002dce40-a978-4fb4-ad8f-def698e9c30d tempest-VolumesServicesTestJSON-528880900 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:23:15.240015 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-002dce40-a978-4fb4-ad8f-def698e9c30d tempest-VolumesServicesTestJSON-528880900 None] Flow 'volume_create_manager' (54614c9f-a5f6-4c1b-a90a-08345f13ba87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:23:15.246997 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-002dce40-a978-4fb4-ad8f-def698e9c30d tempest-VolumesServicesTestJSON-528880900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a47d2ac8-5abf-493f-9e41-34ca56007b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:15.253649 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-002dce40-a978-4fb4-ad8f-def698e9c30d tempest-VolumesServicesTestJSON-528880900 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:23:15.268100 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-002dce40-a978-4fb4-ad8f-def698e9c30d tempest-VolumesServicesTestJSON-528880900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a47d2ac8-5abf-493f-9e41-34ca56007b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-838140516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9f560885-7b61-4df7-b6f8-cadaa42b0533,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad35e7768ea74451a40ece069151432c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:23:15Z,use_quota=True,user_id='1069d12137de4872aac28783bf75a08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:15.273616 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-002dce40-a978-4fb4-ad8f-def698e9c30d tempest-VolumesServicesTestJSON-528880900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b589120-3a81-401a-9847-949bf6e01eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:15.277782 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-002dce40-a978-4fb4-ad8f-def698e9c30d tempest-VolumesServicesTestJSON-528880900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b589120-3a81-401a-9847-949bf6e01eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:15.283606 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-002dce40-a978-4fb4-ad8f-def698e9c30d tempest-VolumesServicesTestJSON-528880900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8766b82d-3157-48eb-814f-430389c63a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:15.287861 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-002dce40-a978-4fb4-ad8f-def698e9c30d tempest-VolumesServicesTestJSON-528880900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8766b82d-3157-48eb-814f-430389c63a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f560885-7b61-4df7-b6f8-cadaa42b0533', 'volume_name': 'volume-9f560885-7b61-4df7-b6f8-cadaa42b0533', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:15.293113 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-002dce40-a978-4fb4-ad8f-def698e9c30d tempest-VolumesServicesTestJSON-528880900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ebdb930-8a46-4722-ba11-777aec7672d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:15.297168 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-002dce40-a978-4fb4-ad8f-def698e9c30d tempest-VolumesServicesTestJSON-528880900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ebdb930-8a46-4722-ba11-777aec7672d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:15.302019 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-002dce40-a978-4fb4-ad8f-def698e9c30d tempest-VolumesServicesTestJSON-528880900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13fc91a2-4c9c-482b-aaa6-f6f905e24c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:15.303101 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-002dce40-a978-4fb4-ad8f-def698e9c30d tempest-VolumesServicesTestJSON-528880900 None] Volume 9f560885-7b61-4df7-b6f8-cadaa42b0533: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f560885-7b61-4df7-b6f8-cadaa42b0533', 'volume_size': 1} Mar 12 21:23:15.303496 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-002dce40-a978-4fb4-ad8f-def698e9c30d tempest-VolumesServicesTestJSON-528880900 None] creating volume 'volume-9f560885-7b61-4df7-b6f8-cadaa42b0533' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:23:15.304487 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-002dce40-a978-4fb4-ad8f-def698e9c30d tempest-VolumesServicesTestJSON-528880900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:23:15.357035 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-002dce40-a978-4fb4-ad8f-def698e9c30d tempest-VolumesServicesTestJSON-528880900 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:23:15.357410 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-002dce40-a978-4fb4-ad8f-def698e9c30d tempest-VolumesServicesTestJSON-528880900 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:23:15.361198 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-002dce40-a978-4fb4-ad8f-def698e9c30d tempest-VolumesServicesTestJSON-528880900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13fc91a2-4c9c-482b-aaa6-f6f905e24c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f560885-7b61-4df7-b6f8-cadaa42b0533', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:15.365959 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-002dce40-a978-4fb4-ad8f-def698e9c30d tempest-VolumesServicesTestJSON-528880900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (460933f7-0263-4e35-b8a2-35a5875d3ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:15.374878 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-002dce40-a978-4fb4-ad8f-def698e9c30d tempest-VolumesServicesTestJSON-528880900 None] Volume volume-9f560885-7b61-4df7-b6f8-cadaa42b0533 (9f560885-7b61-4df7-b6f8-cadaa42b0533): created successfully Mar 12 21:23:15.379081 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-002dce40-a978-4fb4-ad8f-def698e9c30d tempest-VolumesServicesTestJSON-528880900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (460933f7-0263-4e35-b8a2-35a5875d3ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:15.384851 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-002dce40-a978-4fb4-ad8f-def698e9c30d tempest-VolumesServicesTestJSON-528880900 None] Flow 'volume_create_manager' (54614c9f-a5f6-4c1b-a90a-08345f13ba87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:23:15.393978 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-002dce40-a978-4fb4-ad8f-def698e9c30d tempest-VolumesServicesTestJSON-528880900 None] Created volume successfully. Mar 12 21:23:16.355626 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-5cfa1325-af33-4827-9272-b187aea10a3e tempest-VolumesServicesTestJSON-528880900 None] Lock "b'cinder-9f560885-7b61-4df7-b6f8-cadaa42b0533-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:23:16.386322 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-5cfa1325-af33-4827-9272-b187aea10a3e tempest-VolumesServicesTestJSON-528880900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:23:16.422533 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-5cfa1325-af33-4827-9272-b187aea10a3e tempest-VolumesServicesTestJSON-528880900 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:23:16.422900 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-5cfa1325-af33-4827-9272-b187aea10a3e tempest-VolumesServicesTestJSON-528880900 None] Volume volume-9f560885-7b61-4df7-b6f8-cadaa42b0533 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:23:16.428773 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-5cfa1325-af33-4827-9272-b187aea10a3e tempest-VolumesServicesTestJSON-528880900 None] deleting rbd volume volume-9f560885-7b61-4df7-b6f8-cadaa42b0533 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:23:16.612766 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-5cfa1325-af33-4827-9272-b187aea10a3e tempest-VolumesServicesTestJSON-528880900 None] Created reservations ['e771e871-c664-4e87-bc97-cee2069eaf88', 'f00dc1e9-8352-4c05-80f6-ffe8b471b662', '30061a34-a2e3-4eac-9d53-364ab3f0cfac', '07906bb9-f9af-4381-a5f5-972feb1fe35e'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:23:16.654072 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-5cfa1325-af33-4827-9272-b187aea10a3e tempest-VolumesServicesTestJSON-528880900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:23:16.676556 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-5cfa1325-af33-4827-9272-b187aea10a3e tempest-VolumesServicesTestJSON-528880900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:23:16.698875 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-5cfa1325-af33-4827-9272-b187aea10a3e tempest-VolumesServicesTestJSON-528880900 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:23:16.702967 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-5cfa1325-af33-4827-9272-b187aea10a3e tempest-VolumesServicesTestJSON-528880900 None] Deleted volume successfully. Mar 12 21:23:16.717986 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-5cfa1325-af33-4827-9272-b187aea10a3e tempest-VolumesServicesTestJSON-528880900 None] Lock "b'cinder-9f560885-7b61-4df7-b6f8-cadaa42b0533-delete_volume'" released by "delete_volume" :: held 0.362s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:23:36.984148 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-43d80b85-59cb-4f54-b874-8102cdee6cc3 tempest-VolumesActionsTest-2007513843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:23:36.987851 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-43d80b85-59cb-4f54-b874-8102cdee6cc3 tempest-VolumesActionsTest-2007513843 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:23:36.988285 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-43d80b85-59cb-4f54-b874-8102cdee6cc3 tempest-VolumesActionsTest-2007513843 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:23:37.008366 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-43d80b85-59cb-4f54-b874-8102cdee6cc3 tempest-VolumesActionsTest-2007513843 None] Flow 'volume_create_manager' (9600393e-d7b2-4d15-a031-03df1a80b49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:23:37.015314 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-43d80b85-59cb-4f54-b874-8102cdee6cc3 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf76ea23-db54-4d42-913a-5d8a0e7b8c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:37.021518 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-43d80b85-59cb-4f54-b874-8102cdee6cc3 tempest-VolumesActionsTest-2007513843 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:23:37.035633 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-43d80b85-59cb-4f54-b874-8102cdee6cc3 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf76ea23-db54-4d42-913a-5d8a0e7b8c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-697339170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=806ca786-25b3-4fcc-8ff2-aacdd63e713d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f6671ee1ef84f14bfc9ad7998fc2398',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:23:37Z,use_quota=True,user_id='f7685737370a493596376a744d5fb4b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:37.041416 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-43d80b85-59cb-4f54-b874-8102cdee6cc3 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (398691df-f17e-4036-a93e-3b624c0f59f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:37.045574 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-43d80b85-59cb-4f54-b874-8102cdee6cc3 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (398691df-f17e-4036-a93e-3b624c0f59f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:37.051306 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-43d80b85-59cb-4f54-b874-8102cdee6cc3 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33961909-b6fe-4780-8a25-504961fd97e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:37.055501 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-43d80b85-59cb-4f54-b874-8102cdee6cc3 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33961909-b6fe-4780-8a25-504961fd97e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '806ca786-25b3-4fcc-8ff2-aacdd63e713d', 'volume_name': 'volume-806ca786-25b3-4fcc-8ff2-aacdd63e713d', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:37.060483 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-43d80b85-59cb-4f54-b874-8102cdee6cc3 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f600738d-db35-49d6-bd88-e4b3172332a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:37.064527 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-43d80b85-59cb-4f54-b874-8102cdee6cc3 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f600738d-db35-49d6-bd88-e4b3172332a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:37.069268 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-43d80b85-59cb-4f54-b874-8102cdee6cc3 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (425f5ed0-f33c-4a80-876a-49486404f8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:37.070354 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-43d80b85-59cb-4f54-b874-8102cdee6cc3 tempest-VolumesActionsTest-2007513843 None] Volume 806ca786-25b3-4fcc-8ff2-aacdd63e713d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-806ca786-25b3-4fcc-8ff2-aacdd63e713d', 'volume_size': 1} Mar 12 21:23:37.070736 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-43d80b85-59cb-4f54-b874-8102cdee6cc3 tempest-VolumesActionsTest-2007513843 None] creating volume 'volume-806ca786-25b3-4fcc-8ff2-aacdd63e713d' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:23:37.071708 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-43d80b85-59cb-4f54-b874-8102cdee6cc3 tempest-VolumesActionsTest-2007513843 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:23:37.122590 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-43d80b85-59cb-4f54-b874-8102cdee6cc3 tempest-VolumesActionsTest-2007513843 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:23:37.122969 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-43d80b85-59cb-4f54-b874-8102cdee6cc3 tempest-VolumesActionsTest-2007513843 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:23:37.126791 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-43d80b85-59cb-4f54-b874-8102cdee6cc3 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (425f5ed0-f33c-4a80-876a-49486404f8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-806ca786-25b3-4fcc-8ff2-aacdd63e713d', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:37.131588 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-43d80b85-59cb-4f54-b874-8102cdee6cc3 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (756f154e-259f-4cc8-af4f-d6fbbe052d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:37.140357 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-43d80b85-59cb-4f54-b874-8102cdee6cc3 tempest-VolumesActionsTest-2007513843 None] Volume volume-806ca786-25b3-4fcc-8ff2-aacdd63e713d (806ca786-25b3-4fcc-8ff2-aacdd63e713d): created successfully Mar 12 21:23:37.144066 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-43d80b85-59cb-4f54-b874-8102cdee6cc3 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (756f154e-259f-4cc8-af4f-d6fbbe052d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:37.149644 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-43d80b85-59cb-4f54-b874-8102cdee6cc3 tempest-VolumesActionsTest-2007513843 None] Flow 'volume_create_manager' (9600393e-d7b2-4d15-a031-03df1a80b49e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:23:37.159202 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-43d80b85-59cb-4f54-b874-8102cdee6cc3 tempest-VolumesActionsTest-2007513843 None] Created volume successfully. Mar 12 21:23:38.037751 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-d4d9c4a4-ed9e-4a6f-ac91-fac6538ba2e2 tempest-VolumesActionsTest-2007513843 None] Lock "b'cinder-806ca786-25b3-4fcc-8ff2-aacdd63e713d'" acquired by "attach_volume" :: waited 0.009s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:23:38.076500 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-d4d9c4a4-ed9e-4a6f-ac91-fac6538ba2e2 tempest-VolumesActionsTest-2007513843 None] Attaching volume 806ca786-25b3-4fcc-8ff2-aacdd63e713d to instance fc60117a-c031-4145-8525-202f717ad781 at mountpoint /dev/sdb on host None. Mar 12 21:23:38.098490 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-d4d9c4a4-ed9e-4a6f-ac91-fac6538ba2e2 tempest-VolumesActionsTest-2007513843 None] Attach volume completed successfully. Mar 12 21:23:38.102860 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-d4d9c4a4-ed9e-4a6f-ac91-fac6538ba2e2 tempest-VolumesActionsTest-2007513843 None] Lock "b'cinder-806ca786-25b3-4fcc-8ff2-aacdd63e713d'" released by "attach_volume" :: held 0.065s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:23:38.471899 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-fd074cdc-53ba-43b6-8bc5-0c1435fb13e1 tempest-VolumesActionsTest-164651436 None] Terminate volume connection completed successfully. Mar 12 21:23:38.499655 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-fd074cdc-53ba-43b6-8bc5-0c1435fb13e1 tempest-VolumesActionsTest-164651436 None] Lock "b'cinder-806ca786-25b3-4fcc-8ff2-aacdd63e713d-detach_volume'" acquired by "detach_volume" :: waited 0.008s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:23:38.512165 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-fd074cdc-53ba-43b6-8bc5-0c1435fb13e1 tempest-VolumesActionsTest-164651436 None] Detaching volume 806ca786-25b3-4fcc-8ff2-aacdd63e713d from instance fc60117a-c031-4145-8525-202f717ad781. Mar 12 21:23:38.538794 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-fd074cdc-53ba-43b6-8bc5-0c1435fb13e1 tempest-VolumesActionsTest-164651436 None] Detach volume completed successfully. Mar 12 21:23:38.543178 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-fd074cdc-53ba-43b6-8bc5-0c1435fb13e1 tempest-VolumesActionsTest-164651436 None] Lock "b'cinder-806ca786-25b3-4fcc-8ff2-aacdd63e713d-detach_volume'" released by "detach_volume" :: held 0.044s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:23:38.680603 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-34d011fd-4199-4238-bb71-597747c6c34b tempest-VolumesActionsTest-2007513843 None] Lock "b'cinder-806ca786-25b3-4fcc-8ff2-aacdd63e713d-detach_volume'" acquired by "detach_volume" :: waited 0.008s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:23:38.681021 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-34d011fd-4199-4238-bb71-597747c6c34b tempest-VolumesActionsTest-2007513843 None] Volume detach called, but volume not attached. Mar 12 21:23:38.691807 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-34d011fd-4199-4238-bb71-597747c6c34b tempest-VolumesActionsTest-2007513843 None] Lock "b'cinder-806ca786-25b3-4fcc-8ff2-aacdd63e713d-detach_volume'" released by "detach_volume" :: held 0.011s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:23:41.554605 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-b56d7b18-7ea5-4bf4-ad1b-4877d91a55e4 tempest-VolumesActionsTest-2007513843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:23:41.557790 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-b56d7b18-7ea5-4bf4-ad1b-4877d91a55e4 tempest-VolumesActionsTest-2007513843 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:23:41.558233 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-b56d7b18-7ea5-4bf4-ad1b-4877d91a55e4 tempest-VolumesActionsTest-2007513843 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:23:41.577580 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b56d7b18-7ea5-4bf4-ad1b-4877d91a55e4 tempest-VolumesActionsTest-2007513843 None] Flow 'volume_create_manager' (ed97a300-1b05-4bbb-8423-6ed21228304b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:23:41.584220 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b56d7b18-7ea5-4bf4-ad1b-4877d91a55e4 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f223f2cb-1118-48f5-b048-33f1faa309d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:41.590591 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-b56d7b18-7ea5-4bf4-ad1b-4877d91a55e4 tempest-VolumesActionsTest-2007513843 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:23:41.605163 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b56d7b18-7ea5-4bf4-ad1b-4877d91a55e4 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f223f2cb-1118-48f5-b048-33f1faa309d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-819379558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5d9287ef-d9f9-4484-8b81-829bce040eb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f6671ee1ef84f14bfc9ad7998fc2398',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:23:42Z,use_quota=True,user_id='f7685737370a493596376a744d5fb4b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:41.611300 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b56d7b18-7ea5-4bf4-ad1b-4877d91a55e4 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44f47a91-2093-42bb-847c-97691a9c41f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:41.615530 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b56d7b18-7ea5-4bf4-ad1b-4877d91a55e4 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44f47a91-2093-42bb-847c-97691a9c41f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:41.620815 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b56d7b18-7ea5-4bf4-ad1b-4877d91a55e4 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7c44d5e-be13-423d-a95c-0d706eee1efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:41.625096 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b56d7b18-7ea5-4bf4-ad1b-4877d91a55e4 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7c44d5e-be13-423d-a95c-0d706eee1efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d9287ef-d9f9-4484-8b81-829bce040eb9', 'volume_name': 'volume-5d9287ef-d9f9-4484-8b81-829bce040eb9', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:41.630238 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b56d7b18-7ea5-4bf4-ad1b-4877d91a55e4 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (638e1b87-37d6-40d5-bc45-5c2976fb44fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:41.634336 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b56d7b18-7ea5-4bf4-ad1b-4877d91a55e4 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (638e1b87-37d6-40d5-bc45-5c2976fb44fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:41.639165 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b56d7b18-7ea5-4bf4-ad1b-4877d91a55e4 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2112bf0f-91fd-488f-8400-99b8537f4afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:41.640257 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-b56d7b18-7ea5-4bf4-ad1b-4877d91a55e4 tempest-VolumesActionsTest-2007513843 None] Volume 5d9287ef-d9f9-4484-8b81-829bce040eb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d9287ef-d9f9-4484-8b81-829bce040eb9', 'volume_size': 1} Mar 12 21:23:41.640657 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b56d7b18-7ea5-4bf4-ad1b-4877d91a55e4 tempest-VolumesActionsTest-2007513843 None] creating volume 'volume-5d9287ef-d9f9-4484-8b81-829bce040eb9' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:23:41.641735 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b56d7b18-7ea5-4bf4-ad1b-4877d91a55e4 tempest-VolumesActionsTest-2007513843 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:23:41.697917 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b56d7b18-7ea5-4bf4-ad1b-4877d91a55e4 tempest-VolumesActionsTest-2007513843 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:23:41.698299 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b56d7b18-7ea5-4bf4-ad1b-4877d91a55e4 tempest-VolumesActionsTest-2007513843 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:23:41.702120 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b56d7b18-7ea5-4bf4-ad1b-4877d91a55e4 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2112bf0f-91fd-488f-8400-99b8537f4afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d9287ef-d9f9-4484-8b81-829bce040eb9', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:41.706884 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b56d7b18-7ea5-4bf4-ad1b-4877d91a55e4 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3487dc6-615c-45b1-934b-0476ce7a4f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:41.715532 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-b56d7b18-7ea5-4bf4-ad1b-4877d91a55e4 tempest-VolumesActionsTest-2007513843 None] Volume volume-5d9287ef-d9f9-4484-8b81-829bce040eb9 (5d9287ef-d9f9-4484-8b81-829bce040eb9): created successfully Mar 12 21:23:41.719270 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b56d7b18-7ea5-4bf4-ad1b-4877d91a55e4 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3487dc6-615c-45b1-934b-0476ce7a4f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:41.725446 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-b56d7b18-7ea5-4bf4-ad1b-4877d91a55e4 tempest-VolumesActionsTest-2007513843 None] Flow 'volume_create_manager' (ed97a300-1b05-4bbb-8423-6ed21228304b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:23:41.732647 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-b56d7b18-7ea5-4bf4-ad1b-4877d91a55e4 tempest-VolumesActionsTest-2007513843 None] Created volume successfully. Mar 12 21:23:42.726353 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-22d55318-5de9-459b-9992-0787cca49af0 tempest-VolumesActionsTest-164651436 None] Lock "b'cinder-5d9287ef-d9f9-4484-8b81-829bce040eb9-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:23:42.750732 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-22d55318-5de9-459b-9992-0787cca49af0 tempest-VolumesActionsTest-164651436 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:23:42.788380 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-22d55318-5de9-459b-9992-0787cca49af0 tempest-VolumesActionsTest-164651436 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:23:42.788813 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-22d55318-5de9-459b-9992-0787cca49af0 tempest-VolumesActionsTest-164651436 None] Volume volume-5d9287ef-d9f9-4484-8b81-829bce040eb9 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:23:42.794018 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-22d55318-5de9-459b-9992-0787cca49af0 tempest-VolumesActionsTest-164651436 None] deleting rbd volume volume-5d9287ef-d9f9-4484-8b81-829bce040eb9 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:23:42.980503 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-22d55318-5de9-459b-9992-0787cca49af0 tempest-VolumesActionsTest-164651436 None] Created reservations ['8d017e9e-8736-412b-9f2f-4268bfc87f8a', '65db92a2-059b-45c8-9db1-76df6e35d991', 'dd94bfe8-0648-4700-979a-128874163454', '3e99907d-5cb3-45ee-82a0-d4001adba26f'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:23:43.021795 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-22d55318-5de9-459b-9992-0787cca49af0 tempest-VolumesActionsTest-164651436 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:23:43.043792 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-22d55318-5de9-459b-9992-0787cca49af0 tempest-VolumesActionsTest-164651436 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:23:43.070197 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-22d55318-5de9-459b-9992-0787cca49af0 tempest-VolumesActionsTest-164651436 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:23:43.074408 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-22d55318-5de9-459b-9992-0787cca49af0 tempest-VolumesActionsTest-164651436 None] Deleted volume successfully. Mar 12 21:23:43.086245 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-22d55318-5de9-459b-9992-0787cca49af0 tempest-VolumesActionsTest-164651436 None] Lock "b'cinder-5d9287ef-d9f9-4484-8b81-829bce040eb9-delete_volume'" released by "delete_volume" :: held 0.360s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:23:44.080577 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc1187da-a6c9-496a-a852-c88092bb52ff tempest-VolumesActionsTest-2007513843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:23:44.083811 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-cc1187da-a6c9-496a-a852-c88092bb52ff tempest-VolumesActionsTest-2007513843 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:23:44.084259 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-cc1187da-a6c9-496a-a852-c88092bb52ff tempest-VolumesActionsTest-2007513843 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:23:44.103408 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-cc1187da-a6c9-496a-a852-c88092bb52ff tempest-VolumesActionsTest-2007513843 None] Flow 'volume_create_manager' (ef3f6cdb-2171-43e4-b08e-8b274fb0d41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:23:44.110497 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-cc1187da-a6c9-496a-a852-c88092bb52ff tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6986f61b-d264-40b8-b00b-24ec1dcb8abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:44.117621 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-cc1187da-a6c9-496a-a852-c88092bb52ff tempest-VolumesActionsTest-2007513843 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:23:44.131371 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-cc1187da-a6c9-496a-a852-c88092bb52ff tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6986f61b-d264-40b8-b00b-24ec1dcb8abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1780717956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=40f3e1a7-0a4b-40f1-a4fb-4852266e8dfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f6671ee1ef84f14bfc9ad7998fc2398',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:23:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:23:44Z,use_quota=True,user_id='f7685737370a493596376a744d5fb4b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:44.136924 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-cc1187da-a6c9-496a-a852-c88092bb52ff tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (319515c4-98e3-4143-879d-5a382e574786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:44.141164 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-cc1187da-a6c9-496a-a852-c88092bb52ff tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (319515c4-98e3-4143-879d-5a382e574786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:44.146469 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-cc1187da-a6c9-496a-a852-c88092bb52ff tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a257b6a6-72c4-4278-ad5a-58fba4811632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:44.150731 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-cc1187da-a6c9-496a-a852-c88092bb52ff tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a257b6a6-72c4-4278-ad5a-58fba4811632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40f3e1a7-0a4b-40f1-a4fb-4852266e8dfa', 'volume_name': 'volume-40f3e1a7-0a4b-40f1-a4fb-4852266e8dfa', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:44.155803 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-cc1187da-a6c9-496a-a852-c88092bb52ff tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2172c2cb-4a39-46c5-b154-3fd30446d6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:44.160425 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-cc1187da-a6c9-496a-a852-c88092bb52ff tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2172c2cb-4a39-46c5-b154-3fd30446d6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:44.165254 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-cc1187da-a6c9-496a-a852-c88092bb52ff tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f526057-30f0-48d5-9831-59ff9190a3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:44.166631 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-cc1187da-a6c9-496a-a852-c88092bb52ff tempest-VolumesActionsTest-2007513843 None] Volume 40f3e1a7-0a4b-40f1-a4fb-4852266e8dfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40f3e1a7-0a4b-40f1-a4fb-4852266e8dfa', 'volume_size': 1} Mar 12 21:23:44.167028 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-cc1187da-a6c9-496a-a852-c88092bb52ff tempest-VolumesActionsTest-2007513843 None] creating volume 'volume-40f3e1a7-0a4b-40f1-a4fb-4852266e8dfa' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:23:44.168018 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-cc1187da-a6c9-496a-a852-c88092bb52ff tempest-VolumesActionsTest-2007513843 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:23:44.216728 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-cc1187da-a6c9-496a-a852-c88092bb52ff tempest-VolumesActionsTest-2007513843 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:23:44.217109 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-cc1187da-a6c9-496a-a852-c88092bb52ff tempest-VolumesActionsTest-2007513843 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:23:44.221535 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-cc1187da-a6c9-496a-a852-c88092bb52ff tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f526057-30f0-48d5-9831-59ff9190a3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40f3e1a7-0a4b-40f1-a4fb-4852266e8dfa', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:44.226288 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-cc1187da-a6c9-496a-a852-c88092bb52ff tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21517f56-14e0-4fc2-b269-8ca8049fa0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:44.236752 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-cc1187da-a6c9-496a-a852-c88092bb52ff tempest-VolumesActionsTest-2007513843 None] Volume volume-40f3e1a7-0a4b-40f1-a4fb-4852266e8dfa (40f3e1a7-0a4b-40f1-a4fb-4852266e8dfa): created successfully Mar 12 21:23:44.239022 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-cc1187da-a6c9-496a-a852-c88092bb52ff tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21517f56-14e0-4fc2-b269-8ca8049fa0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:44.244786 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-cc1187da-a6c9-496a-a852-c88092bb52ff tempest-VolumesActionsTest-2007513843 None] Flow 'volume_create_manager' (ef3f6cdb-2171-43e4-b08e-8b274fb0d41c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:23:44.252770 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-cc1187da-a6c9-496a-a852-c88092bb52ff tempest-VolumesActionsTest-2007513843 None] Created volume successfully. Mar 12 21:23:45.241288 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-b150696a-941f-4a41-9cdd-49b9f730eaa0 tempest-VolumesActionsTest-164651436 None] Lock "b'cinder-40f3e1a7-0a4b-40f1-a4fb-4852266e8dfa-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:23:45.268035 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b150696a-941f-4a41-9cdd-49b9f730eaa0 tempest-VolumesActionsTest-164651436 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:23:45.308084 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b150696a-941f-4a41-9cdd-49b9f730eaa0 tempest-VolumesActionsTest-164651436 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:23:45.308438 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b150696a-941f-4a41-9cdd-49b9f730eaa0 tempest-VolumesActionsTest-164651436 None] Volume volume-40f3e1a7-0a4b-40f1-a4fb-4852266e8dfa is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:23:45.312732 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b150696a-941f-4a41-9cdd-49b9f730eaa0 tempest-VolumesActionsTest-164651436 None] deleting rbd volume volume-40f3e1a7-0a4b-40f1-a4fb-4852266e8dfa {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:23:45.503297 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-b150696a-941f-4a41-9cdd-49b9f730eaa0 tempest-VolumesActionsTest-164651436 None] Created reservations ['7f521255-90dd-477d-962d-8dd9bc46b299', 'f4cde4a4-c9f4-48d7-bd14-f4e53da6eabe', '6319bf64-7636-4cc2-bbda-3106bf8b8d99', '0f75ac68-18ea-4be4-ac1f-1936222daa5d'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:23:45.551544 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b150696a-941f-4a41-9cdd-49b9f730eaa0 tempest-VolumesActionsTest-164651436 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:23:45.574108 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b150696a-941f-4a41-9cdd-49b9f730eaa0 tempest-VolumesActionsTest-164651436 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:23:45.596433 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-b150696a-941f-4a41-9cdd-49b9f730eaa0 tempest-VolumesActionsTest-164651436 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:23:45.603685 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-b150696a-941f-4a41-9cdd-49b9f730eaa0 tempest-VolumesActionsTest-164651436 None] Deleted volume successfully. Mar 12 21:23:45.614710 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-b150696a-941f-4a41-9cdd-49b9f730eaa0 tempest-VolumesActionsTest-164651436 None] Lock "b'cinder-40f3e1a7-0a4b-40f1-a4fb-4852266e8dfa-delete_volume'" released by "delete_volume" :: held 0.374s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:23:46.599420 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-13d6fd46-6bad-4e21-85a5-5df22602cee3 tempest-VolumesActionsTest-2007513843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:23:46.602831 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-13d6fd46-6bad-4e21-85a5-5df22602cee3 tempest-VolumesActionsTest-2007513843 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:23:46.603273 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-13d6fd46-6bad-4e21-85a5-5df22602cee3 tempest-VolumesActionsTest-2007513843 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:23:46.621741 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-13d6fd46-6bad-4e21-85a5-5df22602cee3 tempest-VolumesActionsTest-2007513843 None] Flow 'volume_create_manager' (c6346e79-92a2-4913-b0e3-2deb25a9846c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:23:46.628421 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-13d6fd46-6bad-4e21-85a5-5df22602cee3 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0021398a-c7d8-460a-b85e-a706c3e60e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:46.635559 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-13d6fd46-6bad-4e21-85a5-5df22602cee3 tempest-VolumesActionsTest-2007513843 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:23:46.650144 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-13d6fd46-6bad-4e21-85a5-5df22602cee3 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0021398a-c7d8-460a-b85e-a706c3e60e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:23:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1869093298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0d95197f-8df3-4fd1-863d-0ed4ecd7bcff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f6671ee1ef84f14bfc9ad7998fc2398',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:23:47Z,use_quota=True,user_id='f7685737370a493596376a744d5fb4b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:46.655808 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-13d6fd46-6bad-4e21-85a5-5df22602cee3 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27c2c694-d1d7-40a4-a710-06049ff3d661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:46.660641 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-13d6fd46-6bad-4e21-85a5-5df22602cee3 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27c2c694-d1d7-40a4-a710-06049ff3d661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:46.666160 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-13d6fd46-6bad-4e21-85a5-5df22602cee3 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d36c371f-e83b-41fd-8c71-03b2871ab893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:46.670433 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-13d6fd46-6bad-4e21-85a5-5df22602cee3 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d36c371f-e83b-41fd-8c71-03b2871ab893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d95197f-8df3-4fd1-863d-0ed4ecd7bcff', 'volume_name': 'volume-0d95197f-8df3-4fd1-863d-0ed4ecd7bcff', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:46.675455 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-13d6fd46-6bad-4e21-85a5-5df22602cee3 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (684c7b1d-8bfd-4647-9db0-e45b8f2a41ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:46.679532 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-13d6fd46-6bad-4e21-85a5-5df22602cee3 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (684c7b1d-8bfd-4647-9db0-e45b8f2a41ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:46.684344 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-13d6fd46-6bad-4e21-85a5-5df22602cee3 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18cd909f-7654-4d1b-83b1-99eb1781c6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:46.685427 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-13d6fd46-6bad-4e21-85a5-5df22602cee3 tempest-VolumesActionsTest-2007513843 None] Volume 0d95197f-8df3-4fd1-863d-0ed4ecd7bcff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d95197f-8df3-4fd1-863d-0ed4ecd7bcff', 'volume_size': 1} Mar 12 21:23:46.685836 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-13d6fd46-6bad-4e21-85a5-5df22602cee3 tempest-VolumesActionsTest-2007513843 None] creating volume 'volume-0d95197f-8df3-4fd1-863d-0ed4ecd7bcff' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:23:46.686835 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-13d6fd46-6bad-4e21-85a5-5df22602cee3 tempest-VolumesActionsTest-2007513843 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:23:46.740113 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-13d6fd46-6bad-4e21-85a5-5df22602cee3 tempest-VolumesActionsTest-2007513843 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:23:46.740579 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-13d6fd46-6bad-4e21-85a5-5df22602cee3 tempest-VolumesActionsTest-2007513843 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:23:46.744449 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-13d6fd46-6bad-4e21-85a5-5df22602cee3 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18cd909f-7654-4d1b-83b1-99eb1781c6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d95197f-8df3-4fd1-863d-0ed4ecd7bcff', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:46.749205 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-13d6fd46-6bad-4e21-85a5-5df22602cee3 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5573909d-087c-4155-a190-27003a19d08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:46.758458 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-13d6fd46-6bad-4e21-85a5-5df22602cee3 tempest-VolumesActionsTest-2007513843 None] Volume volume-0d95197f-8df3-4fd1-863d-0ed4ecd7bcff (0d95197f-8df3-4fd1-863d-0ed4ecd7bcff): created successfully Mar 12 21:23:46.762212 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-13d6fd46-6bad-4e21-85a5-5df22602cee3 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5573909d-087c-4155-a190-27003a19d08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:46.768256 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-13d6fd46-6bad-4e21-85a5-5df22602cee3 tempest-VolumesActionsTest-2007513843 None] Flow 'volume_create_manager' (c6346e79-92a2-4913-b0e3-2deb25a9846c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:23:46.776669 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-13d6fd46-6bad-4e21-85a5-5df22602cee3 tempest-VolumesActionsTest-2007513843 None] Created volume successfully. Mar 12 21:23:47.782637 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-ab726ebe-5e2c-4f48-98fa-30e449032997 tempest-VolumesActionsTest-164651436 None] Lock "b'cinder-0d95197f-8df3-4fd1-863d-0ed4ecd7bcff-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:23:47.822149 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-ab726ebe-5e2c-4f48-98fa-30e449032997 tempest-VolumesActionsTest-164651436 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:23:47.883375 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-ab726ebe-5e2c-4f48-98fa-30e449032997 tempest-VolumesActionsTest-164651436 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:23:47.883893 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-ab726ebe-5e2c-4f48-98fa-30e449032997 tempest-VolumesActionsTest-164651436 None] Volume volume-0d95197f-8df3-4fd1-863d-0ed4ecd7bcff is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:23:47.889753 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-ab726ebe-5e2c-4f48-98fa-30e449032997 tempest-VolumesActionsTest-164651436 None] deleting rbd volume volume-0d95197f-8df3-4fd1-863d-0ed4ecd7bcff {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:23:48.184927 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-ab726ebe-5e2c-4f48-98fa-30e449032997 tempest-VolumesActionsTest-164651436 None] Created reservations ['792eb9b9-2937-4dc9-9c2b-84f9f9733027', '87b92860-5fce-4b2f-ae7d-d5893aa1088b', '12862f65-81d2-414a-b872-3633c87ab4ea', '83639d21-4e41-4884-906b-c7c50c877eaf'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:23:48.231564 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-ab726ebe-5e2c-4f48-98fa-30e449032997 tempest-VolumesActionsTest-164651436 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:23:48.268514 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-ab726ebe-5e2c-4f48-98fa-30e449032997 tempest-VolumesActionsTest-164651436 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:23:48.303436 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-ab726ebe-5e2c-4f48-98fa-30e449032997 tempest-VolumesActionsTest-164651436 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:23:48.314621 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-ab726ebe-5e2c-4f48-98fa-30e449032997 tempest-VolumesActionsTest-164651436 None] Deleted volume successfully. Mar 12 21:23:48.326753 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-ab726ebe-5e2c-4f48-98fa-30e449032997 tempest-VolumesActionsTest-164651436 None] Lock "b'cinder-0d95197f-8df3-4fd1-863d-0ed4ecd7bcff-delete_volume'" released by "delete_volume" :: held 0.544s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:23:49.151646 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a0bde18-8ea2-488e-b813-1df9db940128 tempest-VolumesActionsTest-2007513843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:23:49.155060 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-2a0bde18-8ea2-488e-b813-1df9db940128 tempest-VolumesActionsTest-2007513843 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:23:49.155490 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-2a0bde18-8ea2-488e-b813-1df9db940128 tempest-VolumesActionsTest-2007513843 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:23:49.175834 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2a0bde18-8ea2-488e-b813-1df9db940128 tempest-VolumesActionsTest-2007513843 None] Flow 'volume_create_manager' (d06009f8-ef4b-4481-a99b-b67c5471a5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:23:49.182882 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2a0bde18-8ea2-488e-b813-1df9db940128 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e30ff1ee-a9fa-4e5e-8c14-7b973278cbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:49.189196 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-2a0bde18-8ea2-488e-b813-1df9db940128 tempest-VolumesActionsTest-2007513843 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:23:49.203346 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2a0bde18-8ea2-488e-b813-1df9db940128 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e30ff1ee-a9fa-4e5e-8c14-7b973278cbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-884462936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5c692ff7-8c71-4b0c-920b-e3647468ae8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f6671ee1ef84f14bfc9ad7998fc2398',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:23:49Z,use_quota=True,user_id='f7685737370a493596376a744d5fb4b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:49.208926 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2a0bde18-8ea2-488e-b813-1df9db940128 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (659fac29-e5c2-4be2-b48d-a4ad64cdc9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:49.213203 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2a0bde18-8ea2-488e-b813-1df9db940128 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (659fac29-e5c2-4be2-b48d-a4ad64cdc9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:49.218493 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2a0bde18-8ea2-488e-b813-1df9db940128 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a17c816c-eae1-4704-94a3-8950f2f9a455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:49.223402 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2a0bde18-8ea2-488e-b813-1df9db940128 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a17c816c-eae1-4704-94a3-8950f2f9a455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c692ff7-8c71-4b0c-920b-e3647468ae8f', 'volume_name': 'volume-5c692ff7-8c71-4b0c-920b-e3647468ae8f', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:49.228463 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2a0bde18-8ea2-488e-b813-1df9db940128 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fee0a471-b436-4dbd-a6e0-11ea8ba9d7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:49.232584 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2a0bde18-8ea2-488e-b813-1df9db940128 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fee0a471-b436-4dbd-a6e0-11ea8ba9d7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:49.238935 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2a0bde18-8ea2-488e-b813-1df9db940128 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed1355f7-0e1b-437a-9f18-ad5805829ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:49.239121 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-2a0bde18-8ea2-488e-b813-1df9db940128 tempest-VolumesActionsTest-2007513843 None] Volume 5c692ff7-8c71-4b0c-920b-e3647468ae8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c692ff7-8c71-4b0c-920b-e3647468ae8f', 'volume_size': 1} Mar 12 21:23:49.239523 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2a0bde18-8ea2-488e-b813-1df9db940128 tempest-VolumesActionsTest-2007513843 None] creating volume 'volume-5c692ff7-8c71-4b0c-920b-e3647468ae8f' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:23:49.240546 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2a0bde18-8ea2-488e-b813-1df9db940128 tempest-VolumesActionsTest-2007513843 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:23:49.297203 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2a0bde18-8ea2-488e-b813-1df9db940128 tempest-VolumesActionsTest-2007513843 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:23:49.297573 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2a0bde18-8ea2-488e-b813-1df9db940128 tempest-VolumesActionsTest-2007513843 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:23:49.301963 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2a0bde18-8ea2-488e-b813-1df9db940128 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed1355f7-0e1b-437a-9f18-ad5805829ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c692ff7-8c71-4b0c-920b-e3647468ae8f', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:49.306679 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2a0bde18-8ea2-488e-b813-1df9db940128 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a13dded7-9505-4437-b519-d246cd657abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:49.315287 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-2a0bde18-8ea2-488e-b813-1df9db940128 tempest-VolumesActionsTest-2007513843 None] Volume volume-5c692ff7-8c71-4b0c-920b-e3647468ae8f (5c692ff7-8c71-4b0c-920b-e3647468ae8f): created successfully Mar 12 21:23:49.318886 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2a0bde18-8ea2-488e-b813-1df9db940128 tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a13dded7-9505-4437-b519-d246cd657abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:49.324409 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2a0bde18-8ea2-488e-b813-1df9db940128 tempest-VolumesActionsTest-2007513843 None] Flow 'volume_create_manager' (d06009f8-ef4b-4481-a99b-b67c5471a5c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:23:49.331491 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-2a0bde18-8ea2-488e-b813-1df9db940128 tempest-VolumesActionsTest-2007513843 None] Created volume successfully. Mar 12 21:23:49.932162 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-84072dea-f6ea-4c6a-911a-ef02ef180495 req-6e8564e1-f311-4688-bdf5-7b17b5c59b20 tempest-TestVolumeBootPattern-1001263199 None] Terminate volume connection completed successfully. Mar 12 21:23:49.932574 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-84072dea-f6ea-4c6a-911a-ef02ef180495 req-6e8564e1-f311-4688-bdf5-7b17b5c59b20 tempest-TestVolumeBootPattern-1001263199 None] Deleting attachment 1da223bb-db52-4689-ac26-b475e76f377f. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 21:23:50.347250 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-3e0829f8-82da-481f-b3a5-4257564db771 tempest-VolumesActionsTest-164651436 None] Lock "b'cinder-5c692ff7-8c71-4b0c-920b-e3647468ae8f-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:23:50.373512 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3e0829f8-82da-481f-b3a5-4257564db771 tempest-VolumesActionsTest-164651436 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:23:50.439359 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3e0829f8-82da-481f-b3a5-4257564db771 tempest-VolumesActionsTest-164651436 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:23:50.439778 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3e0829f8-82da-481f-b3a5-4257564db771 tempest-VolumesActionsTest-164651436 None] Volume volume-5c692ff7-8c71-4b0c-920b-e3647468ae8f is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:23:50.446030 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3e0829f8-82da-481f-b3a5-4257564db771 tempest-VolumesActionsTest-164651436 None] deleting rbd volume volume-5c692ff7-8c71-4b0c-920b-e3647468ae8f {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:23:50.638444 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-3e0829f8-82da-481f-b3a5-4257564db771 tempest-VolumesActionsTest-164651436 None] Created reservations ['5168de55-b973-4d85-b914-9c77dd7502b5', 'f43c2f73-2aea-4fac-b220-3a8a3a4291d7', '7941887c-94a8-4824-b618-321efa77336a', '3a9f8b69-cd6f-4820-9f23-41bad3548634'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:23:50.680621 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3e0829f8-82da-481f-b3a5-4257564db771 tempest-VolumesActionsTest-164651436 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:23:50.701755 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3e0829f8-82da-481f-b3a5-4257564db771 tempest-VolumesActionsTest-164651436 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:23:50.725658 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-3e0829f8-82da-481f-b3a5-4257564db771 tempest-VolumesActionsTest-164651436 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:23:50.732166 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-3e0829f8-82da-481f-b3a5-4257564db771 tempest-VolumesActionsTest-164651436 None] Deleted volume successfully. Mar 12 21:23:50.743980 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-3e0829f8-82da-481f-b3a5-4257564db771 tempest-VolumesActionsTest-164651436 None] Lock "b'cinder-5c692ff7-8c71-4b0c-920b-e3647468ae8f-delete_volume'" released by "delete_volume" :: held 0.397s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:23:51.316756 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:23:51.317340 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:23:51.339917 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:23:51.364227 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:23:51.546298 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-e7c13bff-1ec7-4094-a549-e5b55d03f1d9 tempest-TestVolumeBootPattern-1001263199 None] Lock "b'cinder-173c91e0-dfb4-4b99-9b0f-7ae1f06598da-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:23:51.580363 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-e7c13bff-1ec7-4094-a549-e5b55d03f1d9 tempest-TestVolumeBootPattern-1001263199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:23:51.672238 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-e7c13bff-1ec7-4094-a549-e5b55d03f1d9 tempest-TestVolumeBootPattern-1001263199 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:23:51.691351 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-e7c13bff-1ec7-4094-a549-e5b55d03f1d9 tempest-TestVolumeBootPattern-1001263199 None] deleting rbd volume volume-173c91e0-dfb4-4b99-9b0f-7ae1f06598da {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:23:51.748893 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ec541e5-ce44-4f47-80f3-bb2d11387bcd tempest-VolumesActionsTest-2007513843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:23:51.752130 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-5ec541e5-ce44-4f47-80f3-bb2d11387bcd tempest-VolumesActionsTest-2007513843 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:23:51.752576 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-5ec541e5-ce44-4f47-80f3-bb2d11387bcd tempest-VolumesActionsTest-2007513843 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:23:51.773512 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5ec541e5-ce44-4f47-80f3-bb2d11387bcd tempest-VolumesActionsTest-2007513843 None] Flow 'volume_create_manager' (6a94c24c-8373-416b-9761-e6ab816277c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:23:51.780519 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5ec541e5-ce44-4f47-80f3-bb2d11387bcd tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27faf3b5-c434-4710-ad7a-abe98e47696f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:51.787992 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-5ec541e5-ce44-4f47-80f3-bb2d11387bcd tempest-VolumesActionsTest-2007513843 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:23:51.802890 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5ec541e5-ce44-4f47-80f3-bb2d11387bcd tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27faf3b5-c434-4710-ad7a-abe98e47696f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1148331636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=292e4a44-a05c-457a-b8bb-4f29b3f73ca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f6671ee1ef84f14bfc9ad7998fc2398',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:23:52Z,use_quota=True,user_id='f7685737370a493596376a744d5fb4b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:51.808521 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5ec541e5-ce44-4f47-80f3-bb2d11387bcd tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a99afc0-2644-47cb-90d4-21ae426d5bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:51.812786 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5ec541e5-ce44-4f47-80f3-bb2d11387bcd tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a99afc0-2644-47cb-90d4-21ae426d5bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:51.818580 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5ec541e5-ce44-4f47-80f3-bb2d11387bcd tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9d73e8e-93c9-4ae4-8beb-03a0fc05d074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:51.823167 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5ec541e5-ce44-4f47-80f3-bb2d11387bcd tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9d73e8e-93c9-4ae4-8beb-03a0fc05d074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '292e4a44-a05c-457a-b8bb-4f29b3f73ca3', 'volume_name': 'volume-292e4a44-a05c-457a-b8bb-4f29b3f73ca3', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:51.828438 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5ec541e5-ce44-4f47-80f3-bb2d11387bcd tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ede79e9-84dd-46c3-9a60-c61f9c3c45d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:51.833304 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5ec541e5-ce44-4f47-80f3-bb2d11387bcd tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ede79e9-84dd-46c3-9a60-c61f9c3c45d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:51.838162 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5ec541e5-ce44-4f47-80f3-bb2d11387bcd tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1e9330d-4b5d-48fa-aae5-c3c2acc0150a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:51.839260 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-5ec541e5-ce44-4f47-80f3-bb2d11387bcd tempest-VolumesActionsTest-2007513843 None] Volume 292e4a44-a05c-457a-b8bb-4f29b3f73ca3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-292e4a44-a05c-457a-b8bb-4f29b3f73ca3', 'volume_size': 1} Mar 12 21:23:51.839690 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-5ec541e5-ce44-4f47-80f3-bb2d11387bcd tempest-VolumesActionsTest-2007513843 None] creating volume 'volume-292e4a44-a05c-457a-b8bb-4f29b3f73ca3' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:23:51.840780 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-5ec541e5-ce44-4f47-80f3-bb2d11387bcd tempest-VolumesActionsTest-2007513843 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:23:51.901195 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-5ec541e5-ce44-4f47-80f3-bb2d11387bcd tempest-VolumesActionsTest-2007513843 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:23:51.901643 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-5ec541e5-ce44-4f47-80f3-bb2d11387bcd tempest-VolumesActionsTest-2007513843 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:23:51.905699 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5ec541e5-ce44-4f47-80f3-bb2d11387bcd tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1e9330d-4b5d-48fa-aae5-c3c2acc0150a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-292e4a44-a05c-457a-b8bb-4f29b3f73ca3', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:51.911578 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5ec541e5-ce44-4f47-80f3-bb2d11387bcd tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84201557-05e4-4030-be2a-983976cce03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:51.921248 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-5ec541e5-ce44-4f47-80f3-bb2d11387bcd tempest-VolumesActionsTest-2007513843 None] Volume volume-292e4a44-a05c-457a-b8bb-4f29b3f73ca3 (292e4a44-a05c-457a-b8bb-4f29b3f73ca3): created successfully Mar 12 21:23:51.925533 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5ec541e5-ce44-4f47-80f3-bb2d11387bcd tempest-VolumesActionsTest-2007513843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84201557-05e4-4030-be2a-983976cce03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:51.931499 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5ec541e5-ce44-4f47-80f3-bb2d11387bcd tempest-VolumesActionsTest-2007513843 None] Flow 'volume_create_manager' (6a94c24c-8373-416b-9761-e6ab816277c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:23:51.948061 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-5ec541e5-ce44-4f47-80f3-bb2d11387bcd tempest-VolumesActionsTest-2007513843 None] Created volume successfully. Mar 12 21:23:51.975718 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-e7c13bff-1ec7-4094-a549-e5b55d03f1d9 tempest-TestVolumeBootPattern-1001263199 None] Created reservations ['de8b5300-2c89-49d5-b666-446394692955', 'a7f935dd-2255-49ad-8e39-62009747f033', 'cdfd7604-8d60-4e12-804e-406f451a051b', '8e48b2fe-0be2-45ee-8ee6-ca2659b4cbde'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:23:52.020737 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-e7c13bff-1ec7-4094-a549-e5b55d03f1d9 tempest-TestVolumeBootPattern-1001263199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:23:52.043355 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-e7c13bff-1ec7-4094-a549-e5b55d03f1d9 tempest-TestVolumeBootPattern-1001263199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:23:52.065581 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-e7c13bff-1ec7-4094-a549-e5b55d03f1d9 tempest-TestVolumeBootPattern-1001263199 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:23:52.069561 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-e7c13bff-1ec7-4094-a549-e5b55d03f1d9 tempest-TestVolumeBootPattern-1001263199 None] Deleted volume successfully. Mar 12 21:23:52.081259 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-e7c13bff-1ec7-4094-a549-e5b55d03f1d9 tempest-TestVolumeBootPattern-1001263199 None] Lock "b'cinder-173c91e0-dfb4-4b99-9b0f-7ae1f06598da-delete_volume'" released by "delete_volume" :: held 0.535s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:23:52.685689 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-b5da7e03-b62f-44ea-8eb9-e4c6f39a63a5 tempest-TestVolumeBootPattern-1001263199 None] Lock "b'cinder-0f010416-9985-4dc8-9bea-9f5dbced4850-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.008s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:23:52.685689 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-b5da7e03-b62f-44ea-8eb9-e4c6f39a63a5 tempest-TestVolumeBootPattern-1001263199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:23:53.245918 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-1b32f778-a377-453e-87bc-9af88aea590b tempest-VolumesActionsTest-2007513843 None] Lock "b'cinder-292e4a44-a05c-457a-b8bb-4f29b3f73ca3-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:23:53.276448 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-1b32f778-a377-453e-87bc-9af88aea590b tempest-VolumesActionsTest-2007513843 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:23:53.314990 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-1b32f778-a377-453e-87bc-9af88aea590b tempest-VolumesActionsTest-2007513843 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:23:53.315417 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-1b32f778-a377-453e-87bc-9af88aea590b tempest-VolumesActionsTest-2007513843 None] Volume volume-292e4a44-a05c-457a-b8bb-4f29b3f73ca3 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:23:53.320581 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-1b32f778-a377-453e-87bc-9af88aea590b tempest-VolumesActionsTest-2007513843 None] deleting rbd volume volume-292e4a44-a05c-457a-b8bb-4f29b3f73ca3 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:23:53.513531 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-1b32f778-a377-453e-87bc-9af88aea590b tempest-VolumesActionsTest-2007513843 None] Created reservations ['37396295-d496-4273-8453-fd0a8680a90e', '11ec2513-2a93-48db-9886-0b121a32ed68', '5ed72c83-60e4-4daa-bf7e-1d4223f99fc0', '5a223a55-34ca-4117-a089-07f70b633f84'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:23:53.555501 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-1b32f778-a377-453e-87bc-9af88aea590b tempest-VolumesActionsTest-2007513843 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:23:53.577799 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-1b32f778-a377-453e-87bc-9af88aea590b tempest-VolumesActionsTest-2007513843 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:23:53.601670 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-1b32f778-a377-453e-87bc-9af88aea590b tempest-VolumesActionsTest-2007513843 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:23:53.607593 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-1b32f778-a377-453e-87bc-9af88aea590b tempest-VolumesActionsTest-2007513843 None] Deleted volume successfully. Mar 12 21:23:53.618172 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-1b32f778-a377-453e-87bc-9af88aea590b tempest-VolumesActionsTest-2007513843 None] Lock "b'cinder-292e4a44-a05c-457a-b8bb-4f29b3f73ca3-delete_volume'" released by "delete_volume" :: held 0.372s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:23:54.466868 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-03b68520-0aa7-47a3-91eb-34b09ba91b16 tempest-VolumesActionsTest-2007513843 None] Lock "b'cinder-806ca786-25b3-4fcc-8ff2-aacdd63e713d-delete_volume'" acquired by "delete_volume" :: waited 0.027s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:23:54.498861 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-03b68520-0aa7-47a3-91eb-34b09ba91b16 tempest-VolumesActionsTest-2007513843 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:23:54.536562 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-03b68520-0aa7-47a3-91eb-34b09ba91b16 tempest-VolumesActionsTest-2007513843 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:23:54.537078 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-03b68520-0aa7-47a3-91eb-34b09ba91b16 tempest-VolumesActionsTest-2007513843 None] Volume volume-806ca786-25b3-4fcc-8ff2-aacdd63e713d is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:23:54.542765 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-03b68520-0aa7-47a3-91eb-34b09ba91b16 tempest-VolumesActionsTest-2007513843 None] deleting rbd volume volume-806ca786-25b3-4fcc-8ff2-aacdd63e713d {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:23:54.733627 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-03b68520-0aa7-47a3-91eb-34b09ba91b16 tempest-VolumesActionsTest-2007513843 None] Created reservations ['1cb355c3-87d8-41a1-b716-0ed8350279bc', 'e5c0dad0-3072-44ab-8b45-b4c786800b05', 'e33de33f-28fc-41a8-9b5a-3caf1ddaa46c', '5236a091-b8a7-49cc-b5b2-bdc8f130d70d'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:23:54.775336 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-03b68520-0aa7-47a3-91eb-34b09ba91b16 tempest-VolumesActionsTest-2007513843 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:23:54.798766 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-03b68520-0aa7-47a3-91eb-34b09ba91b16 tempest-VolumesActionsTest-2007513843 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:23:54.822513 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-03b68520-0aa7-47a3-91eb-34b09ba91b16 tempest-VolumesActionsTest-2007513843 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:23:54.828083 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-03b68520-0aa7-47a3-91eb-34b09ba91b16 tempest-VolumesActionsTest-2007513843 None] Deleted volume successfully. Mar 12 21:23:54.840161 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-03b68520-0aa7-47a3-91eb-34b09ba91b16 tempest-VolumesActionsTest-2007513843 None] Lock "b'cinder-806ca786-25b3-4fcc-8ff2-aacdd63e713d-delete_volume'" released by "delete_volume" :: held 0.373s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:23:58.509444 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:23:58.512965 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:23:58.513413 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:23:58.533828 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] Flow 'volume_create_manager' (7ba562d7-ec94-45d2-b843-5f2d6c3f64b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:23:58.541397 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (541d7a4f-192c-4c18-8ded-9c9dc87b7b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:58.547813 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:23:58.561721 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (541d7a4f-192c-4c18-8ded-9c9dc87b7b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-758939393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9fc6a09f-ebce-407e-89ab-5f24e6628058,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d87b776524b344f4b70a97f28a973bb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:23:58Z,use_quota=True,user_id='a016eb5fa27540c2af3cd771db60346e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:58.567370 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f7c119-3cba-49da-9f78-c65bd12f57ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:58.571652 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f7c119-3cba-49da-9f78-c65bd12f57ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:58.576921 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b90c44e-9230-459e-b85c-323c1b6d9ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:58.653827 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b90c44e-9230-459e-b85c-323c1b6d9ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9fc6a09f-ebce-407e-89ab-5f24e6628058', 'volume_name': 'volume-9fc6a09f-ebce-407e-89ab-5f24e6628058', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:58.659661 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee04a1c-89bc-4c71-8e5f-0af5dc0dece9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:58.663816 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee04a1c-89bc-4c71-8e5f-0af5dc0dece9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:58.668901 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42cb2e9a-a3fa-4bb3-b06a-144878a5326f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:58.670055 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] Volume 9fc6a09f-ebce-407e-89ab-5f24e6628058: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9fc6a09f-ebce-407e-89ab-5f24e6628058', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 12 21:23:58.670628 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] Cloning 9fc6a09f-ebce-407e-89ab-5f24e6628058 from image 539171db-0bd3-4f16-95fd-a7cd5530137d at location (None, None). {{(pid=129531) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Mar 12 21:23:58.678439 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] Lock "b'cinder-539171db-0bd3-4f16-95fd-a7cd5530137d'" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:23:58.687963 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] Found image-volume cache entry: {'id': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'volume_id': '8d802c7b-bd34-4836-bd5d-90755a167ddc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34), 'last_used': datetime.datetime(2022, 3, 12, 21, 23, 58, 683064)}. {{(pid=129531) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 12 21:23:58.688323 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] Image-volume cache entry image_update_at = 2022-03-12 20:39:34+00:00, requested image updated_at = 2022-03-12 20:39:34+00:00. {{(pid=129531) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 12 21:23:58.688800 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] Found cache entry for image = 539171db-0bd3-4f16-95fd-a7cd5530137d on host ncdv-master-1@ceph#ceph. {{(pid=129531) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Mar 12 21:23:58.692586 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] Lock "b'cinder-539171db-0bd3-4f16-95fd-a7cd5530137d'" released by "_prepare_image_cache_entry" :: held 0.014s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:23:58.693452 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] Attempting to retrieve cache entry for image = 539171db-0bd3-4f16-95fd-a7cd5530137d on host ncdv-master-1@ceph#ceph. {{(pid=129531) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Mar 12 21:23:58.698487 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] Found image-volume cache entry: {'id': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'volume_id': '8d802c7b-bd34-4836-bd5d-90755a167ddc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34), 'last_used': datetime.datetime(2022, 3, 12, 21, 23, 58, 696353)}. {{(pid=129531) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 12 21:23:58.698893 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] Image-volume cache entry image_update_at = 2022-03-12 20:39:34+00:00, requested image updated_at = 2022-03-12 20:39:34+00:00. {{(pid=129531) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 12 21:23:58.699275 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] Creating from source image-volume 8d802c7b-bd34-4836-bd5d-90755a167ddc {{(pid=129531) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Mar 12 21:23:58.710630 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:23:58.759111 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] creating snapshot='volume-9fc6a09f-ebce-407e-89ab-5f24e6628058.clone_snap' {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Mar 12 21:23:59.513153 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] cloning 'volume-8d802c7b-bd34-4836-bd5d-90755a167ddc@volume-9fc6a09f-ebce-407e-89ab-5f24e6628058.clone_snap' to 'volume-9fc6a09f-ebce-407e-89ab-5f24e6628058' {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Mar 12 21:23:59.637806 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] Volume volume-9916cd82-3d9b-466f-a769-cf81bdc743fd.deleted is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:23:59.638964 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:23:59.639339 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:23:59.655779 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] clone created successfully {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Mar 12 21:23:59.656394 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.volume_utils [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] Marking volume 9fc6a09f-ebce-407e-89ab-5f24e6628058 as bootable. {{(pid=129531) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 12 21:23:59.663899 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] Copying metadata from image 539171db-0bd3-4f16-95fd-a7cd5530137d to 9fc6a09f-ebce-407e-89ab-5f24e6628058. {{(pid=129531) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Mar 12 21:23:59.664331 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] Creating volume glance metadata for volume 9fc6a09f-ebce-407e-89ab-5f24e6628058 backed by image 539171db-0bd3-4f16-95fd-a7cd5530137d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129531) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Mar 12 21:23:59.712538 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42cb2e9a-a3fa-4bb3-b06a-144878a5326f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fc6a09f-ebce-407e-89ab-5f24e6628058', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:59.717321 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (601859f8-626e-491c-91ab-36bf85ee25ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:23:59.724861 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] Volume volume-9fc6a09f-ebce-407e-89ab-5f24e6628058 (9fc6a09f-ebce-407e-89ab-5f24e6628058): created successfully Mar 12 21:23:59.728686 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (601859f8-626e-491c-91ab-36bf85ee25ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:23:59.734373 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] Flow 'volume_create_manager' (7ba562d7-ec94-45d2-b843-5f2d6c3f64b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:23:59.741821 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-952a7ffa-cadf-4fa3-97ed-4505fdfdb89c tempest-VolumesImageMetadata-1716062735 None] Created volume successfully. Mar 12 21:24:00.830395 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-19f19790-d377-4ff0-975a-4e2253619c4b tempest-VolumesImageMetadata-1716062735 None] Lock "b'cinder-9fc6a09f-ebce-407e-89ab-5f24e6628058-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:24:00.865023 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-19f19790-d377-4ff0-975a-4e2253619c4b tempest-VolumesImageMetadata-1716062735 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:24:00.928596 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-19f19790-d377-4ff0-975a-4e2253619c4b tempest-VolumesImageMetadata-1716062735 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:24:00.935120 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-19f19790-d377-4ff0-975a-4e2253619c4b tempest-VolumesImageMetadata-1716062735 None] deleting rbd volume volume-9fc6a09f-ebce-407e-89ab-5f24e6628058 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:24:01.095557 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-19f19790-d377-4ff0-975a-4e2253619c4b tempest-VolumesImageMetadata-1716062735 None] volume is a clone so cleaning references {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Mar 12 21:24:01.125153 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-19f19790-d377-4ff0-975a-4e2253619c4b tempest-VolumesImageMetadata-1716062735 None] deleting parent snapshot volume-9fc6a09f-ebce-407e-89ab-5f24e6628058.clone_snap {{(pid=129531) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Mar 12 21:24:01.556033 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-19f19790-d377-4ff0-975a-4e2253619c4b tempest-VolumesImageMetadata-1716062735 None] Created reservations ['aa9b738d-2148-4e3a-bff5-b42842281f22', '9266f50a-01f1-4e39-b4e8-d7e1c685b5c5', 'db2b439d-3c4d-45ba-946c-b308a23a9738', 'c3497837-1187-40bf-934c-5947dbe0b63b'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:24:01.597759 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-19f19790-d377-4ff0-975a-4e2253619c4b tempest-VolumesImageMetadata-1716062735 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:24:01.618888 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-19f19790-d377-4ff0-975a-4e2253619c4b tempest-VolumesImageMetadata-1716062735 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:24:01.641344 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-19f19790-d377-4ff0-975a-4e2253619c4b tempest-VolumesImageMetadata-1716062735 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:24:01.645421 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-19f19790-d377-4ff0-975a-4e2253619c4b tempest-VolumesImageMetadata-1716062735 None] Deleted volume successfully. Mar 12 21:24:01.656724 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-19f19790-d377-4ff0-975a-4e2253619c4b tempest-VolumesImageMetadata-1716062735 None] Lock "b'cinder-9fc6a09f-ebce-407e-89ab-5f24e6628058-delete_volume'" released by "delete_volume" :: held 0.826s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:24:03.516134 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-510c45b3-f869-49b2-952b-e1538ba0a510 tempest-SnapshotMetadataTestJSON-244341742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:24:03.520753 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-510c45b3-f869-49b2-952b-e1538ba0a510 tempest-SnapshotMetadataTestJSON-244341742 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:24:03.521189 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-510c45b3-f869-49b2-952b-e1538ba0a510 tempest-SnapshotMetadataTestJSON-244341742 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:24:03.541291 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-510c45b3-f869-49b2-952b-e1538ba0a510 tempest-SnapshotMetadataTestJSON-244341742 None] Flow 'volume_create_manager' (8019b86d-7cf1-475e-850f-0631303c1338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:24:03.547856 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-510c45b3-f869-49b2-952b-e1538ba0a510 tempest-SnapshotMetadataTestJSON-244341742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37f677a8-43be-435b-844a-c3043ae40f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:24:03.554267 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-510c45b3-f869-49b2-952b-e1538ba0a510 tempest-SnapshotMetadataTestJSON-244341742 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:24:03.570529 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-510c45b3-f869-49b2-952b-e1538ba0a510 tempest-SnapshotMetadataTestJSON-244341742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37f677a8-43be-435b-844a-c3043ae40f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1768429568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=93ca2598-a977-4922-bd1c-c366db6db525,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522395f9c5044e0c94f706de60a41dc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:24:03Z,use_quota=True,user_id='5835e66c3a3b421e87535189bdeb918c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:24:03.575950 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-510c45b3-f869-49b2-952b-e1538ba0a510 tempest-SnapshotMetadataTestJSON-244341742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f78804f-041a-4160-89c4-8ddc1d13041b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:24:03.580807 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-510c45b3-f869-49b2-952b-e1538ba0a510 tempest-SnapshotMetadataTestJSON-244341742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f78804f-041a-4160-89c4-8ddc1d13041b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:24:03.585967 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-510c45b3-f869-49b2-952b-e1538ba0a510 tempest-SnapshotMetadataTestJSON-244341742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (455ad584-9afd-4f30-9a30-75dfcf59fc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:24:03.590605 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-510c45b3-f869-49b2-952b-e1538ba0a510 tempest-SnapshotMetadataTestJSON-244341742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (455ad584-9afd-4f30-9a30-75dfcf59fc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93ca2598-a977-4922-bd1c-c366db6db525', 'volume_name': 'volume-93ca2598-a977-4922-bd1c-c366db6db525', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:24:03.595565 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-510c45b3-f869-49b2-952b-e1538ba0a510 tempest-SnapshotMetadataTestJSON-244341742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (724b6a80-6036-4d27-9ad4-72565b579db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:24:03.599558 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-510c45b3-f869-49b2-952b-e1538ba0a510 tempest-SnapshotMetadataTestJSON-244341742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (724b6a80-6036-4d27-9ad4-72565b579db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:24:03.604305 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-510c45b3-f869-49b2-952b-e1538ba0a510 tempest-SnapshotMetadataTestJSON-244341742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbb005b4-a97d-457b-bb0d-31ba9c63b0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:24:03.605354 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-510c45b3-f869-49b2-952b-e1538ba0a510 tempest-SnapshotMetadataTestJSON-244341742 None] Volume 93ca2598-a977-4922-bd1c-c366db6db525: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93ca2598-a977-4922-bd1c-c366db6db525', 'volume_size': 1} Mar 12 21:24:03.605741 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-510c45b3-f869-49b2-952b-e1538ba0a510 tempest-SnapshotMetadataTestJSON-244341742 None] creating volume 'volume-93ca2598-a977-4922-bd1c-c366db6db525' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:24:03.606754 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-510c45b3-f869-49b2-952b-e1538ba0a510 tempest-SnapshotMetadataTestJSON-244341742 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:24:03.655782 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-510c45b3-f869-49b2-952b-e1538ba0a510 tempest-SnapshotMetadataTestJSON-244341742 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:24:03.656290 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-510c45b3-f869-49b2-952b-e1538ba0a510 tempest-SnapshotMetadataTestJSON-244341742 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:24:03.660120 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-510c45b3-f869-49b2-952b-e1538ba0a510 tempest-SnapshotMetadataTestJSON-244341742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbb005b4-a97d-457b-bb0d-31ba9c63b0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93ca2598-a977-4922-bd1c-c366db6db525', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:24:03.664712 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-510c45b3-f869-49b2-952b-e1538ba0a510 tempest-SnapshotMetadataTestJSON-244341742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0b7993d-6b5f-4d27-9026-f51f6d2533dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:24:03.674386 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-510c45b3-f869-49b2-952b-e1538ba0a510 tempest-SnapshotMetadataTestJSON-244341742 None] Volume volume-93ca2598-a977-4922-bd1c-c366db6db525 (93ca2598-a977-4922-bd1c-c366db6db525): created successfully Mar 12 21:24:03.677933 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-510c45b3-f869-49b2-952b-e1538ba0a510 tempest-SnapshotMetadataTestJSON-244341742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0b7993d-6b5f-4d27-9026-f51f6d2533dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:24:03.683593 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-510c45b3-f869-49b2-952b-e1538ba0a510 tempest-SnapshotMetadataTestJSON-244341742 None] Flow 'volume_create_manager' (8019b86d-7cf1-475e-850f-0631303c1338) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:24:03.691437 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-510c45b3-f869-49b2-952b-e1538ba0a510 tempest-SnapshotMetadataTestJSON-244341742 None] Created volume successfully. Mar 12 21:24:04.696344 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-30d82228-f945-47dc-981d-28ac5214b163 tempest-SnapshotMetadataTestJSON-244341742 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:24:04.858883 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-30d82228-f945-47dc-981d-28ac5214b163 tempest-SnapshotMetadataTestJSON-244341742 None] Create snapshot completed successfully Mar 12 21:24:06.275941 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-cfcdefdf-d807-4f8c-8034-2a15d9010dcd tempest-SnapshotMetadataTestJSON-244341742 None] Lock "b'cinder-5bd73b70-badf-4d72-8125-9dd4e1092ff3-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:24:06.277373 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-cfcdefdf-d807-4f8c-8034-2a15d9010dcd tempest-SnapshotMetadataTestJSON-244341742 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:24:06.899647 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-cfcdefdf-d807-4f8c-8034-2a15d9010dcd tempest-SnapshotMetadataTestJSON-244341742 None] Created reservations ['febfd5ea-2e70-4410-9a44-dea77325c757', '5a81d666-5484-4e48-ad89-91036e2601ae', 'f1d2b2bd-777e-4332-aad9-7afd413f2853', '33e08e75-6a25-4e0e-9bae-5980e62af165'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:24:06.935098 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-cfcdefdf-d807-4f8c-8034-2a15d9010dcd tempest-SnapshotMetadataTestJSON-244341742 None] Delete snapshot completed successfully. Mar 12 21:24:06.940148 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-cfcdefdf-d807-4f8c-8034-2a15d9010dcd tempest-SnapshotMetadataTestJSON-244341742 None] Lock "b'cinder-5bd73b70-badf-4d72-8125-9dd4e1092ff3-delete_snapshot'" released by "delete_snapshot" :: held 0.664s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:24:07.375844 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-4319c39c-0ccc-45ee-a47e-12118a3d915b tempest-SnapshotMetadataTestJSON-244341742 None] Lock "b'cinder-93ca2598-a977-4922-bd1c-c366db6db525-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:24:07.405019 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-4319c39c-0ccc-45ee-a47e-12118a3d915b tempest-SnapshotMetadataTestJSON-244341742 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:24:07.442441 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-4319c39c-0ccc-45ee-a47e-12118a3d915b tempest-SnapshotMetadataTestJSON-244341742 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:24:07.442896 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-4319c39c-0ccc-45ee-a47e-12118a3d915b tempest-SnapshotMetadataTestJSON-244341742 None] Volume volume-93ca2598-a977-4922-bd1c-c366db6db525 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:24:07.448506 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-4319c39c-0ccc-45ee-a47e-12118a3d915b tempest-SnapshotMetadataTestJSON-244341742 None] deleting rbd volume volume-93ca2598-a977-4922-bd1c-c366db6db525 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:24:07.631215 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-4319c39c-0ccc-45ee-a47e-12118a3d915b tempest-SnapshotMetadataTestJSON-244341742 None] Created reservations ['22760a58-89bd-4e26-9c5e-bc2fcb189294', 'aa804b41-55f9-4313-9fc0-53a3803f12ed', '1896c306-2c58-439f-8cf9-fd18602f3b6a', 'bc90b4e3-76ec-4753-96b7-00b7158443b4'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:24:07.671487 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-4319c39c-0ccc-45ee-a47e-12118a3d915b tempest-SnapshotMetadataTestJSON-244341742 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:24:07.693032 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-4319c39c-0ccc-45ee-a47e-12118a3d915b tempest-SnapshotMetadataTestJSON-244341742 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:24:07.714715 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-4319c39c-0ccc-45ee-a47e-12118a3d915b tempest-SnapshotMetadataTestJSON-244341742 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:24:07.718740 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-4319c39c-0ccc-45ee-a47e-12118a3d915b tempest-SnapshotMetadataTestJSON-244341742 None] Deleted volume successfully. Mar 12 21:24:07.730476 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-4319c39c-0ccc-45ee-a47e-12118a3d915b tempest-SnapshotMetadataTestJSON-244341742 None] Lock "b'cinder-93ca2598-a977-4922-bd1c-c366db6db525-delete_volume'" released by "delete_volume" :: held 0.355s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:24:11.567761 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:24:11.570973 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:24:11.571402 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:24:11.591073 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] Flow 'volume_create_manager' (012005e0-607c-48e5-8bbf-11ed2e0b2ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:24:11.597657 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7917fd82-ff51-4f2f-abc1-7377f0116c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:24:11.603957 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:24:11.617655 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7917fd82-ff51-4f2f-abc1-7377f0116c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-838846381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=94b99d74-ab5f-4096-94d1-69e6015ded2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c554f033a20474db39becb560824e10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:24:12Z,use_quota=True,user_id='213d0e2ffa0c4c5b8a1be5a38d3d2fb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:24:11.623149 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fceb5c24-fe6a-4515-aa24-e7df482aab51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:24:11.627942 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fceb5c24-fe6a-4515-aa24-e7df482aab51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:24:11.633069 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a82d2e3-bdb8-4ecd-8a58-be31db1cb237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:24:11.709671 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a82d2e3-bdb8-4ecd-8a58-be31db1cb237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '94b99d74-ab5f-4096-94d1-69e6015ded2a', 'volume_name': 'volume-94b99d74-ab5f-4096-94d1-69e6015ded2a', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:24:11.714829 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e56723c7-0477-42b7-8f2f-9afb651e0b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:24:11.718968 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e56723c7-0477-42b7-8f2f-9afb651e0b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:24:11.723844 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b3667d4-69ce-42d0-ae28-d241a7824827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:24:11.724988 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] Volume 94b99d74-ab5f-4096-94d1-69e6015ded2a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-94b99d74-ab5f-4096-94d1-69e6015ded2a', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 12 21:24:11.725541 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] Cloning 94b99d74-ab5f-4096-94d1-69e6015ded2a from image 539171db-0bd3-4f16-95fd-a7cd5530137d at location (None, None). {{(pid=129531) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Mar 12 21:24:11.733331 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] Lock "b'cinder-539171db-0bd3-4f16-95fd-a7cd5530137d'" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:24:11.743151 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] Found image-volume cache entry: {'id': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'volume_id': '8d802c7b-bd34-4836-bd5d-90755a167ddc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34), 'last_used': datetime.datetime(2022, 3, 12, 21, 24, 11, 737959)}. {{(pid=129531) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 12 21:24:11.743572 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] Image-volume cache entry image_update_at = 2022-03-12 20:39:34+00:00, requested image updated_at = 2022-03-12 20:39:34+00:00. {{(pid=129531) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 12 21:24:11.743974 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] Found cache entry for image = 539171db-0bd3-4f16-95fd-a7cd5530137d on host ncdv-master-1@ceph#ceph. {{(pid=129531) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Mar 12 21:24:11.747794 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] Lock "b'cinder-539171db-0bd3-4f16-95fd-a7cd5530137d'" released by "_prepare_image_cache_entry" :: held 0.014s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:24:11.748619 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] Attempting to retrieve cache entry for image = 539171db-0bd3-4f16-95fd-a7cd5530137d on host ncdv-master-1@ceph#ceph. {{(pid=129531) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Mar 12 21:24:11.754282 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] Found image-volume cache entry: {'id': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'volume_id': '8d802c7b-bd34-4836-bd5d-90755a167ddc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34), 'last_used': datetime.datetime(2022, 3, 12, 21, 24, 11, 752171)}. {{(pid=129531) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 12 21:24:11.754696 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] Image-volume cache entry image_update_at = 2022-03-12 20:39:34+00:00, requested image updated_at = 2022-03-12 20:39:34+00:00. {{(pid=129531) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 12 21:24:11.755084 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] Creating from source image-volume 8d802c7b-bd34-4836-bd5d-90755a167ddc {{(pid=129531) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Mar 12 21:24:11.768675 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:24:11.822578 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] creating snapshot='volume-94b99d74-ab5f-4096-94d1-69e6015ded2a.clone_snap' {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Mar 12 21:24:11.896491 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] cloning 'volume-8d802c7b-bd34-4836-bd5d-90755a167ddc@volume-94b99d74-ab5f-4096-94d1-69e6015ded2a.clone_snap' to 'volume-94b99d74-ab5f-4096-94d1-69e6015ded2a' {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Mar 12 21:24:12.019015 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] Volume volume-9916cd82-3d9b-466f-a769-cf81bdc743fd.deleted is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:24:12.020160 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:24:12.020538 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:24:12.035914 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] clone created successfully {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Mar 12 21:24:12.036521 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.volume_utils [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] Marking volume 94b99d74-ab5f-4096-94d1-69e6015ded2a as bootable. {{(pid=129531) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 12 21:24:12.044026 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] Copying metadata from image 539171db-0bd3-4f16-95fd-a7cd5530137d to 94b99d74-ab5f-4096-94d1-69e6015ded2a. {{(pid=129531) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Mar 12 21:24:12.044429 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] Creating volume glance metadata for volume 94b99d74-ab5f-4096-94d1-69e6015ded2a backed by image 539171db-0bd3-4f16-95fd-a7cd5530137d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129531) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Mar 12 21:24:12.105606 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b3667d4-69ce-42d0-ae28-d241a7824827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94b99d74-ab5f-4096-94d1-69e6015ded2a', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:24:12.112665 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7803fbf-9c26-4355-8a6c-47838a4502db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:24:12.121150 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] Volume volume-94b99d74-ab5f-4096-94d1-69e6015ded2a (94b99d74-ab5f-4096-94d1-69e6015ded2a): created successfully Mar 12 21:24:12.125045 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7803fbf-9c26-4355-8a6c-47838a4502db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:24:12.131283 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] Flow 'volume_create_manager' (012005e0-607c-48e5-8bbf-11ed2e0b2ca5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:24:12.138371 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-5666229d-a425-4507-b3d3-7ff6598dbf73 tempest-VolumesCloneTest-1695787821 None] Created volume successfully. Mar 12 21:24:12.903335 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-90a1edce-d540-4fb1-bdf8-4342ce75872f tempest-VolumesCloneTest-1695787821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:24:12.930018 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-90a1edce-d540-4fb1-bdf8-4342ce75872f tempest-VolumesCloneTest-1695787821 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:24:12.930457 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-90a1edce-d540-4fb1-bdf8-4342ce75872f tempest-VolumesCloneTest-1695787821 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:24:12.958542 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-90a1edce-d540-4fb1-bdf8-4342ce75872f tempest-VolumesCloneTest-1695787821 None] Flow 'volume_create_manager' (4200b3da-0d13-4fba-a6fe-44d8fd77416a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:24:12.965080 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-90a1edce-d540-4fb1-bdf8-4342ce75872f tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c589e9f-0339-4a1a-96ae-306d78d276d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:24:12.971532 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-90a1edce-d540-4fb1-bdf8-4342ce75872f tempest-VolumesCloneTest-1695787821 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:24:12.985906 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-90a1edce-d540-4fb1-bdf8-4342ce75872f tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c589e9f-0339-4a1a-96ae-306d78d276d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1839945552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b29a2d3b-577c-49a3-ada6-9a4e3ed68b46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c554f033a20474db39becb560824e10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=94b99d74-ab5f-4096-94d1-69e6015ded2a,status='creating',terminated_at=None,updated_at=2022-03-12T21:24:13Z,use_quota=True,user_id='213d0e2ffa0c4c5b8a1be5a38d3d2fb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:24:12.991361 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-90a1edce-d540-4fb1-bdf8-4342ce75872f tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c6c123b-5e3d-4e02-9742-4dbd4f8693b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:24:12.995535 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-90a1edce-d540-4fb1-bdf8-4342ce75872f tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c6c123b-5e3d-4e02-9742-4dbd4f8693b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:24:13.001378 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-90a1edce-d540-4fb1-bdf8-4342ce75872f tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (814d4ea4-43c5-47ac-a398-724c7706605c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:24:13.015932 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-90a1edce-d540-4fb1-bdf8-4342ce75872f tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (814d4ea4-43c5-47ac-a398-724c7706605c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b29a2d3b-577c-49a3-ada6-9a4e3ed68b46', 'volume_name': 'volume-b29a2d3b-577c-49a3-ada6-9a4e3ed68b46', 'volume_size': 1, 'source_volid': '94b99d74-ab5f-4096-94d1-69e6015ded2a', 'source_volstatus': 'available'}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:24:13.020988 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-90a1edce-d540-4fb1-bdf8-4342ce75872f tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e44c86b-2718-4daa-8ada-09eeea9891d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:24:13.025042 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-90a1edce-d540-4fb1-bdf8-4342ce75872f tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e44c86b-2718-4daa-8ada-09eeea9891d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:24:13.029876 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-90a1edce-d540-4fb1-bdf8-4342ce75872f tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b6b6ea1-26f0-403c-b716-6781f3f229d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:24:13.030989 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-90a1edce-d540-4fb1-bdf8-4342ce75872f tempest-VolumesCloneTest-1695787821 None] Volume b29a2d3b-577c-49a3-ada6-9a4e3ed68b46: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b29a2d3b-577c-49a3-ada6-9a4e3ed68b46', 'volume_size': 1, 'source_volid': '94b99d74-ab5f-4096-94d1-69e6015ded2a', 'source_volstatus': 'available'} Mar 12 21:24:13.042052 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-90a1edce-d540-4fb1-bdf8-4342ce75872f tempest-VolumesCloneTest-1695787821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:24:13.112744 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-90a1edce-d540-4fb1-bdf8-4342ce75872f tempest-VolumesCloneTest-1695787821 None] creating snapshot='volume-b29a2d3b-577c-49a3-ada6-9a4e3ed68b46.clone_snap' {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Mar 12 21:24:13.904896 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-90a1edce-d540-4fb1-bdf8-4342ce75872f tempest-VolumesCloneTest-1695787821 None] cloning 'volume-94b99d74-ab5f-4096-94d1-69e6015ded2a@volume-b29a2d3b-577c-49a3-ada6-9a4e3ed68b46.clone_snap' to 'volume-b29a2d3b-577c-49a3-ada6-9a4e3ed68b46' {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Mar 12 21:24:14.083680 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-90a1edce-d540-4fb1-bdf8-4342ce75872f tempest-VolumesCloneTest-1695787821 None] Volume volume-9916cd82-3d9b-466f-a769-cf81bdc743fd.deleted is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:24:14.084741 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-90a1edce-d540-4fb1-bdf8-4342ce75872f tempest-VolumesCloneTest-1695787821 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:24:14.085120 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-90a1edce-d540-4fb1-bdf8-4342ce75872f tempest-VolumesCloneTest-1695787821 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:24:14.102450 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-90a1edce-d540-4fb1-bdf8-4342ce75872f tempest-VolumesCloneTest-1695787821 None] clone created successfully {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Mar 12 21:24:14.103016 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.volume_utils [None req-90a1edce-d540-4fb1-bdf8-4342ce75872f tempest-VolumesCloneTest-1695787821 None] Marking volume b29a2d3b-577c-49a3-ada6-9a4e3ed68b46 as bootable. {{(pid=129531) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 12 21:24:14.111870 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-90a1edce-d540-4fb1-bdf8-4342ce75872f tempest-VolumesCloneTest-1695787821 None] Copying metadata from source volume 94b99d74-ab5f-4096-94d1-69e6015ded2a to b29a2d3b-577c-49a3-ada6-9a4e3ed68b46. {{(pid=129531) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:431}} Mar 12 21:24:14.138865 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-90a1edce-d540-4fb1-bdf8-4342ce75872f tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b6b6ea1-26f0-403c-b716-6781f3f229d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b29a2d3b-577c-49a3-ada6-9a4e3ed68b46', 'volume_size': 1, 'source_volid': '94b99d74-ab5f-4096-94d1-69e6015ded2a', 'source_volstatus': 'available'}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:24:14.143663 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-90a1edce-d540-4fb1-bdf8-4342ce75872f tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e27f9b01-1266-4e4f-9270-5263df7a35a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:24:14.151233 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-90a1edce-d540-4fb1-bdf8-4342ce75872f tempest-VolumesCloneTest-1695787821 None] Volume volume-b29a2d3b-577c-49a3-ada6-9a4e3ed68b46 (b29a2d3b-577c-49a3-ada6-9a4e3ed68b46): created successfully Mar 12 21:24:14.154822 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-90a1edce-d540-4fb1-bdf8-4342ce75872f tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e27f9b01-1266-4e4f-9270-5263df7a35a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:24:14.160903 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-90a1edce-d540-4fb1-bdf8-4342ce75872f tempest-VolumesCloneTest-1695787821 None] Flow 'volume_create_manager' (4200b3da-0d13-4fba-a6fe-44d8fd77416a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:24:14.172772 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-90a1edce-d540-4fb1-bdf8-4342ce75872f tempest-VolumesCloneTest-1695787821 None] Created volume successfully. Mar 12 21:24:15.293247 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eb7a4ea-6483-4ead-bc06-bf6401fe06d1 tempest-VolumesCloneTest-1695787821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:24:15.296493 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-7eb7a4ea-6483-4ead-bc06-bf6401fe06d1 tempest-VolumesCloneTest-1695787821 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:24:15.298128 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-7eb7a4ea-6483-4ead-bc06-bf6401fe06d1 tempest-VolumesCloneTest-1695787821 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:24:15.316872 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7eb7a4ea-6483-4ead-bc06-bf6401fe06d1 tempest-VolumesCloneTest-1695787821 None] Flow 'volume_create_manager' (011630cf-62a9-4ebf-ad6b-5b37f7b0b493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:24:15.323440 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7eb7a4ea-6483-4ead-bc06-bf6401fe06d1 tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c92c41d-ffd7-4a95-9a47-7d80ed499b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:24:15.329909 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-7eb7a4ea-6483-4ead-bc06-bf6401fe06d1 tempest-VolumesCloneTest-1695787821 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:24:15.344404 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7eb7a4ea-6483-4ead-bc06-bf6401fe06d1 tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c92c41d-ffd7-4a95-9a47-7d80ed499b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1562497551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=020b0637-9315-434e-bf39-3465e3e64792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c554f033a20474db39becb560824e10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:24:15Z,use_quota=True,user_id='213d0e2ffa0c4c5b8a1be5a38d3d2fb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:24:15.349893 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7eb7a4ea-6483-4ead-bc06-bf6401fe06d1 tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (252c1e87-a569-4d7a-97ce-6fc718c03def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:24:15.354080 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7eb7a4ea-6483-4ead-bc06-bf6401fe06d1 tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (252c1e87-a569-4d7a-97ce-6fc718c03def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:24:15.359268 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7eb7a4ea-6483-4ead-bc06-bf6401fe06d1 tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04db5e50-28af-4758-b6f1-14616738b91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:24:15.364113 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7eb7a4ea-6483-4ead-bc06-bf6401fe06d1 tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04db5e50-28af-4758-b6f1-14616738b91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '020b0637-9315-434e-bf39-3465e3e64792', 'volume_name': 'volume-020b0637-9315-434e-bf39-3465e3e64792', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:24:15.369116 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7eb7a4ea-6483-4ead-bc06-bf6401fe06d1 tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (804796fa-3b4c-471c-b21e-a680f5613e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:24:15.373159 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7eb7a4ea-6483-4ead-bc06-bf6401fe06d1 tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (804796fa-3b4c-471c-b21e-a680f5613e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:24:15.378002 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7eb7a4ea-6483-4ead-bc06-bf6401fe06d1 tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af7dcd36-c80a-48e0-889e-6ab1f987b6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:24:15.379075 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-7eb7a4ea-6483-4ead-bc06-bf6401fe06d1 tempest-VolumesCloneTest-1695787821 None] Volume 020b0637-9315-434e-bf39-3465e3e64792: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-020b0637-9315-434e-bf39-3465e3e64792', 'volume_size': 1} Mar 12 21:24:15.379463 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-7eb7a4ea-6483-4ead-bc06-bf6401fe06d1 tempest-VolumesCloneTest-1695787821 None] creating volume 'volume-020b0637-9315-434e-bf39-3465e3e64792' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:24:15.380447 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-7eb7a4ea-6483-4ead-bc06-bf6401fe06d1 tempest-VolumesCloneTest-1695787821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:24:15.428938 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-7eb7a4ea-6483-4ead-bc06-bf6401fe06d1 tempest-VolumesCloneTest-1695787821 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:24:15.429314 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-7eb7a4ea-6483-4ead-bc06-bf6401fe06d1 tempest-VolumesCloneTest-1695787821 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:24:15.433067 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7eb7a4ea-6483-4ead-bc06-bf6401fe06d1 tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af7dcd36-c80a-48e0-889e-6ab1f987b6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-020b0637-9315-434e-bf39-3465e3e64792', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:24:15.437803 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7eb7a4ea-6483-4ead-bc06-bf6401fe06d1 tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfbd1731-3a89-423c-a9c3-c540a7c67dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:24:15.446498 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-7eb7a4ea-6483-4ead-bc06-bf6401fe06d1 tempest-VolumesCloneTest-1695787821 None] Volume volume-020b0637-9315-434e-bf39-3465e3e64792 (020b0637-9315-434e-bf39-3465e3e64792): created successfully Mar 12 21:24:15.450024 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7eb7a4ea-6483-4ead-bc06-bf6401fe06d1 tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfbd1731-3a89-423c-a9c3-c540a7c67dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:24:15.456572 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-7eb7a4ea-6483-4ead-bc06-bf6401fe06d1 tempest-VolumesCloneTest-1695787821 None] Flow 'volume_create_manager' (011630cf-62a9-4ebf-ad6b-5b37f7b0b493) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:24:15.465585 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-7eb7a4ea-6483-4ead-bc06-bf6401fe06d1 tempest-VolumesCloneTest-1695787821 None] Created volume successfully. Mar 12 21:24:16.610730 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fec68f0-26e9-4d84-b2b5-42dac97031dc tempest-VolumesCloneTest-1695787821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:24:16.614118 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-8fec68f0-26e9-4d84-b2b5-42dac97031dc tempest-VolumesCloneTest-1695787821 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:24:16.614562 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-8fec68f0-26e9-4d84-b2b5-42dac97031dc tempest-VolumesCloneTest-1695787821 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:24:16.642307 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8fec68f0-26e9-4d84-b2b5-42dac97031dc tempest-VolumesCloneTest-1695787821 None] Flow 'volume_create_manager' (0fba801e-f679-4454-b6a0-421ba4185586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:24:16.648861 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8fec68f0-26e9-4d84-b2b5-42dac97031dc tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23283352-cab8-4e9b-9b0f-c16e073a830a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:24:16.655301 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-8fec68f0-26e9-4d84-b2b5-42dac97031dc tempest-VolumesCloneTest-1695787821 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:24:16.669614 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8fec68f0-26e9-4d84-b2b5-42dac97031dc tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23283352-cab8-4e9b-9b0f-c16e073a830a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:24:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1759358139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1e65d373-7cda-44a3-9ea0-feabaf2ceeaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c554f033a20474db39becb560824e10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:24:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=020b0637-9315-434e-bf39-3465e3e64792,status='creating',terminated_at=None,updated_at=2022-03-12T21:24:17Z,use_quota=True,user_id='213d0e2ffa0c4c5b8a1be5a38d3d2fb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:24:16.675676 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8fec68f0-26e9-4d84-b2b5-42dac97031dc tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7159f6a-b233-4df7-87af-8b4eb027a203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:24:16.679900 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8fec68f0-26e9-4d84-b2b5-42dac97031dc tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7159f6a-b233-4df7-87af-8b4eb027a203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:24:16.685889 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8fec68f0-26e9-4d84-b2b5-42dac97031dc tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21cd52b6-1674-416d-83cf-837928a1c6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:24:16.702779 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8fec68f0-26e9-4d84-b2b5-42dac97031dc tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21cd52b6-1674-416d-83cf-837928a1c6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1e65d373-7cda-44a3-9ea0-feabaf2ceeaf', 'volume_name': 'volume-1e65d373-7cda-44a3-9ea0-feabaf2ceeaf', 'volume_size': 2, 'source_volid': '020b0637-9315-434e-bf39-3465e3e64792', 'source_volstatus': 'available'}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:24:16.707865 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8fec68f0-26e9-4d84-b2b5-42dac97031dc tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4595528c-bd8d-43f0-8101-a62521c4cb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:24:16.711959 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8fec68f0-26e9-4d84-b2b5-42dac97031dc tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4595528c-bd8d-43f0-8101-a62521c4cb05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:24:16.716857 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8fec68f0-26e9-4d84-b2b5-42dac97031dc tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac258403-be9c-4eb4-9b2e-3b5e099526bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:24:16.717965 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-8fec68f0-26e9-4d84-b2b5-42dac97031dc tempest-VolumesCloneTest-1695787821 None] Volume 1e65d373-7cda-44a3-9ea0-feabaf2ceeaf: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1e65d373-7cda-44a3-9ea0-feabaf2ceeaf', 'volume_size': 2, 'source_volid': '020b0637-9315-434e-bf39-3465e3e64792', 'source_volstatus': 'available'} Mar 12 21:24:16.728335 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8fec68f0-26e9-4d84-b2b5-42dac97031dc tempest-VolumesCloneTest-1695787821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:24:16.764947 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8fec68f0-26e9-4d84-b2b5-42dac97031dc tempest-VolumesCloneTest-1695787821 None] creating snapshot='volume-1e65d373-7cda-44a3-9ea0-feabaf2ceeaf.clone_snap' {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Mar 12 21:24:16.921849 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8fec68f0-26e9-4d84-b2b5-42dac97031dc tempest-VolumesCloneTest-1695787821 None] cloning 'volume-020b0637-9315-434e-bf39-3465e3e64792@volume-1e65d373-7cda-44a3-9ea0-feabaf2ceeaf.clone_snap' to 'volume-1e65d373-7cda-44a3-9ea0-feabaf2ceeaf' {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Mar 12 21:24:17.004675 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8fec68f0-26e9-4d84-b2b5-42dac97031dc tempest-VolumesCloneTest-1695787821 None] Volume volume-020b0637-9315-434e-bf39-3465e3e64792 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:24:17.005871 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8fec68f0-26e9-4d84-b2b5-42dac97031dc tempest-VolumesCloneTest-1695787821 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:24:17.006258 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8fec68f0-26e9-4d84-b2b5-42dac97031dc tempest-VolumesCloneTest-1695787821 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:24:17.018741 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8fec68f0-26e9-4d84-b2b5-42dac97031dc tempest-VolumesCloneTest-1695787821 None] resize volume 'volume-1e65d373-7cda-44a3-9ea0-feabaf2ceeaf' from 1 to 2 {{(pid=129531) _extend_if_required /opt/stack/cinder/cinder/volume/drivers/rbd.py:742}} Mar 12 21:24:17.019358 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8fec68f0-26e9-4d84-b2b5-42dac97031dc tempest-VolumesCloneTest-1695787821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:24:17.122140 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-8fec68f0-26e9-4d84-b2b5-42dac97031dc tempest-VolumesCloneTest-1695787821 None] clone created successfully {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Mar 12 21:24:17.126301 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8fec68f0-26e9-4d84-b2b5-42dac97031dc tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac258403-be9c-4eb4-9b2e-3b5e099526bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e65d373-7cda-44a3-9ea0-feabaf2ceeaf', 'volume_size': 2, 'source_volid': '020b0637-9315-434e-bf39-3465e3e64792', 'source_volstatus': 'available'}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:24:17.130988 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8fec68f0-26e9-4d84-b2b5-42dac97031dc tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1710de8-ef38-4c52-a8cc-39c31d50c9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:24:17.139623 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-8fec68f0-26e9-4d84-b2b5-42dac97031dc tempest-VolumesCloneTest-1695787821 None] Volume volume-1e65d373-7cda-44a3-9ea0-feabaf2ceeaf (1e65d373-7cda-44a3-9ea0-feabaf2ceeaf): created successfully Mar 12 21:24:17.143255 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8fec68f0-26e9-4d84-b2b5-42dac97031dc tempest-VolumesCloneTest-1695787821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1710de8-ef38-4c52-a8cc-39c31d50c9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:24:17.148972 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-8fec68f0-26e9-4d84-b2b5-42dac97031dc tempest-VolumesCloneTest-1695787821 None] Flow 'volume_create_manager' (0fba801e-f679-4454-b6a0-421ba4185586) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:24:17.160921 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-8fec68f0-26e9-4d84-b2b5-42dac97031dc tempest-VolumesCloneTest-1695787821 None] Created volume successfully. Mar 12 21:24:17.717688 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-31502c39-e6e0-457c-8c1b-7bedd5edbc86 tempest-VolumesCloneTest-1695787821 None] Lock "b'cinder-1e65d373-7cda-44a3-9ea0-feabaf2ceeaf-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:24:17.747880 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-31502c39-e6e0-457c-8c1b-7bedd5edbc86 tempest-VolumesCloneTest-1695787821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:24:17.796076 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-31502c39-e6e0-457c-8c1b-7bedd5edbc86 tempest-VolumesCloneTest-1695787821 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:24:17.802697 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-31502c39-e6e0-457c-8c1b-7bedd5edbc86 tempest-VolumesCloneTest-1695787821 None] deleting rbd volume volume-1e65d373-7cda-44a3-9ea0-feabaf2ceeaf {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:24:17.973028 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-31502c39-e6e0-457c-8c1b-7bedd5edbc86 tempest-VolumesCloneTest-1695787821 None] volume is a clone so cleaning references {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Mar 12 21:24:17.990182 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-31502c39-e6e0-457c-8c1b-7bedd5edbc86 tempest-VolumesCloneTest-1695787821 None] Volume volume-020b0637-9315-434e-bf39-3465e3e64792 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:24:17.990752 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-31502c39-e6e0-457c-8c1b-7bedd5edbc86 tempest-VolumesCloneTest-1695787821 None] deleting parent snapshot volume-1e65d373-7cda-44a3-9ea0-feabaf2ceeaf.clone_snap {{(pid=129531) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Mar 12 21:24:18.887532 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-31502c39-e6e0-457c-8c1b-7bedd5edbc86 tempest-VolumesCloneTest-1695787821 None] Created reservations ['8c43a454-98a9-4e11-b0ac-c746f29ce50d', '318116b1-c165-4237-8b3c-355b1db2e38d', '8821d07c-95ba-4854-bb77-a0f2b2d763b2', 'a4ff7157-b95f-48e0-b5e4-c2845f2b180b'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:24:18.931134 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-31502c39-e6e0-457c-8c1b-7bedd5edbc86 tempest-VolumesCloneTest-1695787821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:24:18.953026 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-31502c39-e6e0-457c-8c1b-7bedd5edbc86 tempest-VolumesCloneTest-1695787821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:24:18.974400 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-31502c39-e6e0-457c-8c1b-7bedd5edbc86 tempest-VolumesCloneTest-1695787821 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:24:18.979575 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-31502c39-e6e0-457c-8c1b-7bedd5edbc86 tempest-VolumesCloneTest-1695787821 None] Deleted volume successfully. Mar 12 21:24:18.991729 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-31502c39-e6e0-457c-8c1b-7bedd5edbc86 tempest-VolumesCloneTest-1695787821 None] Lock "b'cinder-1e65d373-7cda-44a3-9ea0-feabaf2ceeaf-delete_volume'" released by "delete_volume" :: held 1.274s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:24:19.899151 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-aeccecf4-410b-430a-8427-1ea9399df548 tempest-VolumesCloneTest-1695787821 None] Lock "b'cinder-020b0637-9315-434e-bf39-3465e3e64792-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:24:19.932715 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-aeccecf4-410b-430a-8427-1ea9399df548 tempest-VolumesCloneTest-1695787821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:24:19.970462 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-aeccecf4-410b-430a-8427-1ea9399df548 tempest-VolumesCloneTest-1695787821 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:24:19.970916 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-aeccecf4-410b-430a-8427-1ea9399df548 tempest-VolumesCloneTest-1695787821 None] Volume volume-020b0637-9315-434e-bf39-3465e3e64792 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:24:19.975944 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-aeccecf4-410b-430a-8427-1ea9399df548 tempest-VolumesCloneTest-1695787821 None] deleting rbd volume volume-020b0637-9315-434e-bf39-3465e3e64792 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:24:20.167365 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-aeccecf4-410b-430a-8427-1ea9399df548 tempest-VolumesCloneTest-1695787821 None] Created reservations ['f6b71224-c0c1-47b0-9ed3-7644f614f884', '549180f2-297c-46d6-bed3-2c75694f9f78', '48e5c938-a664-4483-a932-7c7fedba807e', '694ecb23-de87-4de1-a704-ba6a64f8a8d2'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:24:20.207897 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-aeccecf4-410b-430a-8427-1ea9399df548 tempest-VolumesCloneTest-1695787821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:24:20.228968 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-aeccecf4-410b-430a-8427-1ea9399df548 tempest-VolumesCloneTest-1695787821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:24:20.251727 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-aeccecf4-410b-430a-8427-1ea9399df548 tempest-VolumesCloneTest-1695787821 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:24:20.256629 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-aeccecf4-410b-430a-8427-1ea9399df548 tempest-VolumesCloneTest-1695787821 None] Deleted volume successfully. Mar 12 21:24:20.267384 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-aeccecf4-410b-430a-8427-1ea9399df548 tempest-VolumesCloneTest-1695787821 None] Lock "b'cinder-020b0637-9315-434e-bf39-3465e3e64792-delete_volume'" released by "delete_volume" :: held 0.368s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:24:21.014824 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-531a334f-30da-4c82-96dc-157990b7f573 tempest-VolumesCloneTest-1695787821 None] Lock "b'cinder-b29a2d3b-577c-49a3-ada6-9a4e3ed68b46-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:24:21.045670 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-531a334f-30da-4c82-96dc-157990b7f573 tempest-VolumesCloneTest-1695787821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:24:21.118797 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-531a334f-30da-4c82-96dc-157990b7f573 tempest-VolumesCloneTest-1695787821 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:24:21.126155 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-531a334f-30da-4c82-96dc-157990b7f573 tempest-VolumesCloneTest-1695787821 None] deleting rbd volume volume-b29a2d3b-577c-49a3-ada6-9a4e3ed68b46 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:24:21.289455 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-531a334f-30da-4c82-96dc-157990b7f573 tempest-VolumesCloneTest-1695787821 None] volume is a clone so cleaning references {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Mar 12 21:24:21.332621 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-531a334f-30da-4c82-96dc-157990b7f573 tempest-VolumesCloneTest-1695787821 None] deleting parent snapshot volume-b29a2d3b-577c-49a3-ada6-9a4e3ed68b46.clone_snap {{(pid=129531) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Mar 12 21:24:22.003222 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-531a334f-30da-4c82-96dc-157990b7f573 tempest-VolumesCloneTest-1695787821 None] Created reservations ['edc38b26-4958-48db-b042-9f85130fa09d', '02c40e91-aa39-47a1-992a-b0d91df918b6', '795c6200-0dca-4b9b-9599-ab935ef45f93', 'c0c8a6c9-97e9-4bed-9cb8-dca483552c09'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:24:22.045476 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-531a334f-30da-4c82-96dc-157990b7f573 tempest-VolumesCloneTest-1695787821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:24:22.074907 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-531a334f-30da-4c82-96dc-157990b7f573 tempest-VolumesCloneTest-1695787821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:24:22.101375 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-531a334f-30da-4c82-96dc-157990b7f573 tempest-VolumesCloneTest-1695787821 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:24:22.105389 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-531a334f-30da-4c82-96dc-157990b7f573 tempest-VolumesCloneTest-1695787821 None] Deleted volume successfully. Mar 12 21:24:22.118069 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-531a334f-30da-4c82-96dc-157990b7f573 tempest-VolumesCloneTest-1695787821 None] Lock "b'cinder-b29a2d3b-577c-49a3-ada6-9a4e3ed68b46-delete_volume'" released by "delete_volume" :: held 1.103s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:24:22.154623 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-ce9e5fce-b24b-4cd5-8499-09eb1bd58985 tempest-VolumesCloneTest-1695787821 None] Lock "b'cinder-94b99d74-ab5f-4096-94d1-69e6015ded2a-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:24:22.187164 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-ce9e5fce-b24b-4cd5-8499-09eb1bd58985 tempest-VolumesCloneTest-1695787821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:24:22.248500 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-ce9e5fce-b24b-4cd5-8499-09eb1bd58985 tempest-VolumesCloneTest-1695787821 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:24:22.255486 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-ce9e5fce-b24b-4cd5-8499-09eb1bd58985 tempest-VolumesCloneTest-1695787821 None] deleting rbd volume volume-94b99d74-ab5f-4096-94d1-69e6015ded2a {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:24:22.413843 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-ce9e5fce-b24b-4cd5-8499-09eb1bd58985 tempest-VolumesCloneTest-1695787821 None] volume is a clone so cleaning references {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Mar 12 21:24:22.443712 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-ce9e5fce-b24b-4cd5-8499-09eb1bd58985 tempest-VolumesCloneTest-1695787821 None] deleting parent snapshot volume-94b99d74-ab5f-4096-94d1-69e6015ded2a.clone_snap {{(pid=129531) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Mar 12 21:24:23.029562 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-ce9e5fce-b24b-4cd5-8499-09eb1bd58985 tempest-VolumesCloneTest-1695787821 None] Created reservations ['a7b5258b-f018-4dac-9f64-2753f0bfe40d', '0ebd39ff-95a0-4b2e-b5ef-2e62e0ffa341', 'bc3a80f7-48ef-4c71-8e03-ea3320ec4645', 'ce659c8e-84f7-4be9-9c7c-c94186271980'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:24:23.066685 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-b5da7e03-b62f-44ea-8eb9-e4c6f39a63a5 tempest-TestVolumeBootPattern-1001263199 None] Created reservations ['94ada5dd-e6f3-4aba-b05f-59dfc29f206b', '193bbb70-d0a7-43ef-b028-b03358e7243b', '5d78a27e-1347-4250-a54c-d1ccb183f659', '6f4ca344-1b38-4f01-8381-45c8d717f70d'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:24:23.092788 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-ce9e5fce-b24b-4cd5-8499-09eb1bd58985 tempest-VolumesCloneTest-1695787821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:24:23.115648 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-ce9e5fce-b24b-4cd5-8499-09eb1bd58985 tempest-VolumesCloneTest-1695787821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:24:23.137666 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-ce9e5fce-b24b-4cd5-8499-09eb1bd58985 tempest-VolumesCloneTest-1695787821 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:24:23.145665 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-ce9e5fce-b24b-4cd5-8499-09eb1bd58985 tempest-VolumesCloneTest-1695787821 None] Deleted volume successfully. Mar 12 21:24:23.161239 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-ce9e5fce-b24b-4cd5-8499-09eb1bd58985 tempest-VolumesCloneTest-1695787821 None] Lock "b'cinder-94b99d74-ab5f-4096-94d1-69e6015ded2a-delete_volume'" released by "delete_volume" :: held 1.007s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:24:23.163081 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-b5da7e03-b62f-44ea-8eb9-e4c6f39a63a5 tempest-TestVolumeBootPattern-1001263199 None] Delete snapshot completed successfully. Mar 12 21:24:23.167269 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-b5da7e03-b62f-44ea-8eb9-e4c6f39a63a5 tempest-TestVolumeBootPattern-1001263199 None] Lock "b'cinder-0f010416-9985-4dc8-9bea-9f5dbced4850-delete_snapshot'" released by "delete_snapshot" :: held 30.486s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:24:27.076849 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-70071ff2-9cc9-4c8f-b80c-0b1a89bfd959 req-74546c39-2d08-4230-a002-94d1f9945251 tempest-TestVolumeBootPattern-1001263199 None] Terminate volume connection completed successfully. Mar 12 21:24:27.077438 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-70071ff2-9cc9-4c8f-b80c-0b1a89bfd959 req-74546c39-2d08-4230-a002-94d1f9945251 tempest-TestVolumeBootPattern-1001263199 None] Deleting attachment 20363558-125a-47fa-8afb-3cc2818fe3cb. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 21:24:28.922900 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-3e25bf63-bb3e-43c8-8231-c99ecc3c89fb tempest-TestVolumeBootPattern-1001263199 None] Lock "b'cinder-feb089af-2825-4985-aa6e-09e75c64231e-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:24:28.951750 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3e25bf63-bb3e-43c8-8231-c99ecc3c89fb tempest-TestVolumeBootPattern-1001263199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:24:29.013430 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3e25bf63-bb3e-43c8-8231-c99ecc3c89fb tempest-TestVolumeBootPattern-1001263199 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:24:29.019669 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3e25bf63-bb3e-43c8-8231-c99ecc3c89fb tempest-TestVolumeBootPattern-1001263199 None] deleting rbd volume volume-feb089af-2825-4985-aa6e-09e75c64231e {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:24:29.240131 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3e25bf63-bb3e-43c8-8231-c99ecc3c89fb tempest-TestVolumeBootPattern-1001263199 None] volume is a clone so cleaning references {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Mar 12 21:24:29.277338 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3e25bf63-bb3e-43c8-8231-c99ecc3c89fb tempest-TestVolumeBootPattern-1001263199 None] deleting parent snapshot volume-feb089af-2825-4985-aa6e-09e75c64231e.clone_snap {{(pid=129531) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Mar 12 21:24:29.908516 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-3e25bf63-bb3e-43c8-8231-c99ecc3c89fb tempest-TestVolumeBootPattern-1001263199 None] Created reservations ['57ce13cb-c844-4a80-8c69-06a31482e3cf', '67c65aac-c75e-4b49-8153-bc064f4ed068', 'e1e86125-b3b1-4dd8-be06-dc13d86781c2', '5840e0d2-d6fe-4a27-b492-61becb7ad6be'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:24:29.951429 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3e25bf63-bb3e-43c8-8231-c99ecc3c89fb tempest-TestVolumeBootPattern-1001263199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:24:29.982113 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-3e25bf63-bb3e-43c8-8231-c99ecc3c89fb tempest-TestVolumeBootPattern-1001263199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:24:30.011822 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-3e25bf63-bb3e-43c8-8231-c99ecc3c89fb tempest-TestVolumeBootPattern-1001263199 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:24:30.015886 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-3e25bf63-bb3e-43c8-8231-c99ecc3c89fb tempest-TestVolumeBootPattern-1001263199 None] Deleted volume successfully. Mar 12 21:24:30.027675 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-3e25bf63-bb3e-43c8-8231-c99ecc3c89fb tempest-TestVolumeBootPattern-1001263199 None] Lock "b'cinder-feb089af-2825-4985-aa6e-09e75c64231e-delete_volume'" released by "delete_volume" :: held 1.105s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:24:51.318829 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:24:51.319495 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:24:51.340769 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:24:51.362513 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:25:51.317626 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:25:51.318336 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:25:51.339518 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:25:51.361102 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:26:51.315872 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:26:51.316568 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:26:51.337575 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:26:51.359195 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:27:51.314769 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:27:51.315445 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:27:51.337538 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:27:51.358425 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:28:51.313456 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:28:51.314230 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:28:51.338608 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:28:51.362833 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:29:51.309225 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:29:51.309967 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:29:51.336233 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:29:51.384897 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:30:51.311494 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:30:51.312173 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:30:51.333066 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:30:51.353977 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:31:51.309027 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:31:51.310672 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:31:51.355163 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:31:51.389890 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:32:51.305138 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:32:51.306021 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:32:51.334535 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:32:51.374513 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:33:03.260851 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-9baf8e29-dc06-4750-b11b-294da5734ac1 tempest-ServerActionsTestJSON-1173026094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:33:03.265431 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-9baf8e29-dc06-4750-b11b-294da5734ac1 tempest-ServerActionsTestJSON-1173026094 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:33:03.266121 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-9baf8e29-dc06-4750-b11b-294da5734ac1 tempest-ServerActionsTestJSON-1173026094 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:33:03.287142 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9baf8e29-dc06-4750-b11b-294da5734ac1 tempest-ServerActionsTestJSON-1173026094 None] Flow 'volume_create_manager' (e6be4b31-959d-4cd4-8962-e7f702d2cfd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:33:03.294053 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9baf8e29-dc06-4750-b11b-294da5734ac1 tempest-ServerActionsTestJSON-1173026094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df35540-5d7a-462c-a2d4-e4a861f0376e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:33:03.300531 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-9baf8e29-dc06-4750-b11b-294da5734ac1 tempest-ServerActionsTestJSON-1173026094 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:33:03.315755 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9baf8e29-dc06-4750-b11b-294da5734ac1 tempest-ServerActionsTestJSON-1173026094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df35540-5d7a-462c-a2d4-e4a861f0376e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1234436702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f38d0574-4c66-480c-a8f6-8b21ad0a473a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b7d22f573c34c77b0bc58bc6b248070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:33:03Z,use_quota=True,user_id='2dc99cab406e42d6b6cd00fddedaf960',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:33:03.321670 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9baf8e29-dc06-4750-b11b-294da5734ac1 tempest-ServerActionsTestJSON-1173026094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c164ace6-17b1-4d9f-a1a4-f6975bbfca05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:33:03.326229 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9baf8e29-dc06-4750-b11b-294da5734ac1 tempest-ServerActionsTestJSON-1173026094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c164ace6-17b1-4d9f-a1a4-f6975bbfca05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:33:03.332214 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9baf8e29-dc06-4750-b11b-294da5734ac1 tempest-ServerActionsTestJSON-1173026094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7844e4d-3950-425a-b09e-a4cbd6d20ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:33:03.336539 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9baf8e29-dc06-4750-b11b-294da5734ac1 tempest-ServerActionsTestJSON-1173026094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7844e4d-3950-425a-b09e-a4cbd6d20ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f38d0574-4c66-480c-a8f6-8b21ad0a473a', 'volume_name': 'volume-f38d0574-4c66-480c-a8f6-8b21ad0a473a', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:33:03.342885 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9baf8e29-dc06-4750-b11b-294da5734ac1 tempest-ServerActionsTestJSON-1173026094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa7a756b-a4ed-45cd-b76f-c81007913cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:33:03.347220 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9baf8e29-dc06-4750-b11b-294da5734ac1 tempest-ServerActionsTestJSON-1173026094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa7a756b-a4ed-45cd-b76f-c81007913cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:33:03.352064 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9baf8e29-dc06-4750-b11b-294da5734ac1 tempest-ServerActionsTestJSON-1173026094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7cc525a-d824-44d5-81bd-f3b4fd3228bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:33:03.353165 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-9baf8e29-dc06-4750-b11b-294da5734ac1 tempest-ServerActionsTestJSON-1173026094 None] Volume f38d0574-4c66-480c-a8f6-8b21ad0a473a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f38d0574-4c66-480c-a8f6-8b21ad0a473a', 'volume_size': 1} Mar 12 21:33:03.353559 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9baf8e29-dc06-4750-b11b-294da5734ac1 tempest-ServerActionsTestJSON-1173026094 None] creating volume 'volume-f38d0574-4c66-480c-a8f6-8b21ad0a473a' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:33:03.354738 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9baf8e29-dc06-4750-b11b-294da5734ac1 tempest-ServerActionsTestJSON-1173026094 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:33:03.424129 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9baf8e29-dc06-4750-b11b-294da5734ac1 tempest-ServerActionsTestJSON-1173026094 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:33:03.424509 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9baf8e29-dc06-4750-b11b-294da5734ac1 tempest-ServerActionsTestJSON-1173026094 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:33:03.428347 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9baf8e29-dc06-4750-b11b-294da5734ac1 tempest-ServerActionsTestJSON-1173026094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7cc525a-d824-44d5-81bd-f3b4fd3228bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f38d0574-4c66-480c-a8f6-8b21ad0a473a', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:33:03.433079 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9baf8e29-dc06-4750-b11b-294da5734ac1 tempest-ServerActionsTestJSON-1173026094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40803bc9-85cb-4bbb-9fbc-dde37c471e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:33:03.442876 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-9baf8e29-dc06-4750-b11b-294da5734ac1 tempest-ServerActionsTestJSON-1173026094 None] Volume volume-f38d0574-4c66-480c-a8f6-8b21ad0a473a (f38d0574-4c66-480c-a8f6-8b21ad0a473a): created successfully Mar 12 21:33:03.446543 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9baf8e29-dc06-4750-b11b-294da5734ac1 tempest-ServerActionsTestJSON-1173026094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40803bc9-85cb-4bbb-9fbc-dde37c471e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:33:03.452914 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9baf8e29-dc06-4750-b11b-294da5734ac1 tempest-ServerActionsTestJSON-1173026094 None] Flow 'volume_create_manager' (e6be4b31-959d-4cd4-8962-e7f702d2cfd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:33:03.462976 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-9baf8e29-dc06-4750-b11b-294da5734ac1 tempest-ServerActionsTestJSON-1173026094 None] Created volume successfully. Mar 12 21:33:04.821793 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-c403419f-39c5-459c-a79f-d2afa44e8978 req-dc56c2a4-6adc-4393-adf8-ca141c3ca023 tempest-ServerActionsTestJSON-1173026094 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 21:33:05.461503 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-c403419f-39c5-459c-a79f-d2afa44e8978 req-dc56c2a4-6adc-4393-adf8-ca141c3ca023 tempest-ServerActionsTestJSON-1173026094 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.639s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 21:33:05.462367 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-c403419f-39c5-459c-a79f-d2afa44e8978 req-dc56c2a4-6adc-4393-adf8-ca141c3ca023 tempest-ServerActionsTestJSON-1173026094 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f38d0574-4c66-480c-a8f6-8b21ad0a473a', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': 'f38d0574-4c66-480c-a8f6-8b21ad0a473a', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 21:33:05.485146 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-c403419f-39c5-459c-a79f-d2afa44e8978 req-dc56c2a4-6adc-4393-adf8-ca141c3ca023 tempest-ServerActionsTestJSON-1173026094 None] Connection info returned from driver {'name': 'volumes/volume-f38d0574-4c66-480c-a8f6-8b21ad0a473a', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f38d0574-4c66-480c-a8f6-8b21ad0a473a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f2513c22-3316-4dd1-8f5b-fdd52ededc76'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 21:33:05.528806 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-c403419f-39c5-459c-a79f-d2afa44e8978 req-dc56c2a4-6adc-4393-adf8-ca141c3ca023 tempest-ServerActionsTestJSON-1173026094 None] attachment_update completed successfully. Mar 12 21:33:26.147765 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-6c22e5d5-a017-48d2-89e4-6cad9a1f8043 req-58009b8a-5a34-46d9-9d5c-86d34dcf703d tempest-ServerActionsTestJSON-1173026094 None] Terminate volume connection completed successfully. Mar 12 21:33:26.148436 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-6c22e5d5-a017-48d2-89e4-6cad9a1f8043 req-58009b8a-5a34-46d9-9d5c-86d34dcf703d tempest-ServerActionsTestJSON-1173026094 None] Deleting attachment f2513c22-3316-4dd1-8f5b-fdd52ededc76. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 21:33:27.932632 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-6c22e5d5-a017-48d2-89e4-6cad9a1f8043 req-e0433e7e-aa93-42b2-b8c0-beb931ce4b5f tempest-ServerActionsTestJSON-1173026094 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 21:33:28.576991 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-6c22e5d5-a017-48d2-89e4-6cad9a1f8043 req-e0433e7e-aa93-42b2-b8c0-beb931ce4b5f tempest-ServerActionsTestJSON-1173026094 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.644s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 21:33:28.577856 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-6c22e5d5-a017-48d2-89e4-6cad9a1f8043 req-e0433e7e-aa93-42b2-b8c0-beb931ce4b5f tempest-ServerActionsTestJSON-1173026094 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f38d0574-4c66-480c-a8f6-8b21ad0a473a', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': 'f38d0574-4c66-480c-a8f6-8b21ad0a473a', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 21:33:28.600553 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-6c22e5d5-a017-48d2-89e4-6cad9a1f8043 req-e0433e7e-aa93-42b2-b8c0-beb931ce4b5f tempest-ServerActionsTestJSON-1173026094 None] Connection info returned from driver {'name': 'volumes/volume-f38d0574-4c66-480c-a8f6-8b21ad0a473a', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f38d0574-4c66-480c-a8f6-8b21ad0a473a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a35f239e-bf4f-4441-b0d3-3dd7bdaee7db'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 21:33:28.647769 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-6c22e5d5-a017-48d2-89e4-6cad9a1f8043 req-e0433e7e-aa93-42b2-b8c0-beb931ce4b5f tempest-ServerActionsTestJSON-1173026094 None] attachment_update completed successfully. Mar 12 21:33:35.756114 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-acdaeda3-1e84-44c2-bfbd-0dedf5fb6e8b req-2f10798b-db6d-4dd5-8d73-604203f9e3b4 tempest-ServerActionsTestJSON-1173026094 None] Terminate volume connection completed successfully. Mar 12 21:33:35.756719 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-acdaeda3-1e84-44c2-bfbd-0dedf5fb6e8b req-2f10798b-db6d-4dd5-8d73-604203f9e3b4 tempest-ServerActionsTestJSON-1173026094 None] Deleting attachment a35f239e-bf4f-4441-b0d3-3dd7bdaee7db. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 21:33:38.134552 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-acdaeda3-1e84-44c2-bfbd-0dedf5fb6e8b req-e651a990-1122-4d28-925e-4766a4361891 tempest-ServerActionsTestJSON-1173026094 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 21:33:38.797761 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-acdaeda3-1e84-44c2-bfbd-0dedf5fb6e8b req-e651a990-1122-4d28-925e-4766a4361891 tempest-ServerActionsTestJSON-1173026094 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.663s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 21:33:38.798670 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-acdaeda3-1e84-44c2-bfbd-0dedf5fb6e8b req-e651a990-1122-4d28-925e-4766a4361891 tempest-ServerActionsTestJSON-1173026094 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f38d0574-4c66-480c-a8f6-8b21ad0a473a', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': 'f38d0574-4c66-480c-a8f6-8b21ad0a473a', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 21:33:38.821472 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-acdaeda3-1e84-44c2-bfbd-0dedf5fb6e8b req-e651a990-1122-4d28-925e-4766a4361891 tempest-ServerActionsTestJSON-1173026094 None] Connection info returned from driver {'name': 'volumes/volume-f38d0574-4c66-480c-a8f6-8b21ad0a473a', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f38d0574-4c66-480c-a8f6-8b21ad0a473a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b4450ce8-bfcb-47c2-84a7-3cbd6e2323af'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 21:33:38.867398 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-acdaeda3-1e84-44c2-bfbd-0dedf5fb6e8b req-e651a990-1122-4d28-925e-4766a4361891 tempest-ServerActionsTestJSON-1173026094 None] attachment_update completed successfully. Mar 12 21:33:44.902839 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-7126a51f-54a2-42a8-944e-aecbf9f4c2e1 req-554f996d-1ca2-40df-a18f-ed0fbf8eb0d0 tempest-ServerActionsTestJSON-1173026094 None] Terminate volume connection completed successfully. Mar 12 21:33:44.903573 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-7126a51f-54a2-42a8-944e-aecbf9f4c2e1 req-554f996d-1ca2-40df-a18f-ed0fbf8eb0d0 tempest-ServerActionsTestJSON-1173026094 None] Deleting attachment b4450ce8-bfcb-47c2-84a7-3cbd6e2323af. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 21:33:46.067691 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-9482276d-e1b6-4cfb-b5de-a47ec9b4f193 tempest-ServerActionsTestJSON-1173026094 None] Lock "b'cinder-f38d0574-4c66-480c-a8f6-8b21ad0a473a-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:33:46.097627 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9482276d-e1b6-4cfb-b5de-a47ec9b4f193 tempest-ServerActionsTestJSON-1173026094 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:33:46.135046 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9482276d-e1b6-4cfb-b5de-a47ec9b4f193 tempest-ServerActionsTestJSON-1173026094 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:33:46.135589 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9482276d-e1b6-4cfb-b5de-a47ec9b4f193 tempest-ServerActionsTestJSON-1173026094 None] Volume volume-f38d0574-4c66-480c-a8f6-8b21ad0a473a is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:33:46.141082 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9482276d-e1b6-4cfb-b5de-a47ec9b4f193 tempest-ServerActionsTestJSON-1173026094 None] deleting rbd volume volume-f38d0574-4c66-480c-a8f6-8b21ad0a473a {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:33:46.326744 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-9482276d-e1b6-4cfb-b5de-a47ec9b4f193 tempest-ServerActionsTestJSON-1173026094 None] Created reservations ['2419cedc-11ca-42d9-b271-e47a1316b0fa', 'd4154601-f9ae-4406-85b6-ea299df88658', '02da946c-8582-48f0-b1b6-01069d23ba0c', '31c9cf36-4b6c-44ed-8aad-80dea2f8c631'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:33:46.372044 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9482276d-e1b6-4cfb-b5de-a47ec9b4f193 tempest-ServerActionsTestJSON-1173026094 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:33:46.394578 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9482276d-e1b6-4cfb-b5de-a47ec9b4f193 tempest-ServerActionsTestJSON-1173026094 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:33:46.417599 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-9482276d-e1b6-4cfb-b5de-a47ec9b4f193 tempest-ServerActionsTestJSON-1173026094 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:33:46.422986 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-9482276d-e1b6-4cfb-b5de-a47ec9b4f193 tempest-ServerActionsTestJSON-1173026094 None] Deleted volume successfully. Mar 12 21:33:46.434455 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-9482276d-e1b6-4cfb-b5de-a47ec9b4f193 tempest-ServerActionsTestJSON-1173026094 None] Lock "b'cinder-f38d0574-4c66-480c-a8f6-8b21ad0a473a-delete_volume'" released by "delete_volume" :: held 0.367s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:33:51.309060 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:33:51.310477 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:33:51.340119 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:33:51.368268 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:34:51.314924 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:34:51.316396 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:34:51.355463 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:34:51.393700 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:35:14.584225 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-2594d53d-9a67-49f1-9063-cc415b229a3d tempest-TestMinimumBasicScenario-1749035881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:35:14.588017 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-2594d53d-9a67-49f1-9063-cc415b229a3d tempest-TestMinimumBasicScenario-1749035881 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:35:14.588502 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-2594d53d-9a67-49f1-9063-cc415b229a3d tempest-TestMinimumBasicScenario-1749035881 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:35:14.608013 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2594d53d-9a67-49f1-9063-cc415b229a3d tempest-TestMinimumBasicScenario-1749035881 None] Flow 'volume_create_manager' (d9fcc5fe-f119-4af6-b032-ccf1f2c55852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:35:14.615182 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2594d53d-9a67-49f1-9063-cc415b229a3d tempest-TestMinimumBasicScenario-1749035881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fabef749-17ff-41d7-b2ef-586de6a2e4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:35:14.622072 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-2594d53d-9a67-49f1-9063-cc415b229a3d tempest-TestMinimumBasicScenario-1749035881 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:35:14.637253 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2594d53d-9a67-49f1-9063-cc415b229a3d tempest-TestMinimumBasicScenario-1749035881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fabef749-17ff-41d7-b2ef-586de6a2e4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1417772568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ec6c3fe2-8c71-43b5-b5e6-a13ef83c84f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf5558ecf7a94032ba36db2e467d97ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:35:15Z,use_quota=True,user_id='4111688f50434e13b938b6c99c71912b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:35:14.642818 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2594d53d-9a67-49f1-9063-cc415b229a3d tempest-TestMinimumBasicScenario-1749035881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (001a9d8c-a81a-4a67-aa7e-b74192d82b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:35:14.646995 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2594d53d-9a67-49f1-9063-cc415b229a3d tempest-TestMinimumBasicScenario-1749035881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (001a9d8c-a81a-4a67-aa7e-b74192d82b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:35:14.652121 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2594d53d-9a67-49f1-9063-cc415b229a3d tempest-TestMinimumBasicScenario-1749035881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (073db55e-7993-4f8e-8883-c191846df975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:35:14.656343 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2594d53d-9a67-49f1-9063-cc415b229a3d tempest-TestMinimumBasicScenario-1749035881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (073db55e-7993-4f8e-8883-c191846df975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec6c3fe2-8c71-43b5-b5e6-a13ef83c84f1', 'volume_name': 'volume-ec6c3fe2-8c71-43b5-b5e6-a13ef83c84f1', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:35:14.661292 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2594d53d-9a67-49f1-9063-cc415b229a3d tempest-TestMinimumBasicScenario-1749035881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30caf456-9961-4747-87c0-b28469ae2439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:35:14.665274 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2594d53d-9a67-49f1-9063-cc415b229a3d tempest-TestMinimumBasicScenario-1749035881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30caf456-9961-4747-87c0-b28469ae2439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:35:14.670305 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2594d53d-9a67-49f1-9063-cc415b229a3d tempest-TestMinimumBasicScenario-1749035881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7409b149-35bd-4e6e-abb2-653987efca6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:35:14.671367 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-2594d53d-9a67-49f1-9063-cc415b229a3d tempest-TestMinimumBasicScenario-1749035881 None] Volume ec6c3fe2-8c71-43b5-b5e6-a13ef83c84f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec6c3fe2-8c71-43b5-b5e6-a13ef83c84f1', 'volume_size': 1} Mar 12 21:35:14.671754 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2594d53d-9a67-49f1-9063-cc415b229a3d tempest-TestMinimumBasicScenario-1749035881 None] creating volume 'volume-ec6c3fe2-8c71-43b5-b5e6-a13ef83c84f1' {{(pid=129531) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 12 21:35:14.672737 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2594d53d-9a67-49f1-9063-cc415b229a3d tempest-TestMinimumBasicScenario-1749035881 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:35:14.775373 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2594d53d-9a67-49f1-9063-cc415b229a3d tempest-TestMinimumBasicScenario-1749035881 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:35:14.775755 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-2594d53d-9a67-49f1-9063-cc415b229a3d tempest-TestMinimumBasicScenario-1749035881 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:35:14.779842 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2594d53d-9a67-49f1-9063-cc415b229a3d tempest-TestMinimumBasicScenario-1749035881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7409b149-35bd-4e6e-abb2-653987efca6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec6c3fe2-8c71-43b5-b5e6-a13ef83c84f1', 'volume_size': 1}' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:35:14.784581 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2594d53d-9a67-49f1-9063-cc415b229a3d tempest-TestMinimumBasicScenario-1749035881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1064c89e-dd1d-461b-8198-0b33453e6710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:35:14.794299 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-2594d53d-9a67-49f1-9063-cc415b229a3d tempest-TestMinimumBasicScenario-1749035881 None] Volume volume-ec6c3fe2-8c71-43b5-b5e6-a13ef83c84f1 (ec6c3fe2-8c71-43b5-b5e6-a13ef83c84f1): created successfully Mar 12 21:35:14.798639 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2594d53d-9a67-49f1-9063-cc415b229a3d tempest-TestMinimumBasicScenario-1749035881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1064c89e-dd1d-461b-8198-0b33453e6710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:35:14.804137 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-2594d53d-9a67-49f1-9063-cc415b229a3d tempest-TestMinimumBasicScenario-1749035881 None] Flow 'volume_create_manager' (d9fcc5fe-f119-4af6-b032-ccf1f2c55852) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:35:14.811912 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-2594d53d-9a67-49f1-9063-cc415b229a3d tempest-TestMinimumBasicScenario-1749035881 None] Created volume successfully. Mar 12 21:35:16.118044 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-23bdbc38-f438-49ce-865b-252e60b573ef req-915927c3-4b20-4e00-95e7-aecb7a27e9f1 tempest-TestMinimumBasicScenario-1749035881 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 21:35:17.133212 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-23bdbc38-f438-49ce-865b-252e60b573ef req-915927c3-4b20-4e00-95e7-aecb7a27e9f1 tempest-TestMinimumBasicScenario-1749035881 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.015s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 21:35:17.134204 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-23bdbc38-f438-49ce-865b-252e60b573ef req-915927c3-4b20-4e00-95e7-aecb7a27e9f1 tempest-TestMinimumBasicScenario-1749035881 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ec6c3fe2-8c71-43b5-b5e6-a13ef83c84f1', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': 'ec6c3fe2-8c71-43b5-b5e6-a13ef83c84f1', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 21:35:17.160035 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-23bdbc38-f438-49ce-865b-252e60b573ef req-915927c3-4b20-4e00-95e7-aecb7a27e9f1 tempest-TestMinimumBasicScenario-1749035881 None] Connection info returned from driver {'name': 'volumes/volume-ec6c3fe2-8c71-43b5-b5e6-a13ef83c84f1', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ec6c3fe2-8c71-43b5-b5e6-a13ef83c84f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ca05a692-fc02-41f5-a538-ef2def6001e8'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 21:35:17.205989 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-23bdbc38-f438-49ce-865b-252e60b573ef req-915927c3-4b20-4e00-95e7-aecb7a27e9f1 tempest-TestMinimumBasicScenario-1749035881 None] attachment_update completed successfully. Mar 12 21:35:51.320026 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:35:51.321103 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:35:51.348994 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:35:51.377792 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:36:40.317172 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-2dcb494a-9877-4685-bbae-ce3325529f62 req-d2bc6b72-3226-45f4-a897-2ee538adda96 tempest-TestMinimumBasicScenario-1749035881 None] Terminate volume connection completed successfully. Mar 12 21:36:40.317958 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-2dcb494a-9877-4685-bbae-ce3325529f62 req-d2bc6b72-3226-45f4-a897-2ee538adda96 tempest-TestMinimumBasicScenario-1749035881 None] Deleting attachment ca05a692-fc02-41f5-a538-ef2def6001e8. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 21:36:40.964265 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-c24c74c7-83af-4ad7-be57-df20c8c2b31c tempest-TestMinimumBasicScenario-1749035881 None] Lock "b'cinder-ec6c3fe2-8c71-43b5-b5e6-a13ef83c84f1-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:36:41.002746 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c24c74c7-83af-4ad7-be57-df20c8c2b31c tempest-TestMinimumBasicScenario-1749035881 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:36:41.042368 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c24c74c7-83af-4ad7-be57-df20c8c2b31c tempest-TestMinimumBasicScenario-1749035881 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:36:41.042821 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c24c74c7-83af-4ad7-be57-df20c8c2b31c tempest-TestMinimumBasicScenario-1749035881 None] Volume volume-ec6c3fe2-8c71-43b5-b5e6-a13ef83c84f1 is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:36:41.048174 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c24c74c7-83af-4ad7-be57-df20c8c2b31c tempest-TestMinimumBasicScenario-1749035881 None] deleting rbd volume volume-ec6c3fe2-8c71-43b5-b5e6-a13ef83c84f1 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:36:41.240800 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [None req-c24c74c7-83af-4ad7-be57-df20c8c2b31c tempest-TestMinimumBasicScenario-1749035881 None] Created reservations ['f6c91fef-4323-45dc-8bfa-e02b9e37dfac', 'ebadda35-2d6d-4e49-881f-7848d1bdd38e', '97430423-8f45-4427-8633-adb4daddd56d', '146c6ebf-5e20-4ef3-89eb-c00e9f03fd9d'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:36:41.280008 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c24c74c7-83af-4ad7-be57-df20c8c2b31c tempest-TestMinimumBasicScenario-1749035881 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:36:41.302708 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-c24c74c7-83af-4ad7-be57-df20c8c2b31c tempest-TestMinimumBasicScenario-1749035881 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:36:41.328214 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-c24c74c7-83af-4ad7-be57-df20c8c2b31c tempest-TestMinimumBasicScenario-1749035881 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:36:41.333038 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-c24c74c7-83af-4ad7-be57-df20c8c2b31c tempest-TestMinimumBasicScenario-1749035881 None] Deleted volume successfully. Mar 12 21:36:41.343971 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-c24c74c7-83af-4ad7-be57-df20c8c2b31c tempest-TestMinimumBasicScenario-1749035881 None] Lock "b'cinder-ec6c3fe2-8c71-43b5-b5e6-a13ef83c84f1-delete_volume'" released by "delete_volume" :: held 0.380s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:36:51.323078 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:36:51.324557 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:36:51.358956 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:36:51.391522 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:37:51.321008 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:37:51.321694 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:37:51.346758 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:37:51.368205 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:39:51.325241 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:39:51.325900 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:39:51.349612 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:39:51.375287 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:40:51.330472 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:40:51.331203 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:40:51.352114 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:40:51.375294 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:41:51.331321 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:41:51.332025 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:41:51.353225 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:41:51.375066 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:42:51.330385 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:42:51.331096 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:42:51.352409 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:42:51.375853 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:43:51.330376 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:43:51.331076 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:43:51.352318 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:43:51.374556 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:44:51.330017 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:44:51.330766 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:44:51.354549 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:44:51.385059 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:45:51.334153 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:45:51.334904 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:45:51.355968 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:45:51.377445 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:46:51.332294 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:46:51.333090 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:46:51.381724 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:46:51.435699 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:47:51.332397 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:47:51.333089 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:47:51.354610 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:47:51.375413 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:48:51.331032 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:48:51.331836 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:48:51.352584 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:48:51.374056 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:49:51.329327 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:49:51.330502 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:49:51.359548 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:49:51.383356 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:50:51.328406 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:50:51.329174 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:50:51.352140 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:50:51.373189 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:51:51.328663 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:51:51.329363 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:51:51.350184 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:51:51.372814 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:52:14.805633 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129531) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Mar 12 21:52:14.809160 ncdv-master-1 cinder-volume[129531]: WARNING stevedore.named [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 12 21:52:14.809639 ncdv-master-1 cinder-volume[129531]: WARNING castellan.key_manager [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 12 21:52:14.829547 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] Flow 'volume_create_manager' (796a893b-2b6b-47ae-8a77-ead6a3404908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:52:14.836277 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9db0befb-9e85-4ff8-b0e4-45619ca2a433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:52:14.843498 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_db.sqlalchemy.engines [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 21:52:14.858526 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9db0befb-9e85-4ff8-b0e4-45619ca2a433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-12T21:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-120278111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=06bbc9c3-1465-48de-9575-e1c40e6428b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe4938aa90944ae7b17fbccaa7f8afe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-12T21:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-12T21:52:15Z,use_quota=True,user_id='b5a0b91da24b4522b5556fb5797cffa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed93340d-f172-4ec4-a08b-9b8d4fe49a4c),volume_type_id=ed93340d-f172-4ec4-a08b-9b8d4fe49a4c)' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:52:14.864999 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (010d1919-8358-4276-b157-22a4bd9883c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:52:14.869177 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (010d1919-8358-4276-b157-22a4bd9883c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:52:14.874339 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a6dc1fa-3d42-430b-b531-3d08bebd806b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:52:14.953325 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a6dc1fa-3d42-430b-b531-3d08bebd806b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '06bbc9c3-1465-48de-9575-e1c40e6428b5', 'volume_name': 'volume-06bbc9c3-1465-48de-9575-e1c40e6428b5', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:52:14.958606 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a38a9eb7-7cfc-40ac-b240-eeaf4982eb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:52:14.963268 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a38a9eb7-7cfc-40ac-b240-eeaf4982eb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:52:14.968159 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f078b7c8-cfdd-42bc-9b42-495f0cfa28bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:52:14.969305 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] Volume 06bbc9c3-1465-48de-9575-e1c40e6428b5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-06bbc9c3-1465-48de-9575-e1c40e6428b5', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 12 21:52:14.969901 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] Cloning 06bbc9c3-1465-48de-9575-e1c40e6428b5 from image 539171db-0bd3-4f16-95fd-a7cd5530137d at location (None, None). {{(pid=129531) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Mar 12 21:52:14.979811 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] Lock "b'cinder-539171db-0bd3-4f16-95fd-a7cd5530137d'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:52:14.988943 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] Found image-volume cache entry: {'id': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'volume_id': '8d802c7b-bd34-4836-bd5d-90755a167ddc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34), 'last_used': datetime.datetime(2022, 3, 12, 21, 52, 14, 984132)}. {{(pid=129531) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 12 21:52:14.989375 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] Image-volume cache entry image_update_at = 2022-03-12 20:39:34+00:00, requested image updated_at = 2022-03-12 20:39:34+00:00. {{(pid=129531) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 12 21:52:14.989820 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] Found cache entry for image = 539171db-0bd3-4f16-95fd-a7cd5530137d on host ncdv-master-1@ceph#ceph. {{(pid=129531) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Mar 12 21:52:14.993743 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] Lock "b'cinder-539171db-0bd3-4f16-95fd-a7cd5530137d'" released by "_prepare_image_cache_entry" :: held 0.014s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:52:14.994672 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] Attempting to retrieve cache entry for image = 539171db-0bd3-4f16-95fd-a7cd5530137d on host ncdv-master-1@ceph#ceph. {{(pid=129531) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Mar 12 21:52:14.999827 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] Found image-volume cache entry: {'id': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'volume_id': '8d802c7b-bd34-4836-bd5d-90755a167ddc', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34), 'last_used': datetime.datetime(2022, 3, 12, 21, 52, 14, 997648)}. {{(pid=129531) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 12 21:52:15.000237 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.image.cache [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] Image-volume cache entry image_update_at = 2022-03-12 20:39:34+00:00, requested image updated_at = 2022-03-12 20:39:34+00:00. {{(pid=129531) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 12 21:52:15.000625 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] Creating from source image-volume 8d802c7b-bd34-4836-bd5d-90755a167ddc {{(pid=129531) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Mar 12 21:52:15.011535 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:52:15.092060 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] creating snapshot='volume-06bbc9c3-1465-48de-9575-e1c40e6428b5.clone_snap' {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Mar 12 21:52:15.915780 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] cloning 'volume-8d802c7b-bd34-4836-bd5d-90755a167ddc@volume-06bbc9c3-1465-48de-9575-e1c40e6428b5.clone_snap' to 'volume-06bbc9c3-1465-48de-9575-e1c40e6428b5' {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Mar 12 21:52:16.041752 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] Volume volume-9916cd82-3d9b-466f-a769-cf81bdc743fd.deleted is not a clone. {{(pid=129531) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 12 21:52:16.042969 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 12 21:52:16.043378 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129531) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 12 21:52:16.059677 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] clone created successfully {{(pid=129531) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Mar 12 21:52:16.060402 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.volume_utils [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] Marking volume 06bbc9c3-1465-48de-9575-e1c40e6428b5 as bootable. {{(pid=129531) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 12 21:52:16.068170 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] Copying metadata from image 539171db-0bd3-4f16-95fd-a7cd5530137d to 06bbc9c3-1465-48de-9575-e1c40e6428b5. {{(pid=129531) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Mar 12 21:52:16.068724 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] Creating volume glance metadata for volume 06bbc9c3-1465-48de-9575-e1c40e6428b5 backed by image 539171db-0bd3-4f16-95fd-a7cd5530137d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129531) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Mar 12 21:52:16.118438 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f078b7c8-cfdd-42bc-9b42-495f0cfa28bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06bbc9c3-1465-48de-9575-e1c40e6428b5', 'volume_size': 1, 'image_id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd5ca5cfad1154c72810eaebe46ff3de5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '539171db-0bd3-4f16-95fd-a7cd5530137d', 'created_at': datetime.datetime(2022, 3, 12, 20, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 12, 20, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/539171db-0bd3-4f16-95fd-a7cd5530137d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:52:16.123450 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b420b4-5f0c-489d-abcc-bac11c7b0b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 12 21:52:16.131257 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.flows.manager.create_volume [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] Volume volume-06bbc9c3-1465-48de-9575-e1c40e6428b5 (06bbc9c3-1465-48de-9575-e1c40e6428b5): created successfully Mar 12 21:52:16.134945 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b420b4-5f0c-489d-abcc-bac11c7b0b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129531) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 12 21:52:16.140461 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] Flow 'volume_create_manager' (796a893b-2b6b-47ae-8a77-ead6a3404908) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129531) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 12 21:52:16.147784 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [None req-9ff33132-8ebf-4e39-84c9-5378fce94ec5 tempest-TestShelveInstance-371818113 None] Created volume successfully. Mar 12 21:52:18.740963 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-0bce5036-aeb6-4623-a2d6-0c6ef286eefc req-c92c25b9-2571-4daa-a6a4-cd823dfabb2f tempest-TestShelveInstance-371818113 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 21:52:19.478217 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-0bce5036-aeb6-4623-a2d6-0c6ef286eefc req-c92c25b9-2571-4daa-a6a4-cd823dfabb2f tempest-TestShelveInstance-371818113 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.736s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 21:52:19.479045 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-0bce5036-aeb6-4623-a2d6-0c6ef286eefc req-c92c25b9-2571-4daa-a6a4-cd823dfabb2f tempest-TestShelveInstance-371818113 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-06bbc9c3-1465-48de-9575-e1c40e6428b5', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': '06bbc9c3-1465-48de-9575-e1c40e6428b5', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 21:52:19.503299 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-0bce5036-aeb6-4623-a2d6-0c6ef286eefc req-c92c25b9-2571-4daa-a6a4-cd823dfabb2f tempest-TestShelveInstance-371818113 None] Connection info returned from driver {'name': 'volumes/volume-06bbc9c3-1465-48de-9575-e1c40e6428b5', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '06bbc9c3-1465-48de-9575-e1c40e6428b5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '09088a0d-9a01-4f97-b846-123391d085e4'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 21:52:19.549067 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-0bce5036-aeb6-4623-a2d6-0c6ef286eefc req-c92c25b9-2571-4daa-a6a4-cd823dfabb2f tempest-TestShelveInstance-371818113 None] attachment_update completed successfully. Mar 12 21:52:51.328478 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:52:51.329578 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:52:51.354990 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:52:51.377241 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:53:51.332691 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:53:51.333992 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:53:51.354757 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:53:51.375913 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:54:50.024373 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-01560de5-42f6-4b69-a7df-829f37bef5b3 req-884b40af-ab97-4154-bb73-a70217bb6825 tempest-TestShelveInstance-371818113 None] Terminate volume connection completed successfully. Mar 12 21:54:50.025547 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-01560de5-42f6-4b69-a7df-829f37bef5b3 req-884b40af-ab97-4154-bb73-a70217bb6825 tempest-TestShelveInstance-371818113 None] Deleting attachment 09088a0d-9a01-4f97-b846-123391d085e4. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 21:54:51.331275 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:54:51.332227 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:54:51.358082 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:54:51.393632 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:54:51.612996 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-6b044f5a-19de-4c01-946e-4eb2153cc37e req-58454951-325a-48ea-a6b2-7d8218a99fdd tempest-TestShelveInstance-371818113 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 21:54:52.254497 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_concurrency.processutils [req-6b044f5a-19de-4c01-946e-4eb2153cc37e req-58454951-325a-48ea-a6b2-7d8218a99fdd tempest-TestShelveInstance-371818113 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.641s {{(pid=129531) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 21:54:52.255349 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-6b044f5a-19de-4c01-946e-4eb2153cc37e req-58454951-325a-48ea-a6b2-7d8218a99fdd tempest-TestShelveInstance-371818113 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-06bbc9c3-1465-48de-9575-e1c40e6428b5', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5e3100ba-8a2c-4c90-b040-e119dab0eaf8', 'volume_id': '06bbc9c3-1465-48de-9575-e1c40e6428b5', 'discard': True}} {{(pid=129531) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 12 21:54:52.279014 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-6b044f5a-19de-4c01-946e-4eb2153cc37e req-58454951-325a-48ea-a6b2-7d8218a99fdd tempest-TestShelveInstance-371818113 None] Connection info returned from driver {'name': 'volumes/volume-06bbc9c3-1465-48de-9575-e1c40e6428b5', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '06bbc9c3-1465-48de-9575-e1c40e6428b5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b5f158c9-9306-4793-b86d-9626d6240b71'} {{(pid=129531) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 12 21:54:52.325398 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-6b044f5a-19de-4c01-946e-4eb2153cc37e req-58454951-325a-48ea-a6b2-7d8218a99fdd tempest-TestShelveInstance-371818113 None] attachment_update completed successfully. Mar 12 21:55:51.329762 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:55:51.330673 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:55:51.353072 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:55:51.374938 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:56:18.837313 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-e619e66c-7088-4f4a-973f-e2f41324837b req-2df30ad1-8583-4c12-a5c9-50b58cddd364 tempest-TestShelveInstance-371818113 None] Terminate volume connection completed successfully. Mar 12 21:56:18.838007 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.manager [req-e619e66c-7088-4f4a-973f-e2f41324837b req-2df30ad1-8583-4c12-a5c9-50b58cddd364 tempest-TestShelveInstance-371818113 None] Deleting attachment b5f158c9-9306-4793-b86d-9626d6240b71. {{(pid=129531) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 12 21:56:18.959814 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [req-e619e66c-7088-4f4a-973f-e2f41324837b req-107481f9-7089-4d32-9f69-917b2732f89e tempest-TestShelveInstance-371818113 None] Lock "b'cinder-06bbc9c3-1465-48de-9575-e1c40e6428b5-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 12 21:56:18.991959 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-e619e66c-7088-4f4a-973f-e2f41324837b req-107481f9-7089-4d32-9f69-917b2732f89e tempest-TestShelveInstance-371818113 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:56:19.079776 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-e619e66c-7088-4f4a-973f-e2f41324837b req-107481f9-7089-4d32-9f69-917b2732f89e tempest-TestShelveInstance-371818113 None] volume has no backup snaps {{(pid=129531) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 12 21:56:19.087055 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-e619e66c-7088-4f4a-973f-e2f41324837b req-107481f9-7089-4d32-9f69-917b2732f89e tempest-TestShelveInstance-371818113 None] deleting rbd volume volume-06bbc9c3-1465-48de-9575-e1c40e6428b5 {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 12 21:56:19.371832 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-e619e66c-7088-4f4a-973f-e2f41324837b req-107481f9-7089-4d32-9f69-917b2732f89e tempest-TestShelveInstance-371818113 None] volume is a clone so cleaning references {{(pid=129531) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Mar 12 21:56:19.406919 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-e619e66c-7088-4f4a-973f-e2f41324837b req-107481f9-7089-4d32-9f69-917b2732f89e tempest-TestShelveInstance-371818113 None] deleting parent snapshot volume-06bbc9c3-1465-48de-9575-e1c40e6428b5.clone_snap {{(pid=129531) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Mar 12 21:56:20.024652 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.quota [req-e619e66c-7088-4f4a-973f-e2f41324837b req-107481f9-7089-4d32-9f69-917b2732f89e tempest-TestShelveInstance-371818113 None] Created reservations ['ca0bb3b4-64a7-4f08-b6a8-5048da269433', '3c8ab3fb-77dd-4a8d-96df-739a9ba685ee', '7955b9ec-470c-472a-8896-f37cfb8e0ce8', '7b24a4c4-defd-453e-96d3-a8c959a7f1f7'] {{(pid=129531) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 12 21:56:20.067563 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-e619e66c-7088-4f4a-973f-e2f41324837b req-107481f9-7089-4d32-9f69-917b2732f89e tempest-TestShelveInstance-371818113 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:56:20.089691 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [req-e619e66c-7088-4f4a-973f-e2f41324837b req-107481f9-7089-4d32-9f69-917b2732f89e tempest-TestShelveInstance-371818113 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:56:20.111934 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [req-e619e66c-7088-4f4a-973f-e2f41324837b req-107481f9-7089-4d32-9f69-917b2732f89e tempest-TestShelveInstance-371818113 None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:56:20.116188 ncdv-master-1 cinder-volume[129531]: INFO cinder.volume.manager [req-e619e66c-7088-4f4a-973f-e2f41324837b req-107481f9-7089-4d32-9f69-917b2732f89e tempest-TestShelveInstance-371818113 None] Deleted volume successfully. Mar 12 21:56:20.128227 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.coordination [req-e619e66c-7088-4f4a-973f-e2f41324837b req-107481f9-7089-4d32-9f69-917b2732f89e tempest-TestShelveInstance-371818113 None] Lock "b'cinder-06bbc9c3-1465-48de-9575-e1c40e6428b5-delete_volume'" released by "delete_volume" :: held 1.168s {{(pid=129531) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 12 21:56:51.330605 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:56:51.331502 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:56:51.356068 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:56:51.387548 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:57:51.332662 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:57:51.333389 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:57:51.355183 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:57:51.380741 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:58:51.335711 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:58:51.336465 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:58:51.357932 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:58:51.379387 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 21:59:51.334562 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 21:59:51.335278 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:59:51.380254 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 21:59:51.402999 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 22:00:51.337973 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 22:00:51.339131 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 22:00:51.360335 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 22:00:51.383390 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 22:01:51.338913 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 22:01:51.339642 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 22:01:51.361119 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 22:01:51.383358 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 22:02:51.342685 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 22:02:51.343436 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 22:02:51.364751 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 22:02:51.386114 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 22:03:51.341133 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 22:03:51.341877 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 22:03:51.363449 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 22:03:51.385138 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 22:04:51.339563 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 22:04:51.340253 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 22:04:51.361189 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 22:04:51.386127 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 22:05:51.341684 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 22:05:51.342871 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 22:05:51.364301 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 22:05:51.385303 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 22:06:51.339987 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 22:06:51.340687 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 22:06:51.362514 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 22:06:51.383643 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 22:07:51.338252 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 22:07:51.338961 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 22:07:51.360089 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 22:07:51.382196 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 22:08:51.338378 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 22:08:51.339089 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 22:08:51.360166 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 22:08:51.383692 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 12 22:09:51.339715 ncdv-master-1 cinder-volume[129531]: DEBUG oslo_service.periodic_task [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129531) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 12 22:09:51.340957 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 22:09:51.362329 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.volume.drivers.rbd [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129531) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 12 22:09:51.383518 ncdv-master-1 cinder-volume[129531]: DEBUG cinder.manager [None req-a50874f5-4513-494e-8731-f83a1761b74a None None] Notifying Schedulers of capabilities ... {{(pid=129531) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}