-- Logs begin at Sat 2022-04-09 20:01:14 UTC, end at Sat 2022-04-09 22:21:26 UTC. -- Apr 09 20:45:00.698549 ncdv-master-1 systemd[1]: Started Devstack devstack@c-vol.service. Apr 09 20:45:04.036178 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=134827) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 09 20:45:04.036784 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=134827) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 09 20:45:04.514138 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_db.sqlalchemy.engines [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134827) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 09 20:45:04.729283 ncdv-master-1 cinder-volume[134827]: INFO cinder.rpc [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 09 20:45:04.735016 ncdv-master-1 cinder-volume[134827]: INFO cinder.rpc [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 09 20:45:04.742981 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_db.sqlalchemy.engines [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134827) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 09 20:45:04.811861 ncdv-master-1 cinder-volume[134827]: INFO cinder.volume.manager [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] Determined volume DB was empty at startup. Apr 09 20:45:04.812550 ncdv-master-1 cinder-volume[134827]: DEBUG cinder.volume.manager [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=134827) __init__ /opt/stack/cinder/cinder/volume/manager.py:286}} Apr 09 20:45:04.820462 ncdv-master-1 cinder-volume[134827]: INFO cinder.volume.manager [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 09 20:45:04.821475 ncdv-master-1 cinder-volume[134827]: WARNING stevedore.named [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 09 20:45:04.821953 ncdv-master-1 cinder-volume[134827]: WARNING castellan.key_manager [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 09 20:45:04.823185 ncdv-master-1 cinder-volume[134827]: WARNING cinder.keymgr.conf_key_mgr [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 09 20:45:04.840439 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_db.sqlalchemy.engines [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134827) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 09 20:45:04.845984 ncdv-master-1 cinder-volume[134827]: INFO cinder.rpc [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 09 20:45:04.849803 ncdv-master-1 cinder-volume[134827]: INFO cinder.rpc [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] Automatically selected cinder-volume RPC version 3.18 as minimum service version. Apr 09 20:45:04.850506 ncdv-master-1 cinder-volume[134827]: WARNING stevedore.named [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 09 20:45:04.850912 ncdv-master-1 cinder-volume[134827]: WARNING castellan.key_manager [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 09 20:45:04.852742 ncdv-master-1 cinder-volume[134827]: INFO cinder.volume.manager [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] Image-volume cache enabled for host ncdv-master-1@ceph. Apr 09 20:45:04.863394 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_db.sqlalchemy.engines [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134827) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 09 20:45:04.882841 ncdv-master-1 cinder-volume[134827]: INFO oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] Starting 1 workers Apr 09 20:45:04.888397 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] Started child 135002 {{(pid=134827) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Apr 09 20:45:04.889828 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] Full set of CONF: {{(pid=134827) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Apr 09 20:45:04.890392 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ******************************************************************************** {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 09 20:45:04.890846 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] Configuration options gathered from: {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 09 20:45:04.891340 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 09 20:45:04.892225 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 09 20:45:04.892830 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ================================================================================ {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 09 20:45:04.893702 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] allow_availability_zone_fallback = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.894402 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] allow_compression_on_image_upload = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.895025 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] allowed_direct_url_schemes = [] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.895569 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] api_rate_limit = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.896015 ncdv-master-1 cinder-volume[135002]: INFO cinder.service [-] Starting cinder-volume node (version 20.1.0) Apr 09 20:45:04.896556 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] auth_strategy = keystone {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.896649 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] az_cache_duration = 3600 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.897004 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_availability_zone = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.897516 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_host = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.897885 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_name = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.898276 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_stats_polling_interval = 60 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.898652 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backup_api_class = cinder.backup.api.API {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.899020 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.899422 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backup_name_template = backup-%s {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.899807 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backup_use_same_host = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.900175 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backup_use_temp_snapshot = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.900596 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] chap_password = **** {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.900960 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] chap_username = {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.901377 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.901785 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] cinder_internal_tenant_project_id = a6cf2e406d07415cac661e73b93ccb02 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.902160 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] cinder_internal_tenant_user_id = 6504d578b1b64feb93ba69d947a971e9 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.902619 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] cloned_volume_same_az = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.902989 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] cluster = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.903367 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] compression_format = gzip {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.903762 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] compute_api_class = cinder.compute.nova.API {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.913117 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] config_dir = [] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.918451 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.918451 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] config_source = [] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.918451 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.918451 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] control_exchange = openstack {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.918451 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] debug = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.918451 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] default_availability_zone = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.918875 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] default_group_type = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.918875 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.918875 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] default_volume_type = ceph {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.918875 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] driver_client_cert = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.918875 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] driver_client_cert_key = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.919247 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] driver_data_namespace = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.919247 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] driver_ssl_cert_path = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.919247 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] driver_ssl_cert_verify = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.919247 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] driver_use_ssl = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.919247 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] enable_force_upload = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.919573 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] enable_new_services = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.919913 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] enable_unsupported_driver = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.920465 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] enabled_backends = ['ceph'] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.920970 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] enforce_multipath_for_image_xfer = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.921489 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] filter_function = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.921997 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] glance_api_insecure = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.922511 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] glance_api_servers = ['http://10.222.0.30/image'] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.923206 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] glance_api_ssl_compression = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.923714 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] glance_ca_certificates_file = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.924333 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] glance_catalog_info = image:glance:publicURL {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.925403 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] glance_certfile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.926047 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.926554 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] glance_keyfile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.927064 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] glance_num_retries = 3 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.927553 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] glance_request_timeout = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.928080 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] goodness_function = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.928596 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] graceful_shutdown_timeout = 5 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.929134 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] group_api_class = cinder.group.api.API {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:04.929589 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] host = ncdv-master-1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.197807 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] iet_conf = /etc/iet/ietd.conf {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.197807 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] image_compress_on_upload = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.197807 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] image_conversion_address_space_limit = 1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.197807 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] image_conversion_cpu_limit = 60 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.197807 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.197807 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] image_upload_use_cinder_backend = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.200093 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] image_upload_use_internal_tenant = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.200093 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] image_volume_cache_enabled = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.200093 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] image_volume_cache_max_count = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.200093 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] image_volume_cache_max_size_gb = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.200093 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] init_host_max_objects_retrieval = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.200093 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] instance_format = [instance: %(uuid)s] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.200093 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.200724 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-11b988cf-2379-4dfe-895c-e25304b3e3bc None None] Starting volume driver RBDDriver (1.2.0) Apr 09 20:45:05.200821 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] iscsi_iotype = fileio {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.200821 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] iscsi_secondary_ip_addresses = [] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.200821 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] iscsi_target_flags = {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.200821 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] iscsi_write_cache = on {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.200821 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] iser_helper = tgtadm {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.200821 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] iser_ip_address = 10.222.0.30 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.200821 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] iser_port = 3260 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.201381 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-11b988cf-2379-4dfe-895c-e25304b3e3bc None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:45:05.201466 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.201466 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] log_config_append = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.201466 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.201466 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] log_dir = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.201466 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] log_file = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.201466 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] log_options = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.201466 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] log_rotate_interval = 1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.201989 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] log_rotate_interval_type = days {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.201989 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] log_rotation_type = none {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.201989 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.201989 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.201989 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.202375 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.202375 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.202375 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] max_age = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.202375 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] max_logfile_count = 30 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.202375 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] max_logfile_size_mb = 200 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.202375 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] max_over_subscription_ratio = 20.0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.202824 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] message_reap_interval = 86400 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.202824 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] message_ttl = 2592000 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.202824 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] migration_create_volume_timeout_secs = 300 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.202824 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] monkey_patch = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.202824 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] monkey_patch_modules = [] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.202824 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] my_ip = 10.222.0.30 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.202824 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] no_snapshot_gb_quota = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.203424 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] num_iser_scan_tries = 3 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.203424 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] num_shell_tries = 3 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.203424 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] num_volume_device_scan_tries = 3 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.203424 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] nvmet_ns_id = 10 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.203424 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] nvmet_port_id = 1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.203424 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] osapi_max_limit = 1000 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.203424 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] osapi_volume_ext_list = [] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.203933 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.203933 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] osapi_volume_listen = 0.0.0.0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.203933 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] osapi_volume_listen_port = 8776 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.203933 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] osapi_volume_use_ssl = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.203933 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] osapi_volume_workers = 2 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.203933 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] per_volume_size_limit = -1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.204365 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] periodic_fuzzy_delay = 60 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.204365 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] periodic_interval = 60 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.204365 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] project_id_regex = [0-9a-f\-]+ {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.204365 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] public_endpoint = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.204365 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] publish_errors = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.204365 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] quota_backup_gigabytes = 1000 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.204365 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] quota_backups = 10 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.204957 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] quota_consistencygroups = 10 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.204957 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.204957 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] quota_gigabytes = 1000 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.204957 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] quota_groups = 10 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.204957 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] quota_snapshots = 10 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.204957 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] quota_volumes = 10 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.204957 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] rate_limit_burst = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.205541 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] rate_limit_except_level = CRITICAL {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.205541 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] rate_limit_interval = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.205541 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] reinit_driver_count = 3 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.205541 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] replication_device = **** {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.205541 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] report_discard_supported = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.205541 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] report_interval = 10 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.205541 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] reservation_clean_interval = 86400 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.206027 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] reservation_expire = 86400 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.206027 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] reserved_percentage = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.206027 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.206027 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.206027 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] rpc_response_timeout = 120 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.206027 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] run_external_periodic_tasks = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.206453 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.206453 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] scst_target_driver = iscsi {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.206453 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] scst_target_iqn_name = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.206453 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] service_down_time = 60 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.206453 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] snapshot_name_template = snapshot-%s {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.206453 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] snapshot_same_host = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.206890 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] split_loggers = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.206890 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] state_path = /opt/stack/data/cinder {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.206890 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] storage_availability_zone = nova {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.206890 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] storage_protocol = iscsi {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.206890 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] syslog_log_facility = LOG_USER {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.206890 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] target_helper = lioadm {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.207312 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] target_ip_address = 10.222.0.30 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.207312 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] target_port = 3260 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.207312 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.207312 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] target_protocol = iscsi {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.207312 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] trace_flags = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.207312 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] transfer_api_class = cinder.transfer.api.API {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.207730 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] transport_url = **** {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.207730 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] until_refresh = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.207730 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] use_chap_auth = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.207730 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] use_default_quota_class = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.207730 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] use_eventlog = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.207730 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] use_journal = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.207730 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] use_json = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.208238 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] use_multipath_for_image_xfer = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.208238 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] use_stderr = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.208238 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] use_syslog = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.208238 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] verify_glance_signatures = enabled {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.208238 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] volume_api_class = cinder.volume.api.API {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.208238 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] volume_backend_name = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.208238 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] volume_clear = zero {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.208757 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] volume_clear_ionice = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.208757 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] volume_clear_size = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.208757 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.208757 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] volume_copy_bps_limit = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.208757 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] volume_dd_blocksize = 1M {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.208757 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.209641 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] volume_name_template = volume-%s {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.209641 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] volume_service_inithost_offload = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.209641 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] volume_usage_audit_period = month {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.209641 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.209641 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] watch_log_file = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.209641 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] zoning_mode = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 09 20:45:05.210199 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.210199 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.210199 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_policy.enforce_new_defaults = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.210199 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_policy.enforce_scope = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.210199 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_policy.policy_default_rule = default {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.210199 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.210583 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_policy.policy_file = policy.yaml {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.210583 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.210583 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.210583 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.210583 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.210583 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.211114 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-11b988cf-2379-4dfe-895c-e25304b3e3bc None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:45:05.211205 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_concurrency.disable_process_locking = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.211205 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.211205 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] keystone_authtoken.admin_password = **** {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.211205 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.211205 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] keystone_authtoken.admin_token = **** {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.211205 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] keystone_authtoken.admin_user = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.211569 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] keystone_authtoken.auth_admin_prefix = {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.211569 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.211569 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] keystone_authtoken.auth_port = 35357 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.211569 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] keystone_authtoken.auth_protocol = https {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.211569 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] keystone_authtoken.auth_section = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.211569 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] keystone_authtoken.auth_type = password {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.211569 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] keystone_authtoken.auth_uri = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.211991 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] keystone_authtoken.auth_version = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.211991 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] keystone_authtoken.cache = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.211991 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.211991 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] keystone_authtoken.certfile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.211991 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] keystone_authtoken.delay_auth_decision = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.211991 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.212353 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] keystone_authtoken.http_connect_timeout = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.212353 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.212353 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] keystone_authtoken.identity_uri = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.212353 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] keystone_authtoken.include_service_catalog = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.212353 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] keystone_authtoken.insecure = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.212353 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] keystone_authtoken.interface = public {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.212703 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] keystone_authtoken.keyfile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.212703 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.212703 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.212703 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.212703 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.212703 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.213089 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.213089 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.213089 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.213089 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.213089 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] keystone_authtoken.region_name = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.213089 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.213467 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] keystone_authtoken.service_token_roles_required = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.213467 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] keystone_authtoken.service_type = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.213467 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] keystone_authtoken.token_cache_time = 300 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.213467 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.213467 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] cache.backend = dogpile.cache.null {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.213467 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] cache.backend_argument = **** {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.213844 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] cache.config_prefix = cache.oslo {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.213844 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] cache.dead_timeout = 60.0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.213844 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] cache.debug_cache_backend = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.213844 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] cache.enable_retry_client = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.213844 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] cache.enable_socket_keepalive = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.213844 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] cache.enabled = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.213844 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] cache.expiration_time = 600 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.214298 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] cache.hashclient_retry_attempts = 2 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.214298 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] cache.hashclient_retry_delay = 1.0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.214298 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] cache.memcache_dead_retry = 300 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.214298 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.214298 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.214298 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] cache.memcache_pool_maxsize = 10 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.214298 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.214719 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.214719 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] cache.memcache_socket_timeout = 1.0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.214719 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] cache.proxies = [] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.214719 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] cache.retry_attempts = 2 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.214719 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] cache.retry_delay = 0.0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.214719 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] cache.socket_keepalive_count = 1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.214719 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] cache.socket_keepalive_idle = 1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.215105 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] cache.socket_keepalive_interval = 1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.215105 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] cache.tls_allowed_ciphers = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.215105 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] cache.tls_cafile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.215105 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] cache.tls_certfile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.215105 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] cache.tls_enabled = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.215105 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] cache.tls_keyfile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.215105 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] coordination.backend_url = etcd3+http://10.222.0.30:2379 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.215500 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] database.backend = sqlalchemy {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.215500 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] database.connection = **** {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.215500 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] database.connection_debug = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.215500 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] database.connection_parameters = {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.215743 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-11b988cf-2379-4dfe-895c-e25304b3e3bc None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:45:05.215810 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] database.connection_recycle_time = 3600 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.215810 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] database.connection_trace = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.215810 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] database.db_inc_retry_interval = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.215810 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] database.db_max_retries = 20 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.215810 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] database.db_max_retry_interval = 10 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.215810 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] database.db_retry_interval = 1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.215810 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] database.max_overflow = 50 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.216614 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] database.max_pool_size = 5 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.216614 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] database.max_retries = 10 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.216614 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] database.mysql_enable_ndb = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.216614 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.216614 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] database.pool_timeout = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.216614 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] database.retry_interval = 10 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.216614 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] database.slave_connection = **** {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.217193 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] database.sqlite_synchronous = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.217193 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] database.use_db_reconnect = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.217193 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.217193 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.217193 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.217193 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.218134 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.218134 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] profiler.connection_string = messaging:// {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.218134 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] profiler.enabled = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.218134 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] profiler.es_doc_type = notification {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.218134 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] profiler.es_scroll_size = 10000 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.218134 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] profiler.es_scroll_time = 2m {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.218578 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] profiler.filter_error_trace = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.218578 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] profiler.hmac_keys = SECRET_KEY {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.218578 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] profiler.sentinel_service_name = mymaster {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.218578 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] profiler.socket_timeout = 0.1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.218578 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] profiler.trace_sqlalchemy = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.218578 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] privsep_osbrick.capabilities = [21] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.218578 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] privsep_osbrick.group = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.222273 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] privsep_osbrick.helper_command = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.222273 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.222273 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.222273 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] privsep_osbrick.user = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.222273 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.222273 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] cinder_sys_admin.group = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.222273 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] cinder_sys_admin.helper_command = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.222881 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.222881 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.222881 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] cinder_sys_admin.user = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.222881 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] service_user.auth_section = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.222881 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] service_user.auth_type = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.222881 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] service_user.cafile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.222881 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] service_user.certfile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.223427 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] service_user.collect_timing = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.223427 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] service_user.insecure = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.223427 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] service_user.keyfile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.223427 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] service_user.send_service_user_token = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.223427 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] service_user.split_loggers = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.223427 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] service_user.timeout = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.223427 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.backend_availability_zone = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.224017 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.224017 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.224017 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.chap_password = **** {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.224017 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.chap_username = {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.224017 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.224017 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.deferred_deletion_delay = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.224452 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.deferred_deletion_purge_interval = 60 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.224452 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.driver_client_cert = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.224452 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.driver_client_cert_key = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.224452 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.driver_data_namespace = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.224452 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.224452 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.224876 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.driver_use_ssl = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.224876 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.enable_deferred_deletion = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.224876 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.enable_unsupported_driver = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.224876 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.224876 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.extra_capabilities = {} {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.224876 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.filter_function = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.225343 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.goodness_function = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.225343 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.225343 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.225343 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.225343 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.225343 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.225777 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.225777 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.iscsi_iotype = fileio {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.225777 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.225777 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.iscsi_target_flags = {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.226080 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.driver [None req-11b988cf-2379-4dfe-895c-e25304b3e3bc None None] Driver hasn't implemented _init_vendor_properties() Apr 09 20:45:05.226168 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.iscsi_write_cache = on {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.226283 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.driver [None req-11b988cf-2379-4dfe-895c-e25304b3e3bc None None] Initialized capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:1192182f-c1ed-4d7f-89e2-8dd1c9abc163:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=135002) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:811}} Apr 09 20:45:05.226397 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.iser_helper = tgtadm {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.226397 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.iser_ip_address = 10.222.0.30 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.226397 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.iser_port = 3260 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.226397 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.226397 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.226397 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.226822 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.num_shell_tries = 3 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.226822 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.226822 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.226822 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.nvmet_port_id = 1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.226822 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.rados_connect_timeout = -1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.226822 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.rados_connection_interval = 5 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.226822 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.rados_connection_retries = 3 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.230087 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.rbd_ceph_conf = {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.230087 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.rbd_cluster_name = ceph {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.230087 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.rbd_exclusive_cinder_pool = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.230087 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.rbd_flatten_volume_from_snapshot = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.230087 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.rbd_max_clone_depth = 5 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.230087 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.rbd_pool = rbd {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.230548 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.rbd_secret_uuid = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.230548 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.rbd_store_chunk_size = 4 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.230548 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.rbd_user = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.230548 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.replication_connect_timeout = 5 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.230548 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.replication_device = **** {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.230548 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.report_discard_supported = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.230985 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.report_dynamic_total_capacity = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.230985 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.reserved_percentage = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.230985 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.scst_target_driver = iscsi {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.231210 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_db.sqlalchemy.engines [None req-11b988cf-2379-4dfe-895c-e25304b3e3bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=135002) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 09 20:45:05.231300 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.scst_target_iqn_name = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.231300 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.storage_protocol = iscsi {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.231300 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.231300 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.target_helper = tgtadm {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.231300 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.target_ip_address = 10.222.0.30 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.231300 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.target_port = 3260 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.231839 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.231839 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.target_protocol = iscsi {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.231839 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.trace_flags = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.231839 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.unique_fqdn_network = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.237136 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.use_chap_auth = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.237136 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.237136 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.volume_backend_name = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.237136 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.volume_clear = zero {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.237136 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.volume_clear_ionice = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.237136 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.volume_clear_size = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.237713 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.237713 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.237713 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.237713 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.237713 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.237713 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_reports.file_event_handler = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.238944 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.239464 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_reports.log_dir = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.240012 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.backend_availability_zone = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.240510 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.backend_host = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.241006 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.backend_native_threads_pool_size = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.241529 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.backup_use_temp_snapshot = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.242040 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.chap_password = **** {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.242533 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.chap_username = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.243566 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.chiscsi_conf = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.244068 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.deferred_deletion_delay = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.244571 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.deferred_deletion_purge_interval = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.245152 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.driver_client_cert = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.245637 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.driver_client_cert_key = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.246136 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.driver_data_namespace = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.246633 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.driver_ssl_cert_path = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.247125 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.driver_ssl_cert_verify = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.247616 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.driver_use_ssl = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.248097 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.enable_deferred_deletion = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.248804 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.enable_unsupported_driver = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.249346 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.enforce_multipath_for_image_xfer = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.249867 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.extra_capabilities = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.250933 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.filter_function = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.251530 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.goodness_function = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.252035 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.iet_conf = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.252591 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.image_upload_use_cinder_backend = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.253108 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.image_upload_use_internal_tenant = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.253618 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.image_volume_cache_enabled = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.254123 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.image_volume_cache_max_count = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.254619 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.image_volume_cache_max_size_gb = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.255116 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.iscsi_iotype = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.255617 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.iscsi_secondary_ip_addresses = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.256110 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.iscsi_target_flags = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.256604 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.iscsi_write_cache = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.257110 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.iser_helper = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.257613 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.iser_ip_address = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.258098 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.iser_port = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.258775 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.iser_target_prefix = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.259295 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.max_over_subscription_ratio = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.259849 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.num_iser_scan_tries = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.260403 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.num_shell_tries = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.260886 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.num_volume_device_scan_tries = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.261452 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.nvmet_ns_id = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.263744 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.nvmet_port_id = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.264293 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.rados_connect_timeout = -1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.264996 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.rados_connection_interval = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.265537 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.rados_connection_retries = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.266086 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.rbd_ceph_conf = /etc/ceph/ceph.conf {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.266585 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.rbd_cluster_name = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.267089 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.rbd_exclusive_cinder_pool = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.267644 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.rbd_flatten_volume_from_snapshot = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.268201 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.rbd_max_clone_depth = 5 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.268892 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.rbd_pool = volumes {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.269441 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.rbd_secret_uuid = 85b3303f-9894-4409-bb45-d72c5aa3a4f1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.269963 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.rbd_store_chunk_size = 4 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.270731 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.rbd_user = cinder {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.271235 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.replication_connect_timeout = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.271721 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.replication_device = **** {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.272225 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.report_discard_supported = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.272723 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.report_dynamic_total_capacity = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.273017 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.db.sqlalchemy.api [None req-11b988cf-2379-4dfe-895c-e25304b3e3bc None None] Building query based on filter {{(pid=135002) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3377}} Apr 09 20:45:05.273398 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.reserved_percentage = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.274239 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.scst_target_driver = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.274728 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.scst_target_iqn_name = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.275211 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.storage_protocol = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.275696 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.suppress_requests_ssl_warnings = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.276372 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.target_helper = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.276857 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.target_ip_address = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.277411 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.target_port = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.278175 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.target_prefix = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.278710 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.target_protocol = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.279484 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.trace_flags = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.280027 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.unique_fqdn_network = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.280552 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.use_chap_auth = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.281099 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.use_multipath_for_image_xfer = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.281638 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.volume_backend_name = ceph {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.282251 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.volume_clear = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.282790 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.volume_clear_ionice = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.283310 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.volume_clear_size = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.283906 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.volume_copy_blkio_cgroup_name = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.284435 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.volume_copy_bps_limit = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.284970 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.volume_dd_blocksize = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.285865 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.volume_driver = cinder.volume.drivers.rbd.RBDDriver {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.286232 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ceph.volumes_dir = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.286851 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.287411 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.287985 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.288519 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.289605 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.290151 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.290706 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.291246 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.291770 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.292304 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.292864 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.293443 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.293998 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.297026 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.297716 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.298446 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.299012 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.299738 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.300454 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.301022 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.301587 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.302151 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.302303 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.image_utils [None req-11b988cf-2379-4dfe-895c-e25304b3e3bc None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=135002) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:955}} Apr 09 20:45:05.302664 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_messaging_rabbit.ssl = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.303183 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.303623 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.304077 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.304520 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_messaging_rabbit.ssl_version = {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.304900 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_messaging_notifications.driver = [] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.305405 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_messaging_notifications.retry = -1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.305888 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.306307 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] oslo_messaging_notifications.transport_url = **** {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.306776 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.307137 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] key_manager.fixed_key = **** {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.307639 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.308110 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] barbican.barbican_api_version = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.308548 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] barbican.barbican_endpoint = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.308995 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] barbican.barbican_endpoint_type = public {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.309631 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] barbican.barbican_region_name = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.310091 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] barbican.cafile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.310612 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] barbican.certfile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.311147 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] barbican.collect_timing = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.311684 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] barbican.insecure = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.312214 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] barbican.keyfile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.312767 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] barbican.number_of_retries = 60 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.313317 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] barbican.retry_delay = 1 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.313839 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] barbican.send_service_user_token = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.314355 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] barbican.split_loggers = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.314940 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] barbican.timeout = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.315683 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] barbican.verify_ssl = True {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.316331 ncdv-master-1 cinder-volume[135002]: INFO cinder.keymgr.migration [None req-66074b17-d548-4f9d-a680-c4ed9efb0255 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 09 20:45:05.316617 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] barbican.verify_ssl_path = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.317153 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] barbican_service_user.auth_section = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.317658 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] barbican_service_user.auth_type = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.318125 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] barbican_service_user.cafile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.318591 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] barbican_service_user.certfile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.319063 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] barbican_service_user.collect_timing = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.319734 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] barbican_service_user.insecure = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.320215 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] barbican_service_user.keyfile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.320700 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] barbican_service_user.split_loggers = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.321222 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] barbican_service_user.timeout = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.321727 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] vault.approle_role_id = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.322245 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] vault.approle_secret_id = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.322732 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] vault.cafile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.323227 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] vault.certfile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.323723 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] vault.collect_timing = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.324233 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] vault.insecure = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.324732 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] vault.keyfile = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.325295 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] vault.kv_mountpoint = secret {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.325796 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] vault.kv_version = 2 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.326286 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] vault.namespace = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.326793 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] vault.root_token_id = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.327281 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] vault.split_loggers = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.327781 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] vault.ssl_ca_crt_file = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.328261 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] vault.timeout = None {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.328749 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] vault.use_ssl = False {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.329312 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 09 20:45:05.329902 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-11b988cf-2379-4dfe-895c-e25304b3e3bc None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:45:05.330165 ncdv-master-1 cinder-volume[134827]: DEBUG oslo_service.service [None req-21b99bda-8e39-4134-b6df-c7573c05bf29 None None] ******************************************************************************** {{(pid=134827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 09 20:45:05.373569 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-11b988cf-2379-4dfe-895c-e25304b3e3bc None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:45:05.410307 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-11b988cf-2379-4dfe-895c-e25304b3e3bc None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 20:45:05.437739 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-11b988cf-2379-4dfe-895c-e25304b3e3bc None None] Driver initialization completed successfully. Apr 09 20:45:05.452670 ncdv-master-1 cinder-volume[135002]: INFO cinder.manager [None req-11b988cf-2379-4dfe-895c-e25304b3e3bc None None] Initiating service 3 cleanup Apr 09 20:45:05.461915 ncdv-master-1 cinder-volume[135002]: INFO cinder.manager [None req-11b988cf-2379-4dfe-895c-e25304b3e3bc None None] Service 3 cleanup completed. Apr 09 20:45:05.462571 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.service [None req-11b988cf-2379-4dfe-895c-e25304b3e3bc None None] Creating RPC server for service cinder-volume {{(pid=135002) start /opt/stack/cinder/cinder/service.py:231}} Apr 09 20:45:05.471968 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.service [None req-11b988cf-2379-4dfe-895c-e25304b3e3bc None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=135002) start /opt/stack/cinder/cinder/service.py:237}} Apr 09 20:45:05.521189 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-11b988cf-2379-4dfe-895c-e25304b3e3bc None None] Initializing RPC dependent components of volume driver RBDDriver (1.2.0) Apr 09 20:45:05.522153 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-11b988cf-2379-4dfe-895c-e25304b3e3bc None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:45:05.544851 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-11b988cf-2379-4dfe-895c-e25304b3e3bc None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:45:05.594727 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-11b988cf-2379-4dfe-895c-e25304b3e3bc None None] Driver post RPC initialization completed successfully. Apr 09 20:46:49.597327 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 20:46:49.598256 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:46:49.620801 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:46:49.647101 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 20:47:49.594146 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 20:47:49.595221 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:47:49.630749 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:47:49.652855 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 20:48:49.598532 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 20:48:49.599258 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:48:49.622523 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:48:49.648366 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 20:49:49.604009 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 20:49:49.605207 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:49:49.632618 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:49:49.655697 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 20:50:49.600853 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 20:50:49.601996 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:50:49.630408 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:50:49.653318 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 20:51:49.598736 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 20:51:49.599825 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:51:49.633528 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:51:49.654714 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 20:52:49.600014 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 20:52:49.601273 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:52:49.636110 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:52:49.658264 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 20:53:49.603373 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 20:53:49.604534 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:53:49.640409 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:53:49.661431 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 20:54:49.605897 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 20:54:49.607339 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:54:49.715127 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:54:49.797816 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 20:55:49.605129 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 20:55:49.606026 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:55:49.682654 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:55:49.751244 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 20:56:27.848822 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-b76cf6cf-6175-443b-9eb7-8aa21bbd7fde tempest-VolumesAdminNegativeTest-332816096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 20:56:27.976676 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b76cf6cf-6175-443b-9eb7-8aa21bbd7fde tempest-VolumesAdminNegativeTest-332816096 None] Flow 'volume_create_manager' (debf030b-963e-455e-82d2-2a7d669aeca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 20:56:28.005275 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b76cf6cf-6175-443b-9eb7-8aa21bbd7fde tempest-VolumesAdminNegativeTest-332816096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (737c3650-3bd8-4db6-b4e2-0dd7474a6ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:56:28.217502 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b76cf6cf-6175-443b-9eb7-8aa21bbd7fde tempest-VolumesAdminNegativeTest-332816096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (737c3650-3bd8-4db6-b4e2-0dd7474a6ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T20:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-66734125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ab4ed13e-9ca2-4fa0-9398-7b772f66654f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='847209629f944fd98aec4c4bbe9a2bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T20:56:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T20:56:28Z,use_quota=True,user_id='ae8571042b5f47eea035c6f126d4e641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:56:28.238550 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b76cf6cf-6175-443b-9eb7-8aa21bbd7fde tempest-VolumesAdminNegativeTest-332816096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (917a1aeb-6141-427a-95b5-a1f730e9ebbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:56:28.245314 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b76cf6cf-6175-443b-9eb7-8aa21bbd7fde tempest-VolumesAdminNegativeTest-332816096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (917a1aeb-6141-427a-95b5-a1f730e9ebbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:56:28.268749 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b76cf6cf-6175-443b-9eb7-8aa21bbd7fde tempest-VolumesAdminNegativeTest-332816096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5abf5502-f098-496c-acbf-2c9fa28fd567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:56:28.297436 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b76cf6cf-6175-443b-9eb7-8aa21bbd7fde tempest-VolumesAdminNegativeTest-332816096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5abf5502-f098-496c-acbf-2c9fa28fd567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab4ed13e-9ca2-4fa0-9398-7b772f66654f', 'volume_name': 'volume-ab4ed13e-9ca2-4fa0-9398-7b772f66654f', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:56:28.308862 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b76cf6cf-6175-443b-9eb7-8aa21bbd7fde tempest-VolumesAdminNegativeTest-332816096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18ac2e81-3f5d-43a5-a09a-50728ab30589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:56:28.328658 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b76cf6cf-6175-443b-9eb7-8aa21bbd7fde tempest-VolumesAdminNegativeTest-332816096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18ac2e81-3f5d-43a5-a09a-50728ab30589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:56:28.353884 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b76cf6cf-6175-443b-9eb7-8aa21bbd7fde tempest-VolumesAdminNegativeTest-332816096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49d40d54-4634-4009-a92b-5b2ca6a2811e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:56:28.372445 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-b76cf6cf-6175-443b-9eb7-8aa21bbd7fde tempest-VolumesAdminNegativeTest-332816096 None] Volume ab4ed13e-9ca2-4fa0-9398-7b772f66654f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab4ed13e-9ca2-4fa0-9398-7b772f66654f', 'volume_size': 1} Apr 09 20:56:28.372869 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b76cf6cf-6175-443b-9eb7-8aa21bbd7fde tempest-VolumesAdminNegativeTest-332816096 None] creating volume 'volume-ab4ed13e-9ca2-4fa0-9398-7b772f66654f' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 20:56:28.373753 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b76cf6cf-6175-443b-9eb7-8aa21bbd7fde tempest-VolumesAdminNegativeTest-332816096 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:56:28.861871 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b76cf6cf-6175-443b-9eb7-8aa21bbd7fde tempest-VolumesAdminNegativeTest-332816096 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 20:56:28.863275 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b76cf6cf-6175-443b-9eb7-8aa21bbd7fde tempest-VolumesAdminNegativeTest-332816096 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 20:56:28.867496 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b76cf6cf-6175-443b-9eb7-8aa21bbd7fde tempest-VolumesAdminNegativeTest-332816096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49d40d54-4634-4009-a92b-5b2ca6a2811e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab4ed13e-9ca2-4fa0-9398-7b772f66654f', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:56:28.878231 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b76cf6cf-6175-443b-9eb7-8aa21bbd7fde tempest-VolumesAdminNegativeTest-332816096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2556888-aeea-4349-bac2-fa952a976820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:56:28.898387 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-b76cf6cf-6175-443b-9eb7-8aa21bbd7fde tempest-VolumesAdminNegativeTest-332816096 None] Volume volume-ab4ed13e-9ca2-4fa0-9398-7b772f66654f (ab4ed13e-9ca2-4fa0-9398-7b772f66654f): created successfully Apr 09 20:56:28.903284 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b76cf6cf-6175-443b-9eb7-8aa21bbd7fde tempest-VolumesAdminNegativeTest-332816096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2556888-aeea-4349-bac2-fa952a976820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:56:28.909291 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b76cf6cf-6175-443b-9eb7-8aa21bbd7fde tempest-VolumesAdminNegativeTest-332816096 None] Flow 'volume_create_manager' (debf030b-963e-455e-82d2-2a7d669aeca0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 20:56:28.935360 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-b76cf6cf-6175-443b-9eb7-8aa21bbd7fde tempest-VolumesAdminNegativeTest-332816096 None] Created volume successfully. Apr 09 20:56:32.051910 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-5c18ccbc-0d9d-4b10-909c-8b175ead36af req-04a85ccf-3f52-4aa7-bbcd-680fa17f977b tempest-VolumesAdminNegativeTest-332816096 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 20:56:33.276349 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-5c18ccbc-0d9d-4b10-909c-8b175ead36af req-04a85ccf-3f52-4aa7-bbcd-680fa17f977b tempest-VolumesAdminNegativeTest-332816096 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.224s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 20:56:33.278458 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-5c18ccbc-0d9d-4b10-909c-8b175ead36af req-04a85ccf-3f52-4aa7-bbcd-680fa17f977b tempest-VolumesAdminNegativeTest-332816096 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ab4ed13e-9ca2-4fa0-9398-7b772f66654f', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': 'ab4ed13e-9ca2-4fa0-9398-7b772f66654f', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 20:56:33.373752 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-5c18ccbc-0d9d-4b10-909c-8b175ead36af req-04a85ccf-3f52-4aa7-bbcd-680fa17f977b tempest-VolumesAdminNegativeTest-332816096 None] Connection info returned from driver {'name': 'volumes/volume-ab4ed13e-9ca2-4fa0-9398-7b772f66654f', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ab4ed13e-9ca2-4fa0-9398-7b772f66654f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8822da97-2a55-4d14-997a-82796d971f0b'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 20:56:33.562152 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-5c18ccbc-0d9d-4b10-909c-8b175ead36af req-04a85ccf-3f52-4aa7-bbcd-680fa17f977b tempest-VolumesAdminNegativeTest-332816096 None] attachment_update completed successfully. Apr 09 20:56:43.648434 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-45487212-d207-4aad-87bd-48652d1a694e req-b4a1a246-453e-46a4-aa03-b5eee1d83e7f tempest-VolumesAdminNegativeTest-332816096 None] Terminate volume connection completed successfully. Apr 09 20:56:43.649149 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-45487212-d207-4aad-87bd-48652d1a694e req-b4a1a246-453e-46a4-aa03-b5eee1d83e7f tempest-VolumesAdminNegativeTest-332816096 None] Deleting attachment 8822da97-2a55-4d14-997a-82796d971f0b. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 20:56:45.122499 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-95936ebf-ab52-4a01-9f31-d9fefd7ebb0a tempest-VolumesAdminNegativeTest-332816096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 20:56:45.151053 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-95936ebf-ab52-4a01-9f31-d9fefd7ebb0a tempest-VolumesAdminNegativeTest-332816096 None] Flow 'volume_create_manager' (26e28f69-e758-4001-82a5-0bc03e5ee1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 20:56:45.161212 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-95936ebf-ab52-4a01-9f31-d9fefd7ebb0a tempest-VolumesAdminNegativeTest-332816096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ee8d9e1-cd28-4245-9414-5a0c85353bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:56:45.183429 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-95936ebf-ab52-4a01-9f31-d9fefd7ebb0a tempest-VolumesAdminNegativeTest-332816096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ee8d9e1-cd28-4245-9414-5a0c85353bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T20:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1359469155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=46b573ec-b98f-425e-98d5-553e470a3bd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='847209629f944fd98aec4c4bbe9a2bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T20:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T20:56:45Z,use_quota=True,user_id='ae8571042b5f47eea035c6f126d4e641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:56:45.189946 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-95936ebf-ab52-4a01-9f31-d9fefd7ebb0a tempest-VolumesAdminNegativeTest-332816096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16dc8cfb-c73c-4204-86ac-e3a25a46b7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:56:45.194989 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-95936ebf-ab52-4a01-9f31-d9fefd7ebb0a tempest-VolumesAdminNegativeTest-332816096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16dc8cfb-c73c-4204-86ac-e3a25a46b7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:56:45.203109 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-95936ebf-ab52-4a01-9f31-d9fefd7ebb0a tempest-VolumesAdminNegativeTest-332816096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b64011e8-9e97-4285-97f6-c001a17a9932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:56:45.208231 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-95936ebf-ab52-4a01-9f31-d9fefd7ebb0a tempest-VolumesAdminNegativeTest-332816096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b64011e8-9e97-4285-97f6-c001a17a9932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46b573ec-b98f-425e-98d5-553e470a3bd5', 'volume_name': 'volume-46b573ec-b98f-425e-98d5-553e470a3bd5', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:56:45.216344 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-95936ebf-ab52-4a01-9f31-d9fefd7ebb0a tempest-VolumesAdminNegativeTest-332816096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1f9021c-0e86-4c70-b828-d1b9bd183652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:56:45.221236 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-95936ebf-ab52-4a01-9f31-d9fefd7ebb0a tempest-VolumesAdminNegativeTest-332816096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1f9021c-0e86-4c70-b828-d1b9bd183652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:56:45.228494 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-95936ebf-ab52-4a01-9f31-d9fefd7ebb0a tempest-VolumesAdminNegativeTest-332816096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5c70a36-4a57-4dc4-8fcf-20b4af20f4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:56:45.229964 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-95936ebf-ab52-4a01-9f31-d9fefd7ebb0a tempest-VolumesAdminNegativeTest-332816096 None] Volume 46b573ec-b98f-425e-98d5-553e470a3bd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46b573ec-b98f-425e-98d5-553e470a3bd5', 'volume_size': 1} Apr 09 20:56:45.230511 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-95936ebf-ab52-4a01-9f31-d9fefd7ebb0a tempest-VolumesAdminNegativeTest-332816096 None] creating volume 'volume-46b573ec-b98f-425e-98d5-553e470a3bd5' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 20:56:45.231561 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-95936ebf-ab52-4a01-9f31-d9fefd7ebb0a tempest-VolumesAdminNegativeTest-332816096 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:56:45.345327 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-95936ebf-ab52-4a01-9f31-d9fefd7ebb0a tempest-VolumesAdminNegativeTest-332816096 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 20:56:45.345327 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-95936ebf-ab52-4a01-9f31-d9fefd7ebb0a tempest-VolumesAdminNegativeTest-332816096 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 20:56:45.348139 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-95936ebf-ab52-4a01-9f31-d9fefd7ebb0a tempest-VolumesAdminNegativeTest-332816096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5c70a36-4a57-4dc4-8fcf-20b4af20f4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46b573ec-b98f-425e-98d5-553e470a3bd5', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:56:45.364543 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-95936ebf-ab52-4a01-9f31-d9fefd7ebb0a tempest-VolumesAdminNegativeTest-332816096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a306a3ef-c6f0-400e-bbd3-9ad3eda0dca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:56:45.377625 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-95936ebf-ab52-4a01-9f31-d9fefd7ebb0a tempest-VolumesAdminNegativeTest-332816096 None] Volume volume-46b573ec-b98f-425e-98d5-553e470a3bd5 (46b573ec-b98f-425e-98d5-553e470a3bd5): created successfully Apr 09 20:56:45.381862 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-95936ebf-ab52-4a01-9f31-d9fefd7ebb0a tempest-VolumesAdminNegativeTest-332816096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a306a3ef-c6f0-400e-bbd3-9ad3eda0dca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:56:45.387473 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-95936ebf-ab52-4a01-9f31-d9fefd7ebb0a tempest-VolumesAdminNegativeTest-332816096 None] Flow 'volume_create_manager' (26e28f69-e758-4001-82a5-0bc03e5ee1e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 20:56:45.399268 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-95936ebf-ab52-4a01-9f31-d9fefd7ebb0a tempest-VolumesAdminNegativeTest-332816096 None] Created volume successfully. Apr 09 20:56:46.347514 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-10e42424-0b19-48a3-98c5-1f2236399a0d tempest-VolumesAdminNegativeTest-332816096 None] Lock "b'cinder-46b573ec-b98f-425e-98d5-553e470a3bd5-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 20:56:46.418387 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-10e42424-0b19-48a3-98c5-1f2236399a0d tempest-VolumesAdminNegativeTest-332816096 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:56:46.540887 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-10e42424-0b19-48a3-98c5-1f2236399a0d tempest-VolumesAdminNegativeTest-332816096 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 20:56:46.544139 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-10e42424-0b19-48a3-98c5-1f2236399a0d tempest-VolumesAdminNegativeTest-332816096 None] Volume volume-46b573ec-b98f-425e-98d5-553e470a3bd5 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 20:56:46.589775 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-10e42424-0b19-48a3-98c5-1f2236399a0d tempest-VolumesAdminNegativeTest-332816096 None] deleting rbd volume volume-46b573ec-b98f-425e-98d5-553e470a3bd5 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 20:56:47.103849 ncdv-master-1 cinder-volume[135002]: WARNING cinder.quota [None req-10e42424-0b19-48a3-98c5-1f2236399a0d tempest-VolumesAdminNegativeTest-332816096 None] Deprecated: Default quota for resource: volumes_ceph is set by the default quota flag: quota_volumes_ceph, it is now deprecated. Please use the default quota class for default quota. Apr 09 20:56:47.105015 ncdv-master-1 cinder-volume[135002]: WARNING cinder.quota [None req-10e42424-0b19-48a3-98c5-1f2236399a0d tempest-VolumesAdminNegativeTest-332816096 None] Deprecated: Default quota for resource: gigabytes_ceph is set by the default quota flag: quota_gigabytes_ceph, it is now deprecated. Please use the default quota class for default quota. Apr 09 20:56:47.136337 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-10e42424-0b19-48a3-98c5-1f2236399a0d tempest-VolumesAdminNegativeTest-332816096 None] Created reservations ['6a5683ad-c30e-4f0c-8561-beb0c113b910', 'a9edfdbf-1d9b-4240-bf13-c266c225e46b', '06b658bf-d4b2-45c4-a0e0-0510f930cbf6', '168e9b0f-c06a-4674-aca7-2ba2a73ae110'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 20:56:47.247195 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-10e42424-0b19-48a3-98c5-1f2236399a0d tempest-VolumesAdminNegativeTest-332816096 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:56:47.312368 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-10e42424-0b19-48a3-98c5-1f2236399a0d tempest-VolumesAdminNegativeTest-332816096 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:56:47.389432 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-10e42424-0b19-48a3-98c5-1f2236399a0d tempest-VolumesAdminNegativeTest-332816096 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 20:56:47.394832 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-10e42424-0b19-48a3-98c5-1f2236399a0d tempest-VolumesAdminNegativeTest-332816096 None] Deleted volume successfully. Apr 09 20:56:47.422208 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-10e42424-0b19-48a3-98c5-1f2236399a0d tempest-VolumesAdminNegativeTest-332816096 None] Lock "b'cinder-46b573ec-b98f-425e-98d5-553e470a3bd5-delete_volume'" released by "delete_volume" :: held 1.076s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 20:56:47.674917 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-02f63058-7ea6-4d6e-873b-3530706754a1 tempest-VolumesAdminNegativeTest-332816096 None] Lock "b'cinder-ab4ed13e-9ca2-4fa0-9398-7b772f66654f-delete_volume'" acquired by "delete_volume" :: waited 0.029s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 20:56:47.778117 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-02f63058-7ea6-4d6e-873b-3530706754a1 tempest-VolumesAdminNegativeTest-332816096 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:56:47.872570 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-02f63058-7ea6-4d6e-873b-3530706754a1 tempest-VolumesAdminNegativeTest-332816096 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 20:56:47.872994 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-02f63058-7ea6-4d6e-873b-3530706754a1 tempest-VolumesAdminNegativeTest-332816096 None] Volume volume-ab4ed13e-9ca2-4fa0-9398-7b772f66654f is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 20:56:47.885397 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-02f63058-7ea6-4d6e-873b-3530706754a1 tempest-VolumesAdminNegativeTest-332816096 None] deleting rbd volume volume-ab4ed13e-9ca2-4fa0-9398-7b772f66654f {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 20:56:48.361663 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-02f63058-7ea6-4d6e-873b-3530706754a1 tempest-VolumesAdminNegativeTest-332816096 None] Created reservations ['a044edc3-d92d-4ae4-a102-89fc1f3962aa', '16673cbb-df5a-4962-953f-b41984122150', '8d791607-8ecf-4b8c-8e98-36cf393c6d40', '1b4281bf-fd49-45d1-88d9-41c448a060c1'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 20:56:48.467315 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-02f63058-7ea6-4d6e-873b-3530706754a1 tempest-VolumesAdminNegativeTest-332816096 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:56:48.541171 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-02f63058-7ea6-4d6e-873b-3530706754a1 tempest-VolumesAdminNegativeTest-332816096 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:56:48.619821 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-02f63058-7ea6-4d6e-873b-3530706754a1 tempest-VolumesAdminNegativeTest-332816096 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 20:56:48.624373 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-02f63058-7ea6-4d6e-873b-3530706754a1 tempest-VolumesAdminNegativeTest-332816096 None] Deleted volume successfully. Apr 09 20:56:48.643288 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-02f63058-7ea6-4d6e-873b-3530706754a1 tempest-VolumesAdminNegativeTest-332816096 None] Lock "b'cinder-ab4ed13e-9ca2-4fa0-9398-7b772f66654f-delete_volume'" released by "delete_volume" :: held 0.968s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 20:56:49.609775 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 20:56:49.610451 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:56:49.680110 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:56:49.772288 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 20:57:29.218907 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-a07ed4f4-4649-4a79-a57d-b25bb80e5eb7 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 20:57:29.238666 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a07ed4f4-4649-4a79-a57d-b25bb80e5eb7 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Flow 'volume_create_manager' (8b93f526-2e8d-477d-a4aa-09302118e9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 20:57:29.245242 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a07ed4f4-4649-4a79-a57d-b25bb80e5eb7 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2801ff1-1b1c-4af0-8175-9b9e00113ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:57:29.260988 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a07ed4f4-4649-4a79-a57d-b25bb80e5eb7 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2801ff1-1b1c-4af0-8175-9b9e00113ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T20:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveAutoBlockMigrationV225Test-volume-1104396277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5fa8081f-7b54-455a-a346-4214f8f81f79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c23a8d6534a4426b2ea106417c8b68a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T20:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T20:57:29Z,use_quota=True,user_id='9c775742dfc04cec8559f9e4d13239b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:57:29.266477 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a07ed4f4-4649-4a79-a57d-b25bb80e5eb7 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4224d2ac-45a9-4a79-8fa5-4045f9ffb948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:57:29.270544 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a07ed4f4-4649-4a79-a57d-b25bb80e5eb7 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4224d2ac-45a9-4a79-8fa5-4045f9ffb948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:57:29.275715 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a07ed4f4-4649-4a79-a57d-b25bb80e5eb7 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc760d14-9194-456f-9b10-74f9f8e7caef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:57:29.279786 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a07ed4f4-4649-4a79-a57d-b25bb80e5eb7 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc760d14-9194-456f-9b10-74f9f8e7caef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fa8081f-7b54-455a-a346-4214f8f81f79', 'volume_name': 'volume-5fa8081f-7b54-455a-a346-4214f8f81f79', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:57:29.284795 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a07ed4f4-4649-4a79-a57d-b25bb80e5eb7 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb4762e9-a024-44a2-87c9-80c2dd87551f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:57:29.288724 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a07ed4f4-4649-4a79-a57d-b25bb80e5eb7 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb4762e9-a024-44a2-87c9-80c2dd87551f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:57:29.293523 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a07ed4f4-4649-4a79-a57d-b25bb80e5eb7 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58af487d-e0e7-4016-9f3c-d5366cb38071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:57:29.294604 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-a07ed4f4-4649-4a79-a57d-b25bb80e5eb7 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Volume 5fa8081f-7b54-455a-a346-4214f8f81f79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fa8081f-7b54-455a-a346-4214f8f81f79', 'volume_size': 1} Apr 09 20:57:29.294978 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a07ed4f4-4649-4a79-a57d-b25bb80e5eb7 tempest-LiveAutoBlockMigrationV225Test-403680615 None] creating volume 'volume-5fa8081f-7b54-455a-a346-4214f8f81f79' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 20:57:29.295791 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a07ed4f4-4649-4a79-a57d-b25bb80e5eb7 tempest-LiveAutoBlockMigrationV225Test-403680615 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:57:29.362221 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a07ed4f4-4649-4a79-a57d-b25bb80e5eb7 tempest-LiveAutoBlockMigrationV225Test-403680615 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 20:57:29.362604 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a07ed4f4-4649-4a79-a57d-b25bb80e5eb7 tempest-LiveAutoBlockMigrationV225Test-403680615 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 20:57:29.366544 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a07ed4f4-4649-4a79-a57d-b25bb80e5eb7 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58af487d-e0e7-4016-9f3c-d5366cb38071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fa8081f-7b54-455a-a346-4214f8f81f79', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:57:29.372463 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a07ed4f4-4649-4a79-a57d-b25bb80e5eb7 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca81b27f-da16-4208-81b4-3c245eeba18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:57:29.384269 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-a07ed4f4-4649-4a79-a57d-b25bb80e5eb7 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Volume volume-5fa8081f-7b54-455a-a346-4214f8f81f79 (5fa8081f-7b54-455a-a346-4214f8f81f79): created successfully Apr 09 20:57:29.388644 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a07ed4f4-4649-4a79-a57d-b25bb80e5eb7 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca81b27f-da16-4208-81b4-3c245eeba18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:57:29.394387 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a07ed4f4-4649-4a79-a57d-b25bb80e5eb7 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Flow 'volume_create_manager' (8b93f526-2e8d-477d-a4aa-09302118e9a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 20:57:29.404837 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-a07ed4f4-4649-4a79-a57d-b25bb80e5eb7 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Created volume successfully. Apr 09 20:57:31.095101 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-4165c293-e208-43ee-a364-6e90adb49658 req-5d5e2939-535e-49d8-8853-ea78bc8891e6 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 20:57:31.822806 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-4165c293-e208-43ee-a364-6e90adb49658 req-5d5e2939-535e-49d8-8853-ea78bc8891e6 tempest-LiveAutoBlockMigrationV225Test-403680615 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.728s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 20:57:31.823762 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-4165c293-e208-43ee-a364-6e90adb49658 req-5d5e2939-535e-49d8-8853-ea78bc8891e6 tempest-LiveAutoBlockMigrationV225Test-403680615 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5fa8081f-7b54-455a-a346-4214f8f81f79', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': '5fa8081f-7b54-455a-a346-4214f8f81f79', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 20:57:31.853387 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-4165c293-e208-43ee-a364-6e90adb49658 req-5d5e2939-535e-49d8-8853-ea78bc8891e6 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Connection info returned from driver {'name': 'volumes/volume-5fa8081f-7b54-455a-a346-4214f8f81f79', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5fa8081f-7b54-455a-a346-4214f8f81f79', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '1e4ab11c-d78e-42c9-910b-d03b1699060e'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 20:57:31.906737 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-4165c293-e208-43ee-a364-6e90adb49658 req-5d5e2939-535e-49d8-8853-ea78bc8891e6 tempest-LiveAutoBlockMigrationV225Test-403680615 None] attachment_update completed successfully. Apr 09 20:57:49.612310 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 20:57:49.614073 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:57:49.665020 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:57:49.736461 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 20:57:52.583171 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-ef1dfbef-18b0-4c28-9be1-304ab4e76fe8 req-5306b68b-f56f-4a2a-bfde-f3423f1a1486 tempest-LiveAutoBlockMigrationV225Test-2100307713 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 20:57:53.393715 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-ef1dfbef-18b0-4c28-9be1-304ab4e76fe8 req-5306b68b-f56f-4a2a-bfde-f3423f1a1486 tempest-LiveAutoBlockMigrationV225Test-2100307713 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.810s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 20:57:53.395972 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-ef1dfbef-18b0-4c28-9be1-304ab4e76fe8 req-5306b68b-f56f-4a2a-bfde-f3423f1a1486 tempest-LiveAutoBlockMigrationV225Test-2100307713 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5fa8081f-7b54-455a-a346-4214f8f81f79', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': '5fa8081f-7b54-455a-a346-4214f8f81f79', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 20:57:53.431463 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-ef1dfbef-18b0-4c28-9be1-304ab4e76fe8 req-5306b68b-f56f-4a2a-bfde-f3423f1a1486 tempest-LiveAutoBlockMigrationV225Test-2100307713 None] Connection info returned from driver {'name': 'volumes/volume-5fa8081f-7b54-455a-a346-4214f8f81f79', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5fa8081f-7b54-455a-a346-4214f8f81f79', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3c8979b1-2761-4438-bbbf-bb2fadb97aa7'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 20:57:53.558977 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-ef1dfbef-18b0-4c28-9be1-304ab4e76fe8 req-5306b68b-f56f-4a2a-bfde-f3423f1a1486 tempest-LiveAutoBlockMigrationV225Test-2100307713 None] attachment_update completed successfully. Apr 09 20:58:36.491852 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 20:58:36.522585 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Flow 'volume_create_manager' (291446e8-ee60-4762-adb6-591a4317ed09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 20:58:36.529305 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9997bba3-639d-45f5-93ca-9bccede0837b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:58:36.544608 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9997bba3-639d-45f5-93ca-9bccede0837b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T20:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-169556531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6d815065-063f-4887-9bc8-5808837868ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dbc8f96549e4dfaaf941d571addb9c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T20:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T20:58:36Z,use_quota=True,user_id='c3f004d8412d43d7a82f7daa56f47305',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:58:36.550092 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (805dc651-451d-4ae0-8947-af1fa212599a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:58:36.554279 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (805dc651-451d-4ae0-8947-af1fa212599a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:58:36.559414 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (043be4eb-89b7-49dc-97aa-8e610c603c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:58:36.701259 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (043be4eb-89b7-49dc-97aa-8e610c603c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6d815065-063f-4887-9bc8-5808837868ff', 'volume_name': 'volume-6d815065-063f-4887-9bc8-5808837868ff', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:58:36.707993 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faeaab01-b43d-4fe7-bf32-de7a30f4f951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:58:36.712369 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faeaab01-b43d-4fe7-bf32-de7a30f4f951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:58:36.719209 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37b7dd80-0667-492d-8768-febbf1b2e74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:58:36.720797 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Volume 6d815065-063f-4887-9bc8-5808837868ff: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6d815065-063f-4887-9bc8-5808837868ff', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 09 20:58:36.721688 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Cloning 6d815065-063f-4887-9bc8-5808837868ff from image b539c48b-3400-4aa4-9226-8be5a3d07b36 at location (None, None). {{(pid=135002) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Apr 09 20:58:36.732077 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Lock "b'cinder-b539c48b-3400-4aa4-9226-8be5a3d07b36'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 20:58:36.742168 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Preparing cache entry for image = b539c48b-3400-4aa4-9226-8be5a3d07b36 on host ncdv-master-1@ceph#ceph. {{(pid=135002) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:879}} Apr 09 20:58:36.743547 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Attempting to retrieve cache entry for image = b539c48b-3400-4aa4-9226-8be5a3d07b36 on host ncdv-master-1@ceph#ceph. {{(pid=135002) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Apr 09 20:58:49.611795 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 20:58:49.612755 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:58:49.662729 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:58:49.709469 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 20:58:51.438898 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.image_utils [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b539c48b-3400-4aa4-9226-8be5a3d07b36_ifegvdu8ncdv-master-1@ceph, size 616.00 MB, duration 14.68 sec {{(pid=135002) fetch /opt/stack/cinder/cinder/image/image_utils.py:580}} Apr 09 20:58:51.438898 ncdv-master-1 cinder-volume[135002]: INFO cinder.image.image_utils [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Image download 616.00 MB at 41.95 MB/s Apr 09 20:58:51.490356 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_b539c48b-3400-4aa4-9226-8be5a3d07b36_ifegvdu8ncdv-master-1@ceph {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 20:58:51.662265 ncdv-master-1 sudo[146802]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_b539c48b-3400-4aa4-9226-8be5a3d07b36_ifegvdu8ncdv-master-1@ceph Apr 09 20:58:51.663106 ncdv-master-1 sudo[146802]: pam_unix(sudo:session): session opened for user root by (uid=0) Apr 09 20:58:53.034025 ncdv-master-1 sudo[146802]: pam_unix(sudo:session): session closed for user root Apr 09 20:58:53.036290 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_b539c48b-3400-4aa4-9226-8be5a3d07b36_ifegvdu8ncdv-master-1@ceph" returned: 0 in 1.546s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 20:58:53.044828 ncdv-master-1 cinder-volume[135002]: WARNING py.warnings [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Apr 09 20:58:53.044828 ncdv-master-1 cinder-volume[135002]: debtcollector.deprecate( Apr 09 20:58:53.044828 ncdv-master-1 cinder-volume[135002]: Apr 09 20:58:53.045859 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.image_utils [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Temporary image b539c48b-3400-4aa4-9226-8be5a3d07b36 is fetched for user c3f004d8412d43d7a82f7daa56f47305. {{(pid=135002) fetch /opt/stack/cinder/cinder/image/image_utils.py:1088}} Apr 09 20:58:53.130954 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_b539c48b-3400-4aa4-9226-8be5a3d07b36_ifegvdu8ncdv-master-1@ceph {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 20:58:53.293129 ncdv-master-1 sudo[146826]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_b539c48b-3400-4aa4-9226-8be5a3d07b36_ifegvdu8ncdv-master-1@ceph Apr 09 20:58:53.294013 ncdv-master-1 sudo[146826]: pam_unix(sudo:session): session opened for user root by (uid=0) Apr 09 20:58:54.586825 ncdv-master-1 sudo[146826]: pam_unix(sudo:session): session closed for user root Apr 09 20:58:54.589135 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_b539c48b-3400-4aa4-9226-8be5a3d07b36_ifegvdu8ncdv-master-1@ceph" returned: 0 in 1.458s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 20:58:54.590659 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] creating volume 'volume-6d815065-063f-4887-9bc8-5808837868ff' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 20:58:54.591781 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:58:54.674229 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 20:58:54.674622 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 20:58:54.713071 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.volume_utils [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Attempting download of b539c48b-3400-4aa4-9226-8be5a3d07b36 ((None, None)) to volume 6d815065-063f-4887-9bc8-5808837868ff. {{(pid=135002) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Apr 09 20:58:54.761221 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_b539c48b-3400-4aa4-9226-8be5a3d07b36_57of84ff {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 20:58:54.863228 ncdv-master-1 sudo[146851]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_b539c48b-3400-4aa4-9226-8be5a3d07b36_57of84ff Apr 09 20:58:54.864105 ncdv-master-1 sudo[146851]: pam_unix(sudo:session): session opened for user root by (uid=0) Apr 09 20:58:56.198797 ncdv-master-1 sudo[146851]: pam_unix(sudo:session): session closed for user root Apr 09 20:58:56.201190 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_b539c48b-3400-4aa4-9226-8be5a3d07b36_57of84ff" returned: 0 in 1.440s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 20:58:56.206555 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_b539c48b-3400-4aa4-9226-8be5a3d07b36_ifegvdu8ncdv-master-1@ceph {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 20:58:56.387699 ncdv-master-1 sudo[146868]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_b539c48b-3400-4aa4-9226-8be5a3d07b36_ifegvdu8ncdv-master-1@ceph Apr 09 20:58:56.388543 ncdv-master-1 sudo[146868]: pam_unix(sudo:session): session opened for user root by (uid=0) Apr 09 20:58:58.525892 ncdv-master-1 sudo[146868]: pam_unix(sudo:session): session closed for user root Apr 09 20:58:58.529351 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_b539c48b-3400-4aa4-9226-8be5a3d07b36_ifegvdu8ncdv-master-1@ceph" returned: 0 in 2.322s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 20:58:58.533462 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.image_utils [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] b539c48b-3400-4aa4-9226-8be5a3d07b36 was vhdx, converting to raw {{(pid=135002) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:793}} Apr 09 20:58:58.534961 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_b539c48b-3400-4aa4-9226-8be5a3d07b36_ifegvdu8ncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpv2pjem18 {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 20:58:58.563491 ncdv-master-1 sudo[146891]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_b539c48b-3400-4aa4-9226-8be5a3d07b36_ifegvdu8ncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpv2pjem18 Apr 09 20:58:58.565309 ncdv-master-1 sudo[146891]: pam_unix(sudo:session): session opened for user root by (uid=0) Apr 09 20:59:01.521153 ncdv-master-1 sudo[146891]: pam_unix(sudo:session): session closed for user root Apr 09 20:59:01.523548 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_b539c48b-3400-4aa4-9226-8be5a3d07b36_ifegvdu8ncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpv2pjem18" returned: 0 in 2.988s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 20:59:01.525402 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_b539c48b-3400-4aa4-9226-8be5a3d07b36_ifegvdu8ncdv-master-1@ceph {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 20:59:01.747215 ncdv-master-1 sudo[146907]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_b539c48b-3400-4aa4-9226-8be5a3d07b36_ifegvdu8ncdv-master-1@ceph Apr 09 20:59:01.748485 ncdv-master-1 sudo[146907]: pam_unix(sudo:session): session opened for user root by (uid=0) Apr 09 20:59:03.566993 ncdv-master-1 sudo[146907]: pam_unix(sudo:session): session closed for user root Apr 09 20:59:03.569406 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_b539c48b-3400-4aa4-9226-8be5a3d07b36_ifegvdu8ncdv-master-1@ceph" returned: 0 in 2.044s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 20:59:03.570164 ncdv-master-1 cinder-volume[135002]: WARNING py.warnings [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Apr 09 20:59:03.570164 ncdv-master-1 cinder-volume[135002]: debtcollector.deprecate( Apr 09 20:59:03.570164 ncdv-master-1 cinder-volume[135002]: Apr 09 20:59:03.570798 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.image_utils [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b539c48b-3400-4aa4-9226-8be5a3d07b36_ifegvdu8ncdv-master-1@ceph, size 700.00 MB, duration 2.99 sec, destination /opt/stack/data/cinder/conversion/tmpv2pjem18 {{(pid=135002) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:412}} Apr 09 20:59:03.572031 ncdv-master-1 cinder-volume[135002]: INFO cinder.image.image_utils [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Converted 700.00 MB image at 234.09 MB/s Apr 09 20:59:03.575113 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:59:03.697730 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 20:59:03.699018 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Volume volume-6d815065-063f-4887-9bc8-5808837868ff is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 20:59:03.741295 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] deleting rbd volume volume-6d815065-063f-4887-9bc8-5808837868ff {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 20:59:04.147581 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Running cmd (subprocess): rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmpv2pjem18 volume-6d815065-063f-4887-9bc8-5808837868ff --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 20:59:05.875228 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-ef1dfbef-18b0-4c28-9be1-304ab4e76fe8 req-c761f5b2-5a25-49fb-b855-5629f9ea2be9 tempest-LiveAutoBlockMigrationV225Test-2100307713 None] Terminate volume connection completed successfully. Apr 09 20:59:05.882155 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-ef1dfbef-18b0-4c28-9be1-304ab4e76fe8 req-c761f5b2-5a25-49fb-b855-5629f9ea2be9 tempest-LiveAutoBlockMigrationV225Test-2100307713 None] Deleting attachment 1e4ab11c-d78e-42c9-910b-d03b1699060e. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 20:59:10.886474 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] CMD "rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmpv2pjem18 volume-6d815065-063f-4887-9bc8-5808837868ff --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 6.739s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 20:59:11.101522 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:59:11.326903 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 20:59:11.327616 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 20:59:11.328214 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.volume_utils [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Downloaded image b539c48b-3400-4aa4-9226-8be5a3d07b36 ((None, None)) to volume 6d815065-063f-4887-9bc8-5808837868ff successfully. {{(pid=135002) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1218}} Apr 09 20:59:11.427794 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.image_utils [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Temporary image b539c48b-3400-4aa4-9226-8be5a3d07b36 for user c3f004d8412d43d7a82f7daa56f47305 is deleted. {{(pid=135002) fetch /opt/stack/cinder/cinder/image/image_utils.py:1092}} Apr 09 20:59:11.642599 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Created reservations ['762da6a2-cfdd-4f30-8174-6c618ad1e594', 'ae77f12e-b453-4a55-a8ab-82b891cc5851', '7c08803e-eff8-4e2d-ab70-4b097bbf432c', '40624f30-36eb-4356-abb2-105ded3c3b66'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 20:59:11.660447 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Creating image volume entry: {'display_description': None, 'created_at': datetime.datetime(2022, 4, 9, 20, 58, 36, tzinfo=datetime.timezone.utc), 'volume_metadata': [], 'bootable': False, 'scheduled_at': datetime.datetime(2022, 4, 9, 20, 58, 36, tzinfo=datetime.timezone.utc), 'encryption_key_id': None, 'size': 1, 'provider_geometry': None, 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'group_id': None, 'shared_targets': True, 'deleted_at': None, 'availability_zone': 'nova', 'terminated_at': None, 'host': 'ncdv-master-1@ceph#ceph', 'volume_admin_metadata': [], 'replication_driver_data': None, 'updated_at': datetime.datetime(2022, 4, 9, 20, 58, 36, tzinfo=datetime.timezone.utc), 'replication_status': None, 'cluster_name': None, 'project_id': 'a6cf2e406d07415cac661e73b93ccb02', 'display_name': 'image-b539c48b-3400-4aa4-9226-8be5a3d07b36', 'previous_status': None, 'metadata': {}, 'consistencygroup_id': None, 'launched_at': None, 'volume_type_id': '7bed363b-b37b-4bdd-bf92-3fc06f4db0b8', 'ec2_id': None, 'provider_location': None, 'user_id': 'c3f004d8412d43d7a82f7daa56f47305', 'multiattach': False, 'provider_auth': None, 'provider_id': None, 'replication_extended_status': None, 'deleted': False, 'service_uuid': None, 'attach_status': 'detached', 'status': 'creating', 'source_volid': '6d815065-063f-4887-9bc8-5808837868ff'}. {{(pid=135002) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1614}} Apr 09 20:59:11.767082 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Volume reschedule parameters: False retry: None {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 20:59:11.805330 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Flow 'volume_create_manager' (93e7f7d1-8529-4cc5-94e8-8e6797142137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 20:59:11.823147 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bae51c5-f303-4d33-a68e-ec84eb77c1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:59:11.845056 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bae51c5-f303-4d33-a68e-ec84eb77c1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T20:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name='image-b539c48b-3400-4aa4-9226-8be5a3d07b36',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d35656e2-d293-4904-aeae-3113202bb314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6cf2e406d07415cac661e73b93ccb02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T20:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=6d815065-063f-4887-9bc8-5808837868ff,status='creating',terminated_at=None,updated_at=2022-04-09T20:58:36Z,use_quota=True,user_id='c3f004d8412d43d7a82f7daa56f47305',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:59:11.851902 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00a63509-d410-4577-9c57-a365932712c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:59:11.858440 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00a63509-d410-4577-9c57-a365932712c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:59:11.870918 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dbecc44-e236-4329-8b0a-80119c78fafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:59:11.895436 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dbecc44-e236-4329-8b0a-80119c78fafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd35656e2-d293-4904-aeae-3113202bb314', 'volume_name': 'volume-d35656e2-d293-4904-aeae-3113202bb314', 'volume_size': 1, 'source_volid': '6d815065-063f-4887-9bc8-5808837868ff', 'source_volstatus': 'downloading'}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:59:11.901744 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dfe7fe1-5d94-4ab2-8e58-a39e9c5c766e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:59:11.907040 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dfe7fe1-5d94-4ab2-8e58-a39e9c5c766e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:59:11.914917 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3db95f28-d908-4b6e-9fc8-b8c5b205f0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:59:11.916397 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Volume d35656e2-d293-4904-aeae-3113202bb314: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d35656e2-d293-4904-aeae-3113202bb314', 'volume_size': 1, 'source_volid': '6d815065-063f-4887-9bc8-5808837868ff', 'source_volstatus': 'downloading'} Apr 09 20:59:11.932339 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:59:12.018355 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] creating snapshot='volume-d35656e2-d293-4904-aeae-3113202bb314.clone_snap' {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Apr 09 20:59:12.815744 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] cloning 'volume-6d815065-063f-4887-9bc8-5808837868ff@volume-d35656e2-d293-4904-aeae-3113202bb314.clone_snap' to 'volume-d35656e2-d293-4904-aeae-3113202bb314' {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Apr 09 20:59:13.041695 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Volume volume-6d815065-063f-4887-9bc8-5808837868ff is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 20:59:13.046802 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 20:59:13.047476 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 20:59:13.083621 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] clone created successfully {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Apr 09 20:59:13.087920 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3db95f28-d908-4b6e-9fc8-b8c5b205f0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d35656e2-d293-4904-aeae-3113202bb314', 'volume_size': 1, 'source_volid': '6d815065-063f-4887-9bc8-5808837868ff', 'source_volstatus': 'downloading'}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:59:13.114745 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd018792-975e-4b0b-93f9-22d338020068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:59:13.124611 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Volume volume-d35656e2-d293-4904-aeae-3113202bb314 (d35656e2-d293-4904-aeae-3113202bb314): created successfully Apr 09 20:59:13.142917 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd018792-975e-4b0b-93f9-22d338020068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:59:13.155986 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Flow 'volume_create_manager' (93e7f7d1-8529-4cc5-94e8-8e6797142137) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 20:59:13.170102 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Created volume successfully. Apr 09 20:59:13.250394 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Creating new image-volume cache entry for image b539c48b-3400-4aa4-9226-8be5a3d07b36 on ncdv-master-1@ceph#ceph {{(pid=135002) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}} Apr 09 20:59:13.260165 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] New image-volume cache entry created: {'id': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'volume_id': 'd35656e2-d293-4904-aeae-3113202bb314', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36), 'last_used': datetime.datetime(2022, 4, 9, 20, 59, 13, 253640)}. {{(pid=135002) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}} Apr 09 20:59:13.273299 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Lock "b'cinder-b539c48b-3400-4aa4-9226-8be5a3d07b36'" released by "_prepare_image_cache_entry" :: held 36.541s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 20:59:13.273854 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.volume_utils [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Marking volume 6d815065-063f-4887-9bc8-5808837868ff as bootable. {{(pid=135002) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Apr 09 20:59:13.293920 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Copying metadata from image b539c48b-3400-4aa4-9226-8be5a3d07b36 to 6d815065-063f-4887-9bc8-5808837868ff. {{(pid=135002) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Apr 09 20:59:13.296149 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Creating volume glance metadata for volume 6d815065-063f-4887-9bc8-5808837868ff backed by image b539c48b-3400-4aa4-9226-8be5a3d07b36 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=135002) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Apr 09 20:59:13.454704 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37b7dd80-0667-492d-8768-febbf1b2e74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d815065-063f-4887-9bc8-5808837868ff', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:59:13.470402 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6830abf5-781d-416e-8ae6-4b92199d15aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:59:13.497532 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Volume volume-6d815065-063f-4887-9bc8-5808837868ff (6d815065-063f-4887-9bc8-5808837868ff): created successfully Apr 09 20:59:13.504061 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6830abf5-781d-416e-8ae6-4b92199d15aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:59:13.526322 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Flow 'volume_create_manager' (291446e8-ee60-4762-adb6-591a4317ed09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 20:59:13.566146 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-5b443862-bbaa-44d8-a9f5-cce5b832abea tempest-TaggedBootDevicesTest-883782944 None] Created volume successfully. Apr 09 20:59:14.406067 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-5382f06b-6713-4e7c-8016-d579edecb4c3 tempest-TaggedBootDevicesTest-883782944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 20:59:14.454887 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5382f06b-6713-4e7c-8016-d579edecb4c3 tempest-TaggedBootDevicesTest-883782944 None] Flow 'volume_create_manager' (6ae902b2-f395-42fe-9de7-d1578e55c7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 20:59:14.462574 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5382f06b-6713-4e7c-8016-d579edecb4c3 tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7a4a966-de94-410f-bb4c-80221e9b1f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:59:14.480258 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5382f06b-6713-4e7c-8016-d579edecb4c3 tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7a4a966-de94-410f-bb4c-80221e9b1f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T20:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1895459616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=266a3665-0f1a-4dc2-abdc-875ecf11f419,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dbc8f96549e4dfaaf941d571addb9c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T20:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T20:59:14Z,use_quota=True,user_id='c3f004d8412d43d7a82f7daa56f47305',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:59:14.486251 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5382f06b-6713-4e7c-8016-d579edecb4c3 tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0aae3ad-d34b-431b-96d2-ee905291acd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:59:14.494238 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5382f06b-6713-4e7c-8016-d579edecb4c3 tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0aae3ad-d34b-431b-96d2-ee905291acd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:59:14.502553 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5382f06b-6713-4e7c-8016-d579edecb4c3 tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4028f9a-816f-4c31-a050-64241137e9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:59:14.508653 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5382f06b-6713-4e7c-8016-d579edecb4c3 tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4028f9a-816f-4c31-a050-64241137e9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '266a3665-0f1a-4dc2-abdc-875ecf11f419', 'volume_name': 'volume-266a3665-0f1a-4dc2-abdc-875ecf11f419', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:59:14.514101 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5382f06b-6713-4e7c-8016-d579edecb4c3 tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c17a734b-ca59-48c3-aa28-08ac70d08638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:59:14.518802 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5382f06b-6713-4e7c-8016-d579edecb4c3 tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c17a734b-ca59-48c3-aa28-08ac70d08638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:59:14.524896 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5382f06b-6713-4e7c-8016-d579edecb4c3 tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cde4b4f2-34a8-48af-8a53-67bb9d482036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:59:14.526293 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-5382f06b-6713-4e7c-8016-d579edecb4c3 tempest-TaggedBootDevicesTest-883782944 None] Volume 266a3665-0f1a-4dc2-abdc-875ecf11f419: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-266a3665-0f1a-4dc2-abdc-875ecf11f419', 'volume_size': 1} Apr 09 20:59:14.526831 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5382f06b-6713-4e7c-8016-d579edecb4c3 tempest-TaggedBootDevicesTest-883782944 None] creating volume 'volume-266a3665-0f1a-4dc2-abdc-875ecf11f419' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 20:59:14.527975 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5382f06b-6713-4e7c-8016-d579edecb4c3 tempest-TaggedBootDevicesTest-883782944 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:59:14.679804 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5382f06b-6713-4e7c-8016-d579edecb4c3 tempest-TaggedBootDevicesTest-883782944 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 20:59:14.680172 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5382f06b-6713-4e7c-8016-d579edecb4c3 tempest-TaggedBootDevicesTest-883782944 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 20:59:14.683961 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5382f06b-6713-4e7c-8016-d579edecb4c3 tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cde4b4f2-34a8-48af-8a53-67bb9d482036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-266a3665-0f1a-4dc2-abdc-875ecf11f419', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:59:14.688848 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5382f06b-6713-4e7c-8016-d579edecb4c3 tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ba7846a-c794-4e32-b11c-cac8065edb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:59:14.719568 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-5382f06b-6713-4e7c-8016-d579edecb4c3 tempest-TaggedBootDevicesTest-883782944 None] Volume volume-266a3665-0f1a-4dc2-abdc-875ecf11f419 (266a3665-0f1a-4dc2-abdc-875ecf11f419): created successfully Apr 09 20:59:14.734437 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5382f06b-6713-4e7c-8016-d579edecb4c3 tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ba7846a-c794-4e32-b11c-cac8065edb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:59:14.773825 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5382f06b-6713-4e7c-8016-d579edecb4c3 tempest-TaggedBootDevicesTest-883782944 None] Flow 'volume_create_manager' (6ae902b2-f395-42fe-9de7-d1578e55c7c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 20:59:14.804164 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-5382f06b-6713-4e7c-8016-d579edecb4c3 tempest-TaggedBootDevicesTest-883782944 None] Created volume successfully. Apr 09 20:59:15.992384 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-0831b14b-965b-482d-81cc-0c87a86a14fb tempest-TaggedBootDevicesTest-883782944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 20:59:16.041456 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-0831b14b-965b-482d-81cc-0c87a86a14fb tempest-TaggedBootDevicesTest-883782944 None] Flow 'volume_create_manager' (75f2f4dd-2fd8-42ed-8863-3d179c081d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 20:59:16.052391 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-0831b14b-965b-482d-81cc-0c87a86a14fb tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d83ab437-0356-46d8-9d72-9611b03f70f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:59:16.086869 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-0831b14b-965b-482d-81cc-0c87a86a14fb tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d83ab437-0356-46d8-9d72-9611b03f70f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T20:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-517662714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=40f07b2b-d7f8-45aa-929d-798886e42bff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dbc8f96549e4dfaaf941d571addb9c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T20:59:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T20:59:16Z,use_quota=True,user_id='c3f004d8412d43d7a82f7daa56f47305',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:59:16.096611 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-0831b14b-965b-482d-81cc-0c87a86a14fb tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f88e03f-07ff-4dbf-ad65-0676dfacef08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:59:16.136551 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-0831b14b-965b-482d-81cc-0c87a86a14fb tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f88e03f-07ff-4dbf-ad65-0676dfacef08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:59:16.162208 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-0831b14b-965b-482d-81cc-0c87a86a14fb tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d35e6c5f-2ba9-43da-9492-f6a1873bad87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:59:16.181420 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-0831b14b-965b-482d-81cc-0c87a86a14fb tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d35e6c5f-2ba9-43da-9492-f6a1873bad87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40f07b2b-d7f8-45aa-929d-798886e42bff', 'volume_name': 'volume-40f07b2b-d7f8-45aa-929d-798886e42bff', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:59:16.211073 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-0831b14b-965b-482d-81cc-0c87a86a14fb tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64b4b516-dada-4911-87f7-d785ed3ca3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:59:16.230239 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-0831b14b-965b-482d-81cc-0c87a86a14fb tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64b4b516-dada-4911-87f7-d785ed3ca3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:59:16.249296 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-0831b14b-965b-482d-81cc-0c87a86a14fb tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d852244-b530-4f24-b841-bf8ab9d8dda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:59:16.257087 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-0831b14b-965b-482d-81cc-0c87a86a14fb tempest-TaggedBootDevicesTest-883782944 None] Volume 40f07b2b-d7f8-45aa-929d-798886e42bff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40f07b2b-d7f8-45aa-929d-798886e42bff', 'volume_size': 1} Apr 09 20:59:16.260794 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-0831b14b-965b-482d-81cc-0c87a86a14fb tempest-TaggedBootDevicesTest-883782944 None] creating volume 'volume-40f07b2b-d7f8-45aa-929d-798886e42bff' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 20:59:16.262643 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-0831b14b-965b-482d-81cc-0c87a86a14fb tempest-TaggedBootDevicesTest-883782944 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:59:16.429377 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-0831b14b-965b-482d-81cc-0c87a86a14fb tempest-TaggedBootDevicesTest-883782944 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 20:59:16.430224 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-0831b14b-965b-482d-81cc-0c87a86a14fb tempest-TaggedBootDevicesTest-883782944 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 20:59:16.434645 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-0831b14b-965b-482d-81cc-0c87a86a14fb tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d852244-b530-4f24-b841-bf8ab9d8dda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40f07b2b-d7f8-45aa-929d-798886e42bff', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:59:16.445890 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-0831b14b-965b-482d-81cc-0c87a86a14fb tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63886ed2-9f7c-4c29-abfa-bc62b1a9569b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:59:16.472112 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-0831b14b-965b-482d-81cc-0c87a86a14fb tempest-TaggedBootDevicesTest-883782944 None] Volume volume-40f07b2b-d7f8-45aa-929d-798886e42bff (40f07b2b-d7f8-45aa-929d-798886e42bff): created successfully Apr 09 20:59:16.476779 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-0831b14b-965b-482d-81cc-0c87a86a14fb tempest-TaggedBootDevicesTest-883782944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63886ed2-9f7c-4c29-abfa-bc62b1a9569b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:59:16.487509 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-0831b14b-965b-482d-81cc-0c87a86a14fb tempest-TaggedBootDevicesTest-883782944 None] Flow 'volume_create_manager' (75f2f4dd-2fd8-42ed-8863-3d179c081d74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 20:59:16.510649 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-0831b14b-965b-482d-81cc-0c87a86a14fb tempest-TaggedBootDevicesTest-883782944 None] Created volume successfully. Apr 09 20:59:36.646830 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-2ac30b51-9109-4113-9858-d81c493492fe req-cc1aae9a-825a-4915-a6e7-a4dcc3d4c262 tempest-TaggedBootDevicesTest-883782944 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 20:59:37.385703 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-2ac30b51-9109-4113-9858-d81c493492fe req-cc1aae9a-825a-4915-a6e7-a4dcc3d4c262 tempest-TaggedBootDevicesTest-883782944 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.739s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 20:59:37.386632 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-2ac30b51-9109-4113-9858-d81c493492fe req-cc1aae9a-825a-4915-a6e7-a4dcc3d4c262 tempest-TaggedBootDevicesTest-883782944 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6d815065-063f-4887-9bc8-5808837868ff', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': '6d815065-063f-4887-9bc8-5808837868ff', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 20:59:37.412614 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-2ac30b51-9109-4113-9858-d81c493492fe req-cc1aae9a-825a-4915-a6e7-a4dcc3d4c262 tempest-TaggedBootDevicesTest-883782944 None] Connection info returned from driver {'name': 'volumes/volume-6d815065-063f-4887-9bc8-5808837868ff', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '6d815065-063f-4887-9bc8-5808837868ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd1b0f805-f772-4ea3-97df-e6b44bdc53a8'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 20:59:37.470324 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-2ac30b51-9109-4113-9858-d81c493492fe req-cc1aae9a-825a-4915-a6e7-a4dcc3d4c262 tempest-TaggedBootDevicesTest-883782944 None] attachment_update completed successfully. Apr 09 20:59:37.792131 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-2ac30b51-9109-4113-9858-d81c493492fe req-6fe45716-b460-4f32-a392-6c17db906916 tempest-TaggedBootDevicesTest-883782944 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 20:59:38.635146 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-2ac30b51-9109-4113-9858-d81c493492fe req-6fe45716-b460-4f32-a392-6c17db906916 tempest-TaggedBootDevicesTest-883782944 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.842s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 20:59:38.636238 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-2ac30b51-9109-4113-9858-d81c493492fe req-6fe45716-b460-4f32-a392-6c17db906916 tempest-TaggedBootDevicesTest-883782944 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-266a3665-0f1a-4dc2-abdc-875ecf11f419', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': '266a3665-0f1a-4dc2-abdc-875ecf11f419', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 20:59:38.674120 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-2ac30b51-9109-4113-9858-d81c493492fe req-6fe45716-b460-4f32-a392-6c17db906916 tempest-TaggedBootDevicesTest-883782944 None] Connection info returned from driver {'name': 'volumes/volume-266a3665-0f1a-4dc2-abdc-875ecf11f419', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '266a3665-0f1a-4dc2-abdc-875ecf11f419', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0a236cae-f571-446e-931e-259bdf54cd1b'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 20:59:38.738821 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-2ac30b51-9109-4113-9858-d81c493492fe req-6fe45716-b460-4f32-a392-6c17db906916 tempest-TaggedBootDevicesTest-883782944 None] attachment_update completed successfully. Apr 09 20:59:43.696096 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-5c11cd29-f22a-46ef-bce4-77bb1bd9cf4d req-570ee140-8aee-4d6e-8eac-db350079f04a tempest-LiveAutoBlockMigrationV225Test-403680615 None] Terminate volume connection completed successfully. Apr 09 20:59:43.697563 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-5c11cd29-f22a-46ef-bce4-77bb1bd9cf4d req-570ee140-8aee-4d6e-8eac-db350079f04a tempest-LiveAutoBlockMigrationV225Test-403680615 None] Deleting attachment 3c8979b1-2761-4438-bbbf-bb2fadb97aa7. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 20:59:44.965119 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-2ac30b51-9109-4113-9858-d81c493492fe req-cfd135b1-3333-4686-accf-d9588008a007 tempest-TaggedBootDevicesTest-883782944 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 20:59:45.787801 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-2ac30b51-9109-4113-9858-d81c493492fe req-cfd135b1-3333-4686-accf-d9588008a007 tempest-TaggedBootDevicesTest-883782944 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.818s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 20:59:45.795670 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-2ac30b51-9109-4113-9858-d81c493492fe req-cfd135b1-3333-4686-accf-d9588008a007 tempest-TaggedBootDevicesTest-883782944 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-40f07b2b-d7f8-45aa-929d-798886e42bff', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': '40f07b2b-d7f8-45aa-929d-798886e42bff', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 20:59:45.835201 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-2ac30b51-9109-4113-9858-d81c493492fe req-cfd135b1-3333-4686-accf-d9588008a007 tempest-TaggedBootDevicesTest-883782944 None] Connection info returned from driver {'name': 'volumes/volume-40f07b2b-d7f8-45aa-929d-798886e42bff', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '40f07b2b-d7f8-45aa-929d-798886e42bff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3625b49a-9864-40fd-b7dd-046e0c7bc5c2'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 20:59:45.929526 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-2ac30b51-9109-4113-9858-d81c493492fe req-cfd135b1-3333-4686-accf-d9588008a007 tempest-TaggedBootDevicesTest-883782944 None] attachment_update completed successfully. Apr 09 20:59:46.870822 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2be898e-2fbb-4df1-9bdf-ca2a5ab207b9 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 20:59:46.901001 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f2be898e-2fbb-4df1-9bdf-ca2a5ab207b9 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Flow 'volume_create_manager' (e6607ef3-55e2-469c-b182-84aba98726d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 20:59:46.910121 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f2be898e-2fbb-4df1-9bdf-ca2a5ab207b9 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb80feee-1848-4916-9000-e7b8cd9f94ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:59:46.930770 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f2be898e-2fbb-4df1-9bdf-ca2a5ab207b9 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb80feee-1848-4916-9000-e7b8cd9f94ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T20:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1362739752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=39d7897e-1a3d-4d30-842e-25f6d0315f17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c23a8d6534a4426b2ea106417c8b68a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T20:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T20:59:47Z,use_quota=True,user_id='9c775742dfc04cec8559f9e4d13239b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:59:46.938305 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f2be898e-2fbb-4df1-9bdf-ca2a5ab207b9 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79cd1900-8c7e-474c-8dce-1b88c9349f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:59:46.944144 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f2be898e-2fbb-4df1-9bdf-ca2a5ab207b9 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79cd1900-8c7e-474c-8dce-1b88c9349f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:59:46.951652 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f2be898e-2fbb-4df1-9bdf-ca2a5ab207b9 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70b720ea-61b9-4bb7-b1ee-b2e456253c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:59:47.073639 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f2be898e-2fbb-4df1-9bdf-ca2a5ab207b9 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70b720ea-61b9-4bb7-b1ee-b2e456253c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '39d7897e-1a3d-4d30-842e-25f6d0315f17', 'volume_name': 'volume-39d7897e-1a3d-4d30-842e-25f6d0315f17', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:59:47.080433 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f2be898e-2fbb-4df1-9bdf-ca2a5ab207b9 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71784e9c-5ade-4a14-8278-081598514f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:59:47.084807 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f2be898e-2fbb-4df1-9bdf-ca2a5ab207b9 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71784e9c-5ade-4a14-8278-081598514f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:59:47.090720 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f2be898e-2fbb-4df1-9bdf-ca2a5ab207b9 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8adc58e2-e037-4fc9-84f0-9f7d1a21debf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:59:47.092202 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-f2be898e-2fbb-4df1-9bdf-ca2a5ab207b9 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Volume 39d7897e-1a3d-4d30-842e-25f6d0315f17: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-39d7897e-1a3d-4d30-842e-25f6d0315f17', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 09 20:59:47.093200 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2be898e-2fbb-4df1-9bdf-ca2a5ab207b9 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Cloning 39d7897e-1a3d-4d30-842e-25f6d0315f17 from image b539c48b-3400-4aa4-9226-8be5a3d07b36 at location (None, None). {{(pid=135002) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Apr 09 20:59:47.103409 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-f2be898e-2fbb-4df1-9bdf-ca2a5ab207b9 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Lock "b'cinder-b539c48b-3400-4aa4-9226-8be5a3d07b36'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 20:59:47.116273 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-f2be898e-2fbb-4df1-9bdf-ca2a5ab207b9 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'volume_id': 'd35656e2-d293-4904-aeae-3113202bb314', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36), 'last_used': datetime.datetime(2022, 4, 9, 20, 59, 47, 107789)}. {{(pid=135002) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 09 20:59:47.116911 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-f2be898e-2fbb-4df1-9bdf-ca2a5ab207b9 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Image-volume cache entry image_update_at = 2022-04-09 20:45:36+00:00, requested image updated_at = 2022-04-09 20:45:36+00:00. {{(pid=135002) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 09 20:59:47.117517 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2be898e-2fbb-4df1-9bdf-ca2a5ab207b9 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Found cache entry for image = b539c48b-3400-4aa4-9226-8be5a3d07b36 on host ncdv-master-1@ceph#ceph. {{(pid=135002) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Apr 09 20:59:47.122490 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-f2be898e-2fbb-4df1-9bdf-ca2a5ab207b9 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Lock "b'cinder-b539c48b-3400-4aa4-9226-8be5a3d07b36'" released by "_prepare_image_cache_entry" :: held 0.019s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 20:59:47.123642 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2be898e-2fbb-4df1-9bdf-ca2a5ab207b9 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Attempting to retrieve cache entry for image = b539c48b-3400-4aa4-9226-8be5a3d07b36 on host ncdv-master-1@ceph#ceph. {{(pid=135002) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Apr 09 20:59:47.131495 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-f2be898e-2fbb-4df1-9bdf-ca2a5ab207b9 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'volume_id': 'd35656e2-d293-4904-aeae-3113202bb314', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36), 'last_used': datetime.datetime(2022, 4, 9, 20, 59, 47, 127546)}. {{(pid=135002) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 09 20:59:47.131945 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-f2be898e-2fbb-4df1-9bdf-ca2a5ab207b9 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Image-volume cache entry image_update_at = 2022-04-09 20:45:36+00:00, requested image updated_at = 2022-04-09 20:45:36+00:00. {{(pid=135002) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 09 20:59:47.132501 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2be898e-2fbb-4df1-9bdf-ca2a5ab207b9 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Creating from source image-volume d35656e2-d293-4904-aeae-3113202bb314 {{(pid=135002) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Apr 09 20:59:47.144556 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f2be898e-2fbb-4df1-9bdf-ca2a5ab207b9 tempest-LiveAutoBlockMigrationV225Test-403680615 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:59:47.213806 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f2be898e-2fbb-4df1-9bdf-ca2a5ab207b9 tempest-LiveAutoBlockMigrationV225Test-403680615 None] creating snapshot='volume-39d7897e-1a3d-4d30-842e-25f6d0315f17.clone_snap' {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Apr 09 20:59:47.839119 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f2be898e-2fbb-4df1-9bdf-ca2a5ab207b9 tempest-LiveAutoBlockMigrationV225Test-403680615 None] cloning 'volume-d35656e2-d293-4904-aeae-3113202bb314@volume-39d7897e-1a3d-4d30-842e-25f6d0315f17.clone_snap' to 'volume-39d7897e-1a3d-4d30-842e-25f6d0315f17' {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Apr 09 20:59:48.068127 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f2be898e-2fbb-4df1-9bdf-ca2a5ab207b9 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Volume volume-6d815065-063f-4887-9bc8-5808837868ff is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 20:59:48.069207 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f2be898e-2fbb-4df1-9bdf-ca2a5ab207b9 tempest-LiveAutoBlockMigrationV225Test-403680615 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 20:59:48.069585 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f2be898e-2fbb-4df1-9bdf-ca2a5ab207b9 tempest-LiveAutoBlockMigrationV225Test-403680615 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 20:59:48.106745 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f2be898e-2fbb-4df1-9bdf-ca2a5ab207b9 tempest-LiveAutoBlockMigrationV225Test-403680615 None] clone created successfully {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Apr 09 20:59:48.107935 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.volume_utils [None req-f2be898e-2fbb-4df1-9bdf-ca2a5ab207b9 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Marking volume 39d7897e-1a3d-4d30-842e-25f6d0315f17 as bootable. {{(pid=135002) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Apr 09 20:59:48.120538 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2be898e-2fbb-4df1-9bdf-ca2a5ab207b9 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Copying metadata from image b539c48b-3400-4aa4-9226-8be5a3d07b36 to 39d7897e-1a3d-4d30-842e-25f6d0315f17. {{(pid=135002) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Apr 09 20:59:48.121297 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2be898e-2fbb-4df1-9bdf-ca2a5ab207b9 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Creating volume glance metadata for volume 39d7897e-1a3d-4d30-842e-25f6d0315f17 backed by image b539c48b-3400-4aa4-9226-8be5a3d07b36 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=135002) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Apr 09 20:59:48.223609 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f2be898e-2fbb-4df1-9bdf-ca2a5ab207b9 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8adc58e2-e037-4fc9-84f0-9f7d1a21debf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39d7897e-1a3d-4d30-842e-25f6d0315f17', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:59:48.234088 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f2be898e-2fbb-4df1-9bdf-ca2a5ab207b9 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0be8a10-6135-4aaa-b06a-9f7c7cd4f2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 20:59:48.267383 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-f2be898e-2fbb-4df1-9bdf-ca2a5ab207b9 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Volume volume-39d7897e-1a3d-4d30-842e-25f6d0315f17 (39d7897e-1a3d-4d30-842e-25f6d0315f17): created successfully Apr 09 20:59:48.272264 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f2be898e-2fbb-4df1-9bdf-ca2a5ab207b9 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0be8a10-6135-4aaa-b06a-9f7c7cd4f2fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 20:59:48.278130 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f2be898e-2fbb-4df1-9bdf-ca2a5ab207b9 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Flow 'volume_create_manager' (e6607ef3-55e2-469c-b182-84aba98726d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 20:59:48.303727 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-f2be898e-2fbb-4df1-9bdf-ca2a5ab207b9 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Created volume successfully. Apr 09 20:59:49.616748 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 20:59:49.618316 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:59:49.663876 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 20:59:49.718919 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 20:59:54.867348 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-ceb8ba7a-3a0c-4e47-abe5-f6beb9180ead req-e6bce733-a362-4ae7-ae1f-43bd926ca86c tempest-LiveAutoBlockMigrationV225Test-403680615 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 20:59:55.747739 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-ceb8ba7a-3a0c-4e47-abe5-f6beb9180ead req-e6bce733-a362-4ae7-ae1f-43bd926ca86c tempest-LiveAutoBlockMigrationV225Test-403680615 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.880s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 20:59:55.748554 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-ceb8ba7a-3a0c-4e47-abe5-f6beb9180ead req-e6bce733-a362-4ae7-ae1f-43bd926ca86c tempest-LiveAutoBlockMigrationV225Test-403680615 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-39d7897e-1a3d-4d30-842e-25f6d0315f17', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': '39d7897e-1a3d-4d30-842e-25f6d0315f17', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 20:59:55.817298 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-ceb8ba7a-3a0c-4e47-abe5-f6beb9180ead req-e6bce733-a362-4ae7-ae1f-43bd926ca86c tempest-LiveAutoBlockMigrationV225Test-403680615 None] Connection info returned from driver {'name': 'volumes/volume-39d7897e-1a3d-4d30-842e-25f6d0315f17', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '39d7897e-1a3d-4d30-842e-25f6d0315f17', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8beeee36-bbdf-406a-9710-50798bd733d5'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 20:59:55.924540 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-ceb8ba7a-3a0c-4e47-abe5-f6beb9180ead req-e6bce733-a362-4ae7-ae1f-43bd926ca86c tempest-LiveAutoBlockMigrationV225Test-403680615 None] attachment_update completed successfully. Apr 09 21:00:20.127550 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-8903b419-139b-4529-a6fc-fb51e0b7dfb9 tempest-LiveMigrationTest-1096887428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:00:20.158461 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8903b419-139b-4529-a6fc-fb51e0b7dfb9 tempest-LiveMigrationTest-1096887428 None] Flow 'volume_create_manager' (5179b071-d603-4490-b7c4-05944443f50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:00:20.167703 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8903b419-139b-4529-a6fc-fb51e0b7dfb9 tempest-LiveMigrationTest-1096887428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (274017f4-121c-44e0-8c2b-82a27c63237a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:00:20.188047 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8903b419-139b-4529-a6fc-fb51e0b7dfb9 tempest-LiveMigrationTest-1096887428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (274017f4-121c-44e0-8c2b-82a27c63237a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveMigrationTest-volume-445357408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e65996e1-1e66-4a23-ac8b-882a962e48df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352d269ab35841c397ca9168792c1ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:00:20Z,use_quota=True,user_id='ceba42e80d7746e4897669084c078c09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:00:20.195212 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8903b419-139b-4529-a6fc-fb51e0b7dfb9 tempest-LiveMigrationTest-1096887428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd92ced4-4369-4292-bdbb-62dc83df26f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:00:20.200288 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8903b419-139b-4529-a6fc-fb51e0b7dfb9 tempest-LiveMigrationTest-1096887428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd92ced4-4369-4292-bdbb-62dc83df26f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:00:20.206024 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8903b419-139b-4529-a6fc-fb51e0b7dfb9 tempest-LiveMigrationTest-1096887428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3eb96f4-79c7-436d-97f9-0937de6eec19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:00:20.211054 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8903b419-139b-4529-a6fc-fb51e0b7dfb9 tempest-LiveMigrationTest-1096887428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3eb96f4-79c7-436d-97f9-0937de6eec19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e65996e1-1e66-4a23-ac8b-882a962e48df', 'volume_name': 'volume-e65996e1-1e66-4a23-ac8b-882a962e48df', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:00:20.216680 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8903b419-139b-4529-a6fc-fb51e0b7dfb9 tempest-LiveMigrationTest-1096887428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (769a922c-86ac-44f7-af40-97fc45310944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:00:20.222306 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8903b419-139b-4529-a6fc-fb51e0b7dfb9 tempest-LiveMigrationTest-1096887428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (769a922c-86ac-44f7-af40-97fc45310944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:00:20.228074 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8903b419-139b-4529-a6fc-fb51e0b7dfb9 tempest-LiveMigrationTest-1096887428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b76cfb0-3d05-4db9-96d4-b4c3e4dbfe35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:00:20.229798 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-8903b419-139b-4529-a6fc-fb51e0b7dfb9 tempest-LiveMigrationTest-1096887428 None] Volume e65996e1-1e66-4a23-ac8b-882a962e48df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e65996e1-1e66-4a23-ac8b-882a962e48df', 'volume_size': 1} Apr 09 21:00:20.230572 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-8903b419-139b-4529-a6fc-fb51e0b7dfb9 tempest-LiveMigrationTest-1096887428 None] creating volume 'volume-e65996e1-1e66-4a23-ac8b-882a962e48df' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:00:20.231736 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-8903b419-139b-4529-a6fc-fb51e0b7dfb9 tempest-LiveMigrationTest-1096887428 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:00:20.421112 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-8903b419-139b-4529-a6fc-fb51e0b7dfb9 tempest-LiveMigrationTest-1096887428 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:00:20.421738 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-8903b419-139b-4529-a6fc-fb51e0b7dfb9 tempest-LiveMigrationTest-1096887428 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:00:20.426532 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8903b419-139b-4529-a6fc-fb51e0b7dfb9 tempest-LiveMigrationTest-1096887428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b76cfb0-3d05-4db9-96d4-b4c3e4dbfe35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e65996e1-1e66-4a23-ac8b-882a962e48df', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:00:20.442221 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8903b419-139b-4529-a6fc-fb51e0b7dfb9 tempest-LiveMigrationTest-1096887428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98766cdf-ad76-4660-bab5-3fce57bd0ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:00:20.460478 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-8903b419-139b-4529-a6fc-fb51e0b7dfb9 tempest-LiveMigrationTest-1096887428 None] Volume volume-e65996e1-1e66-4a23-ac8b-882a962e48df (e65996e1-1e66-4a23-ac8b-882a962e48df): created successfully Apr 09 21:00:20.466108 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8903b419-139b-4529-a6fc-fb51e0b7dfb9 tempest-LiveMigrationTest-1096887428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98766cdf-ad76-4660-bab5-3fce57bd0ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:00:20.474244 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8903b419-139b-4529-a6fc-fb51e0b7dfb9 tempest-LiveMigrationTest-1096887428 None] Flow 'volume_create_manager' (5179b071-d603-4490-b7c4-05944443f50a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:00:20.507316 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-8903b419-139b-4529-a6fc-fb51e0b7dfb9 tempest-LiveMigrationTest-1096887428 None] Created volume successfully. Apr 09 21:00:23.509893 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-ce913936-5195-4ec5-b264-015a140a7ea0 req-737ed786-aafa-4be8-86a2-1029c86d678f tempest-LiveMigrationTest-1096887428 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:00:24.867100 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-ce913936-5195-4ec5-b264-015a140a7ea0 req-737ed786-aafa-4be8-86a2-1029c86d678f tempest-LiveMigrationTest-1096887428 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.357s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:00:24.867938 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-ce913936-5195-4ec5-b264-015a140a7ea0 req-737ed786-aafa-4be8-86a2-1029c86d678f tempest-LiveMigrationTest-1096887428 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e65996e1-1e66-4a23-ac8b-882a962e48df', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': 'e65996e1-1e66-4a23-ac8b-882a962e48df', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:00:24.929819 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-ce913936-5195-4ec5-b264-015a140a7ea0 req-737ed786-aafa-4be8-86a2-1029c86d678f tempest-LiveMigrationTest-1096887428 None] Connection info returned from driver {'name': 'volumes/volume-e65996e1-1e66-4a23-ac8b-882a962e48df', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e65996e1-1e66-4a23-ac8b-882a962e48df', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '1a36c1ee-4dde-4c3d-a267-57a5aa2422cb'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 21:00:25.104038 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-ce913936-5195-4ec5-b264-015a140a7ea0 req-737ed786-aafa-4be8-86a2-1029c86d678f tempest-LiveMigrationTest-1096887428 None] attachment_update completed successfully. Apr 09 21:00:27.146358 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-4e289c72-f51d-4d41-a7f1-e70ba37f979d req-a3e0f1c4-4a0a-47a1-b353-4f72421b21a1 tempest-LiveAutoBlockMigrationV225Test-2100307713 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:00:28.918018 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-4e289c72-f51d-4d41-a7f1-e70ba37f979d req-a3e0f1c4-4a0a-47a1-b353-4f72421b21a1 tempest-LiveAutoBlockMigrationV225Test-2100307713 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.771s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:00:28.918995 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-4e289c72-f51d-4d41-a7f1-e70ba37f979d req-a3e0f1c4-4a0a-47a1-b353-4f72421b21a1 tempest-LiveAutoBlockMigrationV225Test-2100307713 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-39d7897e-1a3d-4d30-842e-25f6d0315f17', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': '39d7897e-1a3d-4d30-842e-25f6d0315f17', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:00:28.961383 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-4e289c72-f51d-4d41-a7f1-e70ba37f979d req-a3e0f1c4-4a0a-47a1-b353-4f72421b21a1 tempest-LiveAutoBlockMigrationV225Test-2100307713 None] Connection info returned from driver {'name': 'volumes/volume-39d7897e-1a3d-4d30-842e-25f6d0315f17', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '39d7897e-1a3d-4d30-842e-25f6d0315f17', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '1b4ec7ca-5466-4e2e-8307-cff270c469a6'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 21:00:29.145281 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-4e289c72-f51d-4d41-a7f1-e70ba37f979d req-a3e0f1c4-4a0a-47a1-b353-4f72421b21a1 tempest-LiveAutoBlockMigrationV225Test-2100307713 None] attachment_update completed successfully. Apr 09 21:00:39.807389 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-4e289c72-f51d-4d41-a7f1-e70ba37f979d req-b13f3dd1-e41b-4116-8e6e-84c78a275138 tempest-LiveAutoBlockMigrationV225Test-2100307713 None] Terminate volume connection completed successfully. Apr 09 21:00:39.810916 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-4e289c72-f51d-4d41-a7f1-e70ba37f979d req-b13f3dd1-e41b-4116-8e6e-84c78a275138 tempest-LiveAutoBlockMigrationV225Test-2100307713 None] Deleting attachment 8beeee36-bbdf-406a-9710-50798bd733d5. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 21:00:49.509027 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-a0b96d96-85ad-48c7-af64-62b30cf39378 req-0bd025de-ad5f-49a7-9981-af0b54d65487 tempest-LiveMigrationTest-1367615552 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:00:49.621606 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:00:49.622861 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:00:49.705693 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:00:49.759870 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:00:50.813536 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-a0b96d96-85ad-48c7-af64-62b30cf39378 req-0bd025de-ad5f-49a7-9981-af0b54d65487 tempest-LiveMigrationTest-1367615552 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.306s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:00:50.814266 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-a0b96d96-85ad-48c7-af64-62b30cf39378 req-0bd025de-ad5f-49a7-9981-af0b54d65487 tempest-LiveMigrationTest-1367615552 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e65996e1-1e66-4a23-ac8b-882a962e48df', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': 'e65996e1-1e66-4a23-ac8b-882a962e48df', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:00:50.873213 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-a0b96d96-85ad-48c7-af64-62b30cf39378 req-0bd025de-ad5f-49a7-9981-af0b54d65487 tempest-LiveMigrationTest-1367615552 None] Connection info returned from driver {'name': 'volumes/volume-e65996e1-1e66-4a23-ac8b-882a962e48df', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e65996e1-1e66-4a23-ac8b-882a962e48df', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c45b8c96-e71c-4fb9-839c-48c441ab3784'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 21:00:50.993818 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-a0b96d96-85ad-48c7-af64-62b30cf39378 req-0bd025de-ad5f-49a7-9981-af0b54d65487 tempest-LiveMigrationTest-1367615552 None] attachment_update completed successfully. Apr 09 21:00:53.978878 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-f2c4ba30-bf05-49d7-9d6f-a66659abac94 req-d525b853-6cfe-4257-9c16-c837cdd024e5 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Terminate volume connection completed successfully. Apr 09 21:00:53.980020 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-f2c4ba30-bf05-49d7-9d6f-a66659abac94 req-d525b853-6cfe-4257-9c16-c837cdd024e5 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Deleting attachment 1b4ec7ca-5466-4e2e-8307-cff270c469a6. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 21:00:54.221557 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [req-f2c4ba30-bf05-49d7-9d6f-a66659abac94 req-5ed9fb48-72fa-4b2f-b817-73b181f63fba tempest-LiveAutoBlockMigrationV225Test-403680615 None] Lock "b'cinder-39d7897e-1a3d-4d30-842e-25f6d0315f17-delete_volume'" acquired by "delete_volume" :: waited 0.046s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:00:54.296610 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-f2c4ba30-bf05-49d7-9d6f-a66659abac94 req-5ed9fb48-72fa-4b2f-b817-73b181f63fba tempest-LiveAutoBlockMigrationV225Test-403680615 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:00:54.401866 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-f2c4ba30-bf05-49d7-9d6f-a66659abac94 req-5ed9fb48-72fa-4b2f-b817-73b181f63fba tempest-LiveAutoBlockMigrationV225Test-403680615 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:00:54.418150 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-f2c4ba30-bf05-49d7-9d6f-a66659abac94 req-5ed9fb48-72fa-4b2f-b817-73b181f63fba tempest-LiveAutoBlockMigrationV225Test-403680615 None] deleting rbd volume volume-39d7897e-1a3d-4d30-842e-25f6d0315f17 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:00:54.801953 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-3729bfad-19a0-45c6-bc01-a65fb0e77bc7 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Lock "b'cinder-5fa8081f-7b54-455a-a346-4214f8f81f79-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:00:54.874173 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-3729bfad-19a0-45c6-bc01-a65fb0e77bc7 tempest-LiveAutoBlockMigrationV225Test-403680615 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:00:54.946397 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-3729bfad-19a0-45c6-bc01-a65fb0e77bc7 tempest-LiveAutoBlockMigrationV225Test-403680615 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:00:54.946866 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-3729bfad-19a0-45c6-bc01-a65fb0e77bc7 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Volume volume-5fa8081f-7b54-455a-a346-4214f8f81f79 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:00:54.958259 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-3729bfad-19a0-45c6-bc01-a65fb0e77bc7 tempest-LiveAutoBlockMigrationV225Test-403680615 None] deleting rbd volume volume-5fa8081f-7b54-455a-a346-4214f8f81f79 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:00:54.979653 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-f2c4ba30-bf05-49d7-9d6f-a66659abac94 req-5ed9fb48-72fa-4b2f-b817-73b181f63fba tempest-LiveAutoBlockMigrationV225Test-403680615 None] volume is a clone so cleaning references {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Apr 09 21:00:55.040568 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-f2c4ba30-bf05-49d7-9d6f-a66659abac94 req-5ed9fb48-72fa-4b2f-b817-73b181f63fba tempest-LiveAutoBlockMigrationV225Test-403680615 None] deleting parent snapshot volume-39d7897e-1a3d-4d30-842e-25f6d0315f17.clone_snap {{(pid=135002) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Apr 09 21:00:56.081198 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [req-f2c4ba30-bf05-49d7-9d6f-a66659abac94 req-5ed9fb48-72fa-4b2f-b817-73b181f63fba tempest-LiveAutoBlockMigrationV225Test-403680615 None] Created reservations ['b3b0b612-5d95-434c-9d2c-7d4a7d862542', '9f88c349-d718-4a7e-81f8-fd2afadb049a', '82d8b654-7215-4e60-aade-5beb5e7943b6', '501687d7-c614-4b82-b4fe-f9fa1fab5644'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:00:56.111263 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-3729bfad-19a0-45c6-bc01-a65fb0e77bc7 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Created reservations ['3c1cebb1-ba51-4bc1-9aa4-0f7a11ab500b', '69ca00ce-c13f-47c0-9fc0-15c0b83ed1c3', 'fc210b8d-15e4-4bb8-bc00-1159371b1e42', '663a45d5-d3e0-47b3-9f02-8d60304b2560'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:00:56.175500 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-f2c4ba30-bf05-49d7-9d6f-a66659abac94 req-5ed9fb48-72fa-4b2f-b817-73b181f63fba tempest-LiveAutoBlockMigrationV225Test-403680615 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:00:56.219485 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-f2c4ba30-bf05-49d7-9d6f-a66659abac94 req-5ed9fb48-72fa-4b2f-b817-73b181f63fba tempest-LiveAutoBlockMigrationV225Test-403680615 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:00:56.314409 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [req-f2c4ba30-bf05-49d7-9d6f-a66659abac94 req-5ed9fb48-72fa-4b2f-b817-73b181f63fba tempest-LiveAutoBlockMigrationV225Test-403680615 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:00:56.335087 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-f2c4ba30-bf05-49d7-9d6f-a66659abac94 req-5ed9fb48-72fa-4b2f-b817-73b181f63fba tempest-LiveAutoBlockMigrationV225Test-403680615 None] Deleted volume successfully. Apr 09 21:00:56.358318 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [req-f2c4ba30-bf05-49d7-9d6f-a66659abac94 req-5ed9fb48-72fa-4b2f-b817-73b181f63fba tempest-LiveAutoBlockMigrationV225Test-403680615 None] Lock "b'cinder-39d7897e-1a3d-4d30-842e-25f6d0315f17-delete_volume'" released by "delete_volume" :: held 2.137s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:00:56.361519 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-3729bfad-19a0-45c6-bc01-a65fb0e77bc7 tempest-LiveAutoBlockMigrationV225Test-403680615 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:00:56.415184 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-3729bfad-19a0-45c6-bc01-a65fb0e77bc7 tempest-LiveAutoBlockMigrationV225Test-403680615 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:00:56.494761 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-3729bfad-19a0-45c6-bc01-a65fb0e77bc7 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:00:56.499208 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-3729bfad-19a0-45c6-bc01-a65fb0e77bc7 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Deleted volume successfully. Apr 09 21:00:56.513924 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-3729bfad-19a0-45c6-bc01-a65fb0e77bc7 tempest-LiveAutoBlockMigrationV225Test-403680615 None] Lock "b'cinder-5fa8081f-7b54-455a-a346-4214f8f81f79-delete_volume'" released by "delete_volume" :: held 1.712s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:01:03.123626 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-a0b96d96-85ad-48c7-af64-62b30cf39378 req-c3c42f4f-d49d-46a0-b8fe-bc1c9438f24a tempest-LiveMigrationTest-1367615552 None] Terminate volume connection completed successfully. Apr 09 21:01:03.125054 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-a0b96d96-85ad-48c7-af64-62b30cf39378 req-c3c42f4f-d49d-46a0-b8fe-bc1c9438f24a tempest-LiveMigrationTest-1367615552 None] Deleting attachment 1a36c1ee-4dde-4c3d-a267-57a5aa2422cb. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 21:01:11.127061 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-e16575dc-fd10-4f97-b8a2-02edac8a2e12 req-8f10085b-fedd-4855-af8c-7b3a077d3cb0 tempest-LiveMigrationTest-1096887428 None] Terminate volume connection completed successfully. Apr 09 21:01:11.127711 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-e16575dc-fd10-4f97-b8a2-02edac8a2e12 req-8f10085b-fedd-4855-af8c-7b3a077d3cb0 tempest-LiveMigrationTest-1096887428 None] Deleting attachment c45b8c96-e71c-4fb9-839c-48c441ab3784. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 21:01:12.372880 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a26acf5-a534-48c6-b852-880fa1d58e90 tempest-LiveMigrationTest-1096887428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:01:12.423607 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5a26acf5-a534-48c6-b852-880fa1d58e90 tempest-LiveMigrationTest-1096887428 None] Flow 'volume_create_manager' (e8db712a-3d92-4316-bdb4-220e3d7d15d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:01:12.443873 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5a26acf5-a534-48c6-b852-880fa1d58e90 tempest-LiveMigrationTest-1096887428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faceb1db-1ff4-4f31-9dff-de3d7e0bc8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:01:12.468561 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5a26acf5-a534-48c6-b852-880fa1d58e90 tempest-LiveMigrationTest-1096887428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faceb1db-1ff4-4f31-9dff-de3d7e0bc8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-378902316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ef3cc8f1-99be-44b9-a957-0c88e6e49410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352d269ab35841c397ca9168792c1ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:01:12Z,use_quota=True,user_id='ceba42e80d7746e4897669084c078c09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:01:12.475876 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5a26acf5-a534-48c6-b852-880fa1d58e90 tempest-LiveMigrationTest-1096887428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe608e2-5092-4cbc-a5ff-9a1af5635c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:01:12.480916 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5a26acf5-a534-48c6-b852-880fa1d58e90 tempest-LiveMigrationTest-1096887428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe608e2-5092-4cbc-a5ff-9a1af5635c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:01:12.487520 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5a26acf5-a534-48c6-b852-880fa1d58e90 tempest-LiveMigrationTest-1096887428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52bb9671-a1b6-4ae0-b91e-6b31357ea49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:01:12.614245 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5a26acf5-a534-48c6-b852-880fa1d58e90 tempest-LiveMigrationTest-1096887428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52bb9671-a1b6-4ae0-b91e-6b31357ea49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ef3cc8f1-99be-44b9-a957-0c88e6e49410', 'volume_name': 'volume-ef3cc8f1-99be-44b9-a957-0c88e6e49410', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:01:12.629243 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5a26acf5-a534-48c6-b852-880fa1d58e90 tempest-LiveMigrationTest-1096887428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e190800-8b9a-446b-9912-f117b2a19c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:01:12.634069 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5a26acf5-a534-48c6-b852-880fa1d58e90 tempest-LiveMigrationTest-1096887428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e190800-8b9a-446b-9912-f117b2a19c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:01:12.639238 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5a26acf5-a534-48c6-b852-880fa1d58e90 tempest-LiveMigrationTest-1096887428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d960ab2c-3d56-4b0d-abca-57f564d8a154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:01:12.643538 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-5a26acf5-a534-48c6-b852-880fa1d58e90 tempest-LiveMigrationTest-1096887428 None] Volume ef3cc8f1-99be-44b9-a957-0c88e6e49410: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ef3cc8f1-99be-44b9-a957-0c88e6e49410', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 09 21:01:12.649028 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a26acf5-a534-48c6-b852-880fa1d58e90 tempest-LiveMigrationTest-1096887428 None] Cloning ef3cc8f1-99be-44b9-a957-0c88e6e49410 from image b539c48b-3400-4aa4-9226-8be5a3d07b36 at location (None, None). {{(pid=135002) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Apr 09 21:01:12.665524 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-5a26acf5-a534-48c6-b852-880fa1d58e90 tempest-LiveMigrationTest-1096887428 None] Lock "b'cinder-b539c48b-3400-4aa4-9226-8be5a3d07b36'" acquired by "_prepare_image_cache_entry" :: waited 0.015s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:01:12.703276 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-5a26acf5-a534-48c6-b852-880fa1d58e90 tempest-LiveMigrationTest-1096887428 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'volume_id': 'd35656e2-d293-4904-aeae-3113202bb314', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36), 'last_used': datetime.datetime(2022, 4, 9, 21, 1, 12, 670234)}. {{(pid=135002) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 09 21:01:12.703903 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-5a26acf5-a534-48c6-b852-880fa1d58e90 tempest-LiveMigrationTest-1096887428 None] Image-volume cache entry image_update_at = 2022-04-09 20:45:36+00:00, requested image updated_at = 2022-04-09 20:45:36+00:00. {{(pid=135002) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 09 21:01:12.704498 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a26acf5-a534-48c6-b852-880fa1d58e90 tempest-LiveMigrationTest-1096887428 None] Found cache entry for image = b539c48b-3400-4aa4-9226-8be5a3d07b36 on host ncdv-master-1@ceph#ceph. {{(pid=135002) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Apr 09 21:01:12.719395 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-5a26acf5-a534-48c6-b852-880fa1d58e90 tempest-LiveMigrationTest-1096887428 None] Lock "b'cinder-b539c48b-3400-4aa4-9226-8be5a3d07b36'" released by "_prepare_image_cache_entry" :: held 0.054s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:01:12.720544 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a26acf5-a534-48c6-b852-880fa1d58e90 tempest-LiveMigrationTest-1096887428 None] Attempting to retrieve cache entry for image = b539c48b-3400-4aa4-9226-8be5a3d07b36 on host ncdv-master-1@ceph#ceph. {{(pid=135002) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Apr 09 21:01:12.740678 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-5a26acf5-a534-48c6-b852-880fa1d58e90 tempest-LiveMigrationTest-1096887428 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'volume_id': 'd35656e2-d293-4904-aeae-3113202bb314', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36), 'last_used': datetime.datetime(2022, 4, 9, 21, 1, 12, 735116)}. {{(pid=135002) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 09 21:01:12.746561 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-5a26acf5-a534-48c6-b852-880fa1d58e90 tempest-LiveMigrationTest-1096887428 None] Image-volume cache entry image_update_at = 2022-04-09 20:45:36+00:00, requested image updated_at = 2022-04-09 20:45:36+00:00. {{(pid=135002) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 09 21:01:12.749191 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a26acf5-a534-48c6-b852-880fa1d58e90 tempest-LiveMigrationTest-1096887428 None] Creating from source image-volume d35656e2-d293-4904-aeae-3113202bb314 {{(pid=135002) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Apr 09 21:01:12.769004 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5a26acf5-a534-48c6-b852-880fa1d58e90 tempest-LiveMigrationTest-1096887428 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:01:12.930287 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5a26acf5-a534-48c6-b852-880fa1d58e90 tempest-LiveMigrationTest-1096887428 None] creating snapshot='volume-ef3cc8f1-99be-44b9-a957-0c88e6e49410.clone_snap' {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Apr 09 21:01:13.514284 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5a26acf5-a534-48c6-b852-880fa1d58e90 tempest-LiveMigrationTest-1096887428 None] cloning 'volume-d35656e2-d293-4904-aeae-3113202bb314@volume-ef3cc8f1-99be-44b9-a957-0c88e6e49410.clone_snap' to 'volume-ef3cc8f1-99be-44b9-a957-0c88e6e49410' {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Apr 09 21:01:13.793961 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5a26acf5-a534-48c6-b852-880fa1d58e90 tempest-LiveMigrationTest-1096887428 None] Volume volume-6d815065-063f-4887-9bc8-5808837868ff is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:01:13.795799 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5a26acf5-a534-48c6-b852-880fa1d58e90 tempest-LiveMigrationTest-1096887428 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:01:13.796350 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5a26acf5-a534-48c6-b852-880fa1d58e90 tempest-LiveMigrationTest-1096887428 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:01:13.868674 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5a26acf5-a534-48c6-b852-880fa1d58e90 tempest-LiveMigrationTest-1096887428 None] clone created successfully {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Apr 09 21:01:13.869833 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.volume_utils [None req-5a26acf5-a534-48c6-b852-880fa1d58e90 tempest-LiveMigrationTest-1096887428 None] Marking volume ef3cc8f1-99be-44b9-a957-0c88e6e49410 as bootable. {{(pid=135002) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Apr 09 21:01:13.890482 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a26acf5-a534-48c6-b852-880fa1d58e90 tempest-LiveMigrationTest-1096887428 None] Copying metadata from image b539c48b-3400-4aa4-9226-8be5a3d07b36 to ef3cc8f1-99be-44b9-a957-0c88e6e49410. {{(pid=135002) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Apr 09 21:01:13.890928 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a26acf5-a534-48c6-b852-880fa1d58e90 tempest-LiveMigrationTest-1096887428 None] Creating volume glance metadata for volume ef3cc8f1-99be-44b9-a957-0c88e6e49410 backed by image b539c48b-3400-4aa4-9226-8be5a3d07b36 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=135002) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Apr 09 21:01:14.016954 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5a26acf5-a534-48c6-b852-880fa1d58e90 tempest-LiveMigrationTest-1096887428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d960ab2c-3d56-4b0d-abca-57f564d8a154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef3cc8f1-99be-44b9-a957-0c88e6e49410', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:01:14.022647 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5a26acf5-a534-48c6-b852-880fa1d58e90 tempest-LiveMigrationTest-1096887428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05dfb968-5834-4731-bf02-21ec715cdf04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:01:14.039115 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-5a26acf5-a534-48c6-b852-880fa1d58e90 tempest-LiveMigrationTest-1096887428 None] Volume volume-ef3cc8f1-99be-44b9-a957-0c88e6e49410 (ef3cc8f1-99be-44b9-a957-0c88e6e49410): created successfully Apr 09 21:01:14.045888 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5a26acf5-a534-48c6-b852-880fa1d58e90 tempest-LiveMigrationTest-1096887428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05dfb968-5834-4731-bf02-21ec715cdf04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:01:14.054075 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5a26acf5-a534-48c6-b852-880fa1d58e90 tempest-LiveMigrationTest-1096887428 None] Flow 'volume_create_manager' (e8db712a-3d92-4316-bdb4-220e3d7d15d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:01:14.067091 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-5a26acf5-a534-48c6-b852-880fa1d58e90 tempest-LiveMigrationTest-1096887428 None] Created volume successfully. Apr 09 21:01:18.269105 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-b967258d-3834-4350-82a2-f6175f921513 req-6917b6e0-27e1-416f-8052-7e7992e211fe tempest-LiveMigrationTest-1096887428 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:01:19.390969 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-b967258d-3834-4350-82a2-f6175f921513 req-6917b6e0-27e1-416f-8052-7e7992e211fe tempest-LiveMigrationTest-1096887428 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.122s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:01:19.393558 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-b967258d-3834-4350-82a2-f6175f921513 req-6917b6e0-27e1-416f-8052-7e7992e211fe tempest-LiveMigrationTest-1096887428 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ef3cc8f1-99be-44b9-a957-0c88e6e49410', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': 'ef3cc8f1-99be-44b9-a957-0c88e6e49410', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:01:19.476905 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-b967258d-3834-4350-82a2-f6175f921513 req-6917b6e0-27e1-416f-8052-7e7992e211fe tempest-LiveMigrationTest-1096887428 None] Connection info returned from driver {'name': 'volumes/volume-ef3cc8f1-99be-44b9-a957-0c88e6e49410', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ef3cc8f1-99be-44b9-a957-0c88e6e49410', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'aa50aaec-275e-4d81-9807-150c3a5fe082'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 21:01:19.611900 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-b967258d-3834-4350-82a2-f6175f921513 req-6917b6e0-27e1-416f-8052-7e7992e211fe tempest-LiveMigrationTest-1096887428 None] attachment_update completed successfully. Apr 09 21:01:49.619337 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:01:49.622920 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:01:49.727116 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:01:49.816525 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:01:58.143932 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-c46149aa-e5f1-480c-b726-2a40308a37dd req-ee67a1ff-8ec1-4ccf-8684-77d2469cc307 tempest-LiveMigrationTest-1367615552 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:01:59.464481 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-c46149aa-e5f1-480c-b726-2a40308a37dd req-ee67a1ff-8ec1-4ccf-8684-77d2469cc307 tempest-LiveMigrationTest-1367615552 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.320s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:01:59.467009 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-c46149aa-e5f1-480c-b726-2a40308a37dd req-ee67a1ff-8ec1-4ccf-8684-77d2469cc307 tempest-LiveMigrationTest-1367615552 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ef3cc8f1-99be-44b9-a957-0c88e6e49410', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': 'ef3cc8f1-99be-44b9-a957-0c88e6e49410', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:01:59.518166 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-c46149aa-e5f1-480c-b726-2a40308a37dd req-ee67a1ff-8ec1-4ccf-8684-77d2469cc307 tempest-LiveMigrationTest-1367615552 None] Connection info returned from driver {'name': 'volumes/volume-ef3cc8f1-99be-44b9-a957-0c88e6e49410', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ef3cc8f1-99be-44b9-a957-0c88e6e49410', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9b5c4376-cb45-419e-bc13-73b1426f08e7'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 21:01:59.626097 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-c46149aa-e5f1-480c-b726-2a40308a37dd req-ee67a1ff-8ec1-4ccf-8684-77d2469cc307 tempest-LiveMigrationTest-1367615552 None] attachment_update completed successfully. Apr 09 21:02:10.646101 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-c46149aa-e5f1-480c-b726-2a40308a37dd req-3a7e435c-ada3-42df-b7c4-47edeaaeced7 tempest-LiveMigrationTest-1367615552 None] Terminate volume connection completed successfully. Apr 09 21:02:10.646737 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-c46149aa-e5f1-480c-b726-2a40308a37dd req-3a7e435c-ada3-42df-b7c4-47edeaaeced7 tempest-LiveMigrationTest-1367615552 None] Deleting attachment aa50aaec-275e-4d81-9807-150c3a5fe082. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 21:02:35.120912 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-c5df8a1e-92e9-47f2-a72b-aca586b7e2e5 req-ae6116e8-4558-4a36-a6d6-baf5ba3fa975 tempest-LiveMigrationTest-1096887428 None] Terminate volume connection completed successfully. Apr 09 21:02:35.122429 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-c5df8a1e-92e9-47f2-a72b-aca586b7e2e5 req-ae6116e8-4558-4a36-a6d6-baf5ba3fa975 tempest-LiveMigrationTest-1096887428 None] Deleting attachment 9b5c4376-cb45-419e-bc13-73b1426f08e7. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 21:02:35.534424 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [req-c5df8a1e-92e9-47f2-a72b-aca586b7e2e5 req-af5dd54e-8c7b-4b5b-b8ba-b13ec8e6ec14 tempest-LiveMigrationTest-1096887428 None] Lock "b'cinder-ef3cc8f1-99be-44b9-a957-0c88e6e49410-delete_volume'" acquired by "delete_volume" :: waited 0.035s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:02:35.664265 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-c5df8a1e-92e9-47f2-a72b-aca586b7e2e5 req-af5dd54e-8c7b-4b5b-b8ba-b13ec8e6ec14 tempest-LiveMigrationTest-1096887428 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:02:35.823211 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-c5df8a1e-92e9-47f2-a72b-aca586b7e2e5 req-af5dd54e-8c7b-4b5b-b8ba-b13ec8e6ec14 tempest-LiveMigrationTest-1096887428 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:02:35.846976 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-c5df8a1e-92e9-47f2-a72b-aca586b7e2e5 req-af5dd54e-8c7b-4b5b-b8ba-b13ec8e6ec14 tempest-LiveMigrationTest-1096887428 None] deleting rbd volume volume-ef3cc8f1-99be-44b9-a957-0c88e6e49410 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:02:36.458364 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-c5df8a1e-92e9-47f2-a72b-aca586b7e2e5 req-af5dd54e-8c7b-4b5b-b8ba-b13ec8e6ec14 tempest-LiveMigrationTest-1096887428 None] volume is a clone so cleaning references {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Apr 09 21:02:36.507258 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-c5df8a1e-92e9-47f2-a72b-aca586b7e2e5 req-af5dd54e-8c7b-4b5b-b8ba-b13ec8e6ec14 tempest-LiveMigrationTest-1096887428 None] deleting parent snapshot volume-ef3cc8f1-99be-44b9-a957-0c88e6e49410.clone_snap {{(pid=135002) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Apr 09 21:02:37.493027 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-23eab3ae-c66d-4a84-b6f3-b04579525f0f tempest-LiveMigrationTest-1096887428 None] Lock "b'cinder-e65996e1-1e66-4a23-ac8b-882a962e48df-delete_volume'" acquired by "delete_volume" :: waited 0.027s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:02:37.571710 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-23eab3ae-c66d-4a84-b6f3-b04579525f0f tempest-LiveMigrationTest-1096887428 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:02:37.659053 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-23eab3ae-c66d-4a84-b6f3-b04579525f0f tempest-LiveMigrationTest-1096887428 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:02:37.660932 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-23eab3ae-c66d-4a84-b6f3-b04579525f0f tempest-LiveMigrationTest-1096887428 None] Volume volume-e65996e1-1e66-4a23-ac8b-882a962e48df is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:02:37.677538 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-23eab3ae-c66d-4a84-b6f3-b04579525f0f tempest-LiveMigrationTest-1096887428 None] deleting rbd volume volume-e65996e1-1e66-4a23-ac8b-882a962e48df {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:02:37.690066 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [req-c5df8a1e-92e9-47f2-a72b-aca586b7e2e5 req-af5dd54e-8c7b-4b5b-b8ba-b13ec8e6ec14 tempest-LiveMigrationTest-1096887428 None] Created reservations ['90490096-6f4e-4308-b64b-5757a4d90f31', 'b867df6a-d2dd-46f6-8f6c-9d399479962a', 'bd51b3c7-4bf5-47ff-a908-09fe0028b357', '99342574-666d-4605-9895-5d3ed04ea430'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:02:37.831583 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-c5df8a1e-92e9-47f2-a72b-aca586b7e2e5 req-af5dd54e-8c7b-4b5b-b8ba-b13ec8e6ec14 tempest-LiveMigrationTest-1096887428 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:02:37.945456 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-c5df8a1e-92e9-47f2-a72b-aca586b7e2e5 req-af5dd54e-8c7b-4b5b-b8ba-b13ec8e6ec14 tempest-LiveMigrationTest-1096887428 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:02:38.016119 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [req-c5df8a1e-92e9-47f2-a72b-aca586b7e2e5 req-af5dd54e-8c7b-4b5b-b8ba-b13ec8e6ec14 tempest-LiveMigrationTest-1096887428 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:02:38.028330 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-c5df8a1e-92e9-47f2-a72b-aca586b7e2e5 req-af5dd54e-8c7b-4b5b-b8ba-b13ec8e6ec14 tempest-LiveMigrationTest-1096887428 None] Deleted volume successfully. Apr 09 21:02:38.052963 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [req-c5df8a1e-92e9-47f2-a72b-aca586b7e2e5 req-af5dd54e-8c7b-4b5b-b8ba-b13ec8e6ec14 tempest-LiveMigrationTest-1096887428 None] Lock "b'cinder-ef3cc8f1-99be-44b9-a957-0c88e6e49410-delete_volume'" released by "delete_volume" :: held 2.519s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:02:38.225317 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-23eab3ae-c66d-4a84-b6f3-b04579525f0f tempest-LiveMigrationTest-1096887428 None] Created reservations ['719193bf-451e-4ebd-88ea-4800545e90b5', 'a08b0506-5c60-4be1-bacb-f0503af4d7e6', '3823fad9-e752-434e-a8b5-f4104bd02735', 'fd8cea51-11bc-40ca-b7f2-5d9d23bb0eb7'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:02:38.302476 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-23eab3ae-c66d-4a84-b6f3-b04579525f0f tempest-LiveMigrationTest-1096887428 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:02:38.387260 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-23eab3ae-c66d-4a84-b6f3-b04579525f0f tempest-LiveMigrationTest-1096887428 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:02:38.454812 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-23eab3ae-c66d-4a84-b6f3-b04579525f0f tempest-LiveMigrationTest-1096887428 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:02:38.459369 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-23eab3ae-c66d-4a84-b6f3-b04579525f0f tempest-LiveMigrationTest-1096887428 None] Deleted volume successfully. Apr 09 21:02:38.494674 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-23eab3ae-c66d-4a84-b6f3-b04579525f0f tempest-LiveMigrationTest-1096887428 None] Lock "b'cinder-e65996e1-1e66-4a23-ac8b-882a962e48df-delete_volume'" released by "delete_volume" :: held 1.004s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:02:49.621324 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:02:49.622690 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:02:49.697573 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:02:49.752844 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:03:20.577743 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-f69b9d52-2db1-4f87-9f65-6d202367bbc2 tempest-AttachSCSIVolumeTestJSON-1115941662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:03:20.600169 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f69b9d52-2db1-4f87-9f65-6d202367bbc2 tempest-AttachSCSIVolumeTestJSON-1115941662 None] Flow 'volume_create_manager' (7d2b3dda-87a0-41a0-a3ae-302141e80fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:03:20.606874 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f69b9d52-2db1-4f87-9f65-6d202367bbc2 tempest-AttachSCSIVolumeTestJSON-1115941662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd43218-126c-4859-959a-59cbfc7012ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:03:20.622216 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f69b9d52-2db1-4f87-9f65-6d202367bbc2 tempest-AttachSCSIVolumeTestJSON-1115941662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd43218-126c-4859-959a-59cbfc7012ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-717983142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ca2f4e91-7e66-48aa-a017-1fd991c6fa19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d288e617526417680b8d375cf87e380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:03:21Z,use_quota=True,user_id='dd753dc1202f4e138094f0f50b83b2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:03:20.627664 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f69b9d52-2db1-4f87-9f65-6d202367bbc2 tempest-AttachSCSIVolumeTestJSON-1115941662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd12bd38-6461-4ccb-9900-75e1fc68ac2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:03:20.631995 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f69b9d52-2db1-4f87-9f65-6d202367bbc2 tempest-AttachSCSIVolumeTestJSON-1115941662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd12bd38-6461-4ccb-9900-75e1fc68ac2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:03:20.637569 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f69b9d52-2db1-4f87-9f65-6d202367bbc2 tempest-AttachSCSIVolumeTestJSON-1115941662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76296698-7f68-4d7d-b2d4-a0b5e2ada052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:03:20.641741 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f69b9d52-2db1-4f87-9f65-6d202367bbc2 tempest-AttachSCSIVolumeTestJSON-1115941662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76296698-7f68-4d7d-b2d4-a0b5e2ada052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca2f4e91-7e66-48aa-a017-1fd991c6fa19', 'volume_name': 'volume-ca2f4e91-7e66-48aa-a017-1fd991c6fa19', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:03:20.646748 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f69b9d52-2db1-4f87-9f65-6d202367bbc2 tempest-AttachSCSIVolumeTestJSON-1115941662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b84f8748-7308-4251-89a8-3a2737f1b3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:03:20.650851 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f69b9d52-2db1-4f87-9f65-6d202367bbc2 tempest-AttachSCSIVolumeTestJSON-1115941662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b84f8748-7308-4251-89a8-3a2737f1b3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:03:20.655567 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f69b9d52-2db1-4f87-9f65-6d202367bbc2 tempest-AttachSCSIVolumeTestJSON-1115941662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (279adc1a-f5b9-4e6c-88b8-9ff574774153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:03:20.656650 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-f69b9d52-2db1-4f87-9f65-6d202367bbc2 tempest-AttachSCSIVolumeTestJSON-1115941662 None] Volume ca2f4e91-7e66-48aa-a017-1fd991c6fa19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca2f4e91-7e66-48aa-a017-1fd991c6fa19', 'volume_size': 1} Apr 09 21:03:20.657063 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f69b9d52-2db1-4f87-9f65-6d202367bbc2 tempest-AttachSCSIVolumeTestJSON-1115941662 None] creating volume 'volume-ca2f4e91-7e66-48aa-a017-1fd991c6fa19' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:03:20.657873 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f69b9d52-2db1-4f87-9f65-6d202367bbc2 tempest-AttachSCSIVolumeTestJSON-1115941662 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:03:20.715999 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f69b9d52-2db1-4f87-9f65-6d202367bbc2 tempest-AttachSCSIVolumeTestJSON-1115941662 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:03:20.716426 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f69b9d52-2db1-4f87-9f65-6d202367bbc2 tempest-AttachSCSIVolumeTestJSON-1115941662 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:03:20.720216 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f69b9d52-2db1-4f87-9f65-6d202367bbc2 tempest-AttachSCSIVolumeTestJSON-1115941662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (279adc1a-f5b9-4e6c-88b8-9ff574774153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca2f4e91-7e66-48aa-a017-1fd991c6fa19', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:03:20.725583 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f69b9d52-2db1-4f87-9f65-6d202367bbc2 tempest-AttachSCSIVolumeTestJSON-1115941662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (103a2f64-c61d-4ff9-b606-e8a6129da9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:03:20.737626 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-f69b9d52-2db1-4f87-9f65-6d202367bbc2 tempest-AttachSCSIVolumeTestJSON-1115941662 None] Volume volume-ca2f4e91-7e66-48aa-a017-1fd991c6fa19 (ca2f4e91-7e66-48aa-a017-1fd991c6fa19): created successfully Apr 09 21:03:20.741284 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f69b9d52-2db1-4f87-9f65-6d202367bbc2 tempest-AttachSCSIVolumeTestJSON-1115941662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (103a2f64-c61d-4ff9-b606-e8a6129da9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:03:20.746988 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f69b9d52-2db1-4f87-9f65-6d202367bbc2 tempest-AttachSCSIVolumeTestJSON-1115941662 None] Flow 'volume_create_manager' (7d2b3dda-87a0-41a0-a3ae-302141e80fd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:03:20.757452 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-f69b9d52-2db1-4f87-9f65-6d202367bbc2 tempest-AttachSCSIVolumeTestJSON-1115941662 None] Created volume successfully. Apr 09 21:03:22.695384 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-9626af77-95b7-484f-b0ec-4dcd68e308ea req-0c7869e8-7dfc-48b7-af3c-d8f1109a93ed tempest-AttachSCSIVolumeTestJSON-1115941662 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:03:23.699758 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-9626af77-95b7-484f-b0ec-4dcd68e308ea req-0c7869e8-7dfc-48b7-af3c-d8f1109a93ed tempest-AttachSCSIVolumeTestJSON-1115941662 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.006s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:03:23.701443 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-9626af77-95b7-484f-b0ec-4dcd68e308ea req-0c7869e8-7dfc-48b7-af3c-d8f1109a93ed tempest-AttachSCSIVolumeTestJSON-1115941662 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ca2f4e91-7e66-48aa-a017-1fd991c6fa19', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': 'ca2f4e91-7e66-48aa-a017-1fd991c6fa19', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:03:23.728082 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-9626af77-95b7-484f-b0ec-4dcd68e308ea req-0c7869e8-7dfc-48b7-af3c-d8f1109a93ed tempest-AttachSCSIVolumeTestJSON-1115941662 None] Connection info returned from driver {'name': 'volumes/volume-ca2f4e91-7e66-48aa-a017-1fd991c6fa19', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ca2f4e91-7e66-48aa-a017-1fd991c6fa19', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '2e539231-def7-4e8e-b9cd-92e7afb60556'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 21:03:23.778544 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-9626af77-95b7-484f-b0ec-4dcd68e308ea req-0c7869e8-7dfc-48b7-af3c-d8f1109a93ed tempest-AttachSCSIVolumeTestJSON-1115941662 None] attachment_update completed successfully. Apr 09 21:03:29.079453 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-18dd4062-7f7a-4de6-a9a5-e731dc1f024d req-b03f1bc9-9ccf-4b69-b6ef-55dc239ed6e9 tempest-AttachSCSIVolumeTestJSON-1115941662 None] Terminate volume connection completed successfully. Apr 09 21:03:29.080174 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-18dd4062-7f7a-4de6-a9a5-e731dc1f024d req-b03f1bc9-9ccf-4b69-b6ef-55dc239ed6e9 tempest-AttachSCSIVolumeTestJSON-1115941662 None] Deleting attachment 2e539231-def7-4e8e-b9cd-92e7afb60556. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 21:03:43.252582 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-ad5f5a7e-9cae-4121-ae79-abf938b847e6 tempest-AttachSCSIVolumeTestJSON-1115941662 None] Lock "b'cinder-ca2f4e91-7e66-48aa-a017-1fd991c6fa19-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:03:43.352331 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ad5f5a7e-9cae-4121-ae79-abf938b847e6 tempest-AttachSCSIVolumeTestJSON-1115941662 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:03:43.469723 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ad5f5a7e-9cae-4121-ae79-abf938b847e6 tempest-AttachSCSIVolumeTestJSON-1115941662 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:03:43.470945 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ad5f5a7e-9cae-4121-ae79-abf938b847e6 tempest-AttachSCSIVolumeTestJSON-1115941662 None] Volume volume-ca2f4e91-7e66-48aa-a017-1fd991c6fa19 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:03:43.487889 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ad5f5a7e-9cae-4121-ae79-abf938b847e6 tempest-AttachSCSIVolumeTestJSON-1115941662 None] deleting rbd volume volume-ca2f4e91-7e66-48aa-a017-1fd991c6fa19 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:03:44.016921 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-ad5f5a7e-9cae-4121-ae79-abf938b847e6 tempest-AttachSCSIVolumeTestJSON-1115941662 None] Created reservations ['72e805c3-92c4-449d-b0ac-48609818e547', '45bb44e5-2a32-4f51-84e5-cd6f14103bd0', '690fee4f-d7fa-473a-9f58-32ab4946f455', 'ac8f393d-52d6-45c6-9129-90533aa8f2c9'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:03:44.106234 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ad5f5a7e-9cae-4121-ae79-abf938b847e6 tempest-AttachSCSIVolumeTestJSON-1115941662 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:03:44.187121 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ad5f5a7e-9cae-4121-ae79-abf938b847e6 tempest-AttachSCSIVolumeTestJSON-1115941662 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:03:44.260276 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-ad5f5a7e-9cae-4121-ae79-abf938b847e6 tempest-AttachSCSIVolumeTestJSON-1115941662 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:03:44.265484 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-ad5f5a7e-9cae-4121-ae79-abf938b847e6 tempest-AttachSCSIVolumeTestJSON-1115941662 None] Deleted volume successfully. Apr 09 21:03:44.291291 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-ad5f5a7e-9cae-4121-ae79-abf938b847e6 tempest-AttachSCSIVolumeTestJSON-1115941662 None] Lock "b'cinder-ca2f4e91-7e66-48aa-a017-1fd991c6fa19-delete_volume'" released by "delete_volume" :: held 1.039s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:03:49.618711 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:03:49.620271 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:03:49.699117 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:03:49.765474 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:04:49.622614 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:04:49.623316 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:04:49.703712 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:04:49.763794 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:05:00.583731 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-f5fd81c5-d06b-4a7b-90c5-f523b358d3aa req-ee9da41f-f3a8-40b4-960c-b87a1acd0de6 tempest-TaggedBootDevicesTest-883782944 None] Terminate volume connection completed successfully. Apr 09 21:05:00.586785 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-f5fd81c5-d06b-4a7b-90c5-f523b358d3aa req-ee9da41f-f3a8-40b4-960c-b87a1acd0de6 tempest-TaggedBootDevicesTest-883782944 None] Deleting attachment d1b0f805-f772-4ea3-97df-e6b44bdc53a8. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 21:05:00.762972 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-f5fd81c5-d06b-4a7b-90c5-f523b358d3aa req-9fd55cff-d2f4-47b3-bc3f-7ee6eb84828d tempest-TaggedBootDevicesTest-883782944 None] Terminate volume connection completed successfully. Apr 09 21:05:00.763389 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-f5fd81c5-d06b-4a7b-90c5-f523b358d3aa req-9fd55cff-d2f4-47b3-bc3f-7ee6eb84828d tempest-TaggedBootDevicesTest-883782944 None] Deleting attachment 0a236cae-f571-446e-931e-259bdf54cd1b. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 21:05:00.955056 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-f5fd81c5-d06b-4a7b-90c5-f523b358d3aa req-d22446e7-5779-4899-a775-0786775bc1c3 tempest-TaggedBootDevicesTest-883782944 None] Terminate volume connection completed successfully. Apr 09 21:05:00.955729 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-f5fd81c5-d06b-4a7b-90c5-f523b358d3aa req-d22446e7-5779-4899-a775-0786775bc1c3 tempest-TaggedBootDevicesTest-883782944 None] Deleting attachment 3625b49a-9864-40fd-b7dd-046e0c7bc5c2. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 21:05:10.559417 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-2c4a28c9-b938-4c51-a6cd-78f22de92add tempest-TaggedBootDevicesTest-883782944 None] Lock "b'cinder-40f07b2b-d7f8-45aa-929d-798886e42bff-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:05:10.602405 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2c4a28c9-b938-4c51-a6cd-78f22de92add tempest-TaggedBootDevicesTest-883782944 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:05:10.686679 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2c4a28c9-b938-4c51-a6cd-78f22de92add tempest-TaggedBootDevicesTest-883782944 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:05:10.687035 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2c4a28c9-b938-4c51-a6cd-78f22de92add tempest-TaggedBootDevicesTest-883782944 None] Volume volume-40f07b2b-d7f8-45aa-929d-798886e42bff is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:05:10.694266 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2c4a28c9-b938-4c51-a6cd-78f22de92add tempest-TaggedBootDevicesTest-883782944 None] deleting rbd volume volume-40f07b2b-d7f8-45aa-929d-798886e42bff {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:05:10.937531 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-2c4a28c9-b938-4c51-a6cd-78f22de92add tempest-TaggedBootDevicesTest-883782944 None] Created reservations ['e0cf8397-b124-4a68-bcfa-f05ac264aeaf', 'c02478ee-8352-4c2d-8c3d-8306264bfdd0', '17c012d9-9f64-46db-851a-da3e1e99d087', '797a95d0-1849-4219-9ff3-dd2101ded9ab'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:05:10.983278 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2c4a28c9-b938-4c51-a6cd-78f22de92add tempest-TaggedBootDevicesTest-883782944 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:05:11.019307 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2c4a28c9-b938-4c51-a6cd-78f22de92add tempest-TaggedBootDevicesTest-883782944 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:05:11.060892 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-2c4a28c9-b938-4c51-a6cd-78f22de92add tempest-TaggedBootDevicesTest-883782944 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:05:11.071123 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-2c4a28c9-b938-4c51-a6cd-78f22de92add tempest-TaggedBootDevicesTest-883782944 None] Deleted volume successfully. Apr 09 21:05:11.098017 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-2c4a28c9-b938-4c51-a6cd-78f22de92add tempest-TaggedBootDevicesTest-883782944 None] Lock "b'cinder-40f07b2b-d7f8-45aa-929d-798886e42bff-delete_volume'" released by "delete_volume" :: held 0.538s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:05:11.760365 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-20876e58-108a-4931-9bc1-f902e1bd3500 tempest-TaggedBootDevicesTest-883782944 None] Lock "b'cinder-266a3665-0f1a-4dc2-abdc-875ecf11f419-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:05:11.832410 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-20876e58-108a-4931-9bc1-f902e1bd3500 tempest-TaggedBootDevicesTest-883782944 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:05:11.904965 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-20876e58-108a-4931-9bc1-f902e1bd3500 tempest-TaggedBootDevicesTest-883782944 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:05:11.905672 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-20876e58-108a-4931-9bc1-f902e1bd3500 tempest-TaggedBootDevicesTest-883782944 None] Volume volume-266a3665-0f1a-4dc2-abdc-875ecf11f419 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:05:11.914731 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-20876e58-108a-4931-9bc1-f902e1bd3500 tempest-TaggedBootDevicesTest-883782944 None] deleting rbd volume volume-266a3665-0f1a-4dc2-abdc-875ecf11f419 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:05:12.249920 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-20876e58-108a-4931-9bc1-f902e1bd3500 tempest-TaggedBootDevicesTest-883782944 None] Created reservations ['87308f1a-d687-46e9-8274-c89565573eb1', '6decfac9-ee6d-47d2-977c-600d5138a733', 'b656e367-cdd3-4570-9061-0af66e9f5d7f', '356cc229-a9e8-493a-89de-9514c74434fa'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:05:12.295478 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-20876e58-108a-4931-9bc1-f902e1bd3500 tempest-TaggedBootDevicesTest-883782944 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:05:12.323829 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-20876e58-108a-4931-9bc1-f902e1bd3500 tempest-TaggedBootDevicesTest-883782944 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:05:12.366970 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-20876e58-108a-4931-9bc1-f902e1bd3500 tempest-TaggedBootDevicesTest-883782944 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:05:12.383250 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-20876e58-108a-4931-9bc1-f902e1bd3500 tempest-TaggedBootDevicesTest-883782944 None] Deleted volume successfully. Apr 09 21:05:12.405179 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-20876e58-108a-4931-9bc1-f902e1bd3500 tempest-TaggedBootDevicesTest-883782944 None] Lock "b'cinder-266a3665-0f1a-4dc2-abdc-875ecf11f419-delete_volume'" released by "delete_volume" :: held 0.646s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:05:12.927152 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-0d07c008-dc93-484a-9c17-dda035eabf4b tempest-TaggedBootDevicesTest-883782944 None] Lock "b'cinder-6d815065-063f-4887-9bc8-5808837868ff-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:05:12.969675 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-0d07c008-dc93-484a-9c17-dda035eabf4b tempest-TaggedBootDevicesTest-883782944 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:05:13.036627 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-0d07c008-dc93-484a-9c17-dda035eabf4b tempest-TaggedBootDevicesTest-883782944 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:05:13.037096 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-0d07c008-dc93-484a-9c17-dda035eabf4b tempest-TaggedBootDevicesTest-883782944 None] volume has clone snapshot(s) {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1284}} Apr 09 21:05:13.038505 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-0d07c008-dc93-484a-9c17-dda035eabf4b tempest-TaggedBootDevicesTest-883782944 None] Volume volume-6d815065-063f-4887-9bc8-5808837868ff is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:05:13.159745 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-0d07c008-dc93-484a-9c17-dda035eabf4b tempest-TaggedBootDevicesTest-883782944 None] Created reservations ['df6ce41e-70ec-4a9d-b560-de9b73c23131', 'ed77cbf6-4a34-4bc2-8e43-a4a654b3605b', '692780b9-a5fe-4562-b999-2023855b2f03', '80e5fb04-81c2-4b3e-94ad-219b55cab2e3'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:05:13.213771 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-0d07c008-dc93-484a-9c17-dda035eabf4b tempest-TaggedBootDevicesTest-883782944 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:05:13.290059 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-0d07c008-dc93-484a-9c17-dda035eabf4b tempest-TaggedBootDevicesTest-883782944 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:05:13.356156 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-0d07c008-dc93-484a-9c17-dda035eabf4b tempest-TaggedBootDevicesTest-883782944 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:05:13.366704 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-0d07c008-dc93-484a-9c17-dda035eabf4b tempest-TaggedBootDevicesTest-883782944 None] Deleted volume successfully. Apr 09 21:05:13.381114 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-0d07c008-dc93-484a-9c17-dda035eabf4b tempest-TaggedBootDevicesTest-883782944 None] Lock "b'cinder-6d815065-063f-4887-9bc8-5808837868ff-delete_volume'" released by "delete_volume" :: held 0.454s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:05:15.963698 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7e33805-b7b0-478b-905f-b662b94997ae tempest-DeleteServersTestJSON-183073171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:05:15.989480 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d7e33805-b7b0-478b-905f-b662b94997ae tempest-DeleteServersTestJSON-183073171 None] Flow 'volume_create_manager' (fb4e11b7-15a5-4f41-b88f-e1ea0531e642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:05:15.996968 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d7e33805-b7b0-478b-905f-b662b94997ae tempest-DeleteServersTestJSON-183073171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0130b55-9683-4589-97f6-299b19235de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:05:16.017572 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d7e33805-b7b0-478b-905f-b662b94997ae tempest-DeleteServersTestJSON-183073171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0130b55-9683-4589-97f6-299b19235de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-698648338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e0c028f7-71a8-49c5-ac02-f31bc59e0c82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184d9189f1364fc1bdd88feff79103e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:05:16Z,use_quota=True,user_id='38f474d5daf947ff9f632424e909390a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:05:16.024581 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d7e33805-b7b0-478b-905f-b662b94997ae tempest-DeleteServersTestJSON-183073171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1afdda3e-4606-4d8b-8c12-0d8849847dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:05:16.029950 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d7e33805-b7b0-478b-905f-b662b94997ae tempest-DeleteServersTestJSON-183073171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1afdda3e-4606-4d8b-8c12-0d8849847dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:05:16.036576 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d7e33805-b7b0-478b-905f-b662b94997ae tempest-DeleteServersTestJSON-183073171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62058342-da1b-473e-8713-cf3efff8cc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:05:16.041099 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d7e33805-b7b0-478b-905f-b662b94997ae tempest-DeleteServersTestJSON-183073171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62058342-da1b-473e-8713-cf3efff8cc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0c028f7-71a8-49c5-ac02-f31bc59e0c82', 'volume_name': 'volume-e0c028f7-71a8-49c5-ac02-f31bc59e0c82', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:05:16.047620 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d7e33805-b7b0-478b-905f-b662b94997ae tempest-DeleteServersTestJSON-183073171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a070b60-1904-4691-8e40-c1544f7f78f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:05:16.052282 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d7e33805-b7b0-478b-905f-b662b94997ae tempest-DeleteServersTestJSON-183073171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a070b60-1904-4691-8e40-c1544f7f78f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:05:16.058388 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d7e33805-b7b0-478b-905f-b662b94997ae tempest-DeleteServersTestJSON-183073171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8afdd6ed-df00-41f8-8ce3-ec2bb6caa55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:05:16.059681 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-d7e33805-b7b0-478b-905f-b662b94997ae tempest-DeleteServersTestJSON-183073171 None] Volume e0c028f7-71a8-49c5-ac02-f31bc59e0c82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0c028f7-71a8-49c5-ac02-f31bc59e0c82', 'volume_size': 1} Apr 09 21:05:16.060264 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d7e33805-b7b0-478b-905f-b662b94997ae tempest-DeleteServersTestJSON-183073171 None] creating volume 'volume-e0c028f7-71a8-49c5-ac02-f31bc59e0c82' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:05:16.061867 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d7e33805-b7b0-478b-905f-b662b94997ae tempest-DeleteServersTestJSON-183073171 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:05:16.163530 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d7e33805-b7b0-478b-905f-b662b94997ae tempest-DeleteServersTestJSON-183073171 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:05:16.164454 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d7e33805-b7b0-478b-905f-b662b94997ae tempest-DeleteServersTestJSON-183073171 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:05:16.169810 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d7e33805-b7b0-478b-905f-b662b94997ae tempest-DeleteServersTestJSON-183073171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8afdd6ed-df00-41f8-8ce3-ec2bb6caa55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0c028f7-71a8-49c5-ac02-f31bc59e0c82', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:05:16.175279 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d7e33805-b7b0-478b-905f-b662b94997ae tempest-DeleteServersTestJSON-183073171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e6721b3-220f-4035-beb5-3331bb61b092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:05:16.190432 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-d7e33805-b7b0-478b-905f-b662b94997ae tempest-DeleteServersTestJSON-183073171 None] Volume volume-e0c028f7-71a8-49c5-ac02-f31bc59e0c82 (e0c028f7-71a8-49c5-ac02-f31bc59e0c82): created successfully Apr 09 21:05:16.198703 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d7e33805-b7b0-478b-905f-b662b94997ae tempest-DeleteServersTestJSON-183073171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e6721b3-220f-4035-beb5-3331bb61b092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:05:16.206055 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d7e33805-b7b0-478b-905f-b662b94997ae tempest-DeleteServersTestJSON-183073171 None] Flow 'volume_create_manager' (fb4e11b7-15a5-4f41-b88f-e1ea0531e642) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:05:16.219301 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-d7e33805-b7b0-478b-905f-b662b94997ae tempest-DeleteServersTestJSON-183073171 None] Created volume successfully. Apr 09 21:05:18.976068 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-7ae93fb5-2bf2-42d5-9783-5b5ff7bb4f52 req-e3f661bf-27b3-4231-8e50-554b4e10e3de tempest-DeleteServersTestJSON-183073171 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:05:19.614907 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-7ae93fb5-2bf2-42d5-9783-5b5ff7bb4f52 req-e3f661bf-27b3-4231-8e50-554b4e10e3de tempest-DeleteServersTestJSON-183073171 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.639s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:05:19.615672 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-7ae93fb5-2bf2-42d5-9783-5b5ff7bb4f52 req-e3f661bf-27b3-4231-8e50-554b4e10e3de tempest-DeleteServersTestJSON-183073171 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e0c028f7-71a8-49c5-ac02-f31bc59e0c82', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': 'e0c028f7-71a8-49c5-ac02-f31bc59e0c82', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:05:19.638319 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-7ae93fb5-2bf2-42d5-9783-5b5ff7bb4f52 req-e3f661bf-27b3-4231-8e50-554b4e10e3de tempest-DeleteServersTestJSON-183073171 None] Connection info returned from driver {'name': 'volumes/volume-e0c028f7-71a8-49c5-ac02-f31bc59e0c82', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e0c028f7-71a8-49c5-ac02-f31bc59e0c82', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ff360045-6eec-4234-9011-d8c3ef0723ee'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 21:05:19.685785 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-7ae93fb5-2bf2-42d5-9783-5b5ff7bb4f52 req-e3f661bf-27b3-4231-8e50-554b4e10e3de tempest-DeleteServersTestJSON-183073171 None] attachment_update completed successfully. Apr 09 21:05:26.992709 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-ff7e698c-1214-40b4-85a4-bd4c48d0f29a req-76441147-e51c-4b44-9335-011eac13d93d tempest-DeleteServersTestJSON-183073171 None] Terminate volume connection completed successfully. Apr 09 21:05:27.005892 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-ff7e698c-1214-40b4-85a4-bd4c48d0f29a req-76441147-e51c-4b44-9335-011eac13d93d tempest-DeleteServersTestJSON-183073171 None] Deleting attachment ff360045-6eec-4234-9011-d8c3ef0723ee. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 21:05:49.619375 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:05:49.620369 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:05:49.656401 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:05:49.724378 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:06:02.855518 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-dde20327-f7ce-4203-a739-2dcd2d1f805f tempest-ServersTestBootFromVolume-95666480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:06:02.892858 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-dde20327-f7ce-4203-a739-2dcd2d1f805f tempest-ServersTestBootFromVolume-95666480 None] Flow 'volume_create_manager' (be4952d1-e73a-40ec-8721-2e03f576d243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:06:02.900510 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-dde20327-f7ce-4203-a739-2dcd2d1f805f tempest-ServersTestBootFromVolume-95666480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d3f2d4a-1687-4161-bf61-4edd701c76b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:06:02.918494 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-dde20327-f7ce-4203-a739-2dcd2d1f805f tempest-ServersTestBootFromVolume-95666480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d3f2d4a-1687-4161-bf61-4edd701c76b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-525619921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d53c9d4e-bdd8-4af9-b74f-32b2cc76eb15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4603cd745c848eba3a1645f624e590e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:06:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:06:03Z,use_quota=True,user_id='0f54a88615644f5da8173e9bade66599',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:06:02.924451 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-dde20327-f7ce-4203-a739-2dcd2d1f805f tempest-ServersTestBootFromVolume-95666480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0ce567b-cfb8-4b83-a9d3-b0b73ad01766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:06:02.929005 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-dde20327-f7ce-4203-a739-2dcd2d1f805f tempest-ServersTestBootFromVolume-95666480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0ce567b-cfb8-4b83-a9d3-b0b73ad01766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:06:02.934627 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-dde20327-f7ce-4203-a739-2dcd2d1f805f tempest-ServersTestBootFromVolume-95666480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51eb825d-8f41-41d5-8008-5aaab831ee2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:06:03.195842 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-dde20327-f7ce-4203-a739-2dcd2d1f805f tempest-ServersTestBootFromVolume-95666480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51eb825d-8f41-41d5-8008-5aaab831ee2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd53c9d4e-bdd8-4af9-b74f-32b2cc76eb15', 'volume_name': 'volume-d53c9d4e-bdd8-4af9-b74f-32b2cc76eb15', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:06:03.209649 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-dde20327-f7ce-4203-a739-2dcd2d1f805f tempest-ServersTestBootFromVolume-95666480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (662d9ab3-e31a-4e5c-82fa-16be3e288222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:06:03.215504 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-dde20327-f7ce-4203-a739-2dcd2d1f805f tempest-ServersTestBootFromVolume-95666480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (662d9ab3-e31a-4e5c-82fa-16be3e288222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:06:03.232353 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-dde20327-f7ce-4203-a739-2dcd2d1f805f tempest-ServersTestBootFromVolume-95666480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10e952db-65a8-4290-b161-83183cffa4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:06:03.236179 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-dde20327-f7ce-4203-a739-2dcd2d1f805f tempest-ServersTestBootFromVolume-95666480 None] Volume d53c9d4e-bdd8-4af9-b74f-32b2cc76eb15: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d53c9d4e-bdd8-4af9-b74f-32b2cc76eb15', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 09 21:06:03.239421 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-dde20327-f7ce-4203-a739-2dcd2d1f805f tempest-ServersTestBootFromVolume-95666480 None] Cloning d53c9d4e-bdd8-4af9-b74f-32b2cc76eb15 from image b539c48b-3400-4aa4-9226-8be5a3d07b36 at location (None, None). {{(pid=135002) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Apr 09 21:06:03.252719 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-dde20327-f7ce-4203-a739-2dcd2d1f805f tempest-ServersTestBootFromVolume-95666480 None] Lock "b'cinder-b539c48b-3400-4aa4-9226-8be5a3d07b36'" acquired by "_prepare_image_cache_entry" :: waited 0.012s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:06:03.268197 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-dde20327-f7ce-4203-a739-2dcd2d1f805f tempest-ServersTestBootFromVolume-95666480 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'volume_id': 'd35656e2-d293-4904-aeae-3113202bb314', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36), 'last_used': datetime.datetime(2022, 4, 9, 21, 6, 3, 259385)}. {{(pid=135002) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 09 21:06:03.268540 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-dde20327-f7ce-4203-a739-2dcd2d1f805f tempest-ServersTestBootFromVolume-95666480 None] Image-volume cache entry image_update_at = 2022-04-09 20:45:36+00:00, requested image updated_at = 2022-04-09 20:45:36+00:00. {{(pid=135002) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 09 21:06:03.269379 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-dde20327-f7ce-4203-a739-2dcd2d1f805f tempest-ServersTestBootFromVolume-95666480 None] Found cache entry for image = b539c48b-3400-4aa4-9226-8be5a3d07b36 on host ncdv-master-1@ceph#ceph. {{(pid=135002) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Apr 09 21:06:03.282134 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-dde20327-f7ce-4203-a739-2dcd2d1f805f tempest-ServersTestBootFromVolume-95666480 None] Lock "b'cinder-b539c48b-3400-4aa4-9226-8be5a3d07b36'" released by "_prepare_image_cache_entry" :: held 0.027s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:06:03.284980 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-dde20327-f7ce-4203-a739-2dcd2d1f805f tempest-ServersTestBootFromVolume-95666480 None] Attempting to retrieve cache entry for image = b539c48b-3400-4aa4-9226-8be5a3d07b36 on host ncdv-master-1@ceph#ceph. {{(pid=135002) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Apr 09 21:06:03.298238 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-dde20327-f7ce-4203-a739-2dcd2d1f805f tempest-ServersTestBootFromVolume-95666480 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'volume_id': 'd35656e2-d293-4904-aeae-3113202bb314', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36), 'last_used': datetime.datetime(2022, 4, 9, 21, 6, 3, 291172)}. {{(pid=135002) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 09 21:06:03.298373 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-dde20327-f7ce-4203-a739-2dcd2d1f805f tempest-ServersTestBootFromVolume-95666480 None] Image-volume cache entry image_update_at = 2022-04-09 20:45:36+00:00, requested image updated_at = 2022-04-09 20:45:36+00:00. {{(pid=135002) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 09 21:06:03.301242 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-dde20327-f7ce-4203-a739-2dcd2d1f805f tempest-ServersTestBootFromVolume-95666480 None] Creating from source image-volume d35656e2-d293-4904-aeae-3113202bb314 {{(pid=135002) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Apr 09 21:06:03.327588 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-dde20327-f7ce-4203-a739-2dcd2d1f805f tempest-ServersTestBootFromVolume-95666480 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:06:03.499074 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-dde20327-f7ce-4203-a739-2dcd2d1f805f tempest-ServersTestBootFromVolume-95666480 None] creating snapshot='volume-d53c9d4e-bdd8-4af9-b74f-32b2cc76eb15.clone_snap' {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Apr 09 21:06:04.664433 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-dde20327-f7ce-4203-a739-2dcd2d1f805f tempest-ServersTestBootFromVolume-95666480 None] cloning 'volume-d35656e2-d293-4904-aeae-3113202bb314@volume-d53c9d4e-bdd8-4af9-b74f-32b2cc76eb15.clone_snap' to 'volume-d53c9d4e-bdd8-4af9-b74f-32b2cc76eb15' {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Apr 09 21:06:04.929323 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-dde20327-f7ce-4203-a739-2dcd2d1f805f tempest-ServersTestBootFromVolume-95666480 None] Volume volume-6d815065-063f-4887-9bc8-5808837868ff.deleted is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:06:04.931466 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-dde20327-f7ce-4203-a739-2dcd2d1f805f tempest-ServersTestBootFromVolume-95666480 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:06:04.932265 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-dde20327-f7ce-4203-a739-2dcd2d1f805f tempest-ServersTestBootFromVolume-95666480 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:06:05.003695 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-dde20327-f7ce-4203-a739-2dcd2d1f805f tempest-ServersTestBootFromVolume-95666480 None] clone created successfully {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Apr 09 21:06:05.004974 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.volume_utils [None req-dde20327-f7ce-4203-a739-2dcd2d1f805f tempest-ServersTestBootFromVolume-95666480 None] Marking volume d53c9d4e-bdd8-4af9-b74f-32b2cc76eb15 as bootable. {{(pid=135002) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Apr 09 21:06:05.017412 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-dde20327-f7ce-4203-a739-2dcd2d1f805f tempest-ServersTestBootFromVolume-95666480 None] Copying metadata from image b539c48b-3400-4aa4-9226-8be5a3d07b36 to d53c9d4e-bdd8-4af9-b74f-32b2cc76eb15. {{(pid=135002) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Apr 09 21:06:05.018558 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-dde20327-f7ce-4203-a739-2dcd2d1f805f tempest-ServersTestBootFromVolume-95666480 None] Creating volume glance metadata for volume d53c9d4e-bdd8-4af9-b74f-32b2cc76eb15 backed by image b539c48b-3400-4aa4-9226-8be5a3d07b36 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=135002) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Apr 09 21:06:05.104421 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-dde20327-f7ce-4203-a739-2dcd2d1f805f tempest-ServersTestBootFromVolume-95666480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10e952db-65a8-4290-b161-83183cffa4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d53c9d4e-bdd8-4af9-b74f-32b2cc76eb15', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:06:05.114725 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-dde20327-f7ce-4203-a739-2dcd2d1f805f tempest-ServersTestBootFromVolume-95666480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e78c450-f66f-43a1-b269-fed2ce3d5c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:06:05.133812 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-dde20327-f7ce-4203-a739-2dcd2d1f805f tempest-ServersTestBootFromVolume-95666480 None] Volume volume-d53c9d4e-bdd8-4af9-b74f-32b2cc76eb15 (d53c9d4e-bdd8-4af9-b74f-32b2cc76eb15): created successfully Apr 09 21:06:05.139906 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-dde20327-f7ce-4203-a739-2dcd2d1f805f tempest-ServersTestBootFromVolume-95666480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e78c450-f66f-43a1-b269-fed2ce3d5c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:06:05.149090 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-dde20327-f7ce-4203-a739-2dcd2d1f805f tempest-ServersTestBootFromVolume-95666480 None] Flow 'volume_create_manager' (be4952d1-e73a-40ec-8721-2e03f576d243) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:06:05.167485 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-dde20327-f7ce-4203-a739-2dcd2d1f805f tempest-ServersTestBootFromVolume-95666480 None] Created volume successfully. Apr 09 21:06:12.023611 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-f7c99224-74f0-41f9-8a7f-8a5bb40afde6 req-dc28330d-69f8-402f-93fc-3a457882d84e tempest-ServersTestBootFromVolume-95666480 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:06:13.344885 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-f7c99224-74f0-41f9-8a7f-8a5bb40afde6 req-dc28330d-69f8-402f-93fc-3a457882d84e tempest-ServersTestBootFromVolume-95666480 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.321s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:06:13.345784 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-f7c99224-74f0-41f9-8a7f-8a5bb40afde6 req-dc28330d-69f8-402f-93fc-3a457882d84e tempest-ServersTestBootFromVolume-95666480 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d53c9d4e-bdd8-4af9-b74f-32b2cc76eb15', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': 'd53c9d4e-bdd8-4af9-b74f-32b2cc76eb15', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:06:13.387186 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-f7c99224-74f0-41f9-8a7f-8a5bb40afde6 req-dc28330d-69f8-402f-93fc-3a457882d84e tempest-ServersTestBootFromVolume-95666480 None] Connection info returned from driver {'name': 'volumes/volume-d53c9d4e-bdd8-4af9-b74f-32b2cc76eb15', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd53c9d4e-bdd8-4af9-b74f-32b2cc76eb15', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a9da6bec-1d39-4c5c-b2a5-97bcfcdb9ac6'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 21:06:13.447107 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-f7c99224-74f0-41f9-8a7f-8a5bb40afde6 req-dc28330d-69f8-402f-93fc-3a457882d84e tempest-ServersTestBootFromVolume-95666480 None] attachment_update completed successfully. Apr 09 21:06:49.620517 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:06:49.622775 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:06:49.719540 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:06:49.811988 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:07:02.223210 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-1356cb4a-a3a5-4b8b-a813-5f46fdca0993 tempest-ServersNegativeTestJSON-1285629641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:07:02.274207 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1356cb4a-a3a5-4b8b-a813-5f46fdca0993 tempest-ServersNegativeTestJSON-1285629641 None] Flow 'volume_create_manager' (1bf9ad2d-bcd4-401e-bea8-9ee7ac54bfc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:07:02.289383 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1356cb4a-a3a5-4b8b-a813-5f46fdca0993 tempest-ServersNegativeTestJSON-1285629641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd9c2e96-9fe0-49f7-972a-204e51b5943c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:07:02.316607 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1356cb4a-a3a5-4b8b-a813-5f46fdca0993 tempest-ServersNegativeTestJSON-1285629641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd9c2e96-9fe0-49f7-972a-204e51b5943c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1870771592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9612699b-0256-46d7-9683-7562f3c0f614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e27519c6c114724bf36126f0362a7c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:07:02Z,use_quota=True,user_id='cdab30a578b947068144a0509c85eb0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:07:02.333758 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1356cb4a-a3a5-4b8b-a813-5f46fdca0993 tempest-ServersNegativeTestJSON-1285629641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abd2f2f7-740f-4dc7-9a5b-e90d50640787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:07:02.341374 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1356cb4a-a3a5-4b8b-a813-5f46fdca0993 tempest-ServersNegativeTestJSON-1285629641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abd2f2f7-740f-4dc7-9a5b-e90d50640787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:07:02.353132 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1356cb4a-a3a5-4b8b-a813-5f46fdca0993 tempest-ServersNegativeTestJSON-1285629641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3af420b8-d35d-41c9-96ad-c41016db59ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:07:02.363895 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1356cb4a-a3a5-4b8b-a813-5f46fdca0993 tempest-ServersNegativeTestJSON-1285629641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3af420b8-d35d-41c9-96ad-c41016db59ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9612699b-0256-46d7-9683-7562f3c0f614', 'volume_name': 'volume-9612699b-0256-46d7-9683-7562f3c0f614', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:07:02.392676 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1356cb4a-a3a5-4b8b-a813-5f46fdca0993 tempest-ServersNegativeTestJSON-1285629641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dbb9e39-24cd-4226-9e4c-fd3c4f47c9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:07:02.397381 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1356cb4a-a3a5-4b8b-a813-5f46fdca0993 tempest-ServersNegativeTestJSON-1285629641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dbb9e39-24cd-4226-9e4c-fd3c4f47c9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:07:02.410046 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1356cb4a-a3a5-4b8b-a813-5f46fdca0993 tempest-ServersNegativeTestJSON-1285629641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2ab1e71-c653-442e-a2e5-2623a5674c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:07:02.411621 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-1356cb4a-a3a5-4b8b-a813-5f46fdca0993 tempest-ServersNegativeTestJSON-1285629641 None] Volume 9612699b-0256-46d7-9683-7562f3c0f614: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9612699b-0256-46d7-9683-7562f3c0f614', 'volume_size': 1} Apr 09 21:07:02.412214 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1356cb4a-a3a5-4b8b-a813-5f46fdca0993 tempest-ServersNegativeTestJSON-1285629641 None] creating volume 'volume-9612699b-0256-46d7-9683-7562f3c0f614' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:07:02.419953 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1356cb4a-a3a5-4b8b-a813-5f46fdca0993 tempest-ServersNegativeTestJSON-1285629641 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:07:02.650238 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1356cb4a-a3a5-4b8b-a813-5f46fdca0993 tempest-ServersNegativeTestJSON-1285629641 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:07:02.650969 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1356cb4a-a3a5-4b8b-a813-5f46fdca0993 tempest-ServersNegativeTestJSON-1285629641 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:07:02.657515 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1356cb4a-a3a5-4b8b-a813-5f46fdca0993 tempest-ServersNegativeTestJSON-1285629641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2ab1e71-c653-442e-a2e5-2623a5674c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9612699b-0256-46d7-9683-7562f3c0f614', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:07:02.671237 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1356cb4a-a3a5-4b8b-a813-5f46fdca0993 tempest-ServersNegativeTestJSON-1285629641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6545189-eda1-4f2b-9b33-32400cf52b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:07:02.689547 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-1356cb4a-a3a5-4b8b-a813-5f46fdca0993 tempest-ServersNegativeTestJSON-1285629641 None] Volume volume-9612699b-0256-46d7-9683-7562f3c0f614 (9612699b-0256-46d7-9683-7562f3c0f614): created successfully Apr 09 21:07:02.699415 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1356cb4a-a3a5-4b8b-a813-5f46fdca0993 tempest-ServersNegativeTestJSON-1285629641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6545189-eda1-4f2b-9b33-32400cf52b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:07:02.710618 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1356cb4a-a3a5-4b8b-a813-5f46fdca0993 tempest-ServersNegativeTestJSON-1285629641 None] Flow 'volume_create_manager' (1bf9ad2d-bcd4-401e-bea8-9ee7ac54bfc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:07:02.736198 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-1356cb4a-a3a5-4b8b-a813-5f46fdca0993 tempest-ServersNegativeTestJSON-1285629641 None] Created volume successfully. Apr 09 21:07:05.534803 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-f379c069-98b5-4c0d-bdea-208b665ca3ef tempest-ServersNegativeTestJSON-1285629641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:07:05.563217 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f379c069-98b5-4c0d-bdea-208b665ca3ef tempest-ServersNegativeTestJSON-1285629641 None] Flow 'volume_create_manager' (ba5a5ca6-d933-47dd-af0a-f0a725d9fd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:07:05.598753 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f379c069-98b5-4c0d-bdea-208b665ca3ef tempest-ServersNegativeTestJSON-1285629641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe2666af-c4f1-47c4-8b5f-0912e62feaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:07:05.635757 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f379c069-98b5-4c0d-bdea-208b665ca3ef tempest-ServersNegativeTestJSON-1285629641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe2666af-c4f1-47c4-8b5f-0912e62feaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-247218737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=79325784-0b89-4f9d-b167-92b7b7ce911a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e27519c6c114724bf36126f0362a7c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:07:05Z,use_quota=True,user_id='cdab30a578b947068144a0509c85eb0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:07:05.659121 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f379c069-98b5-4c0d-bdea-208b665ca3ef tempest-ServersNegativeTestJSON-1285629641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4781750-6d74-4e2d-80fd-3a06a01c1560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:07:05.680358 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f379c069-98b5-4c0d-bdea-208b665ca3ef tempest-ServersNegativeTestJSON-1285629641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4781750-6d74-4e2d-80fd-3a06a01c1560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:07:05.702589 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f379c069-98b5-4c0d-bdea-208b665ca3ef tempest-ServersNegativeTestJSON-1285629641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3d66a1c-3aef-479c-a164-2646427bcd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:07:05.716887 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f379c069-98b5-4c0d-bdea-208b665ca3ef tempest-ServersNegativeTestJSON-1285629641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3d66a1c-3aef-479c-a164-2646427bcd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79325784-0b89-4f9d-b167-92b7b7ce911a', 'volume_name': 'volume-79325784-0b89-4f9d-b167-92b7b7ce911a', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:07:05.728838 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f379c069-98b5-4c0d-bdea-208b665ca3ef tempest-ServersNegativeTestJSON-1285629641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f94adcd2-4365-4f2b-badf-9de3154626bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:07:05.741064 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f379c069-98b5-4c0d-bdea-208b665ca3ef tempest-ServersNegativeTestJSON-1285629641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f94adcd2-4365-4f2b-badf-9de3154626bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:07:05.755980 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f379c069-98b5-4c0d-bdea-208b665ca3ef tempest-ServersNegativeTestJSON-1285629641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b04ca80-a8ba-475d-a845-bdc3c585ab5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:07:05.759536 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-f379c069-98b5-4c0d-bdea-208b665ca3ef tempest-ServersNegativeTestJSON-1285629641 None] Volume 79325784-0b89-4f9d-b167-92b7b7ce911a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79325784-0b89-4f9d-b167-92b7b7ce911a', 'volume_size': 1} Apr 09 21:07:05.760394 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f379c069-98b5-4c0d-bdea-208b665ca3ef tempest-ServersNegativeTestJSON-1285629641 None] creating volume 'volume-79325784-0b89-4f9d-b167-92b7b7ce911a' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:07:05.762577 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f379c069-98b5-4c0d-bdea-208b665ca3ef tempest-ServersNegativeTestJSON-1285629641 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:07:05.987913 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f379c069-98b5-4c0d-bdea-208b665ca3ef tempest-ServersNegativeTestJSON-1285629641 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:07:05.988483 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f379c069-98b5-4c0d-bdea-208b665ca3ef tempest-ServersNegativeTestJSON-1285629641 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:07:05.993430 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f379c069-98b5-4c0d-bdea-208b665ca3ef tempest-ServersNegativeTestJSON-1285629641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b04ca80-a8ba-475d-a845-bdc3c585ab5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79325784-0b89-4f9d-b167-92b7b7ce911a', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:07:06.004049 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f379c069-98b5-4c0d-bdea-208b665ca3ef tempest-ServersNegativeTestJSON-1285629641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (886f1769-7d64-4c82-8981-4f72710c06e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:07:06.031069 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-f379c069-98b5-4c0d-bdea-208b665ca3ef tempest-ServersNegativeTestJSON-1285629641 None] Volume volume-79325784-0b89-4f9d-b167-92b7b7ce911a (79325784-0b89-4f9d-b167-92b7b7ce911a): created successfully Apr 09 21:07:06.037502 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f379c069-98b5-4c0d-bdea-208b665ca3ef tempest-ServersNegativeTestJSON-1285629641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (886f1769-7d64-4c82-8981-4f72710c06e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:07:06.046642 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f379c069-98b5-4c0d-bdea-208b665ca3ef tempest-ServersNegativeTestJSON-1285629641 None] Flow 'volume_create_manager' (ba5a5ca6-d933-47dd-af0a-f0a725d9fd50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:07:06.060698 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-f379c069-98b5-4c0d-bdea-208b665ca3ef tempest-ServersNegativeTestJSON-1285629641 None] Created volume successfully. Apr 09 21:07:40.336970 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-fe418a04-6ed7-4f94-8f1a-3b50e3d23b70 req-5a994726-014f-41ef-ba5b-e52b893f9e35 tempest-ServersTestBootFromVolume-95666480 None] Terminate volume connection completed successfully. Apr 09 21:07:40.337618 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-fe418a04-6ed7-4f94-8f1a-3b50e3d23b70 req-5a994726-014f-41ef-ba5b-e52b893f9e35 tempest-ServersTestBootFromVolume-95666480 None] Deleting attachment a9da6bec-1d39-4c5c-b2a5-97bcfcdb9ac6. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 21:07:40.561888 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [req-fe418a04-6ed7-4f94-8f1a-3b50e3d23b70 req-3b230707-3f71-471e-9ada-b8e6ad683513 tempest-ServersTestBootFromVolume-95666480 None] Lock "b'cinder-d53c9d4e-bdd8-4af9-b74f-32b2cc76eb15-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:07:40.667956 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-fe418a04-6ed7-4f94-8f1a-3b50e3d23b70 req-3b230707-3f71-471e-9ada-b8e6ad683513 tempest-ServersTestBootFromVolume-95666480 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:07:40.798021 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-fe418a04-6ed7-4f94-8f1a-3b50e3d23b70 req-3b230707-3f71-471e-9ada-b8e6ad683513 tempest-ServersTestBootFromVolume-95666480 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:07:40.822476 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-fe418a04-6ed7-4f94-8f1a-3b50e3d23b70 req-3b230707-3f71-471e-9ada-b8e6ad683513 tempest-ServersTestBootFromVolume-95666480 None] deleting rbd volume volume-d53c9d4e-bdd8-4af9-b74f-32b2cc76eb15 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:07:41.383441 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-fe418a04-6ed7-4f94-8f1a-3b50e3d23b70 req-3b230707-3f71-471e-9ada-b8e6ad683513 tempest-ServersTestBootFromVolume-95666480 None] volume is a clone so cleaning references {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Apr 09 21:07:41.421970 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-fe418a04-6ed7-4f94-8f1a-3b50e3d23b70 req-3b230707-3f71-471e-9ada-b8e6ad683513 tempest-ServersTestBootFromVolume-95666480 None] deleting parent snapshot volume-d53c9d4e-bdd8-4af9-b74f-32b2cc76eb15.clone_snap {{(pid=135002) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Apr 09 21:07:41.916881 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [req-fe418a04-6ed7-4f94-8f1a-3b50e3d23b70 req-3b230707-3f71-471e-9ada-b8e6ad683513 tempest-ServersTestBootFromVolume-95666480 None] Created reservations ['2adb789b-3977-40fc-9c04-e06ef470cf50', 'e397d889-bc8c-4e0a-96fa-48c646de535b', '4177ea26-a007-4f19-8769-d4a3e4690de3', '517fe204-7d94-4368-8fe3-ca0b73a88adc'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:07:41.975546 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-fe418a04-6ed7-4f94-8f1a-3b50e3d23b70 req-3b230707-3f71-471e-9ada-b8e6ad683513 tempest-ServersTestBootFromVolume-95666480 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:07:42.019942 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-fe418a04-6ed7-4f94-8f1a-3b50e3d23b70 req-3b230707-3f71-471e-9ada-b8e6ad683513 tempest-ServersTestBootFromVolume-95666480 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:07:42.076774 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [req-fe418a04-6ed7-4f94-8f1a-3b50e3d23b70 req-3b230707-3f71-471e-9ada-b8e6ad683513 tempest-ServersTestBootFromVolume-95666480 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:07:42.082417 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-fe418a04-6ed7-4f94-8f1a-3b50e3d23b70 req-3b230707-3f71-471e-9ada-b8e6ad683513 tempest-ServersTestBootFromVolume-95666480 None] Deleted volume successfully. Apr 09 21:07:42.108103 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [req-fe418a04-6ed7-4f94-8f1a-3b50e3d23b70 req-3b230707-3f71-471e-9ada-b8e6ad683513 tempest-ServersTestBootFromVolume-95666480 None] Lock "b'cinder-d53c9d4e-bdd8-4af9-b74f-32b2cc76eb15-delete_volume'" released by "delete_volume" :: held 1.549s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:07:49.628330 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:07:49.628330 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:07:49.670925 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:07:49.717960 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:08:31.216357 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-57c59311-6b0b-4754-a5c0-8d171e682c71 tempest-VolumesTestJSON-1095162168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:08:31.249662 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-57c59311-6b0b-4754-a5c0-8d171e682c71 tempest-VolumesTestJSON-1095162168 None] Flow 'volume_create_manager' (5e3c937f-ea64-4533-9311-73848d3eca3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:08:31.263123 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-57c59311-6b0b-4754-a5c0-8d171e682c71 tempest-VolumesTestJSON-1095162168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (203e5eae-96fc-4b61-902e-ca0ca70831c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:08:31.314058 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-57c59311-6b0b-4754-a5c0-8d171e682c71 tempest-VolumesTestJSON-1095162168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (203e5eae-96fc-4b61-902e-ca0ca70831c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1072698155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=bc727759-fac6-4647-b6d1-3bc210398620,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d0191b5014da4a86ab5222b06297f56b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:08:31Z,use_quota=True,user_id='0284bafdc9784fc99edf39a9c4da1dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:08:31.337368 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-57c59311-6b0b-4754-a5c0-8d171e682c71 tempest-VolumesTestJSON-1095162168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8792af04-0a8e-48f1-badb-122fe33ef382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:08:31.345292 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-57c59311-6b0b-4754-a5c0-8d171e682c71 tempest-VolumesTestJSON-1095162168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8792af04-0a8e-48f1-badb-122fe33ef382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:08:31.362691 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-57c59311-6b0b-4754-a5c0-8d171e682c71 tempest-VolumesTestJSON-1095162168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b70e47e1-bb75-4829-9ef7-d67f88f375b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:08:31.372861 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-57c59311-6b0b-4754-a5c0-8d171e682c71 tempest-VolumesTestJSON-1095162168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b70e47e1-bb75-4829-9ef7-d67f88f375b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc727759-fac6-4647-b6d1-3bc210398620', 'volume_name': 'volume-bc727759-fac6-4647-b6d1-3bc210398620', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:08:31.386857 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-57c59311-6b0b-4754-a5c0-8d171e682c71 tempest-VolumesTestJSON-1095162168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75b3b5ed-b10f-4d7b-8698-71e68af2c8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:08:31.393318 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-57c59311-6b0b-4754-a5c0-8d171e682c71 tempest-VolumesTestJSON-1095162168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75b3b5ed-b10f-4d7b-8698-71e68af2c8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:08:31.401024 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-57c59311-6b0b-4754-a5c0-8d171e682c71 tempest-VolumesTestJSON-1095162168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a5460b4-4b49-422e-8e0b-583663cca78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:08:31.402261 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-57c59311-6b0b-4754-a5c0-8d171e682c71 tempest-VolumesTestJSON-1095162168 None] Volume bc727759-fac6-4647-b6d1-3bc210398620: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc727759-fac6-4647-b6d1-3bc210398620', 'volume_size': 1} Apr 09 21:08:31.402659 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-57c59311-6b0b-4754-a5c0-8d171e682c71 tempest-VolumesTestJSON-1095162168 None] creating volume 'volume-bc727759-fac6-4647-b6d1-3bc210398620' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:08:31.406146 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-57c59311-6b0b-4754-a5c0-8d171e682c71 tempest-VolumesTestJSON-1095162168 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:08:31.635443 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-57c59311-6b0b-4754-a5c0-8d171e682c71 tempest-VolumesTestJSON-1095162168 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:08:31.636028 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-57c59311-6b0b-4754-a5c0-8d171e682c71 tempest-VolumesTestJSON-1095162168 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:08:31.640229 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-57c59311-6b0b-4754-a5c0-8d171e682c71 tempest-VolumesTestJSON-1095162168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a5460b4-4b49-422e-8e0b-583663cca78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc727759-fac6-4647-b6d1-3bc210398620', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:08:31.645700 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-57c59311-6b0b-4754-a5c0-8d171e682c71 tempest-VolumesTestJSON-1095162168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eeddb77-1a5c-4a8e-9717-dae4b9a655d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:08:31.671210 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-57c59311-6b0b-4754-a5c0-8d171e682c71 tempest-VolumesTestJSON-1095162168 None] Volume volume-bc727759-fac6-4647-b6d1-3bc210398620 (bc727759-fac6-4647-b6d1-3bc210398620): created successfully Apr 09 21:08:31.692891 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-57c59311-6b0b-4754-a5c0-8d171e682c71 tempest-VolumesTestJSON-1095162168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eeddb77-1a5c-4a8e-9717-dae4b9a655d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:08:31.727138 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-57c59311-6b0b-4754-a5c0-8d171e682c71 tempest-VolumesTestJSON-1095162168 None] Flow 'volume_create_manager' (5e3c937f-ea64-4533-9311-73848d3eca3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:08:31.755164 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-57c59311-6b0b-4754-a5c0-8d171e682c71 tempest-VolumesTestJSON-1095162168 None] Created volume successfully. Apr 09 21:08:34.255192 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-34e354fe-2461-4330-b97f-9f89a797a0d1 tempest-VolumesTestJSON-1095162168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:08:34.405114 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-34e354fe-2461-4330-b97f-9f89a797a0d1 tempest-VolumesTestJSON-1095162168 None] Flow 'volume_create_manager' (83b86f6e-b0af-4e68-8865-cd4e9496ee85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:08:34.428904 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-34e354fe-2461-4330-b97f-9f89a797a0d1 tempest-VolumesTestJSON-1095162168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1312a62-3fb4-4604-8b98-6688ce7e2e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:08:34.477498 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-34e354fe-2461-4330-b97f-9f89a797a0d1 tempest-VolumesTestJSON-1095162168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1312a62-3fb4-4604-8b98-6688ce7e2e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1985297780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c2522bba-83b3-4fd0-9394-ea578cfd8752,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d0191b5014da4a86ab5222b06297f56b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:08:34Z,use_quota=True,user_id='0284bafdc9784fc99edf39a9c4da1dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:08:34.487615 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-34e354fe-2461-4330-b97f-9f89a797a0d1 tempest-VolumesTestJSON-1095162168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa75046c-59e0-4459-bb36-ceeb661128b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:08:34.496473 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-34e354fe-2461-4330-b97f-9f89a797a0d1 tempest-VolumesTestJSON-1095162168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa75046c-59e0-4459-bb36-ceeb661128b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:08:34.505981 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-34e354fe-2461-4330-b97f-9f89a797a0d1 tempest-VolumesTestJSON-1095162168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d263c21d-601f-4af5-ad18-a9f28b3c4bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:08:34.512639 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-34e354fe-2461-4330-b97f-9f89a797a0d1 tempest-VolumesTestJSON-1095162168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d263c21d-601f-4af5-ad18-a9f28b3c4bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2522bba-83b3-4fd0-9394-ea578cfd8752', 'volume_name': 'volume-c2522bba-83b3-4fd0-9394-ea578cfd8752', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:08:34.522370 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-34e354fe-2461-4330-b97f-9f89a797a0d1 tempest-VolumesTestJSON-1095162168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aeddc49-ef17-4bf9-8883-12bebc74589c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:08:34.530159 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-34e354fe-2461-4330-b97f-9f89a797a0d1 tempest-VolumesTestJSON-1095162168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aeddc49-ef17-4bf9-8883-12bebc74589c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:08:34.538724 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-34e354fe-2461-4330-b97f-9f89a797a0d1 tempest-VolumesTestJSON-1095162168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1868be21-df4e-49e1-9edb-52655438e10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:08:34.540343 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-34e354fe-2461-4330-b97f-9f89a797a0d1 tempest-VolumesTestJSON-1095162168 None] Volume c2522bba-83b3-4fd0-9394-ea578cfd8752: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2522bba-83b3-4fd0-9394-ea578cfd8752', 'volume_size': 1} Apr 09 21:08:34.541008 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-34e354fe-2461-4330-b97f-9f89a797a0d1 tempest-VolumesTestJSON-1095162168 None] creating volume 'volume-c2522bba-83b3-4fd0-9394-ea578cfd8752' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:08:34.542558 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-34e354fe-2461-4330-b97f-9f89a797a0d1 tempest-VolumesTestJSON-1095162168 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:08:34.713587 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-34e354fe-2461-4330-b97f-9f89a797a0d1 tempest-VolumesTestJSON-1095162168 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:08:34.714120 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-34e354fe-2461-4330-b97f-9f89a797a0d1 tempest-VolumesTestJSON-1095162168 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:08:34.721202 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-34e354fe-2461-4330-b97f-9f89a797a0d1 tempest-VolumesTestJSON-1095162168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1868be21-df4e-49e1-9edb-52655438e10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2522bba-83b3-4fd0-9394-ea578cfd8752', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:08:34.749730 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-34e354fe-2461-4330-b97f-9f89a797a0d1 tempest-VolumesTestJSON-1095162168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (906922c2-0309-4433-96dd-beac74d03a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:08:34.786336 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-34e354fe-2461-4330-b97f-9f89a797a0d1 tempest-VolumesTestJSON-1095162168 None] Volume volume-c2522bba-83b3-4fd0-9394-ea578cfd8752 (c2522bba-83b3-4fd0-9394-ea578cfd8752): created successfully Apr 09 21:08:34.796909 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-34e354fe-2461-4330-b97f-9f89a797a0d1 tempest-VolumesTestJSON-1095162168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (906922c2-0309-4433-96dd-beac74d03a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:08:34.818834 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-34e354fe-2461-4330-b97f-9f89a797a0d1 tempest-VolumesTestJSON-1095162168 None] Flow 'volume_create_manager' (83b86f6e-b0af-4e68-8865-cd4e9496ee85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:08:34.843721 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-34e354fe-2461-4330-b97f-9f89a797a0d1 tempest-VolumesTestJSON-1095162168 None] Created volume successfully. Apr 09 21:08:36.360244 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb60c9ac-3e76-40db-b8ff-bd06ada21408 tempest-VolumesTestJSON-1095162168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:08:36.398990 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eb60c9ac-3e76-40db-b8ff-bd06ada21408 tempest-VolumesTestJSON-1095162168 None] Flow 'volume_create_manager' (f7ebd9e8-cbbb-43a4-bfc0-182985e1467e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:08:36.418475 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eb60c9ac-3e76-40db-b8ff-bd06ada21408 tempest-VolumesTestJSON-1095162168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0666a0d-8e1a-441e-8d8a-1eb1df9badc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:08:36.460694 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eb60c9ac-3e76-40db-b8ff-bd06ada21408 tempest-VolumesTestJSON-1095162168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0666a0d-8e1a-441e-8d8a-1eb1df9badc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2120485562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4beefcd8-b027-4b6c-86eb-7a298d0edd5c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d0191b5014da4a86ab5222b06297f56b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:08:36Z,use_quota=True,user_id='0284bafdc9784fc99edf39a9c4da1dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:08:36.468555 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eb60c9ac-3e76-40db-b8ff-bd06ada21408 tempest-VolumesTestJSON-1095162168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d790f93-9585-47fe-b94e-584ecad0880c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:08:36.477700 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eb60c9ac-3e76-40db-b8ff-bd06ada21408 tempest-VolumesTestJSON-1095162168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d790f93-9585-47fe-b94e-584ecad0880c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:08:36.499558 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eb60c9ac-3e76-40db-b8ff-bd06ada21408 tempest-VolumesTestJSON-1095162168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5223fee-7fff-4919-ab78-2ed289b86ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:08:36.515740 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eb60c9ac-3e76-40db-b8ff-bd06ada21408 tempest-VolumesTestJSON-1095162168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5223fee-7fff-4919-ab78-2ed289b86ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4beefcd8-b027-4b6c-86eb-7a298d0edd5c', 'volume_name': 'volume-4beefcd8-b027-4b6c-86eb-7a298d0edd5c', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:08:36.528613 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eb60c9ac-3e76-40db-b8ff-bd06ada21408 tempest-VolumesTestJSON-1095162168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f97bb97e-79e5-413d-9f88-310c590da92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:08:36.551215 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eb60c9ac-3e76-40db-b8ff-bd06ada21408 tempest-VolumesTestJSON-1095162168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f97bb97e-79e5-413d-9f88-310c590da92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:08:36.565524 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eb60c9ac-3e76-40db-b8ff-bd06ada21408 tempest-VolumesTestJSON-1095162168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d61269a6-9ef6-4203-84c4-3b0026f709c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:08:36.567367 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-eb60c9ac-3e76-40db-b8ff-bd06ada21408 tempest-VolumesTestJSON-1095162168 None] Volume 4beefcd8-b027-4b6c-86eb-7a298d0edd5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4beefcd8-b027-4b6c-86eb-7a298d0edd5c', 'volume_size': 1} Apr 09 21:08:36.567769 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-eb60c9ac-3e76-40db-b8ff-bd06ada21408 tempest-VolumesTestJSON-1095162168 None] creating volume 'volume-4beefcd8-b027-4b6c-86eb-7a298d0edd5c' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:08:36.568466 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-eb60c9ac-3e76-40db-b8ff-bd06ada21408 tempest-VolumesTestJSON-1095162168 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:08:36.817990 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-eb60c9ac-3e76-40db-b8ff-bd06ada21408 tempest-VolumesTestJSON-1095162168 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:08:36.818851 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-eb60c9ac-3e76-40db-b8ff-bd06ada21408 tempest-VolumesTestJSON-1095162168 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:08:36.823268 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eb60c9ac-3e76-40db-b8ff-bd06ada21408 tempest-VolumesTestJSON-1095162168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d61269a6-9ef6-4203-84c4-3b0026f709c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4beefcd8-b027-4b6c-86eb-7a298d0edd5c', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:08:36.830820 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eb60c9ac-3e76-40db-b8ff-bd06ada21408 tempest-VolumesTestJSON-1095162168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76662870-7a01-4071-ba5b-171fe723dd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:08:36.856299 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-eb60c9ac-3e76-40db-b8ff-bd06ada21408 tempest-VolumesTestJSON-1095162168 None] Volume volume-4beefcd8-b027-4b6c-86eb-7a298d0edd5c (4beefcd8-b027-4b6c-86eb-7a298d0edd5c): created successfully Apr 09 21:08:36.860848 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eb60c9ac-3e76-40db-b8ff-bd06ada21408 tempest-VolumesTestJSON-1095162168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76662870-7a01-4071-ba5b-171fe723dd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:08:36.901248 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eb60c9ac-3e76-40db-b8ff-bd06ada21408 tempest-VolumesTestJSON-1095162168 None] Flow 'volume_create_manager' (f7ebd9e8-cbbb-43a4-bfc0-182985e1467e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:08:36.935220 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-eb60c9ac-3e76-40db-b8ff-bd06ada21408 tempest-VolumesTestJSON-1095162168 None] Created volume successfully. Apr 09 21:08:45.658804 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-1c6ebdef-40a1-4c72-955a-556e04eeda15 tempest-VolumesTestJSON-1095162168 None] Lock "b'cinder-4beefcd8-b027-4b6c-86eb-7a298d0edd5c-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:08:45.735300 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1c6ebdef-40a1-4c72-955a-556e04eeda15 tempest-VolumesTestJSON-1095162168 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:08:45.815063 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1c6ebdef-40a1-4c72-955a-556e04eeda15 tempest-VolumesTestJSON-1095162168 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:08:45.815521 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1c6ebdef-40a1-4c72-955a-556e04eeda15 tempest-VolumesTestJSON-1095162168 None] Volume volume-4beefcd8-b027-4b6c-86eb-7a298d0edd5c is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:08:45.830976 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1c6ebdef-40a1-4c72-955a-556e04eeda15 tempest-VolumesTestJSON-1095162168 None] deleting rbd volume volume-4beefcd8-b027-4b6c-86eb-7a298d0edd5c {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:08:46.438950 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-1c6ebdef-40a1-4c72-955a-556e04eeda15 tempest-VolumesTestJSON-1095162168 None] Created reservations ['1650ec21-c576-4293-926a-c85cca927b68', '58135090-c324-4e1c-a533-47c4d0ca5eab', '9b33b7f6-32ca-4603-a87a-f9076193ea6f', '81e4e284-bcbc-400b-addf-bf3b3941f5bd'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:08:46.548102 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1c6ebdef-40a1-4c72-955a-556e04eeda15 tempest-VolumesTestJSON-1095162168 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:08:46.650841 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1c6ebdef-40a1-4c72-955a-556e04eeda15 tempest-VolumesTestJSON-1095162168 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:08:46.741547 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-1c6ebdef-40a1-4c72-955a-556e04eeda15 tempest-VolumesTestJSON-1095162168 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:08:46.751857 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-1c6ebdef-40a1-4c72-955a-556e04eeda15 tempest-VolumesTestJSON-1095162168 None] Deleted volume successfully. Apr 09 21:08:46.801970 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-1c6ebdef-40a1-4c72-955a-556e04eeda15 tempest-VolumesTestJSON-1095162168 None] Lock "b'cinder-4beefcd8-b027-4b6c-86eb-7a298d0edd5c-delete_volume'" released by "delete_volume" :: held 1.141s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:08:46.915590 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-014e7c5a-8640-456c-a0f5-70a0d9fdfa5a tempest-VolumesTestJSON-1095162168 None] Lock "b'cinder-c2522bba-83b3-4fd0-9394-ea578cfd8752-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:08:47.022480 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-014e7c5a-8640-456c-a0f5-70a0d9fdfa5a tempest-VolumesTestJSON-1095162168 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:08:47.125425 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-014e7c5a-8640-456c-a0f5-70a0d9fdfa5a tempest-VolumesTestJSON-1095162168 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:08:47.125877 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-014e7c5a-8640-456c-a0f5-70a0d9fdfa5a tempest-VolumesTestJSON-1095162168 None] Volume volume-c2522bba-83b3-4fd0-9394-ea578cfd8752 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:08:47.145281 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-014e7c5a-8640-456c-a0f5-70a0d9fdfa5a tempest-VolumesTestJSON-1095162168 None] deleting rbd volume volume-c2522bba-83b3-4fd0-9394-ea578cfd8752 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:08:47.247664 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-9a101137-cf0e-4a78-8fe8-802ae8d12ec6 tempest-DeleteServersTestJSON-183073171 None] Lock "b'cinder-e0c028f7-71a8-49c5-ac02-f31bc59e0c82-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:08:47.320487 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9a101137-cf0e-4a78-8fe8-802ae8d12ec6 tempest-DeleteServersTestJSON-183073171 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:08:47.406915 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9a101137-cf0e-4a78-8fe8-802ae8d12ec6 tempest-DeleteServersTestJSON-183073171 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:08:47.407301 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9a101137-cf0e-4a78-8fe8-802ae8d12ec6 tempest-DeleteServersTestJSON-183073171 None] Volume volume-e0c028f7-71a8-49c5-ac02-f31bc59e0c82 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:08:47.442074 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9a101137-cf0e-4a78-8fe8-802ae8d12ec6 tempest-DeleteServersTestJSON-183073171 None] deleting rbd volume volume-e0c028f7-71a8-49c5-ac02-f31bc59e0c82 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:08:47.787554 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-014e7c5a-8640-456c-a0f5-70a0d9fdfa5a tempest-VolumesTestJSON-1095162168 None] Created reservations ['24b0db14-24a8-4a35-ac7f-16818b272da6', '76c1fbca-f169-4799-9147-d772a9a9fb64', '567c34d9-3e42-47d6-b20a-2ba25e0ae353', 'd8ce60fd-a479-42ce-a64e-e472c79df420'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:08:47.892667 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-014e7c5a-8640-456c-a0f5-70a0d9fdfa5a tempest-VolumesTestJSON-1095162168 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:08:47.979679 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-014e7c5a-8640-456c-a0f5-70a0d9fdfa5a tempest-VolumesTestJSON-1095162168 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:08:48.095566 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-014e7c5a-8640-456c-a0f5-70a0d9fdfa5a tempest-VolumesTestJSON-1095162168 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:08:48.100757 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-014e7c5a-8640-456c-a0f5-70a0d9fdfa5a tempest-VolumesTestJSON-1095162168 None] Deleted volume successfully. Apr 09 21:08:48.175537 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-014e7c5a-8640-456c-a0f5-70a0d9fdfa5a tempest-VolumesTestJSON-1095162168 None] Lock "b'cinder-c2522bba-83b3-4fd0-9394-ea578cfd8752-delete_volume'" released by "delete_volume" :: held 1.267s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:08:48.223532 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-9a101137-cf0e-4a78-8fe8-802ae8d12ec6 tempest-DeleteServersTestJSON-183073171 None] Created reservations ['49bab4c9-f3c3-4e57-b138-da3c52e142d0', '29039302-062b-4499-85ef-dbadfaa3654d', 'bf48f07b-2d25-4782-9586-f415b83bf6c5', '6cc15834-d68a-4798-b150-1f4d2e1a04f7'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:08:48.305383 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-7ebd8e20-b020-4cb2-8b25-35f1206b1031 tempest-VolumesTestJSON-1095162168 None] Lock "b'cinder-bc727759-fac6-4647-b6d1-3bc210398620-delete_volume'" acquired by "delete_volume" :: waited 0.049s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:08:48.408868 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-7ebd8e20-b020-4cb2-8b25-35f1206b1031 tempest-VolumesTestJSON-1095162168 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:08:48.480981 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-7ebd8e20-b020-4cb2-8b25-35f1206b1031 tempest-VolumesTestJSON-1095162168 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:08:48.481802 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-7ebd8e20-b020-4cb2-8b25-35f1206b1031 tempest-VolumesTestJSON-1095162168 None] Volume volume-bc727759-fac6-4647-b6d1-3bc210398620 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:08:48.508493 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-7ebd8e20-b020-4cb2-8b25-35f1206b1031 tempest-VolumesTestJSON-1095162168 None] deleting rbd volume volume-bc727759-fac6-4647-b6d1-3bc210398620 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:08:48.511520 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9a101137-cf0e-4a78-8fe8-802ae8d12ec6 tempest-DeleteServersTestJSON-183073171 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:08:48.581132 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9a101137-cf0e-4a78-8fe8-802ae8d12ec6 tempest-DeleteServersTestJSON-183073171 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:08:48.645605 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-9a101137-cf0e-4a78-8fe8-802ae8d12ec6 tempest-DeleteServersTestJSON-183073171 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:08:48.649958 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-9a101137-cf0e-4a78-8fe8-802ae8d12ec6 tempest-DeleteServersTestJSON-183073171 None] Deleted volume successfully. Apr 09 21:08:48.676702 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-9a101137-cf0e-4a78-8fe8-802ae8d12ec6 tempest-DeleteServersTestJSON-183073171 None] Lock "b'cinder-e0c028f7-71a8-49c5-ac02-f31bc59e0c82-delete_volume'" released by "delete_volume" :: held 1.429s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:08:48.972336 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-7ebd8e20-b020-4cb2-8b25-35f1206b1031 tempest-VolumesTestJSON-1095162168 None] Created reservations ['aff94021-6b05-4266-84f3-dbdc31f61fbb', '6bef6779-2b90-4304-b97c-ade3496cbc23', 'f986dd67-119d-46da-a003-29e5b5409c1c', 'd0a85758-afce-4cda-b04a-b2d7daaf95b0'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:08:49.069293 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-7ebd8e20-b020-4cb2-8b25-35f1206b1031 tempest-VolumesTestJSON-1095162168 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:08:49.167433 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-7ebd8e20-b020-4cb2-8b25-35f1206b1031 tempest-VolumesTestJSON-1095162168 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:08:49.281811 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-7ebd8e20-b020-4cb2-8b25-35f1206b1031 tempest-VolumesTestJSON-1095162168 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:08:49.290103 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-7ebd8e20-b020-4cb2-8b25-35f1206b1031 tempest-VolumesTestJSON-1095162168 None] Deleted volume successfully. Apr 09 21:08:49.321864 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-7ebd8e20-b020-4cb2-8b25-35f1206b1031 tempest-VolumesTestJSON-1095162168 None] Lock "b'cinder-bc727759-fac6-4647-b6d1-3bc210398620-delete_volume'" released by "delete_volume" :: held 1.018s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:08:49.623337 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:08:49.624187 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:08:49.701284 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:08:49.774012 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:09:26.486726 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-060ef119-7cb9-4339-a1a3-87633191e13f tempest-TaggedBootDevicesTest_v242-429285116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:09:26.560344 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-060ef119-7cb9-4339-a1a3-87633191e13f tempest-TaggedBootDevicesTest_v242-429285116 None] Flow 'volume_create_manager' (23969988-b2fa-460b-b965-fc7ed29869f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:09:26.580541 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-060ef119-7cb9-4339-a1a3-87633191e13f tempest-TaggedBootDevicesTest_v242-429285116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92abbaa0-6eff-4a25-9bba-019d347ea566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:09:26.606950 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-060ef119-7cb9-4339-a1a3-87633191e13f tempest-TaggedBootDevicesTest_v242-429285116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92abbaa0-6eff-4a25-9bba-019d347ea566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1347586429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=bbcf93e0-b776-46ad-9196-c4638c713502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60eee2c55ed842f78ac0fa9e1b400fbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:09:26Z,use_quota=True,user_id='e2b92cb8d21d42eea56146d7935a74e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:09:26.613343 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-060ef119-7cb9-4339-a1a3-87633191e13f tempest-TaggedBootDevicesTest_v242-429285116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f1b339-d70c-4e10-bf55-f8fa01f8a5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:09:26.618058 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-060ef119-7cb9-4339-a1a3-87633191e13f tempest-TaggedBootDevicesTest_v242-429285116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f1b339-d70c-4e10-bf55-f8fa01f8a5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:09:26.626404 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-060ef119-7cb9-4339-a1a3-87633191e13f tempest-TaggedBootDevicesTest_v242-429285116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d18e63-ce77-457b-8e97-af7ae0ee8e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:09:26.766545 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-060ef119-7cb9-4339-a1a3-87633191e13f tempest-TaggedBootDevicesTest_v242-429285116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d18e63-ce77-457b-8e97-af7ae0ee8e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bbcf93e0-b776-46ad-9196-c4638c713502', 'volume_name': 'volume-bbcf93e0-b776-46ad-9196-c4638c713502', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:09:26.790230 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-060ef119-7cb9-4339-a1a3-87633191e13f tempest-TaggedBootDevicesTest_v242-429285116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb1fe4be-884e-4288-8280-2539b0bd4ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:09:26.797227 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-060ef119-7cb9-4339-a1a3-87633191e13f tempest-TaggedBootDevicesTest_v242-429285116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb1fe4be-884e-4288-8280-2539b0bd4ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:09:26.805632 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-060ef119-7cb9-4339-a1a3-87633191e13f tempest-TaggedBootDevicesTest_v242-429285116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6fff457-01fd-413d-b235-dfe3c54fe917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:09:26.807165 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-060ef119-7cb9-4339-a1a3-87633191e13f tempest-TaggedBootDevicesTest_v242-429285116 None] Volume bbcf93e0-b776-46ad-9196-c4638c713502: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bbcf93e0-b776-46ad-9196-c4638c713502', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 09 21:09:26.808492 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-060ef119-7cb9-4339-a1a3-87633191e13f tempest-TaggedBootDevicesTest_v242-429285116 None] Cloning bbcf93e0-b776-46ad-9196-c4638c713502 from image b539c48b-3400-4aa4-9226-8be5a3d07b36 at location (None, None). {{(pid=135002) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Apr 09 21:09:26.818457 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-060ef119-7cb9-4339-a1a3-87633191e13f tempest-TaggedBootDevicesTest_v242-429285116 None] Lock "b'cinder-b539c48b-3400-4aa4-9226-8be5a3d07b36'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:09:26.844904 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-060ef119-7cb9-4339-a1a3-87633191e13f tempest-TaggedBootDevicesTest_v242-429285116 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'volume_id': 'd35656e2-d293-4904-aeae-3113202bb314', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36), 'last_used': datetime.datetime(2022, 4, 9, 21, 9, 26, 823442)}. {{(pid=135002) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 09 21:09:26.847834 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-060ef119-7cb9-4339-a1a3-87633191e13f tempest-TaggedBootDevicesTest_v242-429285116 None] Image-volume cache entry image_update_at = 2022-04-09 20:45:36+00:00, requested image updated_at = 2022-04-09 20:45:36+00:00. {{(pid=135002) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 09 21:09:26.850655 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-060ef119-7cb9-4339-a1a3-87633191e13f tempest-TaggedBootDevicesTest_v242-429285116 None] Found cache entry for image = b539c48b-3400-4aa4-9226-8be5a3d07b36 on host ncdv-master-1@ceph#ceph. {{(pid=135002) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Apr 09 21:09:26.859860 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-060ef119-7cb9-4339-a1a3-87633191e13f tempest-TaggedBootDevicesTest_v242-429285116 None] Lock "b'cinder-b539c48b-3400-4aa4-9226-8be5a3d07b36'" released by "_prepare_image_cache_entry" :: held 0.041s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:09:26.863363 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-060ef119-7cb9-4339-a1a3-87633191e13f tempest-TaggedBootDevicesTest_v242-429285116 None] Attempting to retrieve cache entry for image = b539c48b-3400-4aa4-9226-8be5a3d07b36 on host ncdv-master-1@ceph#ceph. {{(pid=135002) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Apr 09 21:09:26.875203 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-060ef119-7cb9-4339-a1a3-87633191e13f tempest-TaggedBootDevicesTest_v242-429285116 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'volume_id': 'd35656e2-d293-4904-aeae-3113202bb314', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36), 'last_used': datetime.datetime(2022, 4, 9, 21, 9, 26, 871796)}. {{(pid=135002) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 09 21:09:26.876006 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-060ef119-7cb9-4339-a1a3-87633191e13f tempest-TaggedBootDevicesTest_v242-429285116 None] Image-volume cache entry image_update_at = 2022-04-09 20:45:36+00:00, requested image updated_at = 2022-04-09 20:45:36+00:00. {{(pid=135002) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 09 21:09:26.884563 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-060ef119-7cb9-4339-a1a3-87633191e13f tempest-TaggedBootDevicesTest_v242-429285116 None] Creating from source image-volume d35656e2-d293-4904-aeae-3113202bb314 {{(pid=135002) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Apr 09 21:09:26.898809 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-060ef119-7cb9-4339-a1a3-87633191e13f tempest-TaggedBootDevicesTest_v242-429285116 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:09:27.010738 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-060ef119-7cb9-4339-a1a3-87633191e13f tempest-TaggedBootDevicesTest_v242-429285116 None] creating snapshot='volume-bbcf93e0-b776-46ad-9196-c4638c713502.clone_snap' {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Apr 09 21:09:27.941414 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-060ef119-7cb9-4339-a1a3-87633191e13f tempest-TaggedBootDevicesTest_v242-429285116 None] cloning 'volume-d35656e2-d293-4904-aeae-3113202bb314@volume-bbcf93e0-b776-46ad-9196-c4638c713502.clone_snap' to 'volume-bbcf93e0-b776-46ad-9196-c4638c713502' {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Apr 09 21:09:28.198096 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-060ef119-7cb9-4339-a1a3-87633191e13f tempest-TaggedBootDevicesTest_v242-429285116 None] Volume volume-6d815065-063f-4887-9bc8-5808837868ff.deleted is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:09:28.199542 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-060ef119-7cb9-4339-a1a3-87633191e13f tempest-TaggedBootDevicesTest_v242-429285116 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:09:28.200076 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-060ef119-7cb9-4339-a1a3-87633191e13f tempest-TaggedBootDevicesTest_v242-429285116 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:09:28.270466 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-060ef119-7cb9-4339-a1a3-87633191e13f tempest-TaggedBootDevicesTest_v242-429285116 None] clone created successfully {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Apr 09 21:09:28.271551 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.volume_utils [None req-060ef119-7cb9-4339-a1a3-87633191e13f tempest-TaggedBootDevicesTest_v242-429285116 None] Marking volume bbcf93e0-b776-46ad-9196-c4638c713502 as bootable. {{(pid=135002) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Apr 09 21:09:28.286562 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-060ef119-7cb9-4339-a1a3-87633191e13f tempest-TaggedBootDevicesTest_v242-429285116 None] Copying metadata from image b539c48b-3400-4aa4-9226-8be5a3d07b36 to bbcf93e0-b776-46ad-9196-c4638c713502. {{(pid=135002) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Apr 09 21:09:28.287084 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-060ef119-7cb9-4339-a1a3-87633191e13f tempest-TaggedBootDevicesTest_v242-429285116 None] Creating volume glance metadata for volume bbcf93e0-b776-46ad-9196-c4638c713502 backed by image b539c48b-3400-4aa4-9226-8be5a3d07b36 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=135002) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Apr 09 21:09:28.404842 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-060ef119-7cb9-4339-a1a3-87633191e13f tempest-TaggedBootDevicesTest_v242-429285116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6fff457-01fd-413d-b235-dfe3c54fe917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbcf93e0-b776-46ad-9196-c4638c713502', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:09:28.440502 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-060ef119-7cb9-4339-a1a3-87633191e13f tempest-TaggedBootDevicesTest_v242-429285116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b92f8fb9-ccdb-4b53-a267-0c0b14800dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:09:28.473144 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-060ef119-7cb9-4339-a1a3-87633191e13f tempest-TaggedBootDevicesTest_v242-429285116 None] Volume volume-bbcf93e0-b776-46ad-9196-c4638c713502 (bbcf93e0-b776-46ad-9196-c4638c713502): created successfully Apr 09 21:09:28.486019 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-060ef119-7cb9-4339-a1a3-87633191e13f tempest-TaggedBootDevicesTest_v242-429285116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b92f8fb9-ccdb-4b53-a267-0c0b14800dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:09:28.514082 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-060ef119-7cb9-4339-a1a3-87633191e13f tempest-TaggedBootDevicesTest_v242-429285116 None] Flow 'volume_create_manager' (23969988-b2fa-460b-b965-fc7ed29869f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:09:28.539509 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-060ef119-7cb9-4339-a1a3-87633191e13f tempest-TaggedBootDevicesTest_v242-429285116 None] Created volume successfully. Apr 09 21:09:29.519975 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-4bee146c-3ff1-48d4-822c-f7520d35b93d tempest-ServersNegativeTestJSON-1285629641 None] Lock "b'cinder-79325784-0b89-4f9d-b167-92b7b7ce911a-delete_volume'" acquired by "delete_volume" :: waited 0.047s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:09:29.612968 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-4bee146c-3ff1-48d4-822c-f7520d35b93d tempest-ServersNegativeTestJSON-1285629641 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:09:29.688520 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-4bee146c-3ff1-48d4-822c-f7520d35b93d tempest-ServersNegativeTestJSON-1285629641 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:09:29.689420 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-4bee146c-3ff1-48d4-822c-f7520d35b93d tempest-ServersNegativeTestJSON-1285629641 None] Volume volume-79325784-0b89-4f9d-b167-92b7b7ce911a is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:09:29.705312 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-4bee146c-3ff1-48d4-822c-f7520d35b93d tempest-ServersNegativeTestJSON-1285629641 None] deleting rbd volume volume-79325784-0b89-4f9d-b167-92b7b7ce911a {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:09:30.304314 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-4bee146c-3ff1-48d4-822c-f7520d35b93d tempest-ServersNegativeTestJSON-1285629641 None] Created reservations ['2b64c158-1859-4d77-b3b3-f5e87f74e2a0', '4ebe8619-6023-4bba-9667-11cfc134b369', '3b672f2c-d0f7-459c-ad9e-a7d406b32de3', 'd1778450-d020-4f80-bced-622a0838e062'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:09:30.396142 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-4bee146c-3ff1-48d4-822c-f7520d35b93d tempest-ServersNegativeTestJSON-1285629641 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:09:30.465969 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-4bee146c-3ff1-48d4-822c-f7520d35b93d tempest-ServersNegativeTestJSON-1285629641 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:09:30.529298 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-4bee146c-3ff1-48d4-822c-f7520d35b93d tempest-ServersNegativeTestJSON-1285629641 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:09:30.535883 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce19975f-de37-4c9e-b3ae-09323b8b57c7 tempest-TaggedBootDevicesTest_v242-429285116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:09:30.576676 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ce19975f-de37-4c9e-b3ae-09323b8b57c7 tempest-TaggedBootDevicesTest_v242-429285116 None] Flow 'volume_create_manager' (14d4a211-25e6-428f-82e1-3c794e89aafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:09:30.591482 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ce19975f-de37-4c9e-b3ae-09323b8b57c7 tempest-TaggedBootDevicesTest_v242-429285116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c8df8ae-0e13-4798-9e76-79b1d795977a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:09:30.609208 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-4bee146c-3ff1-48d4-822c-f7520d35b93d tempest-ServersNegativeTestJSON-1285629641 None] Deleted volume successfully. Apr 09 21:09:30.621856 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ce19975f-de37-4c9e-b3ae-09323b8b57c7 tempest-TaggedBootDevicesTest_v242-429285116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c8df8ae-0e13-4798-9e76-79b1d795977a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1681659957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b029c091-ed41-4629-909c-273feb0867db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60eee2c55ed842f78ac0fa9e1b400fbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:09:30Z,use_quota=True,user_id='e2b92cb8d21d42eea56146d7935a74e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:09:30.635926 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ce19975f-de37-4c9e-b3ae-09323b8b57c7 tempest-TaggedBootDevicesTest_v242-429285116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603fd228-7ac9-4d85-b1eb-3d9da1bd9876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:09:30.642361 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ce19975f-de37-4c9e-b3ae-09323b8b57c7 tempest-TaggedBootDevicesTest_v242-429285116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603fd228-7ac9-4d85-b1eb-3d9da1bd9876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:09:30.652846 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ce19975f-de37-4c9e-b3ae-09323b8b57c7 tempest-TaggedBootDevicesTest_v242-429285116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eb54929-e7b0-4ad5-8bb1-ebaad1b2b5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:09:30.695095 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ce19975f-de37-4c9e-b3ae-09323b8b57c7 tempest-TaggedBootDevicesTest_v242-429285116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eb54929-e7b0-4ad5-8bb1-ebaad1b2b5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b029c091-ed41-4629-909c-273feb0867db', 'volume_name': 'volume-b029c091-ed41-4629-909c-273feb0867db', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:09:30.724544 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ce19975f-de37-4c9e-b3ae-09323b8b57c7 tempest-TaggedBootDevicesTest_v242-429285116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a92c4e2-976c-40fe-a9df-9c19e9706372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:09:30.743931 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ce19975f-de37-4c9e-b3ae-09323b8b57c7 tempest-TaggedBootDevicesTest_v242-429285116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a92c4e2-976c-40fe-a9df-9c19e9706372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:09:30.758489 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ce19975f-de37-4c9e-b3ae-09323b8b57c7 tempest-TaggedBootDevicesTest_v242-429285116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ee5fdfc-d5f4-41a8-a51c-656d246012f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:09:30.774946 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-ce19975f-de37-4c9e-b3ae-09323b8b57c7 tempest-TaggedBootDevicesTest_v242-429285116 None] Volume b029c091-ed41-4629-909c-273feb0867db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b029c091-ed41-4629-909c-273feb0867db', 'volume_size': 1} Apr 09 21:09:30.775747 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ce19975f-de37-4c9e-b3ae-09323b8b57c7 tempest-TaggedBootDevicesTest_v242-429285116 None] creating volume 'volume-b029c091-ed41-4629-909c-273feb0867db' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:09:30.776452 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ce19975f-de37-4c9e-b3ae-09323b8b57c7 tempest-TaggedBootDevicesTest_v242-429285116 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:09:30.941384 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-3b58e46b-b287-424c-919a-1e8cafa43895 tempest-ServersNegativeTestJSON-1285629641 None] Lock "b'cinder-9612699b-0256-46d7-9683-7562f3c0f614-delete_volume'" acquired by "delete_volume" :: waited 0.027s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:09:30.965686 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ce19975f-de37-4c9e-b3ae-09323b8b57c7 tempest-TaggedBootDevicesTest_v242-429285116 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:09:30.967443 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ce19975f-de37-4c9e-b3ae-09323b8b57c7 tempest-TaggedBootDevicesTest_v242-429285116 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:09:30.990509 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ce19975f-de37-4c9e-b3ae-09323b8b57c7 tempest-TaggedBootDevicesTest_v242-429285116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ee5fdfc-d5f4-41a8-a51c-656d246012f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b029c091-ed41-4629-909c-273feb0867db', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:09:30.998286 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ce19975f-de37-4c9e-b3ae-09323b8b57c7 tempest-TaggedBootDevicesTest_v242-429285116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c59a700-0530-4d09-b850-3ca2fffcc1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:09:31.004884 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-4bee146c-3ff1-48d4-822c-f7520d35b93d tempest-ServersNegativeTestJSON-1285629641 None] Lock "b'cinder-79325784-0b89-4f9d-b167-92b7b7ce911a-delete_volume'" released by "delete_volume" :: held 1.485s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:09:31.021290 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-ce19975f-de37-4c9e-b3ae-09323b8b57c7 tempest-TaggedBootDevicesTest_v242-429285116 None] Volume volume-b029c091-ed41-4629-909c-273feb0867db (b029c091-ed41-4629-909c-273feb0867db): created successfully Apr 09 21:09:31.025686 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ce19975f-de37-4c9e-b3ae-09323b8b57c7 tempest-TaggedBootDevicesTest_v242-429285116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c59a700-0530-4d09-b850-3ca2fffcc1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:09:31.032147 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ce19975f-de37-4c9e-b3ae-09323b8b57c7 tempest-TaggedBootDevicesTest_v242-429285116 None] Flow 'volume_create_manager' (14d4a211-25e6-428f-82e1-3c794e89aafe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:09:31.053728 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-3b58e46b-b287-424c-919a-1e8cafa43895 tempest-ServersNegativeTestJSON-1285629641 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:09:31.158184 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-3b58e46b-b287-424c-919a-1e8cafa43895 tempest-ServersNegativeTestJSON-1285629641 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:09:31.158635 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-3b58e46b-b287-424c-919a-1e8cafa43895 tempest-ServersNegativeTestJSON-1285629641 None] Volume volume-9612699b-0256-46d7-9683-7562f3c0f614 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:09:31.172432 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-3b58e46b-b287-424c-919a-1e8cafa43895 tempest-ServersNegativeTestJSON-1285629641 None] deleting rbd volume volume-9612699b-0256-46d7-9683-7562f3c0f614 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:09:31.180806 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-ce19975f-de37-4c9e-b3ae-09323b8b57c7 tempest-TaggedBootDevicesTest_v242-429285116 None] Created volume successfully. Apr 09 21:09:31.811483 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-3b58e46b-b287-424c-919a-1e8cafa43895 tempest-ServersNegativeTestJSON-1285629641 None] Created reservations ['202a274e-a2b6-4c27-9c59-5b44d114d844', '6abda3dc-1084-4bd8-a06f-0f2c03a0cbcc', '59290779-d9bd-4976-9d7e-4cd214f0098f', '4b7b6b58-70f6-4f2a-ab55-b74ecfa0cdca'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:09:31.937682 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-3b58e46b-b287-424c-919a-1e8cafa43895 tempest-ServersNegativeTestJSON-1285629641 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:09:32.043950 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-3b58e46b-b287-424c-919a-1e8cafa43895 tempest-ServersNegativeTestJSON-1285629641 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:09:32.118300 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-3b58e46b-b287-424c-919a-1e8cafa43895 tempest-ServersNegativeTestJSON-1285629641 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:09:32.122967 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-3b58e46b-b287-424c-919a-1e8cafa43895 tempest-ServersNegativeTestJSON-1285629641 None] Deleted volume successfully. Apr 09 21:09:32.144439 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-3b58e46b-b287-424c-919a-1e8cafa43895 tempest-ServersNegativeTestJSON-1285629641 None] Lock "b'cinder-9612699b-0256-46d7-9683-7562f3c0f614-delete_volume'" released by "delete_volume" :: held 1.205s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:09:32.205656 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e2e0330-45ba-4ba3-819f-e2fd13e8c749 tempest-TaggedBootDevicesTest_v242-429285116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:09:32.271860 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8e2e0330-45ba-4ba3-819f-e2fd13e8c749 tempest-TaggedBootDevicesTest_v242-429285116 None] Flow 'volume_create_manager' (d1185877-c7a7-4079-be6e-b4324f3a662c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:09:32.312994 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8e2e0330-45ba-4ba3-819f-e2fd13e8c749 tempest-TaggedBootDevicesTest_v242-429285116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005821d4-97ba-4bbf-8735-17c988b4dd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:09:32.347680 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8e2e0330-45ba-4ba3-819f-e2fd13e8c749 tempest-TaggedBootDevicesTest_v242-429285116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005821d4-97ba-4bbf-8735-17c988b4dd25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-389202613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=62419bbe-a53e-46ce-b201-23fb7182945c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60eee2c55ed842f78ac0fa9e1b400fbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:09:32Z,use_quota=True,user_id='e2b92cb8d21d42eea56146d7935a74e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:09:32.353983 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8e2e0330-45ba-4ba3-819f-e2fd13e8c749 tempest-TaggedBootDevicesTest_v242-429285116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ac9197-e531-4490-a214-a202c29384ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:09:32.367814 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8e2e0330-45ba-4ba3-819f-e2fd13e8c749 tempest-TaggedBootDevicesTest_v242-429285116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ac9197-e531-4490-a214-a202c29384ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:09:32.376324 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8e2e0330-45ba-4ba3-819f-e2fd13e8c749 tempest-TaggedBootDevicesTest_v242-429285116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6183a7e-968f-48cc-8252-ad9153bc2aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:09:32.390861 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8e2e0330-45ba-4ba3-819f-e2fd13e8c749 tempest-TaggedBootDevicesTest_v242-429285116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6183a7e-968f-48cc-8252-ad9153bc2aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62419bbe-a53e-46ce-b201-23fb7182945c', 'volume_name': 'volume-62419bbe-a53e-46ce-b201-23fb7182945c', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:09:32.396692 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8e2e0330-45ba-4ba3-819f-e2fd13e8c749 tempest-TaggedBootDevicesTest_v242-429285116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1329f51f-6187-475a-bcbb-ff9e5f9dcbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:09:32.401561 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8e2e0330-45ba-4ba3-819f-e2fd13e8c749 tempest-TaggedBootDevicesTest_v242-429285116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1329f51f-6187-475a-bcbb-ff9e5f9dcbf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:09:32.408096 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8e2e0330-45ba-4ba3-819f-e2fd13e8c749 tempest-TaggedBootDevicesTest_v242-429285116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cda79c1-9adc-4e63-8b3e-0a00230efc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:09:32.413924 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-8e2e0330-45ba-4ba3-819f-e2fd13e8c749 tempest-TaggedBootDevicesTest_v242-429285116 None] Volume 62419bbe-a53e-46ce-b201-23fb7182945c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62419bbe-a53e-46ce-b201-23fb7182945c', 'volume_size': 1} Apr 09 21:09:32.414571 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-8e2e0330-45ba-4ba3-819f-e2fd13e8c749 tempest-TaggedBootDevicesTest_v242-429285116 None] creating volume 'volume-62419bbe-a53e-46ce-b201-23fb7182945c' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:09:32.416033 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-8e2e0330-45ba-4ba3-819f-e2fd13e8c749 tempest-TaggedBootDevicesTest_v242-429285116 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:09:32.526172 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-8e2e0330-45ba-4ba3-819f-e2fd13e8c749 tempest-TaggedBootDevicesTest_v242-429285116 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:09:32.526948 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-8e2e0330-45ba-4ba3-819f-e2fd13e8c749 tempest-TaggedBootDevicesTest_v242-429285116 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:09:32.532530 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8e2e0330-45ba-4ba3-819f-e2fd13e8c749 tempest-TaggedBootDevicesTest_v242-429285116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cda79c1-9adc-4e63-8b3e-0a00230efc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62419bbe-a53e-46ce-b201-23fb7182945c', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:09:32.538519 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8e2e0330-45ba-4ba3-819f-e2fd13e8c749 tempest-TaggedBootDevicesTest_v242-429285116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4058d7e6-b564-4462-afd9-7d122bf06556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:09:32.551390 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-8e2e0330-45ba-4ba3-819f-e2fd13e8c749 tempest-TaggedBootDevicesTest_v242-429285116 None] Volume volume-62419bbe-a53e-46ce-b201-23fb7182945c (62419bbe-a53e-46ce-b201-23fb7182945c): created successfully Apr 09 21:09:32.556498 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8e2e0330-45ba-4ba3-819f-e2fd13e8c749 tempest-TaggedBootDevicesTest_v242-429285116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4058d7e6-b564-4462-afd9-7d122bf06556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:09:32.564656 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8e2e0330-45ba-4ba3-819f-e2fd13e8c749 tempest-TaggedBootDevicesTest_v242-429285116 None] Flow 'volume_create_manager' (d1185877-c7a7-4079-be6e-b4324f3a662c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:09:32.589225 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-8e2e0330-45ba-4ba3-819f-e2fd13e8c749 tempest-TaggedBootDevicesTest_v242-429285116 None] Created volume successfully. Apr 09 21:09:49.619297 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:09:49.620052 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:09:49.702000 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:09:49.780396 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:09:52.195621 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-7b858938-9956-4e9b-aeae-4bb8f6997fa5 req-98a0fd64-aff0-4ca4-bfc8-d3097f662d96 tempest-TaggedBootDevicesTest_v242-429285116 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:09:53.005675 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-7b858938-9956-4e9b-aeae-4bb8f6997fa5 req-98a0fd64-aff0-4ca4-bfc8-d3097f662d96 tempest-TaggedBootDevicesTest_v242-429285116 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.809s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:09:53.006806 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-7b858938-9956-4e9b-aeae-4bb8f6997fa5 req-98a0fd64-aff0-4ca4-bfc8-d3097f662d96 tempest-TaggedBootDevicesTest_v242-429285116 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-bbcf93e0-b776-46ad-9196-c4638c713502', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': 'bbcf93e0-b776-46ad-9196-c4638c713502', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:09:53.050535 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-7b858938-9956-4e9b-aeae-4bb8f6997fa5 req-98a0fd64-aff0-4ca4-bfc8-d3097f662d96 tempest-TaggedBootDevicesTest_v242-429285116 None] Connection info returned from driver {'name': 'volumes/volume-bbcf93e0-b776-46ad-9196-c4638c713502', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'bbcf93e0-b776-46ad-9196-c4638c713502', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b514c2d3-d924-4399-a0ba-547481bde82f'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 21:09:53.136058 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-7b858938-9956-4e9b-aeae-4bb8f6997fa5 req-98a0fd64-aff0-4ca4-bfc8-d3097f662d96 tempest-TaggedBootDevicesTest_v242-429285116 None] attachment_update completed successfully. Apr 09 21:09:53.555084 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-7b858938-9956-4e9b-aeae-4bb8f6997fa5 req-fbe17c53-d981-4e61-ac48-46e63e762ffe tempest-TaggedBootDevicesTest_v242-429285116 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:09:54.610579 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-7b858938-9956-4e9b-aeae-4bb8f6997fa5 req-fbe17c53-d981-4e61-ac48-46e63e762ffe tempest-TaggedBootDevicesTest_v242-429285116 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.055s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:09:54.613432 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-7b858938-9956-4e9b-aeae-4bb8f6997fa5 req-fbe17c53-d981-4e61-ac48-46e63e762ffe tempest-TaggedBootDevicesTest_v242-429285116 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b029c091-ed41-4629-909c-273feb0867db', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': 'b029c091-ed41-4629-909c-273feb0867db', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:09:54.654907 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-7b858938-9956-4e9b-aeae-4bb8f6997fa5 req-fbe17c53-d981-4e61-ac48-46e63e762ffe tempest-TaggedBootDevicesTest_v242-429285116 None] Connection info returned from driver {'name': 'volumes/volume-b029c091-ed41-4629-909c-273feb0867db', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b029c091-ed41-4629-909c-273feb0867db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'de452355-6246-496f-9604-ae8a67cab89d'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 21:09:54.758345 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-7b858938-9956-4e9b-aeae-4bb8f6997fa5 req-fbe17c53-d981-4e61-ac48-46e63e762ffe tempest-TaggedBootDevicesTest_v242-429285116 None] attachment_update completed successfully. Apr 09 21:09:55.223666 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-7b858938-9956-4e9b-aeae-4bb8f6997fa5 req-5fd94cd3-712b-4ab8-86d9-4df4f02ebeb3 tempest-TaggedBootDevicesTest_v242-429285116 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:09:56.684902 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-7b858938-9956-4e9b-aeae-4bb8f6997fa5 req-5fd94cd3-712b-4ab8-86d9-4df4f02ebeb3 tempest-TaggedBootDevicesTest_v242-429285116 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.461s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:09:56.690011 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-7b858938-9956-4e9b-aeae-4bb8f6997fa5 req-5fd94cd3-712b-4ab8-86d9-4df4f02ebeb3 tempest-TaggedBootDevicesTest_v242-429285116 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-62419bbe-a53e-46ce-b201-23fb7182945c', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': '62419bbe-a53e-46ce-b201-23fb7182945c', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:09:56.722311 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-7b858938-9956-4e9b-aeae-4bb8f6997fa5 req-5fd94cd3-712b-4ab8-86d9-4df4f02ebeb3 tempest-TaggedBootDevicesTest_v242-429285116 None] Connection info returned from driver {'name': 'volumes/volume-62419bbe-a53e-46ce-b201-23fb7182945c', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '62419bbe-a53e-46ce-b201-23fb7182945c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '75220b00-d03c-41dc-8233-5cae456c67cd'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 21:09:56.892620 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-7b858938-9956-4e9b-aeae-4bb8f6997fa5 req-5fd94cd3-712b-4ab8-86d9-4df4f02ebeb3 tempest-TaggedBootDevicesTest_v242-429285116 None] attachment_update completed successfully. Apr 09 21:09:56.922586 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b57de5a-8e24-4778-b7c9-58628f98ad3b tempest-ServerRescueNegativeTestJSON-1017505455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:09:56.959218 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b57de5a-8e24-4778-b7c9-58628f98ad3b tempest-ServerRescueNegativeTestJSON-1017505455 None] Flow 'volume_create_manager' (bb31c78d-fa5d-43b9-8c10-5ba87b7f7090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:09:56.969449 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b57de5a-8e24-4778-b7c9-58628f98ad3b tempest-ServerRescueNegativeTestJSON-1017505455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08b5ed88-c10d-4fbe-acef-2d81152ece96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:09:57.041447 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b57de5a-8e24-4778-b7c9-58628f98ad3b tempest-ServerRescueNegativeTestJSON-1017505455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08b5ed88-c10d-4fbe-acef-2d81152ece96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1485977940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=08e25379-e4c4-487a-824c-200bb454843f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d475c8fbc1f74285a1c98fd75bd109f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:09:57Z,use_quota=True,user_id='2abb09d2f7844f3ba0f7a20787d73e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:09:57.050179 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b57de5a-8e24-4778-b7c9-58628f98ad3b tempest-ServerRescueNegativeTestJSON-1017505455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d84aee6-d004-4fc2-b7d3-a38a2b08df16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:09:57.070423 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b57de5a-8e24-4778-b7c9-58628f98ad3b tempest-ServerRescueNegativeTestJSON-1017505455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d84aee6-d004-4fc2-b7d3-a38a2b08df16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:09:57.083209 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b57de5a-8e24-4778-b7c9-58628f98ad3b tempest-ServerRescueNegativeTestJSON-1017505455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a76e45a-fb44-49b5-86ea-1eb1e773f5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:09:57.096923 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b57de5a-8e24-4778-b7c9-58628f98ad3b tempest-ServerRescueNegativeTestJSON-1017505455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a76e45a-fb44-49b5-86ea-1eb1e773f5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08e25379-e4c4-487a-824c-200bb454843f', 'volume_name': 'volume-08e25379-e4c4-487a-824c-200bb454843f', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:09:57.103417 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b57de5a-8e24-4778-b7c9-58628f98ad3b tempest-ServerRescueNegativeTestJSON-1017505455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd289364-bfa4-4cfc-9d6e-f1710ae74898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:09:57.115937 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b57de5a-8e24-4778-b7c9-58628f98ad3b tempest-ServerRescueNegativeTestJSON-1017505455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd289364-bfa4-4cfc-9d6e-f1710ae74898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:09:57.128730 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b57de5a-8e24-4778-b7c9-58628f98ad3b tempest-ServerRescueNegativeTestJSON-1017505455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3428f036-8c90-447f-ab73-a84766461954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:09:57.130497 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-5b57de5a-8e24-4778-b7c9-58628f98ad3b tempest-ServerRescueNegativeTestJSON-1017505455 None] Volume 08e25379-e4c4-487a-824c-200bb454843f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08e25379-e4c4-487a-824c-200bb454843f', 'volume_size': 1} Apr 09 21:09:57.131064 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5b57de5a-8e24-4778-b7c9-58628f98ad3b tempest-ServerRescueNegativeTestJSON-1017505455 None] creating volume 'volume-08e25379-e4c4-487a-824c-200bb454843f' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:09:57.133252 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5b57de5a-8e24-4778-b7c9-58628f98ad3b tempest-ServerRescueNegativeTestJSON-1017505455 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:09:57.273812 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5b57de5a-8e24-4778-b7c9-58628f98ad3b tempest-ServerRescueNegativeTestJSON-1017505455 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:09:57.274364 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5b57de5a-8e24-4778-b7c9-58628f98ad3b tempest-ServerRescueNegativeTestJSON-1017505455 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:09:57.278530 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b57de5a-8e24-4778-b7c9-58628f98ad3b tempest-ServerRescueNegativeTestJSON-1017505455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3428f036-8c90-447f-ab73-a84766461954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08e25379-e4c4-487a-824c-200bb454843f', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:09:57.286514 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b57de5a-8e24-4778-b7c9-58628f98ad3b tempest-ServerRescueNegativeTestJSON-1017505455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edbd66b6-26ef-489d-8521-a701ee6b6040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:09:57.303756 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-5b57de5a-8e24-4778-b7c9-58628f98ad3b tempest-ServerRescueNegativeTestJSON-1017505455 None] Volume volume-08e25379-e4c4-487a-824c-200bb454843f (08e25379-e4c4-487a-824c-200bb454843f): created successfully Apr 09 21:09:57.309883 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b57de5a-8e24-4778-b7c9-58628f98ad3b tempest-ServerRescueNegativeTestJSON-1017505455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edbd66b6-26ef-489d-8521-a701ee6b6040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:09:57.316762 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b57de5a-8e24-4778-b7c9-58628f98ad3b tempest-ServerRescueNegativeTestJSON-1017505455 None] Flow 'volume_create_manager' (bb31c78d-fa5d-43b9-8c10-5ba87b7f7090) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:09:57.333548 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-5b57de5a-8e24-4778-b7c9-58628f98ad3b tempest-ServerRescueNegativeTestJSON-1017505455 None] Created volume successfully. Apr 09 21:10:26.333281 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-da880ffa-f85c-4f65-b705-7d60a55fbb7c tempest-ServerRescueNegativeTestJSON-1017505455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:10:26.395774 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-da880ffa-f85c-4f65-b705-7d60a55fbb7c tempest-ServerRescueNegativeTestJSON-1017505455 None] Flow 'volume_create_manager' (76f63cba-7113-4bc8-a35e-39399b46ebbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:10:26.416784 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-da880ffa-f85c-4f65-b705-7d60a55fbb7c tempest-ServerRescueNegativeTestJSON-1017505455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (312b9155-e8c9-48ac-aedc-4f54b3e60cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:10:26.446209 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-da880ffa-f85c-4f65-b705-7d60a55fbb7c tempest-ServerRescueNegativeTestJSON-1017505455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (312b9155-e8c9-48ac-aedc-4f54b3e60cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1050688692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4b07460f-352b-42de-aaa6-13f4befc338a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d475c8fbc1f74285a1c98fd75bd109f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:10:26Z,use_quota=True,user_id='2abb09d2f7844f3ba0f7a20787d73e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:10:26.452743 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-da880ffa-f85c-4f65-b705-7d60a55fbb7c tempest-ServerRescueNegativeTestJSON-1017505455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (419de742-54dc-4f1d-a5e1-0aba0ea9d562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:10:26.459984 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-da880ffa-f85c-4f65-b705-7d60a55fbb7c tempest-ServerRescueNegativeTestJSON-1017505455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (419de742-54dc-4f1d-a5e1-0aba0ea9d562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:10:26.465857 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-da880ffa-f85c-4f65-b705-7d60a55fbb7c tempest-ServerRescueNegativeTestJSON-1017505455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (080505bc-8285-47d6-b873-f1cab3c94a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:10:26.471170 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-da880ffa-f85c-4f65-b705-7d60a55fbb7c tempest-ServerRescueNegativeTestJSON-1017505455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (080505bc-8285-47d6-b873-f1cab3c94a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b07460f-352b-42de-aaa6-13f4befc338a', 'volume_name': 'volume-4b07460f-352b-42de-aaa6-13f4befc338a', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:10:26.476829 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-da880ffa-f85c-4f65-b705-7d60a55fbb7c tempest-ServerRescueNegativeTestJSON-1017505455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b823c37-0351-4c55-8f35-ba81306d1db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:10:26.481236 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-da880ffa-f85c-4f65-b705-7d60a55fbb7c tempest-ServerRescueNegativeTestJSON-1017505455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b823c37-0351-4c55-8f35-ba81306d1db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:10:26.486738 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-da880ffa-f85c-4f65-b705-7d60a55fbb7c tempest-ServerRescueNegativeTestJSON-1017505455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fba9f13f-b7e6-4116-a8fb-638666b5a7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:10:26.488044 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-da880ffa-f85c-4f65-b705-7d60a55fbb7c tempest-ServerRescueNegativeTestJSON-1017505455 None] Volume 4b07460f-352b-42de-aaa6-13f4befc338a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b07460f-352b-42de-aaa6-13f4befc338a', 'volume_size': 1} Apr 09 21:10:26.488595 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-da880ffa-f85c-4f65-b705-7d60a55fbb7c tempest-ServerRescueNegativeTestJSON-1017505455 None] creating volume 'volume-4b07460f-352b-42de-aaa6-13f4befc338a' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:10:26.489454 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-da880ffa-f85c-4f65-b705-7d60a55fbb7c tempest-ServerRescueNegativeTestJSON-1017505455 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:10:26.597440 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-da880ffa-f85c-4f65-b705-7d60a55fbb7c tempest-ServerRescueNegativeTestJSON-1017505455 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:10:26.598055 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-da880ffa-f85c-4f65-b705-7d60a55fbb7c tempest-ServerRescueNegativeTestJSON-1017505455 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:10:26.603696 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-da880ffa-f85c-4f65-b705-7d60a55fbb7c tempest-ServerRescueNegativeTestJSON-1017505455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fba9f13f-b7e6-4116-a8fb-638666b5a7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b07460f-352b-42de-aaa6-13f4befc338a', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:10:26.613517 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-da880ffa-f85c-4f65-b705-7d60a55fbb7c tempest-ServerRescueNegativeTestJSON-1017505455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb3713ed-2eb1-407d-84fa-a29f3714250c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:10:26.630445 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-da880ffa-f85c-4f65-b705-7d60a55fbb7c tempest-ServerRescueNegativeTestJSON-1017505455 None] Volume volume-4b07460f-352b-42de-aaa6-13f4befc338a (4b07460f-352b-42de-aaa6-13f4befc338a): created successfully Apr 09 21:10:26.634607 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-da880ffa-f85c-4f65-b705-7d60a55fbb7c tempest-ServerRescueNegativeTestJSON-1017505455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb3713ed-2eb1-407d-84fa-a29f3714250c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:10:26.650475 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-da880ffa-f85c-4f65-b705-7d60a55fbb7c tempest-ServerRescueNegativeTestJSON-1017505455 None] Flow 'volume_create_manager' (76f63cba-7113-4bc8-a35e-39399b46ebbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:10:26.672936 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-da880ffa-f85c-4f65-b705-7d60a55fbb7c tempest-ServerRescueNegativeTestJSON-1017505455 None] Created volume successfully. Apr 09 21:10:42.229371 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-a273c050-8ba4-4117-8182-bcc3873a3e71 tempest-AttachVolumeShelveTestJSON-1751174024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:10:42.271786 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a273c050-8ba4-4117-8182-bcc3873a3e71 tempest-AttachVolumeShelveTestJSON-1751174024 None] Flow 'volume_create_manager' (4b39d209-85bd-45c7-930a-a2b1a80afe08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:10:42.287030 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a273c050-8ba4-4117-8182-bcc3873a3e71 tempest-AttachVolumeShelveTestJSON-1751174024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (632fad8f-7d7b-4b3a-854e-4469e33b1dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:10:42.305659 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a273c050-8ba4-4117-8182-bcc3873a3e71 tempest-AttachVolumeShelveTestJSON-1751174024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (632fad8f-7d7b-4b3a-854e-4469e33b1dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-359584938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2c7031ef-4247-461a-a5ca-e53470449307,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a1102e4f4e441b947116441b3e330d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:10:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:10:42Z,use_quota=True,user_id='f2809b3bcbea4d2eb9ab6b360669fc67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:10:42.312338 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a273c050-8ba4-4117-8182-bcc3873a3e71 tempest-AttachVolumeShelveTestJSON-1751174024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f2ce19-18ab-477d-a07f-bfd4a8d0c57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:10:42.316972 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a273c050-8ba4-4117-8182-bcc3873a3e71 tempest-AttachVolumeShelveTestJSON-1751174024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f2ce19-18ab-477d-a07f-bfd4a8d0c57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:10:42.323723 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a273c050-8ba4-4117-8182-bcc3873a3e71 tempest-AttachVolumeShelveTestJSON-1751174024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e111f0e2-50fe-4844-a0ff-72d7765ee660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:10:42.329099 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a273c050-8ba4-4117-8182-bcc3873a3e71 tempest-AttachVolumeShelveTestJSON-1751174024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e111f0e2-50fe-4844-a0ff-72d7765ee660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c7031ef-4247-461a-a5ca-e53470449307', 'volume_name': 'volume-2c7031ef-4247-461a-a5ca-e53470449307', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:10:42.334917 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a273c050-8ba4-4117-8182-bcc3873a3e71 tempest-AttachVolumeShelveTestJSON-1751174024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c8af035-a08f-44cd-b253-d79f72cf04be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:10:42.339799 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a273c050-8ba4-4117-8182-bcc3873a3e71 tempest-AttachVolumeShelveTestJSON-1751174024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c8af035-a08f-44cd-b253-d79f72cf04be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:10:42.346207 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a273c050-8ba4-4117-8182-bcc3873a3e71 tempest-AttachVolumeShelveTestJSON-1751174024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05bde945-f50f-4b39-b568-bc649db4e773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:10:42.349642 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-a273c050-8ba4-4117-8182-bcc3873a3e71 tempest-AttachVolumeShelveTestJSON-1751174024 None] Volume 2c7031ef-4247-461a-a5ca-e53470449307: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c7031ef-4247-461a-a5ca-e53470449307', 'volume_size': 1} Apr 09 21:10:42.350251 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a273c050-8ba4-4117-8182-bcc3873a3e71 tempest-AttachVolumeShelveTestJSON-1751174024 None] creating volume 'volume-2c7031ef-4247-461a-a5ca-e53470449307' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:10:42.351160 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a273c050-8ba4-4117-8182-bcc3873a3e71 tempest-AttachVolumeShelveTestJSON-1751174024 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:10:42.502340 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a273c050-8ba4-4117-8182-bcc3873a3e71 tempest-AttachVolumeShelveTestJSON-1751174024 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:10:42.502705 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a273c050-8ba4-4117-8182-bcc3873a3e71 tempest-AttachVolumeShelveTestJSON-1751174024 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:10:42.517254 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a273c050-8ba4-4117-8182-bcc3873a3e71 tempest-AttachVolumeShelveTestJSON-1751174024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05bde945-f50f-4b39-b568-bc649db4e773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c7031ef-4247-461a-a5ca-e53470449307', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:10:42.523044 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a273c050-8ba4-4117-8182-bcc3873a3e71 tempest-AttachVolumeShelveTestJSON-1751174024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92d7523f-d94b-4078-a61b-8e15228e40eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:10:42.553427 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-a273c050-8ba4-4117-8182-bcc3873a3e71 tempest-AttachVolumeShelveTestJSON-1751174024 None] Volume volume-2c7031ef-4247-461a-a5ca-e53470449307 (2c7031ef-4247-461a-a5ca-e53470449307): created successfully Apr 09 21:10:42.564062 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a273c050-8ba4-4117-8182-bcc3873a3e71 tempest-AttachVolumeShelveTestJSON-1751174024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92d7523f-d94b-4078-a61b-8e15228e40eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:10:42.578860 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a273c050-8ba4-4117-8182-bcc3873a3e71 tempest-AttachVolumeShelveTestJSON-1751174024 None] Flow 'volume_create_manager' (4b39d209-85bd-45c7-930a-a2b1a80afe08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:10:42.605153 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-a273c050-8ba4-4117-8182-bcc3873a3e71 tempest-AttachVolumeShelveTestJSON-1751174024 None] Created volume successfully. Apr 09 21:10:43.803411 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-276d33a9-b24b-4b4c-ae81-d104e23ddcd5 tempest-GroupSnapshotsTest-1479474221 None] Group tempest-GroupSnapshotsTest-Group-137443903: creating Apr 09 21:10:43.856541 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-276d33a9-b24b-4b4c-ae81-d104e23ddcd5 tempest-GroupSnapshotsTest-1479474221 None] Group tempest-GroupSnapshotsTest-Group-137443903: created successfully Apr 09 21:10:43.883871 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-276d33a9-b24b-4b4c-ae81-d104e23ddcd5 tempest-GroupSnapshotsTest-1479474221 None] Create group completed successfully. Apr 09 21:10:45.390138 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9a5560b-7326-4ea2-abd3-f84b7325139e tempest-GroupSnapshotsTest-1479474221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:10:45.409501 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d9a5560b-7326-4ea2-abd3-f84b7325139e tempest-GroupSnapshotsTest-1479474221 None] Flow 'volume_create_manager' (4c0fedfb-e06c-4e2f-92a7-7fa9e0303aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:10:45.416115 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d9a5560b-7326-4ea2-abd3-f84b7325139e tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (202dd9b7-64b3-4d5c-9a0d-5d6197f844bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:10:45.431306 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d9a5560b-7326-4ea2-abd3-f84b7325139e tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (202dd9b7-64b3-4d5c-9a0d-5d6197f844bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:10:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-294218446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=06ffdddb-92fa-4d76-9343-08212bec5fe7,host='ncdv-master-1@ceph#ceph',id=68dd5c30-faf2-4306-b13b-492dabff5452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72cf766836c4811b624170c75eb7387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:10:45Z,use_quota=True,user_id='8a6f9e9ae0f7454db191ce65b69ad39b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e766b713-3afd-4192-94ec-096a195365c2),volume_type_id=e766b713-3afd-4192-94ec-096a195365c2)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:10:45.442884 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d9a5560b-7326-4ea2-abd3-f84b7325139e tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d03e2aa-26c8-4a92-9c37-84aae514c971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:10:45.452431 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d9a5560b-7326-4ea2-abd3-f84b7325139e tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d03e2aa-26c8-4a92-9c37-84aae514c971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:10:45.457919 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d9a5560b-7326-4ea2-abd3-f84b7325139e tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1209c8db-a9dd-4daa-a5d3-eaaf4ea39561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:10:45.462346 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d9a5560b-7326-4ea2-abd3-f84b7325139e tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1209c8db-a9dd-4daa-a5d3-eaaf4ea39561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68dd5c30-faf2-4306-b13b-492dabff5452', 'volume_name': 'volume-68dd5c30-faf2-4306-b13b-492dabff5452', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:10:45.467314 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d9a5560b-7326-4ea2-abd3-f84b7325139e tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17a2d518-ff02-4483-83b7-0008a60de110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:10:45.471365 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d9a5560b-7326-4ea2-abd3-f84b7325139e tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17a2d518-ff02-4483-83b7-0008a60de110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:10:45.476898 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d9a5560b-7326-4ea2-abd3-f84b7325139e tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25c99510-2c9f-4455-b661-1235ffedf9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:10:45.477790 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-d9a5560b-7326-4ea2-abd3-f84b7325139e tempest-GroupSnapshotsTest-1479474221 None] Volume 68dd5c30-faf2-4306-b13b-492dabff5452: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68dd5c30-faf2-4306-b13b-492dabff5452', 'volume_size': 1} Apr 09 21:10:45.478182 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d9a5560b-7326-4ea2-abd3-f84b7325139e tempest-GroupSnapshotsTest-1479474221 None] creating volume 'volume-68dd5c30-faf2-4306-b13b-492dabff5452' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:10:45.479059 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d9a5560b-7326-4ea2-abd3-f84b7325139e tempest-GroupSnapshotsTest-1479474221 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:10:45.552430 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d9a5560b-7326-4ea2-abd3-f84b7325139e tempest-GroupSnapshotsTest-1479474221 None] extra_specs: {} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:10:45.552846 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d9a5560b-7326-4ea2-abd3-f84b7325139e tempest-GroupSnapshotsTest-1479474221 None] extra_specs: {} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:10:45.556913 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d9a5560b-7326-4ea2-abd3-f84b7325139e tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25c99510-2c9f-4455-b661-1235ffedf9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68dd5c30-faf2-4306-b13b-492dabff5452', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:10:45.563772 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d9a5560b-7326-4ea2-abd3-f84b7325139e tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b632b22c-b849-4d93-bcaa-e18046a56989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:10:45.578560 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-d9a5560b-7326-4ea2-abd3-f84b7325139e tempest-GroupSnapshotsTest-1479474221 None] Volume volume-68dd5c30-faf2-4306-b13b-492dabff5452 (68dd5c30-faf2-4306-b13b-492dabff5452): created successfully Apr 09 21:10:45.582429 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d9a5560b-7326-4ea2-abd3-f84b7325139e tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b632b22c-b849-4d93-bcaa-e18046a56989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:10:45.588610 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d9a5560b-7326-4ea2-abd3-f84b7325139e tempest-GroupSnapshotsTest-1479474221 None] Flow 'volume_create_manager' (4c0fedfb-e06c-4e2f-92a7-7fa9e0303aaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:10:45.599404 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-d9a5560b-7326-4ea2-abd3-f84b7325139e tempest-GroupSnapshotsTest-1479474221 None] Created volume successfully. Apr 09 21:10:46.860817 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-a044a211-e451-4b5f-aed8-a4884252091f tempest-GroupSnapshotsTest-1479474221 None] GroupSnapshot a61b642c-066d-4b9f-b84c-45ab070e0dab: creating. Apr 09 21:10:46.899511 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a044a211-e451-4b5f-aed8-a4884252091f tempest-GroupSnapshotsTest-1479474221 None] Group snapshot a61b642c-066d-4b9f-b84c-45ab070e0dab: creating. {{(pid=135002) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4076}} Apr 09 21:10:46.914779 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a044a211-e451-4b5f-aed8-a4884252091f tempest-GroupSnapshotsTest-1479474221 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:10:47.964267 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-a044a211-e451-4b5f-aed8-a4884252091f tempest-GroupSnapshotsTest-1479474221 None] group_snapshot a61b642c-066d-4b9f-b84c-45ab070e0dab: created successfully Apr 09 21:10:48.861803 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-4a65e536-8219-4d52-9666-8967b2dbc0f0 tempest-GroupSnapshotsTest-1479474221 None] cloning volumes/volume-68dd5c30-faf2-4306-b13b-492dabff5452@snapshot-5aaf569f-792d-4cdd-a19a-6aaf1e563150 to volume-3b1a7c6d-8a61-4e96-b9f8-0ab35306ddf6 {{(pid=135002) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1090}} Apr 09 21:10:48.862698 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-4a65e536-8219-4d52-9666-8967b2dbc0f0 tempest-GroupSnapshotsTest-1479474221 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:10:48.948735 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-4a65e536-8219-4d52-9666-8967b2dbc0f0 tempest-GroupSnapshotsTest-1479474221 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:10:49.100929 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-4a65e536-8219-4d52-9666-8967b2dbc0f0 tempest-GroupSnapshotsTest-1479474221 None] extra_specs: {} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:10:49.101589 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-4a65e536-8219-4d52-9666-8967b2dbc0f0 tempest-GroupSnapshotsTest-1479474221 None] extra_specs: {} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:10:49.105713 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-4a65e536-8219-4d52-9666-8967b2dbc0f0 tempest-GroupSnapshotsTest-1479474221 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:10:49.141972 ncdv-master-1 cinder-volume[135002]: WARNING cinder.volume.drivers.rbd [None req-4a65e536-8219-4d52-9666-8967b2dbc0f0 tempest-GroupSnapshotsTest-1479474221 None] Not using v2 clone API, please upgrade to mimic+ and set the OSD minimum client compat version to mimic for better performance, fewer deletion issues: NotImplementedError Apr 09 21:10:49.218535 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-4a65e536-8219-4d52-9666-8967b2dbc0f0 tempest-GroupSnapshotsTest-1479474221 None] Create group from source-snapshot-a61b642c-066d-4b9f-b84c-45ab070e0dab completed successfully. Apr 09 21:10:49.615648 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:10:49.616462 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:10:49.643691 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:10:49.672498 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:10:50.455503 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-7600a216-38a1-494d-a7b4-1191280e43c7 tempest-GroupSnapshotsTest-1479474221 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:10:50.529980 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-7600a216-38a1-494d-a7b4-1191280e43c7 tempest-GroupSnapshotsTest-1479474221 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:10:50.542208 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-7600a216-38a1-494d-a7b4-1191280e43c7 tempest-GroupSnapshotsTest-1479474221 None] deleting rbd volume volume-3b1a7c6d-8a61-4e96-b9f8-0ab35306ddf6 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:10:50.851816 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-7600a216-38a1-494d-a7b4-1191280e43c7 tempest-GroupSnapshotsTest-1479474221 None] Created reservations ['d2b5a499-f2c8-4e70-a932-80c8555efde4'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:10:50.867687 ncdv-master-1 cinder-volume[135002]: WARNING cinder.quota [None req-7600a216-38a1-494d-a7b4-1191280e43c7 tempest-GroupSnapshotsTest-1479474221 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1189835259 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1189835259, it is now deprecated. Please use the default quota class for default quota. Apr 09 21:10:50.868457 ncdv-master-1 cinder-volume[135002]: WARNING cinder.quota [None req-7600a216-38a1-494d-a7b4-1191280e43c7 tempest-GroupSnapshotsTest-1479474221 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1189835259 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1189835259, it is now deprecated. Please use the default quota class for default quota. Apr 09 21:10:50.883807 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-7600a216-38a1-494d-a7b4-1191280e43c7 tempest-GroupSnapshotsTest-1479474221 None] Created reservations ['d958d2c4-c0e4-490d-af57-d80abbcc6435', 'c7912b57-f518-45d8-9f13-835918746123', '19a021c2-0551-4168-bce2-72220ef23e92', '11b0df8d-6a94-4769-b365-c0290b3d74b2'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:10:50.982957 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-7600a216-38a1-494d-a7b4-1191280e43c7 tempest-GroupSnapshotsTest-1479474221 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:10:51.027385 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-7600a216-38a1-494d-a7b4-1191280e43c7 tempest-GroupSnapshotsTest-1479474221 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:10:51.056915 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-7600a216-38a1-494d-a7b4-1191280e43c7 tempest-GroupSnapshotsTest-1479474221 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:10:51.061479 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-7600a216-38a1-494d-a7b4-1191280e43c7 tempest-GroupSnapshotsTest-1479474221 None] Delete group completed successfully. Apr 09 21:10:51.674068 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-ac8cb044-1626-4153-94f3-e27f8d1eb601 tempest-GroupSnapshotsTest-1479474221 None] group_snapshot a61b642c-066d-4b9f-b84c-45ab070e0dab: deleting Apr 09 21:10:51.690545 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ac8cb044-1626-4153-94f3-e27f8d1eb601 tempest-GroupSnapshotsTest-1479474221 None] group_snapshot a61b642c-066d-4b9f-b84c-45ab070e0dab: deleting {{(pid=135002) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4251}} Apr 09 21:10:51.710389 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ac8cb044-1626-4153-94f3-e27f8d1eb601 tempest-GroupSnapshotsTest-1479474221 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:10:52.022279 ncdv-master-1 cinder-volume[135002]: WARNING cinder.quota [None req-ac8cb044-1626-4153-94f3-e27f8d1eb601 tempest-GroupSnapshotsTest-1479474221 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1189835259 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1189835259, it is now deprecated. Please use the default quota class for default quota. Apr 09 21:10:52.037725 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-ac8cb044-1626-4153-94f3-e27f8d1eb601 tempest-GroupSnapshotsTest-1479474221 None] Created reservations ['60b26976-abdf-41f5-aa79-5b56694046d4', 'e10ec14a-6971-4712-badb-4e66dc5b19c6', 'c96a7f4b-a776-48a6-8de7-32e5f8b4acc9', 'c00f7829-aa6b-4e0d-8180-00f4c86fad46'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:10:52.098916 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-ac8cb044-1626-4153-94f3-e27f8d1eb601 tempest-GroupSnapshotsTest-1479474221 None] group_snapshot a61b642c-066d-4b9f-b84c-45ab070e0dab: deleted successfully Apr 09 21:10:53.186757 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2479898e-839f-4e8a-b4f7-16c69ac970a3 tempest-GroupSnapshotsTest-1479474221 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:10:53.286390 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2479898e-839f-4e8a-b4f7-16c69ac970a3 tempest-GroupSnapshotsTest-1479474221 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:10:53.286632 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2479898e-839f-4e8a-b4f7-16c69ac970a3 tempest-GroupSnapshotsTest-1479474221 None] Volume volume-68dd5c30-faf2-4306-b13b-492dabff5452 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:10:53.303508 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2479898e-839f-4e8a-b4f7-16c69ac970a3 tempest-GroupSnapshotsTest-1479474221 None] deleting rbd volume volume-68dd5c30-faf2-4306-b13b-492dabff5452 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:10:53.616925 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-2479898e-839f-4e8a-b4f7-16c69ac970a3 tempest-GroupSnapshotsTest-1479474221 None] Created reservations ['fef1007c-ab8b-49f4-b903-e14e86c747a5'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:10:53.649683 ncdv-master-1 cinder-volume[135002]: WARNING cinder.db.sqlalchemy.api [None req-2479898e-839f-4e8a-b4f7-16c69ac970a3 tempest-GroupSnapshotsTest-1479474221 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1189835259'] Apr 09 21:10:53.654514 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-2479898e-839f-4e8a-b4f7-16c69ac970a3 tempest-GroupSnapshotsTest-1479474221 None] Created reservations ['83c82851-c518-40a4-a46b-fa98176fc5fd', '5ccf7b39-72d2-4e3f-8de1-155261754154', '610c0cb7-4413-400c-a9df-04fd5029e18c', 'd5c639ff-27c1-42dc-8d00-195a4d79bb93'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:10:53.745367 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2479898e-839f-4e8a-b4f7-16c69ac970a3 tempest-GroupSnapshotsTest-1479474221 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:10:53.783910 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2479898e-839f-4e8a-b4f7-16c69ac970a3 tempest-GroupSnapshotsTest-1479474221 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:10:53.838095 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-2479898e-839f-4e8a-b4f7-16c69ac970a3 tempest-GroupSnapshotsTest-1479474221 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:10:53.843942 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-2479898e-839f-4e8a-b4f7-16c69ac970a3 tempest-GroupSnapshotsTest-1479474221 None] Delete group completed successfully. Apr 09 21:10:54.587676 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-e0c8e5cc-174b-486d-9d77-34838f543d4c tempest-GroupSnapshotsTest-1479474221 None] Group tempest-GroupSnapshotsTest-Group-838778938: creating Apr 09 21:10:54.606299 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-e0c8e5cc-174b-486d-9d77-34838f543d4c tempest-GroupSnapshotsTest-1479474221 None] Group tempest-GroupSnapshotsTest-Group-838778938: created successfully Apr 09 21:10:54.614864 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-e0c8e5cc-174b-486d-9d77-34838f543d4c tempest-GroupSnapshotsTest-1479474221 None] Create group completed successfully. Apr 09 21:10:56.056020 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cee26dd-9c13-491a-b1ba-b37e56a045f0 tempest-GroupSnapshotsTest-1479474221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:10:56.076151 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6cee26dd-9c13-491a-b1ba-b37e56a045f0 tempest-GroupSnapshotsTest-1479474221 None] Flow 'volume_create_manager' (1593a5c0-83a7-4906-99d1-5a88eaa4bcb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:10:56.085465 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6cee26dd-9c13-491a-b1ba-b37e56a045f0 tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb3a506-ec14-4a58-b470-6fbcf55b4a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:10:56.100918 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6cee26dd-9c13-491a-b1ba-b37e56a045f0 tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb3a506-ec14-4a58-b470-6fbcf55b4a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1130240674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4b289c94-9f7a-446e-8740-3ce0172f1913,host='ncdv-master-1@ceph#ceph',id=d95d2151-7aa1-408e-a98d-32148938050a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72cf766836c4811b624170c75eb7387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:10:56Z,use_quota=True,user_id='8a6f9e9ae0f7454db191ce65b69ad39b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b4e2be9-4af7-4078-9e6b-068da0fdac6a),volume_type_id=4b4e2be9-4af7-4078-9e6b-068da0fdac6a)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:10:56.106339 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6cee26dd-9c13-491a-b1ba-b37e56a045f0 tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be1707a0-15a6-4dd5-bbc0-755c16ed62ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:10:56.110538 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6cee26dd-9c13-491a-b1ba-b37e56a045f0 tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be1707a0-15a6-4dd5-bbc0-755c16ed62ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:10:56.115709 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6cee26dd-9c13-491a-b1ba-b37e56a045f0 tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abe1582b-017d-449b-b064-4f382f768115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:10:56.119891 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6cee26dd-9c13-491a-b1ba-b37e56a045f0 tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abe1582b-017d-449b-b064-4f382f768115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd95d2151-7aa1-408e-a98d-32148938050a', 'volume_name': 'volume-d95d2151-7aa1-408e-a98d-32148938050a', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:10:56.124851 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6cee26dd-9c13-491a-b1ba-b37e56a045f0 tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cef21fd-b19e-45d2-80e1-a541ae5273cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:10:56.128760 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6cee26dd-9c13-491a-b1ba-b37e56a045f0 tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cef21fd-b19e-45d2-80e1-a541ae5273cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:10:56.133479 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6cee26dd-9c13-491a-b1ba-b37e56a045f0 tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72786f10-d958-49b2-8f57-81aea9d76690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:10:56.134624 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-6cee26dd-9c13-491a-b1ba-b37e56a045f0 tempest-GroupSnapshotsTest-1479474221 None] Volume d95d2151-7aa1-408e-a98d-32148938050a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d95d2151-7aa1-408e-a98d-32148938050a', 'volume_size': 1} Apr 09 21:10:56.135004 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-6cee26dd-9c13-491a-b1ba-b37e56a045f0 tempest-GroupSnapshotsTest-1479474221 None] creating volume 'volume-d95d2151-7aa1-408e-a98d-32148938050a' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:10:56.135766 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-6cee26dd-9c13-491a-b1ba-b37e56a045f0 tempest-GroupSnapshotsTest-1479474221 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:10:56.193437 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-6cee26dd-9c13-491a-b1ba-b37e56a045f0 tempest-GroupSnapshotsTest-1479474221 None] extra_specs: {} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:10:56.194261 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-6cee26dd-9c13-491a-b1ba-b37e56a045f0 tempest-GroupSnapshotsTest-1479474221 None] extra_specs: {} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:10:56.198133 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6cee26dd-9c13-491a-b1ba-b37e56a045f0 tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72786f10-d958-49b2-8f57-81aea9d76690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d95d2151-7aa1-408e-a98d-32148938050a', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:10:56.202770 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6cee26dd-9c13-491a-b1ba-b37e56a045f0 tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7029f7e-5028-45e3-a9b8-be40a2d46660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:10:56.212921 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-6cee26dd-9c13-491a-b1ba-b37e56a045f0 tempest-GroupSnapshotsTest-1479474221 None] Volume volume-d95d2151-7aa1-408e-a98d-32148938050a (d95d2151-7aa1-408e-a98d-32148938050a): created successfully Apr 09 21:10:56.217150 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6cee26dd-9c13-491a-b1ba-b37e56a045f0 tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7029f7e-5028-45e3-a9b8-be40a2d46660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:10:56.223040 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6cee26dd-9c13-491a-b1ba-b37e56a045f0 tempest-GroupSnapshotsTest-1479474221 None] Flow 'volume_create_manager' (1593a5c0-83a7-4906-99d1-5a88eaa4bcb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:10:56.232578 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-6cee26dd-9c13-491a-b1ba-b37e56a045f0 tempest-GroupSnapshotsTest-1479474221 None] Created volume successfully. Apr 09 21:10:57.580392 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-79c219f5-07df-43be-890c-c39d72c65b90 tempest-GroupSnapshotsTest-1479474221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:10:57.600096 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-79c219f5-07df-43be-890c-c39d72c65b90 tempest-GroupSnapshotsTest-1479474221 None] Flow 'volume_create_manager' (4c5f8a27-432b-488d-b65c-cbaabb23389f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:10:57.606649 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-79c219f5-07df-43be-890c-c39d72c65b90 tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7de8f484-78c6-4e2b-ba95-67c25f5e3b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:10:57.622422 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-79c219f5-07df-43be-890c-c39d72c65b90 tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7de8f484-78c6-4e2b-ba95-67c25f5e3b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1226857651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4b289c94-9f7a-446e-8740-3ce0172f1913,host='ncdv-master-1@ceph#ceph',id=3e92af43-bc98-440c-8a18-0dd8ba002afa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72cf766836c4811b624170c75eb7387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:10:58Z,use_quota=True,user_id='8a6f9e9ae0f7454db191ce65b69ad39b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b4e2be9-4af7-4078-9e6b-068da0fdac6a),volume_type_id=4b4e2be9-4af7-4078-9e6b-068da0fdac6a)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:10:57.627988 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-79c219f5-07df-43be-890c-c39d72c65b90 tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1db736f-0072-4e57-a464-fac8f63ceb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:10:57.632096 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-79c219f5-07df-43be-890c-c39d72c65b90 tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1db736f-0072-4e57-a464-fac8f63ceb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:10:57.637161 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-79c219f5-07df-43be-890c-c39d72c65b90 tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f29e54d3-be8c-4c39-9bb0-8a4621365856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:10:57.641279 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-79c219f5-07df-43be-890c-c39d72c65b90 tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f29e54d3-be8c-4c39-9bb0-8a4621365856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e92af43-bc98-440c-8a18-0dd8ba002afa', 'volume_name': 'volume-3e92af43-bc98-440c-8a18-0dd8ba002afa', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:10:57.646152 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-79c219f5-07df-43be-890c-c39d72c65b90 tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d8cbef7-d1b3-470f-810c-7ff50e47ae30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:10:57.650017 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-79c219f5-07df-43be-890c-c39d72c65b90 tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d8cbef7-d1b3-470f-810c-7ff50e47ae30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:10:57.654648 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-79c219f5-07df-43be-890c-c39d72c65b90 tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf974f3d-29b7-4195-91a8-6b052b744d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:10:57.656054 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-79c219f5-07df-43be-890c-c39d72c65b90 tempest-GroupSnapshotsTest-1479474221 None] Volume 3e92af43-bc98-440c-8a18-0dd8ba002afa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e92af43-bc98-440c-8a18-0dd8ba002afa', 'volume_size': 1} Apr 09 21:10:57.656429 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-79c219f5-07df-43be-890c-c39d72c65b90 tempest-GroupSnapshotsTest-1479474221 None] creating volume 'volume-3e92af43-bc98-440c-8a18-0dd8ba002afa' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:10:57.657079 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-79c219f5-07df-43be-890c-c39d72c65b90 tempest-GroupSnapshotsTest-1479474221 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:10:57.709713 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-79c219f5-07df-43be-890c-c39d72c65b90 tempest-GroupSnapshotsTest-1479474221 None] extra_specs: {} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:10:57.710208 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-79c219f5-07df-43be-890c-c39d72c65b90 tempest-GroupSnapshotsTest-1479474221 None] extra_specs: {} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:10:57.714048 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-79c219f5-07df-43be-890c-c39d72c65b90 tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf974f3d-29b7-4195-91a8-6b052b744d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e92af43-bc98-440c-8a18-0dd8ba002afa', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:10:57.718921 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-79c219f5-07df-43be-890c-c39d72c65b90 tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c322894d-0052-4c40-8c46-1696ec8a5353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:10:57.729159 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-79c219f5-07df-43be-890c-c39d72c65b90 tempest-GroupSnapshotsTest-1479474221 None] Volume volume-3e92af43-bc98-440c-8a18-0dd8ba002afa (3e92af43-bc98-440c-8a18-0dd8ba002afa): created successfully Apr 09 21:10:57.732812 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-79c219f5-07df-43be-890c-c39d72c65b90 tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c322894d-0052-4c40-8c46-1696ec8a5353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:10:57.738324 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-79c219f5-07df-43be-890c-c39d72c65b90 tempest-GroupSnapshotsTest-1479474221 None] Flow 'volume_create_manager' (4c5f8a27-432b-488d-b65c-cbaabb23389f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:10:57.747763 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-79c219f5-07df-43be-890c-c39d72c65b90 tempest-GroupSnapshotsTest-1479474221 None] Created volume successfully. Apr 09 21:10:58.806133 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-09105463-9b1b-4d1f-8654-5d0b3a5f6e70 tempest-GroupSnapshotsTest-1479474221 None] Update group completed successfully. Apr 09 21:11:00.042755 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-99ee4709-4ccf-488a-a873-9161e33a52a4 tempest-GroupSnapshotsTest-1479474221 None] Update group completed successfully. Apr 09 21:11:01.266555 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-bf015e96-7a69-43e5-bd6b-b82447275ef1 tempest-GroupSnapshotsTest-1479474221 None] Update group completed successfully. Apr 09 21:11:02.482595 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-2cec6860-3861-4c87-8e40-0bba1aaebee3 tempest-GroupSnapshotsTest-1479474221 None] Update group completed successfully. Apr 09 21:11:03.825232 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-e160e28a-3ac8-4626-8032-4e1db25f3d44 tempest-GroupSnapshotsTest-1479474221 None] GroupSnapshot 00966abf-4090-40c3-b4ed-f8d045494e85: creating. Apr 09 21:11:03.842452 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e160e28a-3ac8-4626-8032-4e1db25f3d44 tempest-GroupSnapshotsTest-1479474221 None] Group snapshot 00966abf-4090-40c3-b4ed-f8d045494e85: creating. {{(pid=135002) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4076}} Apr 09 21:11:03.859935 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-e160e28a-3ac8-4626-8032-4e1db25f3d44 tempest-GroupSnapshotsTest-1479474221 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:11:04.622955 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-e160e28a-3ac8-4626-8032-4e1db25f3d44 tempest-GroupSnapshotsTest-1479474221 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:11:05.699463 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-e160e28a-3ac8-4626-8032-4e1db25f3d44 tempest-GroupSnapshotsTest-1479474221 None] group_snapshot 00966abf-4090-40c3-b4ed-f8d045494e85: created successfully Apr 09 21:11:06.068643 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-22450541-c4ed-4148-89af-ef2450251fdc tempest-GroupSnapshotsTest-1479474221 None] group_snapshot 00966abf-4090-40c3-b4ed-f8d045494e85: deleting Apr 09 21:11:06.086118 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-22450541-c4ed-4148-89af-ef2450251fdc tempest-GroupSnapshotsTest-1479474221 None] group_snapshot 00966abf-4090-40c3-b4ed-f8d045494e85: deleting {{(pid=135002) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4251}} Apr 09 21:11:06.102721 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-22450541-c4ed-4148-89af-ef2450251fdc tempest-GroupSnapshotsTest-1479474221 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:11:06.648293 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-22450541-c4ed-4148-89af-ef2450251fdc tempest-GroupSnapshotsTest-1479474221 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:11:07.687855 ncdv-master-1 cinder-volume[135002]: WARNING cinder.quota [None req-22450541-c4ed-4148-89af-ef2450251fdc tempest-GroupSnapshotsTest-1479474221 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1330235882 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1330235882, it is now deprecated. Please use the default quota class for default quota. Apr 09 21:11:07.688690 ncdv-master-1 cinder-volume[135002]: WARNING cinder.quota [None req-22450541-c4ed-4148-89af-ef2450251fdc tempest-GroupSnapshotsTest-1479474221 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1330235882 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1330235882, it is now deprecated. Please use the default quota class for default quota. Apr 09 21:11:07.705410 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-22450541-c4ed-4148-89af-ef2450251fdc tempest-GroupSnapshotsTest-1479474221 None] Created reservations ['9339ddea-d46b-44ff-901c-a0918f551ab2', 'f27b4448-aba4-4acc-9eee-2b167c6facd3', '7e1fd034-fbe8-4a91-b3ba-ba265f3c8b72', 'b411e8b1-f4fc-48b9-bde8-7a15285e23e8'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:11:07.782256 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-22450541-c4ed-4148-89af-ef2450251fdc tempest-GroupSnapshotsTest-1479474221 None] Created reservations ['c83befe0-bccd-4dcb-8695-6256d8c1689f', 'f9de070b-02c1-4c77-8a34-30a9e1cc4c6d', 'ddb162ff-bc60-4bc1-8b2e-2d7d951e75ec', 'b3168123-c432-41f3-ae22-ac1733d345be'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:11:07.830488 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-22450541-c4ed-4148-89af-ef2450251fdc tempest-GroupSnapshotsTest-1479474221 None] group_snapshot 00966abf-4090-40c3-b4ed-f8d045494e85: deleted successfully Apr 09 21:11:08.655873 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-29ef2412-8970-476c-84ea-9ce90933c58a tempest-GroupSnapshotsTest-1479474221 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:11:08.718121 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-29ef2412-8970-476c-84ea-9ce90933c58a tempest-GroupSnapshotsTest-1479474221 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:11:08.718827 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-29ef2412-8970-476c-84ea-9ce90933c58a tempest-GroupSnapshotsTest-1479474221 None] Volume volume-3e92af43-bc98-440c-8a18-0dd8ba002afa is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:11:08.732729 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-29ef2412-8970-476c-84ea-9ce90933c58a tempest-GroupSnapshotsTest-1479474221 None] deleting rbd volume volume-3e92af43-bc98-440c-8a18-0dd8ba002afa {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:11:09.032896 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-29ef2412-8970-476c-84ea-9ce90933c58a tempest-GroupSnapshotsTest-1479474221 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:11:09.110777 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-29ef2412-8970-476c-84ea-9ce90933c58a tempest-GroupSnapshotsTest-1479474221 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:11:09.111207 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-29ef2412-8970-476c-84ea-9ce90933c58a tempest-GroupSnapshotsTest-1479474221 None] Volume volume-d95d2151-7aa1-408e-a98d-32148938050a is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:11:09.128422 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-29ef2412-8970-476c-84ea-9ce90933c58a tempest-GroupSnapshotsTest-1479474221 None] deleting rbd volume volume-d95d2151-7aa1-408e-a98d-32148938050a {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:11:09.560511 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-29ef2412-8970-476c-84ea-9ce90933c58a tempest-GroupSnapshotsTest-1479474221 None] Created reservations ['9135e82f-0863-4506-b530-143683b7a319'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:11:09.590127 ncdv-master-1 cinder-volume[135002]: WARNING cinder.quota [None req-29ef2412-8970-476c-84ea-9ce90933c58a tempest-GroupSnapshotsTest-1479474221 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1330235882 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1330235882, it is now deprecated. Please use the default quota class for default quota. Apr 09 21:11:09.614089 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-29ef2412-8970-476c-84ea-9ce90933c58a tempest-GroupSnapshotsTest-1479474221 None] Created reservations ['837edebb-277b-49bd-8e73-f280685f1498', '92a1576c-34bb-43ad-b1f7-d2d578681023', 'f78c6873-cc1c-4901-a364-2d3bfdc8c64d', '96d17612-a8a6-4a39-b1f0-e475dbca8ee1'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:11:09.751240 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-29ef2412-8970-476c-84ea-9ce90933c58a tempest-GroupSnapshotsTest-1479474221 None] Created reservations ['008fcd0f-5880-4a1b-ae09-e15157365553', '561b37fd-3059-4e08-b389-89c2fc4dafe8', '3f97702b-67a6-4cfa-999d-2b2325d8a8db', '41521da4-c0dc-4c2b-ba1e-ae41d77d693e'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:11:09.924048 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-29ef2412-8970-476c-84ea-9ce90933c58a tempest-GroupSnapshotsTest-1479474221 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:11:09.995582 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-29ef2412-8970-476c-84ea-9ce90933c58a tempest-GroupSnapshotsTest-1479474221 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:11:10.060752 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-29ef2412-8970-476c-84ea-9ce90933c58a tempest-GroupSnapshotsTest-1479474221 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:11:10.079082 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-29ef2412-8970-476c-84ea-9ce90933c58a tempest-GroupSnapshotsTest-1479474221 None] Delete group completed successfully. Apr 09 21:11:11.330503 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-9f9bbd49-8416-48d8-85f7-aa6625f4446e tempest-GroupSnapshotsTest-1479474221 None] Group tempest-GroupSnapshotsTest-Group-1570733419: creating Apr 09 21:11:11.349834 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-9f9bbd49-8416-48d8-85f7-aa6625f4446e tempest-GroupSnapshotsTest-1479474221 None] Group tempest-GroupSnapshotsTest-Group-1570733419: created successfully Apr 09 21:11:11.367948 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-9f9bbd49-8416-48d8-85f7-aa6625f4446e tempest-GroupSnapshotsTest-1479474221 None] Create group completed successfully. Apr 09 21:11:12.987104 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-61c8ee22-e635-4cce-b0e9-a2923a973f55 tempest-GroupSnapshotsTest-1479474221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:11:13.065884 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-61c8ee22-e635-4cce-b0e9-a2923a973f55 tempest-GroupSnapshotsTest-1479474221 None] Flow 'volume_create_manager' (6a5e8135-116d-404c-957c-87cbd14cc708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:11:13.072762 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-61c8ee22-e635-4cce-b0e9-a2923a973f55 tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea1eac5-83e1-45d7-a99e-fa4b1a3c8dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:11:13.093506 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-61c8ee22-e635-4cce-b0e9-a2923a973f55 tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea1eac5-83e1-45d7-a99e-fa4b1a3c8dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-2075201125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d508ec71-08d6-4264-8d50-506c0db1ddb7,host='ncdv-master-1@ceph#ceph',id=67d1e720-efe5-49e1-810f-ff0ead2121a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72cf766836c4811b624170c75eb7387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:11:13Z,use_quota=True,user_id='8a6f9e9ae0f7454db191ce65b69ad39b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d1f9ab1-4d86-4a3f-9d62-492418295246),volume_type_id=6d1f9ab1-4d86-4a3f-9d62-492418295246)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:11:13.102783 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-61c8ee22-e635-4cce-b0e9-a2923a973f55 tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f04521e7-c2e9-45c2-96ef-9d761755340d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:11:13.112095 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-61c8ee22-e635-4cce-b0e9-a2923a973f55 tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f04521e7-c2e9-45c2-96ef-9d761755340d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:11:13.120826 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-61c8ee22-e635-4cce-b0e9-a2923a973f55 tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b11db87-305e-4bad-afff-428023e94d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:11:13.129934 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-61c8ee22-e635-4cce-b0e9-a2923a973f55 tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b11db87-305e-4bad-afff-428023e94d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67d1e720-efe5-49e1-810f-ff0ead2121a2', 'volume_name': 'volume-67d1e720-efe5-49e1-810f-ff0ead2121a2', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:11:13.135594 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-61c8ee22-e635-4cce-b0e9-a2923a973f55 tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02c237e6-4a7c-43e1-a59b-2ec75d046a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:11:13.139767 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-61c8ee22-e635-4cce-b0e9-a2923a973f55 tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02c237e6-4a7c-43e1-a59b-2ec75d046a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:11:13.146721 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-61c8ee22-e635-4cce-b0e9-a2923a973f55 tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6cbc0b8-7e5b-4dd9-81d0-3b64176cde2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:11:13.148188 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-61c8ee22-e635-4cce-b0e9-a2923a973f55 tempest-GroupSnapshotsTest-1479474221 None] Volume 67d1e720-efe5-49e1-810f-ff0ead2121a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67d1e720-efe5-49e1-810f-ff0ead2121a2', 'volume_size': 1} Apr 09 21:11:13.148582 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-61c8ee22-e635-4cce-b0e9-a2923a973f55 tempest-GroupSnapshotsTest-1479474221 None] creating volume 'volume-67d1e720-efe5-49e1-810f-ff0ead2121a2' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:11:13.149971 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-61c8ee22-e635-4cce-b0e9-a2923a973f55 tempest-GroupSnapshotsTest-1479474221 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:11:13.250524 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-61c8ee22-e635-4cce-b0e9-a2923a973f55 tempest-GroupSnapshotsTest-1479474221 None] extra_specs: {} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:11:13.251054 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-61c8ee22-e635-4cce-b0e9-a2923a973f55 tempest-GroupSnapshotsTest-1479474221 None] extra_specs: {} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:11:13.255215 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-61c8ee22-e635-4cce-b0e9-a2923a973f55 tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6cbc0b8-7e5b-4dd9-81d0-3b64176cde2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67d1e720-efe5-49e1-810f-ff0ead2121a2', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:11:13.260259 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-61c8ee22-e635-4cce-b0e9-a2923a973f55 tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91a95a6b-bbe3-49c5-b77f-9f9387f09e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:11:13.270085 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-61c8ee22-e635-4cce-b0e9-a2923a973f55 tempest-GroupSnapshotsTest-1479474221 None] Volume volume-67d1e720-efe5-49e1-810f-ff0ead2121a2 (67d1e720-efe5-49e1-810f-ff0ead2121a2): created successfully Apr 09 21:11:13.273739 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-61c8ee22-e635-4cce-b0e9-a2923a973f55 tempest-GroupSnapshotsTest-1479474221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91a95a6b-bbe3-49c5-b77f-9f9387f09e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:11:13.279477 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-61c8ee22-e635-4cce-b0e9-a2923a973f55 tempest-GroupSnapshotsTest-1479474221 None] Flow 'volume_create_manager' (6a5e8135-116d-404c-957c-87cbd14cc708) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:11:13.311787 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-61c8ee22-e635-4cce-b0e9-a2923a973f55 tempest-GroupSnapshotsTest-1479474221 None] Created volume successfully. Apr 09 21:11:14.235815 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-64b19c18-31c4-45bf-bbff-76675c994313 tempest-GroupSnapshotsTest-1479474221 None] GroupSnapshot 63a6e7b6-c7cc-4c3b-a337-730e0c4de2ec: creating. Apr 09 21:11:14.273423 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-64b19c18-31c4-45bf-bbff-76675c994313 tempest-GroupSnapshotsTest-1479474221 None] Group snapshot 63a6e7b6-c7cc-4c3b-a337-730e0c4de2ec: creating. {{(pid=135002) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4076}} Apr 09 21:11:14.298936 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-64b19c18-31c4-45bf-bbff-76675c994313 tempest-GroupSnapshotsTest-1479474221 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:11:14.800967 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-64b19c18-31c4-45bf-bbff-76675c994313 tempest-GroupSnapshotsTest-1479474221 None] group_snapshot 63a6e7b6-c7cc-4c3b-a337-730e0c4de2ec: created successfully Apr 09 21:11:15.566258 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-41819bf8-f7ba-4eea-990d-d23e3f586294 tempest-GroupSnapshotsTest-1479474221 None] group_snapshot 63a6e7b6-c7cc-4c3b-a337-730e0c4de2ec: deleting Apr 09 21:11:15.613810 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-41819bf8-f7ba-4eea-990d-d23e3f586294 tempest-GroupSnapshotsTest-1479474221 None] group_snapshot 63a6e7b6-c7cc-4c3b-a337-730e0c4de2ec: deleting {{(pid=135002) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4251}} Apr 09 21:11:15.647781 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-41819bf8-f7ba-4eea-990d-d23e3f586294 tempest-GroupSnapshotsTest-1479474221 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:11:16.835096 ncdv-master-1 cinder-volume[135002]: WARNING cinder.quota [None req-41819bf8-f7ba-4eea-990d-d23e3f586294 tempest-GroupSnapshotsTest-1479474221 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-922859511 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-922859511, it is now deprecated. Please use the default quota class for default quota. Apr 09 21:11:16.847339 ncdv-master-1 cinder-volume[135002]: WARNING cinder.quota [None req-41819bf8-f7ba-4eea-990d-d23e3f586294 tempest-GroupSnapshotsTest-1479474221 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-922859511 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-922859511, it is now deprecated. Please use the default quota class for default quota. Apr 09 21:11:16.901136 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-41819bf8-f7ba-4eea-990d-d23e3f586294 tempest-GroupSnapshotsTest-1479474221 None] Created reservations ['f69daa3b-8136-4462-97c4-1cb8aebc0c97', '336b5f6b-c866-429a-8e04-7040c128e4a3', '8a31ffe7-e6bc-4699-a28d-c63051107df9', '0219b645-b038-4edc-b624-46df06e60dfd'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:11:16.985893 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-41819bf8-f7ba-4eea-990d-d23e3f586294 tempest-GroupSnapshotsTest-1479474221 None] group_snapshot 63a6e7b6-c7cc-4c3b-a337-730e0c4de2ec: deleted successfully Apr 09 21:11:18.442223 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-de7931e3-3fae-4062-b1c8-51ceceb63f2a tempest-GroupSnapshotsTest-1479474221 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:11:18.563328 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-de7931e3-3fae-4062-b1c8-51ceceb63f2a tempest-GroupSnapshotsTest-1479474221 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:11:18.563761 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-de7931e3-3fae-4062-b1c8-51ceceb63f2a tempest-GroupSnapshotsTest-1479474221 None] Volume volume-67d1e720-efe5-49e1-810f-ff0ead2121a2 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:11:18.573201 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-de7931e3-3fae-4062-b1c8-51ceceb63f2a tempest-GroupSnapshotsTest-1479474221 None] deleting rbd volume volume-67d1e720-efe5-49e1-810f-ff0ead2121a2 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:11:19.057190 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-de7931e3-3fae-4062-b1c8-51ceceb63f2a tempest-GroupSnapshotsTest-1479474221 None] Created reservations ['a1080e0a-522b-45cb-9564-1b066d2fad43'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:11:19.097308 ncdv-master-1 cinder-volume[135002]: WARNING cinder.quota [None req-de7931e3-3fae-4062-b1c8-51ceceb63f2a tempest-GroupSnapshotsTest-1479474221 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-922859511 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-922859511, it is now deprecated. Please use the default quota class for default quota. Apr 09 21:11:19.123448 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-de7931e3-3fae-4062-b1c8-51ceceb63f2a tempest-GroupSnapshotsTest-1479474221 None] Created reservations ['02cb9bc8-8ad1-4fcc-8285-0943bed24a44', 'e1d2c323-cbb5-4d9e-a70a-65cc26bf685c', '4e418881-2f5b-4617-89e4-d1eda1037892', 'd9a0e9ac-eccc-4b17-86e3-0962da9a8191'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:11:19.289287 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-de7931e3-3fae-4062-b1c8-51ceceb63f2a tempest-GroupSnapshotsTest-1479474221 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:11:19.360553 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-de7931e3-3fae-4062-b1c8-51ceceb63f2a tempest-GroupSnapshotsTest-1479474221 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:11:19.429567 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-de7931e3-3fae-4062-b1c8-51ceceb63f2a tempest-GroupSnapshotsTest-1479474221 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:11:19.444095 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-de7931e3-3fae-4062-b1c8-51ceceb63f2a tempest-GroupSnapshotsTest-1479474221 None] Delete group completed successfully. Apr 09 21:11:21.190446 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [req-8fc0a8c0-dedd-4b54-b045-c2f491b227bb req-ab6c09af-3250-4c0a-8a9b-a3b20a78f1d8 tempest-VolumesSnapshotsTestJSON-718841488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:11:21.233937 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-8fc0a8c0-dedd-4b54-b045-c2f491b227bb req-ab6c09af-3250-4c0a-8a9b-a3b20a78f1d8 tempest-VolumesSnapshotsTestJSON-718841488 None] Flow 'volume_create_manager' (88af7cd4-f062-4834-90d9-33c7b200a2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:11:21.242467 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-8fc0a8c0-dedd-4b54-b045-c2f491b227bb req-ab6c09af-3250-4c0a-8a9b-a3b20a78f1d8 tempest-VolumesSnapshotsTestJSON-718841488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2dd3210-a42b-4f00-b89c-12c5e264b5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:11:21.262111 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-8fc0a8c0-dedd-4b54-b045-c2f491b227bb req-ab6c09af-3250-4c0a-8a9b-a3b20a78f1d8 tempest-VolumesSnapshotsTestJSON-718841488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2dd3210-a42b-4f00-b89c-12c5e264b5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-422299635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6763abd8-48b1-498b-a4db-0761a497ffe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52aec4680cd54b72b29e0ecf9f956ea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:11:21Z,use_quota=True,user_id='9b81f97cb916418bb6a8a27fc1353e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:11:21.269490 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-8fc0a8c0-dedd-4b54-b045-c2f491b227bb req-ab6c09af-3250-4c0a-8a9b-a3b20a78f1d8 tempest-VolumesSnapshotsTestJSON-718841488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b92ef02-ba01-468a-baef-63e5d1c77daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:11:21.274961 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-8fc0a8c0-dedd-4b54-b045-c2f491b227bb req-ab6c09af-3250-4c0a-8a9b-a3b20a78f1d8 tempest-VolumesSnapshotsTestJSON-718841488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b92ef02-ba01-468a-baef-63e5d1c77daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:11:21.281859 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-8fc0a8c0-dedd-4b54-b045-c2f491b227bb req-ab6c09af-3250-4c0a-8a9b-a3b20a78f1d8 tempest-VolumesSnapshotsTestJSON-718841488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d99df2aa-eee1-4927-8fdb-39ceeda712a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:11:21.288499 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-8fc0a8c0-dedd-4b54-b045-c2f491b227bb req-ab6c09af-3250-4c0a-8a9b-a3b20a78f1d8 tempest-VolumesSnapshotsTestJSON-718841488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d99df2aa-eee1-4927-8fdb-39ceeda712a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6763abd8-48b1-498b-a4db-0761a497ffe0', 'volume_name': 'volume-6763abd8-48b1-498b-a4db-0761a497ffe0', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:11:21.294623 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-8fc0a8c0-dedd-4b54-b045-c2f491b227bb req-ab6c09af-3250-4c0a-8a9b-a3b20a78f1d8 tempest-VolumesSnapshotsTestJSON-718841488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb523ed-4703-422f-8afd-5f3faf69420c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:11:21.299674 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-8fc0a8c0-dedd-4b54-b045-c2f491b227bb req-ab6c09af-3250-4c0a-8a9b-a3b20a78f1d8 tempest-VolumesSnapshotsTestJSON-718841488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb523ed-4703-422f-8afd-5f3faf69420c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:11:21.304936 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-8fc0a8c0-dedd-4b54-b045-c2f491b227bb req-ab6c09af-3250-4c0a-8a9b-a3b20a78f1d8 tempest-VolumesSnapshotsTestJSON-718841488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1365f6c1-2dfc-4a2d-b88f-c9cc9f0daef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:11:21.306681 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [req-8fc0a8c0-dedd-4b54-b045-c2f491b227bb req-ab6c09af-3250-4c0a-8a9b-a3b20a78f1d8 tempest-VolumesSnapshotsTestJSON-718841488 None] Volume 6763abd8-48b1-498b-a4db-0761a497ffe0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6763abd8-48b1-498b-a4db-0761a497ffe0', 'volume_size': 1} Apr 09 21:11:21.307143 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-8fc0a8c0-dedd-4b54-b045-c2f491b227bb req-ab6c09af-3250-4c0a-8a9b-a3b20a78f1d8 tempest-VolumesSnapshotsTestJSON-718841488 None] creating volume 'volume-6763abd8-48b1-498b-a4db-0761a497ffe0' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:11:21.308008 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-8fc0a8c0-dedd-4b54-b045-c2f491b227bb req-ab6c09af-3250-4c0a-8a9b-a3b20a78f1d8 tempest-VolumesSnapshotsTestJSON-718841488 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:11:21.433841 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-8fc0a8c0-dedd-4b54-b045-c2f491b227bb req-ab6c09af-3250-4c0a-8a9b-a3b20a78f1d8 tempest-VolumesSnapshotsTestJSON-718841488 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:11:21.434221 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-8fc0a8c0-dedd-4b54-b045-c2f491b227bb req-ab6c09af-3250-4c0a-8a9b-a3b20a78f1d8 tempest-VolumesSnapshotsTestJSON-718841488 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:11:21.438280 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-8fc0a8c0-dedd-4b54-b045-c2f491b227bb req-ab6c09af-3250-4c0a-8a9b-a3b20a78f1d8 tempest-VolumesSnapshotsTestJSON-718841488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1365f6c1-2dfc-4a2d-b88f-c9cc9f0daef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6763abd8-48b1-498b-a4db-0761a497ffe0', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:11:21.447491 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-8fc0a8c0-dedd-4b54-b045-c2f491b227bb req-ab6c09af-3250-4c0a-8a9b-a3b20a78f1d8 tempest-VolumesSnapshotsTestJSON-718841488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5df3bdbc-8160-4dec-a144-2e0dde49ed58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:11:21.474698 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [req-8fc0a8c0-dedd-4b54-b045-c2f491b227bb req-ab6c09af-3250-4c0a-8a9b-a3b20a78f1d8 tempest-VolumesSnapshotsTestJSON-718841488 None] Volume volume-6763abd8-48b1-498b-a4db-0761a497ffe0 (6763abd8-48b1-498b-a4db-0761a497ffe0): created successfully Apr 09 21:11:21.480080 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-8fc0a8c0-dedd-4b54-b045-c2f491b227bb req-ab6c09af-3250-4c0a-8a9b-a3b20a78f1d8 tempest-VolumesSnapshotsTestJSON-718841488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5df3bdbc-8160-4dec-a144-2e0dde49ed58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:11:21.494594 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-8fc0a8c0-dedd-4b54-b045-c2f491b227bb req-ab6c09af-3250-4c0a-8a9b-a3b20a78f1d8 tempest-VolumesSnapshotsTestJSON-718841488 None] Flow 'volume_create_manager' (88af7cd4-f062-4834-90d9-33c7b200a2a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:11:21.507890 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-8fc0a8c0-dedd-4b54-b045-c2f491b227bb req-ab6c09af-3250-4c0a-8a9b-a3b20a78f1d8 tempest-VolumesSnapshotsTestJSON-718841488 None] Created volume successfully. Apr 09 21:11:22.898908 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-ff953875-3901-41e3-8038-088d8146c55c req-a5485e41-e678-4c8e-b975-e6018f7d1458 tempest-VolumesSnapshotsTestJSON-718841488 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:11:23.743933 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-ff953875-3901-41e3-8038-088d8146c55c req-a5485e41-e678-4c8e-b975-e6018f7d1458 tempest-VolumesSnapshotsTestJSON-718841488 None] Create snapshot completed successfully Apr 09 21:11:24.328878 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [req-7cb9b789-20dd-4bca-832c-ff0d7aa24eb6 req-56bf66ea-d25f-453c-b012-5902f38fcb58 tempest-VolumesSnapshotsTestJSON-718841488 None] Lock "b'cinder-13f5ae3d-c0d2-4bc5-80d5-d02601875e88-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:11:24.330768 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-7cb9b789-20dd-4bca-832c-ff0d7aa24eb6 req-56bf66ea-d25f-453c-b012-5902f38fcb58 tempest-VolumesSnapshotsTestJSON-718841488 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:11:24.672449 ncdv-master-1 cinder-volume[135002]: WARNING cinder.quota [req-7cb9b789-20dd-4bca-832c-ff0d7aa24eb6 req-56bf66ea-d25f-453c-b012-5902f38fcb58 tempest-VolumesSnapshotsTestJSON-718841488 None] Deprecated: Default quota for resource: snapshots_ceph is set by the default quota flag: quota_snapshots_ceph, it is now deprecated. Please use the default quota class for default quota. Apr 09 21:11:24.688600 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [req-7cb9b789-20dd-4bca-832c-ff0d7aa24eb6 req-56bf66ea-d25f-453c-b012-5902f38fcb58 tempest-VolumesSnapshotsTestJSON-718841488 None] Created reservations ['07eed3b4-2c41-4fef-b38b-083a0ed3cf49', '3c39e22b-9c1c-462c-9871-22aa4fe3efa7', 'cd3355bd-12d3-40f9-a9fa-0b436140aa06', '6007260c-5db2-4e69-9fbb-1ad4c03ae489'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:11:24.739573 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-7cb9b789-20dd-4bca-832c-ff0d7aa24eb6 req-56bf66ea-d25f-453c-b012-5902f38fcb58 tempest-VolumesSnapshotsTestJSON-718841488 None] Delete snapshot completed successfully. Apr 09 21:11:24.745629 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [req-7cb9b789-20dd-4bca-832c-ff0d7aa24eb6 req-56bf66ea-d25f-453c-b012-5902f38fcb58 tempest-VolumesSnapshotsTestJSON-718841488 None] Lock "b'cinder-13f5ae3d-c0d2-4bc5-80d5-d02601875e88-delete_snapshot'" released by "delete_snapshot" :: held 0.417s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:11:25.539087 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [req-0b2b78b6-47ee-48a6-909b-846e7a22db98 req-472958cc-4859-462e-a889-c018ef1a29f3 tempest-VolumesSnapshotsTestJSON-718841488 None] Lock "b'cinder-6763abd8-48b1-498b-a4db-0761a497ffe0-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:11:25.661521 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-0b2b78b6-47ee-48a6-909b-846e7a22db98 req-472958cc-4859-462e-a889-c018ef1a29f3 tempest-VolumesSnapshotsTestJSON-718841488 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:11:25.718812 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-0b2b78b6-47ee-48a6-909b-846e7a22db98 req-472958cc-4859-462e-a889-c018ef1a29f3 tempest-VolumesSnapshotsTestJSON-718841488 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:11:25.719207 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-0b2b78b6-47ee-48a6-909b-846e7a22db98 req-472958cc-4859-462e-a889-c018ef1a29f3 tempest-VolumesSnapshotsTestJSON-718841488 None] Volume volume-6763abd8-48b1-498b-a4db-0761a497ffe0 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:11:25.732906 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-0b2b78b6-47ee-48a6-909b-846e7a22db98 req-472958cc-4859-462e-a889-c018ef1a29f3 tempest-VolumesSnapshotsTestJSON-718841488 None] deleting rbd volume volume-6763abd8-48b1-498b-a4db-0761a497ffe0 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:11:26.165093 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [req-0b2b78b6-47ee-48a6-909b-846e7a22db98 req-472958cc-4859-462e-a889-c018ef1a29f3 tempest-VolumesSnapshotsTestJSON-718841488 None] Created reservations ['041d7eef-fdda-408d-984f-806d5d39093c', '68b0c87f-a6b0-4e49-9b21-376353968b96', 'cd1c72ca-4946-4a0d-b24d-08b9de655991', '6fdc329f-5c0a-4912-9871-0df8452c3f3d'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:11:26.229140 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-0b2b78b6-47ee-48a6-909b-846e7a22db98 req-472958cc-4859-462e-a889-c018ef1a29f3 tempest-VolumesSnapshotsTestJSON-718841488 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:11:26.302094 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-0b2b78b6-47ee-48a6-909b-846e7a22db98 req-472958cc-4859-462e-a889-c018ef1a29f3 tempest-VolumesSnapshotsTestJSON-718841488 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:11:26.369178 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [req-0b2b78b6-47ee-48a6-909b-846e7a22db98 req-472958cc-4859-462e-a889-c018ef1a29f3 tempest-VolumesSnapshotsTestJSON-718841488 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:11:26.374624 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-0b2b78b6-47ee-48a6-909b-846e7a22db98 req-472958cc-4859-462e-a889-c018ef1a29f3 tempest-VolumesSnapshotsTestJSON-718841488 None] Deleted volume successfully. Apr 09 21:11:26.397021 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [req-0b2b78b6-47ee-48a6-909b-846e7a22db98 req-472958cc-4859-462e-a889-c018ef1a29f3 tempest-VolumesSnapshotsTestJSON-718841488 None] Lock "b'cinder-6763abd8-48b1-498b-a4db-0761a497ffe0-delete_volume'" released by "delete_volume" :: held 0.859s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:11:30.761662 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-6601b2ed-e4d9-4295-988a-655e7aea5bc1 req-e7a53b4d-d36e-4490-9358-885419ce4221 tempest-AttachVolumeShelveTestJSON-1751174024 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:11:31.928537 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-6601b2ed-e4d9-4295-988a-655e7aea5bc1 req-e7a53b4d-d36e-4490-9358-885419ce4221 tempest-AttachVolumeShelveTestJSON-1751174024 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.166s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:11:31.938080 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-6601b2ed-e4d9-4295-988a-655e7aea5bc1 req-e7a53b4d-d36e-4490-9358-885419ce4221 tempest-AttachVolumeShelveTestJSON-1751174024 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2c7031ef-4247-461a-a5ca-e53470449307', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': '2c7031ef-4247-461a-a5ca-e53470449307', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:11:31.997525 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-6601b2ed-e4d9-4295-988a-655e7aea5bc1 req-e7a53b4d-d36e-4490-9358-885419ce4221 tempest-AttachVolumeShelveTestJSON-1751174024 None] Connection info returned from driver {'name': 'volumes/volume-2c7031ef-4247-461a-a5ca-e53470449307', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2c7031ef-4247-461a-a5ca-e53470449307', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f200cf4b-62b6-4010-9fe4-a64d5316d8f9'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 21:11:32.069080 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-6601b2ed-e4d9-4295-988a-655e7aea5bc1 req-e7a53b4d-d36e-4490-9358-885419ce4221 tempest-AttachVolumeShelveTestJSON-1751174024 None] attachment_update completed successfully. Apr 09 21:11:37.563128 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-5f63fb1a-ebc8-4319-aa9a-3561f1cf7c12 req-fc49d5f3-ab2b-453f-b09d-d3a9e528d13d tempest-ServerRescueNegativeTestJSON-1017505455 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:11:38.474189 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-de635ebc-d2bd-4dc6-b75c-d79c3eaf6bf3 tempest-AttachVolumeNegativeTest-1154334807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:11:38.525425 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-de635ebc-d2bd-4dc6-b75c-d79c3eaf6bf3 tempest-AttachVolumeNegativeTest-1154334807 None] Flow 'volume_create_manager' (1b2a84a5-504f-4528-bc26-a4b8944f2b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:11:38.562277 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-de635ebc-d2bd-4dc6-b75c-d79c3eaf6bf3 tempest-AttachVolumeNegativeTest-1154334807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c01515fb-eb30-43ff-aa43-c943c25bda4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:11:38.579478 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-de635ebc-d2bd-4dc6-b75c-d79c3eaf6bf3 tempest-AttachVolumeNegativeTest-1154334807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c01515fb-eb30-43ff-aa43-c943c25bda4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-368461418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=bfadbca7-6ec2-4a80-84f2-c2e391afc3f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92f38b2c41e34e73bd6baa83478dddfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:11:38Z,use_quota=True,user_id='a6dcb8344fde4e4580e73efc09e633a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:11:38.586014 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-de635ebc-d2bd-4dc6-b75c-d79c3eaf6bf3 tempest-AttachVolumeNegativeTest-1154334807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca720462-5141-4250-a96d-1851f229795b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:11:38.605761 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-de635ebc-d2bd-4dc6-b75c-d79c3eaf6bf3 tempest-AttachVolumeNegativeTest-1154334807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca720462-5141-4250-a96d-1851f229795b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:11:38.612231 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-de635ebc-d2bd-4dc6-b75c-d79c3eaf6bf3 tempest-AttachVolumeNegativeTest-1154334807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (759ec90d-1fa6-4170-94e0-a487e2ab40f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:11:38.618206 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-de635ebc-d2bd-4dc6-b75c-d79c3eaf6bf3 tempest-AttachVolumeNegativeTest-1154334807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (759ec90d-1fa6-4170-94e0-a487e2ab40f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfadbca7-6ec2-4a80-84f2-c2e391afc3f4', 'volume_name': 'volume-bfadbca7-6ec2-4a80-84f2-c2e391afc3f4', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:11:38.649987 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-de635ebc-d2bd-4dc6-b75c-d79c3eaf6bf3 tempest-AttachVolumeNegativeTest-1154334807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf78f192-d22a-437e-a27f-c8dd569adbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:11:38.670029 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-de635ebc-d2bd-4dc6-b75c-d79c3eaf6bf3 tempest-AttachVolumeNegativeTest-1154334807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf78f192-d22a-437e-a27f-c8dd569adbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:11:38.718689 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-de635ebc-d2bd-4dc6-b75c-d79c3eaf6bf3 tempest-AttachVolumeNegativeTest-1154334807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7ace5de-0a39-4bb2-bac4-1e1b9e5cb756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:11:38.723728 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-de635ebc-d2bd-4dc6-b75c-d79c3eaf6bf3 tempest-AttachVolumeNegativeTest-1154334807 None] Volume bfadbca7-6ec2-4a80-84f2-c2e391afc3f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfadbca7-6ec2-4a80-84f2-c2e391afc3f4', 'volume_size': 1} Apr 09 21:11:38.724375 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-de635ebc-d2bd-4dc6-b75c-d79c3eaf6bf3 tempest-AttachVolumeNegativeTest-1154334807 None] creating volume 'volume-bfadbca7-6ec2-4a80-84f2-c2e391afc3f4' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:11:38.729301 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-de635ebc-d2bd-4dc6-b75c-d79c3eaf6bf3 tempest-AttachVolumeNegativeTest-1154334807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:11:38.956424 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-de635ebc-d2bd-4dc6-b75c-d79c3eaf6bf3 tempest-AttachVolumeNegativeTest-1154334807 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:11:38.957382 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-de635ebc-d2bd-4dc6-b75c-d79c3eaf6bf3 tempest-AttachVolumeNegativeTest-1154334807 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:11:38.961788 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-de635ebc-d2bd-4dc6-b75c-d79c3eaf6bf3 tempest-AttachVolumeNegativeTest-1154334807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7ace5de-0a39-4bb2-bac4-1e1b9e5cb756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfadbca7-6ec2-4a80-84f2-c2e391afc3f4', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:11:38.969850 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-de635ebc-d2bd-4dc6-b75c-d79c3eaf6bf3 tempest-AttachVolumeNegativeTest-1154334807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (291028a3-89de-4151-ad90-696191e37a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:11:38.987825 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-5f63fb1a-ebc8-4319-aa9a-3561f1cf7c12 req-fc49d5f3-ab2b-453f-b09d-d3a9e528d13d tempest-ServerRescueNegativeTestJSON-1017505455 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.428s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:11:38.989311 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-5f63fb1a-ebc8-4319-aa9a-3561f1cf7c12 req-fc49d5f3-ab2b-453f-b09d-d3a9e528d13d tempest-ServerRescueNegativeTestJSON-1017505455 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4b07460f-352b-42de-aaa6-13f4befc338a', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': '4b07460f-352b-42de-aaa6-13f4befc338a', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:11:38.993616 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-de635ebc-d2bd-4dc6-b75c-d79c3eaf6bf3 tempest-AttachVolumeNegativeTest-1154334807 None] Volume volume-bfadbca7-6ec2-4a80-84f2-c2e391afc3f4 (bfadbca7-6ec2-4a80-84f2-c2e391afc3f4): created successfully Apr 09 21:11:38.997704 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-de635ebc-d2bd-4dc6-b75c-d79c3eaf6bf3 tempest-AttachVolumeNegativeTest-1154334807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (291028a3-89de-4151-ad90-696191e37a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:11:39.004086 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-de635ebc-d2bd-4dc6-b75c-d79c3eaf6bf3 tempest-AttachVolumeNegativeTest-1154334807 None] Flow 'volume_create_manager' (1b2a84a5-504f-4528-bc26-a4b8944f2b88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:11:39.039398 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-de635ebc-d2bd-4dc6-b75c-d79c3eaf6bf3 tempest-AttachVolumeNegativeTest-1154334807 None] Created volume successfully. Apr 09 21:11:39.048138 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-5f63fb1a-ebc8-4319-aa9a-3561f1cf7c12 req-fc49d5f3-ab2b-453f-b09d-d3a9e528d13d tempest-ServerRescueNegativeTestJSON-1017505455 None] Connection info returned from driver {'name': 'volumes/volume-4b07460f-352b-42de-aaa6-13f4befc338a', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '4b07460f-352b-42de-aaa6-13f4befc338a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b0711f46-1d01-44fa-a33f-e39f5bd758cb'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 21:11:39.189344 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-5f63fb1a-ebc8-4319-aa9a-3561f1cf7c12 req-fc49d5f3-ab2b-453f-b09d-d3a9e528d13d tempest-ServerRescueNegativeTestJSON-1017505455 None] attachment_update completed successfully. Apr 09 21:11:40.869401 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-7b63b969-856c-4c88-938c-1a83c642ab5b req-fb3b472a-3ae1-47dc-861f-89d9bf821425 tempest-AttachVolumeNegativeTest-1154334807 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:11:42.069490 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-7b63b969-856c-4c88-938c-1a83c642ab5b req-fb3b472a-3ae1-47dc-861f-89d9bf821425 tempest-AttachVolumeNegativeTest-1154334807 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.200s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:11:42.071145 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-7b63b969-856c-4c88-938c-1a83c642ab5b req-fb3b472a-3ae1-47dc-861f-89d9bf821425 tempest-AttachVolumeNegativeTest-1154334807 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-bfadbca7-6ec2-4a80-84f2-c2e391afc3f4', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': 'bfadbca7-6ec2-4a80-84f2-c2e391afc3f4', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:11:42.129935 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-7b63b969-856c-4c88-938c-1a83c642ab5b req-fb3b472a-3ae1-47dc-861f-89d9bf821425 tempest-AttachVolumeNegativeTest-1154334807 None] Connection info returned from driver {'name': 'volumes/volume-bfadbca7-6ec2-4a80-84f2-c2e391afc3f4', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'bfadbca7-6ec2-4a80-84f2-c2e391afc3f4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c00a45e8-866e-410e-8c38-306b2288540e'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 21:11:42.291807 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-7b63b969-856c-4c88-938c-1a83c642ab5b req-fb3b472a-3ae1-47dc-861f-89d9bf821425 tempest-AttachVolumeNegativeTest-1154334807 None] attachment_update completed successfully. Apr 09 21:11:49.618396 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:11:49.619024 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:11:49.689539 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:11:49.758344 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:11:50.962046 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea213a29-0fa2-4c0a-8af1-15da1c6d96a8 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:11:50.983964 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ea213a29-0fa2-4c0a-8af1-15da1c6d96a8 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Flow 'volume_create_manager' (b2df9167-f83b-4729-8982-ff7ae275be7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:11:50.992152 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ea213a29-0fa2-4c0a-8af1-15da1c6d96a8 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c80bba-7021-4688-b1d8-196fb929b2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:11:51.010511 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ea213a29-0fa2-4c0a-8af1-15da1c6d96a8 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c80bba-7021-4688-b1d8-196fb929b2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-295092450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=281536ca-8bdf-4be0-a123-cad0438ac40d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff962f8646c4b9c93e3ac77e4e750cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:11:51Z,use_quota=True,user_id='10c382520b4140a1bc4b22ca495fd917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:11:51.015765 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ea213a29-0fa2-4c0a-8af1-15da1c6d96a8 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e67a90be-9f4f-4749-933e-9865d74db501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:11:51.019924 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ea213a29-0fa2-4c0a-8af1-15da1c6d96a8 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e67a90be-9f4f-4749-933e-9865d74db501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:11:51.025327 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ea213a29-0fa2-4c0a-8af1-15da1c6d96a8 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79118673-0f4c-44f1-b4c4-a5be36e882f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:11:51.029609 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ea213a29-0fa2-4c0a-8af1-15da1c6d96a8 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79118673-0f4c-44f1-b4c4-a5be36e882f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '281536ca-8bdf-4be0-a123-cad0438ac40d', 'volume_name': 'volume-281536ca-8bdf-4be0-a123-cad0438ac40d', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:11:51.034623 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ea213a29-0fa2-4c0a-8af1-15da1c6d96a8 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e7c0b5a-0960-4c5d-b7e4-35c6656ff903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:11:51.038640 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ea213a29-0fa2-4c0a-8af1-15da1c6d96a8 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e7c0b5a-0960-4c5d-b7e4-35c6656ff903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:11:51.043634 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ea213a29-0fa2-4c0a-8af1-15da1c6d96a8 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f272e73-dd01-4699-8783-370fe828be34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:11:51.044733 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-ea213a29-0fa2-4c0a-8af1-15da1c6d96a8 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Volume 281536ca-8bdf-4be0-a123-cad0438ac40d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-281536ca-8bdf-4be0-a123-cad0438ac40d', 'volume_size': 1} Apr 09 21:11:51.045376 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ea213a29-0fa2-4c0a-8af1-15da1c6d96a8 tempest-VolumeQuotasAdminTestJSON-1870435257 None] creating volume 'volume-281536ca-8bdf-4be0-a123-cad0438ac40d' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:11:51.046099 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ea213a29-0fa2-4c0a-8af1-15da1c6d96a8 tempest-VolumeQuotasAdminTestJSON-1870435257 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:11:51.138487 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ea213a29-0fa2-4c0a-8af1-15da1c6d96a8 tempest-VolumeQuotasAdminTestJSON-1870435257 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:11:51.138898 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ea213a29-0fa2-4c0a-8af1-15da1c6d96a8 tempest-VolumeQuotasAdminTestJSON-1870435257 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:11:51.143751 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ea213a29-0fa2-4c0a-8af1-15da1c6d96a8 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f272e73-dd01-4699-8783-370fe828be34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-281536ca-8bdf-4be0-a123-cad0438ac40d', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:11:51.150319 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ea213a29-0fa2-4c0a-8af1-15da1c6d96a8 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (788ad864-9de6-4834-950e-3805a7f49e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:11:51.163794 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-ea213a29-0fa2-4c0a-8af1-15da1c6d96a8 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Volume volume-281536ca-8bdf-4be0-a123-cad0438ac40d (281536ca-8bdf-4be0-a123-cad0438ac40d): created successfully Apr 09 21:11:51.168061 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ea213a29-0fa2-4c0a-8af1-15da1c6d96a8 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (788ad864-9de6-4834-950e-3805a7f49e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:11:51.174772 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ea213a29-0fa2-4c0a-8af1-15da1c6d96a8 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Flow 'volume_create_manager' (b2df9167-f83b-4729-8982-ff7ae275be7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:11:51.184471 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-ea213a29-0fa2-4c0a-8af1-15da1c6d96a8 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Created volume successfully. Apr 09 21:11:52.116916 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-582b4b8e-900b-4fc5-a636-3486a435a0c5 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Lock "b'cinder-281536ca-8bdf-4be0-a123-cad0438ac40d-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:11:52.208277 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-582b4b8e-900b-4fc5-a636-3486a435a0c5 tempest-VolumeQuotasAdminTestJSON-1870435257 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:11:52.300766 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-582b4b8e-900b-4fc5-a636-3486a435a0c5 tempest-VolumeQuotasAdminTestJSON-1870435257 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:11:52.301292 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-582b4b8e-900b-4fc5-a636-3486a435a0c5 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Volume volume-281536ca-8bdf-4be0-a123-cad0438ac40d is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:11:52.317904 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-582b4b8e-900b-4fc5-a636-3486a435a0c5 tempest-VolumeQuotasAdminTestJSON-1870435257 None] deleting rbd volume volume-281536ca-8bdf-4be0-a123-cad0438ac40d {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:11:52.806685 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-582b4b8e-900b-4fc5-a636-3486a435a0c5 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Created reservations ['8954c0d8-ac3f-466b-b2e9-6feb27d68663', 'a75218b5-5fab-44bf-b36f-de6fc8f3401c', '360d173f-5dfe-497c-beaf-1349b55ac807', '5750cc43-37b5-4c12-bb86-5cc96f3f0145'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:11:52.875500 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-582b4b8e-900b-4fc5-a636-3486a435a0c5 tempest-VolumeQuotasAdminTestJSON-1870435257 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:11:52.929343 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-582b4b8e-900b-4fc5-a636-3486a435a0c5 tempest-VolumeQuotasAdminTestJSON-1870435257 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:11:52.986342 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-582b4b8e-900b-4fc5-a636-3486a435a0c5 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:11:53.007257 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-582b4b8e-900b-4fc5-a636-3486a435a0c5 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Deleted volume successfully. Apr 09 21:11:53.038999 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-582b4b8e-900b-4fc5-a636-3486a435a0c5 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Lock "b'cinder-281536ca-8bdf-4be0-a123-cad0438ac40d-delete_volume'" released by "delete_volume" :: held 0.923s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:11:53.901478 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-334ac701-bcab-4776-9ac1-a9176fc57511 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:11:53.929140 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-334ac701-bcab-4776-9ac1-a9176fc57511 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Flow 'volume_create_manager' (d1e6d781-04bf-4d7b-9af4-809cb43427af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:11:53.937412 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-334ac701-bcab-4776-9ac1-a9176fc57511 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74c0e4a6-451f-414d-a295-c24dd2d2d168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:11:53.954972 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-334ac701-bcab-4776-9ac1-a9176fc57511 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74c0e4a6-451f-414d-a295-c24dd2d2d168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1514919407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4e41b88f-d074-45c5-af16-bb83e239beba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff962f8646c4b9c93e3ac77e4e750cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:11:54Z,use_quota=True,user_id='10c382520b4140a1bc4b22ca495fd917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:11:53.961427 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-334ac701-bcab-4776-9ac1-a9176fc57511 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9344e8e-2cee-457e-9e4e-1ad6b4560179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:11:53.966580 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-334ac701-bcab-4776-9ac1-a9176fc57511 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9344e8e-2cee-457e-9e4e-1ad6b4560179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:11:53.972931 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-334ac701-bcab-4776-9ac1-a9176fc57511 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbe75f0d-2d2d-416a-997e-7492726ca844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:11:53.978131 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-334ac701-bcab-4776-9ac1-a9176fc57511 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbe75f0d-2d2d-416a-997e-7492726ca844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e41b88f-d074-45c5-af16-bb83e239beba', 'volume_name': 'volume-4e41b88f-d074-45c5-af16-bb83e239beba', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:11:53.984233 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-334ac701-bcab-4776-9ac1-a9176fc57511 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fb24722-5e17-402d-b794-13d2a43a8f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:11:53.988719 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-334ac701-bcab-4776-9ac1-a9176fc57511 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fb24722-5e17-402d-b794-13d2a43a8f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:11:53.993995 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-334ac701-bcab-4776-9ac1-a9176fc57511 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48feff84-731b-41fe-96f1-3f858b0aaa41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:11:53.995505 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-334ac701-bcab-4776-9ac1-a9176fc57511 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Volume 4e41b88f-d074-45c5-af16-bb83e239beba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e41b88f-d074-45c5-af16-bb83e239beba', 'volume_size': 1} Apr 09 21:11:53.996084 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-334ac701-bcab-4776-9ac1-a9176fc57511 tempest-VolumeQuotasAdminTestJSON-1870435257 None] creating volume 'volume-4e41b88f-d074-45c5-af16-bb83e239beba' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:11:53.996973 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-334ac701-bcab-4776-9ac1-a9176fc57511 tempest-VolumeQuotasAdminTestJSON-1870435257 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:11:54.106357 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-334ac701-bcab-4776-9ac1-a9176fc57511 tempest-VolumeQuotasAdminTestJSON-1870435257 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:11:54.106829 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-334ac701-bcab-4776-9ac1-a9176fc57511 tempest-VolumeQuotasAdminTestJSON-1870435257 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:11:54.113708 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-334ac701-bcab-4776-9ac1-a9176fc57511 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48feff84-731b-41fe-96f1-3f858b0aaa41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e41b88f-d074-45c5-af16-bb83e239beba', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:11:54.119648 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-334ac701-bcab-4776-9ac1-a9176fc57511 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f6cf61e-0b4c-43b0-9c61-efe5b1ac80d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:11:54.133737 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-334ac701-bcab-4776-9ac1-a9176fc57511 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Volume volume-4e41b88f-d074-45c5-af16-bb83e239beba (4e41b88f-d074-45c5-af16-bb83e239beba): created successfully Apr 09 21:11:54.138477 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-334ac701-bcab-4776-9ac1-a9176fc57511 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f6cf61e-0b4c-43b0-9c61-efe5b1ac80d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:11:54.149063 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-334ac701-bcab-4776-9ac1-a9176fc57511 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Flow 'volume_create_manager' (d1e6d781-04bf-4d7b-9af4-809cb43427af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:11:54.159725 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-334ac701-bcab-4776-9ac1-a9176fc57511 tempest-VolumeQuotasAdminTestJSON-1870435257 None] Created volume successfully. Apr 09 21:11:55.966778 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-2561de68-9fb1-45f1-a445-05af00ad7e1d tempest-VolumeQuotasAdminTestJSON-1407955904 None] Transfer volume completed successfully. Apr 09 21:11:56.670584 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-9c3bb87e-f490-4645-8f09-a2f7d1fb5a75 tempest-VolumeQuotasAdminTestJSON-1830378330 None] Lock "b'cinder-4e41b88f-d074-45c5-af16-bb83e239beba-delete_volume'" acquired by "delete_volume" :: waited 0.034s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:11:56.741298 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9c3bb87e-f490-4645-8f09-a2f7d1fb5a75 tempest-VolumeQuotasAdminTestJSON-1830378330 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:11:56.914813 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9c3bb87e-f490-4645-8f09-a2f7d1fb5a75 tempest-VolumeQuotasAdminTestJSON-1830378330 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:11:56.915249 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9c3bb87e-f490-4645-8f09-a2f7d1fb5a75 tempest-VolumeQuotasAdminTestJSON-1830378330 None] Volume volume-4e41b88f-d074-45c5-af16-bb83e239beba is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:11:56.931865 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9c3bb87e-f490-4645-8f09-a2f7d1fb5a75 tempest-VolumeQuotasAdminTestJSON-1830378330 None] deleting rbd volume volume-4e41b88f-d074-45c5-af16-bb83e239beba {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:11:57.093803 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f4f685a-3a79-4b4a-927f-cea59e073c51 tempest-AttachVolumeTestJSON-873042647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:11:57.122063 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8f4f685a-3a79-4b4a-927f-cea59e073c51 tempest-AttachVolumeTestJSON-873042647 None] Flow 'volume_create_manager' (d72292f8-a9e0-42fc-91c3-2e9d2bb3651d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:11:57.130545 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8f4f685a-3a79-4b4a-927f-cea59e073c51 tempest-AttachVolumeTestJSON-873042647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6604f13c-49db-4ac1-baaf-4cd225ee6f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:11:57.163402 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8f4f685a-3a79-4b4a-927f-cea59e073c51 tempest-AttachVolumeTestJSON-873042647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6604f13c-49db-4ac1-baaf-4cd225ee6f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-905964908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1a4f83a5-a376-4491-abce-9211e77574a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd53d98faf74d6a92cdfabace62b088',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:11:57Z,use_quota=True,user_id='7ce296c1004c4976930f46de34be880d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:11:57.171119 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8f4f685a-3a79-4b4a-927f-cea59e073c51 tempest-AttachVolumeTestJSON-873042647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aadc24ad-a0e9-4eeb-af0c-b0e0c1969ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:11:57.176168 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8f4f685a-3a79-4b4a-927f-cea59e073c51 tempest-AttachVolumeTestJSON-873042647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aadc24ad-a0e9-4eeb-af0c-b0e0c1969ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:11:57.183551 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8f4f685a-3a79-4b4a-927f-cea59e073c51 tempest-AttachVolumeTestJSON-873042647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (778aab47-0b5f-46f1-8572-4bf1c9f3606b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:11:57.188385 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8f4f685a-3a79-4b4a-927f-cea59e073c51 tempest-AttachVolumeTestJSON-873042647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (778aab47-0b5f-46f1-8572-4bf1c9f3606b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a4f83a5-a376-4491-abce-9211e77574a6', 'volume_name': 'volume-1a4f83a5-a376-4491-abce-9211e77574a6', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:11:57.194761 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8f4f685a-3a79-4b4a-927f-cea59e073c51 tempest-AttachVolumeTestJSON-873042647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72927f93-4647-4dbb-a1a2-8c6b124dff83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:11:57.199242 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8f4f685a-3a79-4b4a-927f-cea59e073c51 tempest-AttachVolumeTestJSON-873042647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72927f93-4647-4dbb-a1a2-8c6b124dff83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:11:57.204690 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8f4f685a-3a79-4b4a-927f-cea59e073c51 tempest-AttachVolumeTestJSON-873042647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6f9d698-f94a-4636-ac11-1f294c19d878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:11:57.206138 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-8f4f685a-3a79-4b4a-927f-cea59e073c51 tempest-AttachVolumeTestJSON-873042647 None] Volume 1a4f83a5-a376-4491-abce-9211e77574a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a4f83a5-a376-4491-abce-9211e77574a6', 'volume_size': 1} Apr 09 21:11:57.207293 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-8f4f685a-3a79-4b4a-927f-cea59e073c51 tempest-AttachVolumeTestJSON-873042647 None] creating volume 'volume-1a4f83a5-a376-4491-abce-9211e77574a6' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:11:57.208536 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-8f4f685a-3a79-4b4a-927f-cea59e073c51 tempest-AttachVolumeTestJSON-873042647 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:11:57.328020 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-8f4f685a-3a79-4b4a-927f-cea59e073c51 tempest-AttachVolumeTestJSON-873042647 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:11:57.328309 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-8f4f685a-3a79-4b4a-927f-cea59e073c51 tempest-AttachVolumeTestJSON-873042647 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:11:57.338671 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8f4f685a-3a79-4b4a-927f-cea59e073c51 tempest-AttachVolumeTestJSON-873042647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6f9d698-f94a-4636-ac11-1f294c19d878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a4f83a5-a376-4491-abce-9211e77574a6', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:11:57.355650 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8f4f685a-3a79-4b4a-927f-cea59e073c51 tempest-AttachVolumeTestJSON-873042647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99d4fe79-fd10-4a91-94ee-8876b99bea60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:11:57.383410 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-8f4f685a-3a79-4b4a-927f-cea59e073c51 tempest-AttachVolumeTestJSON-873042647 None] Volume volume-1a4f83a5-a376-4491-abce-9211e77574a6 (1a4f83a5-a376-4491-abce-9211e77574a6): created successfully Apr 09 21:11:57.403414 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8f4f685a-3a79-4b4a-927f-cea59e073c51 tempest-AttachVolumeTestJSON-873042647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99d4fe79-fd10-4a91-94ee-8876b99bea60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:11:57.425252 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8f4f685a-3a79-4b4a-927f-cea59e073c51 tempest-AttachVolumeTestJSON-873042647 None] Flow 'volume_create_manager' (d72292f8-a9e0-42fc-91c3-2e9d2bb3651d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:11:57.454369 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-8f4f685a-3a79-4b4a-927f-cea59e073c51 tempest-AttachVolumeTestJSON-873042647 None] Created volume successfully. Apr 09 21:11:57.563004 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-9c3bb87e-f490-4645-8f09-a2f7d1fb5a75 tempest-VolumeQuotasAdminTestJSON-1830378330 None] Created reservations ['df85f2af-9370-4384-abf5-8da67a187b3a', '785dd6dd-5e2d-42cb-b7a3-8234ab22a60c', 'cb99e305-6c29-437a-88e1-70c57bb319a1', 'abf8d48c-0e00-489a-99a0-84e50be9c71a'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:11:57.690139 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9c3bb87e-f490-4645-8f09-a2f7d1fb5a75 tempest-VolumeQuotasAdminTestJSON-1830378330 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:11:57.782232 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9c3bb87e-f490-4645-8f09-a2f7d1fb5a75 tempest-VolumeQuotasAdminTestJSON-1830378330 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:11:57.867572 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-9c3bb87e-f490-4645-8f09-a2f7d1fb5a75 tempest-VolumeQuotasAdminTestJSON-1830378330 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:11:57.872364 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-9c3bb87e-f490-4645-8f09-a2f7d1fb5a75 tempest-VolumeQuotasAdminTestJSON-1830378330 None] Deleted volume successfully. Apr 09 21:11:57.893966 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-9c3bb87e-f490-4645-8f09-a2f7d1fb5a75 tempest-VolumeQuotasAdminTestJSON-1830378330 None] Lock "b'cinder-4e41b88f-d074-45c5-af16-bb83e239beba-delete_volume'" released by "delete_volume" :: held 1.226s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:12:00.678087 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-2e317500-e657-4f74-a4e0-62cb759dbc8f req-6411b768-7439-4a04-8670-c231277260fd tempest-AttachVolumeTestJSON-873042647 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:12:01.770198 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-2e317500-e657-4f74-a4e0-62cb759dbc8f req-6411b768-7439-4a04-8670-c231277260fd tempest-AttachVolumeTestJSON-873042647 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.091s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:12:01.772065 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-2e317500-e657-4f74-a4e0-62cb759dbc8f req-6411b768-7439-4a04-8670-c231277260fd tempest-AttachVolumeTestJSON-873042647 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1a4f83a5-a376-4491-abce-9211e77574a6', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': '1a4f83a5-a376-4491-abce-9211e77574a6', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:12:01.811891 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-2e317500-e657-4f74-a4e0-62cb759dbc8f req-6411b768-7439-4a04-8670-c231277260fd tempest-AttachVolumeTestJSON-873042647 None] Connection info returned from driver {'name': 'volumes/volume-1a4f83a5-a376-4491-abce-9211e77574a6', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1a4f83a5-a376-4491-abce-9211e77574a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9a9f15e7-1d8f-4836-83db-70862db80b54'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 21:12:01.902781 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-2e317500-e657-4f74-a4e0-62cb759dbc8f req-6411b768-7439-4a04-8670-c231277260fd tempest-AttachVolumeTestJSON-873042647 None] attachment_update completed successfully. Apr 09 21:12:06.582350 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a487b19-fa05-44e9-a3d8-51fe78c88ea3 tempest-VolumeQuotasNegativeTestJSON-1210234901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:12:06.611519 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6a487b19-fa05-44e9-a3d8-51fe78c88ea3 tempest-VolumeQuotasNegativeTestJSON-1210234901 None] Flow 'volume_create_manager' (d6bc2b95-acad-476e-a0e6-ce46bca0fffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:12:06.619454 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6a487b19-fa05-44e9-a3d8-51fe78c88ea3 tempest-VolumeQuotasNegativeTestJSON-1210234901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (060a935d-51e7-445e-b5e3-13714771d7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:06.645263 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6a487b19-fa05-44e9-a3d8-51fe78c88ea3 tempest-VolumeQuotasNegativeTestJSON-1210234901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (060a935d-51e7-445e-b5e3-13714771d7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1221846174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=343e7327-25fd-4e45-9007-b8b2c5c816a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f1b43b503244eac945f137cf5cfdebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:12:07Z,use_quota=True,user_id='5adf05308fc1421595eeddd8f46f744d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:06.652133 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6a487b19-fa05-44e9-a3d8-51fe78c88ea3 tempest-VolumeQuotasNegativeTestJSON-1210234901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06f822d9-513f-4a1c-9b54-01b3439ac93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:06.657009 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6a487b19-fa05-44e9-a3d8-51fe78c88ea3 tempest-VolumeQuotasNegativeTestJSON-1210234901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06f822d9-513f-4a1c-9b54-01b3439ac93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:06.662772 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6a487b19-fa05-44e9-a3d8-51fe78c88ea3 tempest-VolumeQuotasNegativeTestJSON-1210234901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a9b254-3f9b-4935-89cc-e38903d14fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:06.667345 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6a487b19-fa05-44e9-a3d8-51fe78c88ea3 tempest-VolumeQuotasNegativeTestJSON-1210234901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a9b254-3f9b-4935-89cc-e38903d14fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '343e7327-25fd-4e45-9007-b8b2c5c816a1', 'volume_name': 'volume-343e7327-25fd-4e45-9007-b8b2c5c816a1', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:06.673185 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6a487b19-fa05-44e9-a3d8-51fe78c88ea3 tempest-VolumeQuotasNegativeTestJSON-1210234901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (445ec0d9-2d91-49c7-b021-8a58a90bbcf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:06.677401 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6a487b19-fa05-44e9-a3d8-51fe78c88ea3 tempest-VolumeQuotasNegativeTestJSON-1210234901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (445ec0d9-2d91-49c7-b021-8a58a90bbcf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:06.683157 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6a487b19-fa05-44e9-a3d8-51fe78c88ea3 tempest-VolumeQuotasNegativeTestJSON-1210234901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f711f7-6c3b-4c8e-9ca3-ed1e2ee311ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:06.684354 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-6a487b19-fa05-44e9-a3d8-51fe78c88ea3 tempest-VolumeQuotasNegativeTestJSON-1210234901 None] Volume 343e7327-25fd-4e45-9007-b8b2c5c816a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-343e7327-25fd-4e45-9007-b8b2c5c816a1', 'volume_size': 1} Apr 09 21:12:06.684964 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-6a487b19-fa05-44e9-a3d8-51fe78c88ea3 tempest-VolumeQuotasNegativeTestJSON-1210234901 None] creating volume 'volume-343e7327-25fd-4e45-9007-b8b2c5c816a1' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:12:06.686363 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-6a487b19-fa05-44e9-a3d8-51fe78c88ea3 tempest-VolumeQuotasNegativeTestJSON-1210234901 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:06.830251 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-6a487b19-fa05-44e9-a3d8-51fe78c88ea3 tempest-VolumeQuotasNegativeTestJSON-1210234901 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:12:06.831049 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-6a487b19-fa05-44e9-a3d8-51fe78c88ea3 tempest-VolumeQuotasNegativeTestJSON-1210234901 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:12:06.835332 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6a487b19-fa05-44e9-a3d8-51fe78c88ea3 tempest-VolumeQuotasNegativeTestJSON-1210234901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f711f7-6c3b-4c8e-9ca3-ed1e2ee311ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-343e7327-25fd-4e45-9007-b8b2c5c816a1', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:06.844335 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6a487b19-fa05-44e9-a3d8-51fe78c88ea3 tempest-VolumeQuotasNegativeTestJSON-1210234901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97a99c6a-6264-4d2e-bafc-d165e52a1dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:06.859188 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-6a487b19-fa05-44e9-a3d8-51fe78c88ea3 tempest-VolumeQuotasNegativeTestJSON-1210234901 None] Volume volume-343e7327-25fd-4e45-9007-b8b2c5c816a1 (343e7327-25fd-4e45-9007-b8b2c5c816a1): created successfully Apr 09 21:12:06.870776 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6a487b19-fa05-44e9-a3d8-51fe78c88ea3 tempest-VolumeQuotasNegativeTestJSON-1210234901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97a99c6a-6264-4d2e-bafc-d165e52a1dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:06.885789 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6a487b19-fa05-44e9-a3d8-51fe78c88ea3 tempest-VolumeQuotasNegativeTestJSON-1210234901 None] Flow 'volume_create_manager' (d6bc2b95-acad-476e-a0e6-ce46bca0fffa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:12:06.902292 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-6a487b19-fa05-44e9-a3d8-51fe78c88ea3 tempest-VolumeQuotasNegativeTestJSON-1210234901 None] Created volume successfully. Apr 09 21:12:08.992839 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-db3dad19-e92a-45ea-819c-59898089bdaf tempest-VolumeQuotasNegativeTestJSON-1210234901 None] Lock "b'cinder-343e7327-25fd-4e45-9007-b8b2c5c816a1-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:12:09.062621 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-db3dad19-e92a-45ea-819c-59898089bdaf tempest-VolumeQuotasNegativeTestJSON-1210234901 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:09.166425 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-db3dad19-e92a-45ea-819c-59898089bdaf tempest-VolumeQuotasNegativeTestJSON-1210234901 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:12:09.167306 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-db3dad19-e92a-45ea-819c-59898089bdaf tempest-VolumeQuotasNegativeTestJSON-1210234901 None] Volume volume-343e7327-25fd-4e45-9007-b8b2c5c816a1 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:12:09.196831 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-db3dad19-e92a-45ea-819c-59898089bdaf tempest-VolumeQuotasNegativeTestJSON-1210234901 None] deleting rbd volume volume-343e7327-25fd-4e45-9007-b8b2c5c816a1 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:12:09.875936 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-db3dad19-e92a-45ea-819c-59898089bdaf tempest-VolumeQuotasNegativeTestJSON-1210234901 None] Created reservations ['2d467890-1351-469f-bf66-1aa6b5bf0c25', 'a683e594-b9a8-4d43-ade6-8f35667ee7dc', '3795d409-1f51-4258-8361-f3463760d8b7', 'c21aa031-5b00-4810-aa66-8c2a645c5518'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:12:09.951636 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-db3dad19-e92a-45ea-819c-59898089bdaf tempest-VolumeQuotasNegativeTestJSON-1210234901 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:10.042657 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-db3dad19-e92a-45ea-819c-59898089bdaf tempest-VolumeQuotasNegativeTestJSON-1210234901 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:10.123028 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-db3dad19-e92a-45ea-819c-59898089bdaf tempest-VolumeQuotasNegativeTestJSON-1210234901 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:12:10.129640 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-db3dad19-e92a-45ea-819c-59898089bdaf tempest-VolumeQuotasNegativeTestJSON-1210234901 None] Deleted volume successfully. Apr 09 21:12:10.153764 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-db3dad19-e92a-45ea-819c-59898089bdaf tempest-VolumeQuotasNegativeTestJSON-1210234901 None] Lock "b'cinder-343e7327-25fd-4e45-9007-b8b2c5c816a1-delete_volume'" released by "delete_volume" :: held 1.161s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:12:14.093121 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaf58b9d-385c-49ea-b90f-e0b91f233ee6 tempest-VolumeRetypeWithoutMigrationTest-638271825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:12:14.124072 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eaf58b9d-385c-49ea-b90f-e0b91f233ee6 tempest-VolumeRetypeWithoutMigrationTest-638271825 None] Flow 'volume_create_manager' (94c1b658-9204-49bd-b944-da516803866e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:12:14.144514 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eaf58b9d-385c-49ea-b90f-e0b91f233ee6 tempest-VolumeRetypeWithoutMigrationTest-638271825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20df2c51-eca1-4de0-a5ae-f6dad28f022d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:14.165292 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eaf58b9d-385c-49ea-b90f-e0b91f233ee6 tempest-VolumeRetypeWithoutMigrationTest-638271825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20df2c51-eca1-4de0-a5ae-f6dad28f022d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1446905973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=20d11cf0-d3a1-4e31-abcf-cff17b04848f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4278f12b2484658b204fec79172cd04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:12:14Z,use_quota=True,user_id='7a45a5cde3bb44138a006c29a68542e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ac40e9-fff9-4cfa-9736-cdc4b449be97),volume_type_id=a7ac40e9-fff9-4cfa-9736-cdc4b449be97)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:14.174689 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eaf58b9d-385c-49ea-b90f-e0b91f233ee6 tempest-VolumeRetypeWithoutMigrationTest-638271825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4740d749-756a-4837-abcd-0353e86ca656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:14.181694 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eaf58b9d-385c-49ea-b90f-e0b91f233ee6 tempest-VolumeRetypeWithoutMigrationTest-638271825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4740d749-756a-4837-abcd-0353e86ca656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:14.191486 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eaf58b9d-385c-49ea-b90f-e0b91f233ee6 tempest-VolumeRetypeWithoutMigrationTest-638271825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e416165-8838-4f67-8b8e-97af5f9caf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:14.197947 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eaf58b9d-385c-49ea-b90f-e0b91f233ee6 tempest-VolumeRetypeWithoutMigrationTest-638271825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e416165-8838-4f67-8b8e-97af5f9caf4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20d11cf0-d3a1-4e31-abcf-cff17b04848f', 'volume_name': 'volume-20d11cf0-d3a1-4e31-abcf-cff17b04848f', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:14.205445 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eaf58b9d-385c-49ea-b90f-e0b91f233ee6 tempest-VolumeRetypeWithoutMigrationTest-638271825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27b6cb70-5d8c-4798-baab-21f1d1591d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:14.211144 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eaf58b9d-385c-49ea-b90f-e0b91f233ee6 tempest-VolumeRetypeWithoutMigrationTest-638271825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27b6cb70-5d8c-4798-baab-21f1d1591d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:14.218531 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eaf58b9d-385c-49ea-b90f-e0b91f233ee6 tempest-VolumeRetypeWithoutMigrationTest-638271825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca58aeff-4b1e-47e0-83c7-9262fca1b448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:14.220226 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-eaf58b9d-385c-49ea-b90f-e0b91f233ee6 tempest-VolumeRetypeWithoutMigrationTest-638271825 None] Volume 20d11cf0-d3a1-4e31-abcf-cff17b04848f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20d11cf0-d3a1-4e31-abcf-cff17b04848f', 'volume_size': 1} Apr 09 21:12:14.222110 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-eaf58b9d-385c-49ea-b90f-e0b91f233ee6 tempest-VolumeRetypeWithoutMigrationTest-638271825 None] creating volume 'volume-20d11cf0-d3a1-4e31-abcf-cff17b04848f' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:12:14.223199 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-eaf58b9d-385c-49ea-b90f-e0b91f233ee6 tempest-VolumeRetypeWithoutMigrationTest-638271825 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:14.351760 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-eaf58b9d-385c-49ea-b90f-e0b91f233ee6 tempest-VolumeRetypeWithoutMigrationTest-638271825 None] extra_specs: {} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:12:14.352256 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-eaf58b9d-385c-49ea-b90f-e0b91f233ee6 tempest-VolumeRetypeWithoutMigrationTest-638271825 None] extra_specs: {} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:12:14.356189 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eaf58b9d-385c-49ea-b90f-e0b91f233ee6 tempest-VolumeRetypeWithoutMigrationTest-638271825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca58aeff-4b1e-47e0-83c7-9262fca1b448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20d11cf0-d3a1-4e31-abcf-cff17b04848f', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:14.361389 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eaf58b9d-385c-49ea-b90f-e0b91f233ee6 tempest-VolumeRetypeWithoutMigrationTest-638271825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d925757e-d185-400e-b0b7-5bc9b7d8b914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:14.375949 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-eaf58b9d-385c-49ea-b90f-e0b91f233ee6 tempest-VolumeRetypeWithoutMigrationTest-638271825 None] Volume volume-20d11cf0-d3a1-4e31-abcf-cff17b04848f (20d11cf0-d3a1-4e31-abcf-cff17b04848f): created successfully Apr 09 21:12:14.387410 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eaf58b9d-385c-49ea-b90f-e0b91f233ee6 tempest-VolumeRetypeWithoutMigrationTest-638271825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d925757e-d185-400e-b0b7-5bc9b7d8b914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:14.396362 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eaf58b9d-385c-49ea-b90f-e0b91f233ee6 tempest-VolumeRetypeWithoutMigrationTest-638271825 None] Flow 'volume_create_manager' (94c1b658-9204-49bd-b944-da516803866e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:12:14.417251 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-eaf58b9d-385c-49ea-b90f-e0b91f233ee6 tempest-VolumeRetypeWithoutMigrationTest-638271825 None] Created volume successfully. Apr 09 21:12:15.589516 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a0b81bc4-9da6-47c5-8139-f9111249013a tempest-VolumeRetypeWithoutMigrationTest-638271825 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:15.657555 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a0b81bc4-9da6-47c5-8139-f9111249013a tempest-VolumeRetypeWithoutMigrationTest-638271825 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:15.700980 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-a0b81bc4-9da6-47c5-8139-f9111249013a tempest-VolumeRetypeWithoutMigrationTest-638271825 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:12:15.706320 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-a0b81bc4-9da6-47c5-8139-f9111249013a tempest-VolumeRetypeWithoutMigrationTest-638271825 None] Retype volume completed successfully. Apr 09 21:12:15.732827 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2d65ad2-f815-45bf-8735-4f56c1152428 tempest-VolumeSnapshotQuotasNegativeTestJSON-63536344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:12:15.759750 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2d65ad2-f815-45bf-8735-4f56c1152428 tempest-VolumeSnapshotQuotasNegativeTestJSON-63536344 None] Flow 'volume_create_manager' (65fe067c-869e-490f-a65e-3d6ae1a1fb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:12:15.767188 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2d65ad2-f815-45bf-8735-4f56c1152428 tempest-VolumeSnapshotQuotasNegativeTestJSON-63536344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c29cbb6-528f-43b6-b0fa-977587ce7721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:15.787931 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2d65ad2-f815-45bf-8735-4f56c1152428 tempest-VolumeSnapshotQuotasNegativeTestJSON-63536344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c29cbb6-528f-43b6-b0fa-977587ce7721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-671959521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=426716ec-bc93-4162-95fe-e07143c00b2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc1b8680b8e64fe3b97b0b0c90675c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:12:16Z,use_quota=True,user_id='5c8b21ae96b14afa9c0ca9ac21b351f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:15.796233 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2d65ad2-f815-45bf-8735-4f56c1152428 tempest-VolumeSnapshotQuotasNegativeTestJSON-63536344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0b0dd5f-950d-465f-ac94-eda94b88ff42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:15.801777 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2d65ad2-f815-45bf-8735-4f56c1152428 tempest-VolumeSnapshotQuotasNegativeTestJSON-63536344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0b0dd5f-950d-465f-ac94-eda94b88ff42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:15.807811 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2d65ad2-f815-45bf-8735-4f56c1152428 tempest-VolumeSnapshotQuotasNegativeTestJSON-63536344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60887f9f-5e83-477b-b441-f287e79a523c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:15.812584 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2d65ad2-f815-45bf-8735-4f56c1152428 tempest-VolumeSnapshotQuotasNegativeTestJSON-63536344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60887f9f-5e83-477b-b441-f287e79a523c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '426716ec-bc93-4162-95fe-e07143c00b2c', 'volume_name': 'volume-426716ec-bc93-4162-95fe-e07143c00b2c', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:15.819424 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2d65ad2-f815-45bf-8735-4f56c1152428 tempest-VolumeSnapshotQuotasNegativeTestJSON-63536344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7e22029-6b94-4f9b-a57e-e1cb675c599a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:15.826204 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2d65ad2-f815-45bf-8735-4f56c1152428 tempest-VolumeSnapshotQuotasNegativeTestJSON-63536344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7e22029-6b94-4f9b-a57e-e1cb675c599a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:15.833323 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2d65ad2-f815-45bf-8735-4f56c1152428 tempest-VolumeSnapshotQuotasNegativeTestJSON-63536344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2606a4c-3f69-4f26-842f-c9ffbed1d99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:15.835332 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-e2d65ad2-f815-45bf-8735-4f56c1152428 tempest-VolumeSnapshotQuotasNegativeTestJSON-63536344 None] Volume 426716ec-bc93-4162-95fe-e07143c00b2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-426716ec-bc93-4162-95fe-e07143c00b2c', 'volume_size': 1} Apr 09 21:12:15.835817 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-e2d65ad2-f815-45bf-8735-4f56c1152428 tempest-VolumeSnapshotQuotasNegativeTestJSON-63536344 None] creating volume 'volume-426716ec-bc93-4162-95fe-e07143c00b2c' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:12:15.836587 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-e2d65ad2-f815-45bf-8735-4f56c1152428 tempest-VolumeSnapshotQuotasNegativeTestJSON-63536344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:15.958895 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-e2d65ad2-f815-45bf-8735-4f56c1152428 tempest-VolumeSnapshotQuotasNegativeTestJSON-63536344 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:12:15.959850 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-e2d65ad2-f815-45bf-8735-4f56c1152428 tempest-VolumeSnapshotQuotasNegativeTestJSON-63536344 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:12:15.964000 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2d65ad2-f815-45bf-8735-4f56c1152428 tempest-VolumeSnapshotQuotasNegativeTestJSON-63536344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2606a4c-3f69-4f26-842f-c9ffbed1d99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-426716ec-bc93-4162-95fe-e07143c00b2c', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:15.972825 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2d65ad2-f815-45bf-8735-4f56c1152428 tempest-VolumeSnapshotQuotasNegativeTestJSON-63536344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fab535c-0739-4cdd-a175-e09da59b9b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:16.001402 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-e2d65ad2-f815-45bf-8735-4f56c1152428 tempest-VolumeSnapshotQuotasNegativeTestJSON-63536344 None] Volume volume-426716ec-bc93-4162-95fe-e07143c00b2c (426716ec-bc93-4162-95fe-e07143c00b2c): created successfully Apr 09 21:12:16.008192 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2d65ad2-f815-45bf-8735-4f56c1152428 tempest-VolumeSnapshotQuotasNegativeTestJSON-63536344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fab535c-0739-4cdd-a175-e09da59b9b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:16.015002 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2d65ad2-f815-45bf-8735-4f56c1152428 tempest-VolumeSnapshotQuotasNegativeTestJSON-63536344 None] Flow 'volume_create_manager' (65fe067c-869e-490f-a65e-3d6ae1a1fb91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:12:16.026127 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-e2d65ad2-f815-45bf-8735-4f56c1152428 tempest-VolumeSnapshotQuotasNegativeTestJSON-63536344 None] Created volume successfully. Apr 09 21:12:16.759844 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-890ad7f7-cdd8-476c-85b8-dd40b4e224da tempest-VolumeRetypeWithoutMigrationTest-638271825 None] Lock "b'cinder-20d11cf0-d3a1-4e31-abcf-cff17b04848f-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:12:16.824590 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-890ad7f7-cdd8-476c-85b8-dd40b4e224da tempest-VolumeRetypeWithoutMigrationTest-638271825 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:16.907369 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-890ad7f7-cdd8-476c-85b8-dd40b4e224da tempest-VolumeRetypeWithoutMigrationTest-638271825 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:12:16.907870 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-890ad7f7-cdd8-476c-85b8-dd40b4e224da tempest-VolumeRetypeWithoutMigrationTest-638271825 None] Volume volume-20d11cf0-d3a1-4e31-abcf-cff17b04848f is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:12:16.918497 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-890ad7f7-cdd8-476c-85b8-dd40b4e224da tempest-VolumeRetypeWithoutMigrationTest-638271825 None] deleting rbd volume volume-20d11cf0-d3a1-4e31-abcf-cff17b04848f {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:12:17.001472 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-512e5723-e1d6-4503-aaf0-af2676d79627 tempest-VolumeSnapshotQuotasNegativeTestJSON-63536344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:17.247955 ncdv-master-1 cinder-volume[135002]: WARNING cinder.quota [None req-890ad7f7-cdd8-476c-85b8-dd40b4e224da tempest-VolumeRetypeWithoutMigrationTest-638271825 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 09 21:12:17.248753 ncdv-master-1 cinder-volume[135002]: WARNING cinder.quota [None req-890ad7f7-cdd8-476c-85b8-dd40b4e224da tempest-VolumeRetypeWithoutMigrationTest-638271825 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 09 21:12:17.266067 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-890ad7f7-cdd8-476c-85b8-dd40b4e224da tempest-VolumeRetypeWithoutMigrationTest-638271825 None] Created reservations ['dbb08b89-fbb6-4b8a-9cde-7b385b5b4228', '850d96d7-028b-4fdf-90db-4d9a411bbbd3', 'b230e779-b893-4cb3-a17b-6b8181229f2c', '4229bcc0-9e72-4b90-a7b3-eab92afa5f26'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:12:17.314022 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-890ad7f7-cdd8-476c-85b8-dd40b4e224da tempest-VolumeRetypeWithoutMigrationTest-638271825 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:17.355961 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-890ad7f7-cdd8-476c-85b8-dd40b4e224da tempest-VolumeRetypeWithoutMigrationTest-638271825 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:17.384686 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-890ad7f7-cdd8-476c-85b8-dd40b4e224da tempest-VolumeRetypeWithoutMigrationTest-638271825 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:12:17.388897 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-890ad7f7-cdd8-476c-85b8-dd40b4e224da tempest-VolumeRetypeWithoutMigrationTest-638271825 None] Deleted volume successfully. Apr 09 21:12:17.404339 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-890ad7f7-cdd8-476c-85b8-dd40b4e224da tempest-VolumeRetypeWithoutMigrationTest-638271825 None] Lock "b'cinder-20d11cf0-d3a1-4e31-abcf-cff17b04848f-delete_volume'" released by "delete_volume" :: held 0.644s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:12:17.744750 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-512e5723-e1d6-4503-aaf0-af2676d79627 tempest-VolumeSnapshotQuotasNegativeTestJSON-63536344 None] Create snapshot completed successfully Apr 09 21:12:18.541396 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-59cf706d-b41d-4206-ad31-c4e199fe7a7b tempest-VolumeSnapshotQuotasNegativeTestJSON-63536344 None] Lock "b'cinder-3767671c-6d1e-4385-bf20-af331951b8b0-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.035s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:12:18.548740 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-59cf706d-b41d-4206-ad31-c4e199fe7a7b tempest-VolumeSnapshotQuotasNegativeTestJSON-63536344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:19.821058 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-59cf706d-b41d-4206-ad31-c4e199fe7a7b tempest-VolumeSnapshotQuotasNegativeTestJSON-63536344 None] Created reservations ['904d2637-3e2f-4d11-8525-363fe3bcfda2', 'cfe53835-eafb-4d59-b74d-14ee9e7fc02e', '83602525-db13-4167-93f1-ccbeb802dd7a', 'd34f4633-3416-4003-9713-dc5072ecf180'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:12:19.885185 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-59cf706d-b41d-4206-ad31-c4e199fe7a7b tempest-VolumeSnapshotQuotasNegativeTestJSON-63536344 None] Delete snapshot completed successfully. Apr 09 21:12:19.893092 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-59cf706d-b41d-4206-ad31-c4e199fe7a7b tempest-VolumeSnapshotQuotasNegativeTestJSON-63536344 None] Lock "b'cinder-3767671c-6d1e-4385-bf20-af331951b8b0-delete_snapshot'" released by "delete_snapshot" :: held 1.353s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:12:20.696083 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-9d6855fa-4a7d-4c5f-af14-0180bf6dd1bf tempest-VolumeSnapshotQuotasNegativeTestJSON-63536344 None] Lock "b'cinder-426716ec-bc93-4162-95fe-e07143c00b2c-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:12:20.746646 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9d6855fa-4a7d-4c5f-af14-0180bf6dd1bf tempest-VolumeSnapshotQuotasNegativeTestJSON-63536344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:20.798862 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9d6855fa-4a7d-4c5f-af14-0180bf6dd1bf tempest-VolumeSnapshotQuotasNegativeTestJSON-63536344 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:12:20.799521 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9d6855fa-4a7d-4c5f-af14-0180bf6dd1bf tempest-VolumeSnapshotQuotasNegativeTestJSON-63536344 None] Volume volume-426716ec-bc93-4162-95fe-e07143c00b2c is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:12:20.806060 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9d6855fa-4a7d-4c5f-af14-0180bf6dd1bf tempest-VolumeSnapshotQuotasNegativeTestJSON-63536344 None] deleting rbd volume volume-426716ec-bc93-4162-95fe-e07143c00b2c {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:12:21.141509 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-9d6855fa-4a7d-4c5f-af14-0180bf6dd1bf tempest-VolumeSnapshotQuotasNegativeTestJSON-63536344 None] Created reservations ['8a2d7269-b605-4745-8980-1ac9cdbc766c', 'bb8c53dd-a412-4487-b4f1-ed2f4b25351e', '1e2ee25d-c65d-4dd8-b7e6-da7fc3dff36c', 'd6f17517-7fb0-4faf-86c2-3764b166a5c2'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:12:21.192267 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9d6855fa-4a7d-4c5f-af14-0180bf6dd1bf tempest-VolumeSnapshotQuotasNegativeTestJSON-63536344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:21.233020 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9d6855fa-4a7d-4c5f-af14-0180bf6dd1bf tempest-VolumeSnapshotQuotasNegativeTestJSON-63536344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:21.269282 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-9d6855fa-4a7d-4c5f-af14-0180bf6dd1bf tempest-VolumeSnapshotQuotasNegativeTestJSON-63536344 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:12:21.273788 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-9d6855fa-4a7d-4c5f-af14-0180bf6dd1bf tempest-VolumeSnapshotQuotasNegativeTestJSON-63536344 None] Deleted volume successfully. Apr 09 21:12:21.290031 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-9d6855fa-4a7d-4c5f-af14-0180bf6dd1bf tempest-VolumeSnapshotQuotasNegativeTestJSON-63536344 None] Lock "b'cinder-426716ec-bc93-4162-95fe-e07143c00b2c-delete_volume'" released by "delete_volume" :: held 0.592s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:12:27.048509 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7b2ed6c-8ddf-45eb-848f-5affe7bc3a97 tempest-VolumeTypesAccessTest-1135540033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:12:27.088738 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b7b2ed6c-8ddf-45eb-848f-5affe7bc3a97 tempest-VolumeTypesAccessTest-1135540033 None] Flow 'volume_create_manager' (add73896-dafb-4c37-bf2e-a1cc9f102eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:12:27.101736 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b7b2ed6c-8ddf-45eb-848f-5affe7bc3a97 tempest-VolumeTypesAccessTest-1135540033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a735c7f4-f05e-40e2-80ce-2401e1d2fbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:27.145463 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b7b2ed6c-8ddf-45eb-848f-5affe7bc3a97 tempest-VolumeTypesAccessTest-1135540033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a735c7f4-f05e-40e2-80ce-2401e1d2fbfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-480478776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=90a86d59-a116-4f9c-b000-f13ded0f5133,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28015434ce7d4115b79bd9878fd05291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:12:27Z,use_quota=True,user_id='567663080ebd482db1fb952bed288b8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(255865ca-50cd-4033-9a79-1b8b855b215f),volume_type_id=255865ca-50cd-4033-9a79-1b8b855b215f)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:27.152663 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b7b2ed6c-8ddf-45eb-848f-5affe7bc3a97 tempest-VolumeTypesAccessTest-1135540033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a329f6a-1458-4db4-8582-6e2b6e916b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:27.158100 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b7b2ed6c-8ddf-45eb-848f-5affe7bc3a97 tempest-VolumeTypesAccessTest-1135540033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a329f6a-1458-4db4-8582-6e2b6e916b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:27.163974 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b7b2ed6c-8ddf-45eb-848f-5affe7bc3a97 tempest-VolumeTypesAccessTest-1135540033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4441a85e-fea8-4dfe-b923-1afbd192eb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:27.169440 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b7b2ed6c-8ddf-45eb-848f-5affe7bc3a97 tempest-VolumeTypesAccessTest-1135540033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4441a85e-fea8-4dfe-b923-1afbd192eb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90a86d59-a116-4f9c-b000-f13ded0f5133', 'volume_name': 'volume-90a86d59-a116-4f9c-b000-f13ded0f5133', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:27.175118 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b7b2ed6c-8ddf-45eb-848f-5affe7bc3a97 tempest-VolumeTypesAccessTest-1135540033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4586891e-a832-4c32-ba38-9a44a0dde904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:27.180390 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b7b2ed6c-8ddf-45eb-848f-5affe7bc3a97 tempest-VolumeTypesAccessTest-1135540033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4586891e-a832-4c32-ba38-9a44a0dde904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:27.185910 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b7b2ed6c-8ddf-45eb-848f-5affe7bc3a97 tempest-VolumeTypesAccessTest-1135540033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd00ded-ed3f-4f53-bda1-3f5235a3f0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:27.187307 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-b7b2ed6c-8ddf-45eb-848f-5affe7bc3a97 tempest-VolumeTypesAccessTest-1135540033 None] Volume 90a86d59-a116-4f9c-b000-f13ded0f5133: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90a86d59-a116-4f9c-b000-f13ded0f5133', 'volume_size': 1} Apr 09 21:12:27.187872 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b7b2ed6c-8ddf-45eb-848f-5affe7bc3a97 tempest-VolumeTypesAccessTest-1135540033 None] creating volume 'volume-90a86d59-a116-4f9c-b000-f13ded0f5133' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:12:27.189004 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b7b2ed6c-8ddf-45eb-848f-5affe7bc3a97 tempest-VolumeTypesAccessTest-1135540033 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:27.346741 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b7b2ed6c-8ddf-45eb-848f-5affe7bc3a97 tempest-VolumeTypesAccessTest-1135540033 None] extra_specs: {} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:12:27.347445 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b7b2ed6c-8ddf-45eb-848f-5affe7bc3a97 tempest-VolumeTypesAccessTest-1135540033 None] extra_specs: {} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:12:27.360625 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b7b2ed6c-8ddf-45eb-848f-5affe7bc3a97 tempest-VolumeTypesAccessTest-1135540033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd00ded-ed3f-4f53-bda1-3f5235a3f0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90a86d59-a116-4f9c-b000-f13ded0f5133', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:27.376973 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b7b2ed6c-8ddf-45eb-848f-5affe7bc3a97 tempest-VolumeTypesAccessTest-1135540033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02ed5d37-d968-409f-a8cd-4b67799ed9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:27.402221 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-b7b2ed6c-8ddf-45eb-848f-5affe7bc3a97 tempest-VolumeTypesAccessTest-1135540033 None] Volume volume-90a86d59-a116-4f9c-b000-f13ded0f5133 (90a86d59-a116-4f9c-b000-f13ded0f5133): created successfully Apr 09 21:12:27.409902 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b7b2ed6c-8ddf-45eb-848f-5affe7bc3a97 tempest-VolumeTypesAccessTest-1135540033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02ed5d37-d968-409f-a8cd-4b67799ed9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:27.417895 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b7b2ed6c-8ddf-45eb-848f-5affe7bc3a97 tempest-VolumeTypesAccessTest-1135540033 None] Flow 'volume_create_manager' (add73896-dafb-4c37-bf2e-a1cc9f102eda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:12:27.431428 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-b7b2ed6c-8ddf-45eb-848f-5affe7bc3a97 tempest-VolumeTypesAccessTest-1135540033 None] Created volume successfully. Apr 09 21:12:28.644074 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-0d9a3596-a493-4860-b420-b60bc5308c67 tempest-VolumeTypesAccessTest-1135540033 None] Lock "b'cinder-90a86d59-a116-4f9c-b000-f13ded0f5133-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:12:28.715568 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-0d9a3596-a493-4860-b420-b60bc5308c67 tempest-VolumeTypesAccessTest-1135540033 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:28.797181 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-0d9a3596-a493-4860-b420-b60bc5308c67 tempest-VolumeTypesAccessTest-1135540033 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:12:28.797650 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-0d9a3596-a493-4860-b420-b60bc5308c67 tempest-VolumeTypesAccessTest-1135540033 None] Volume volume-90a86d59-a116-4f9c-b000-f13ded0f5133 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:12:28.827059 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-0d9a3596-a493-4860-b420-b60bc5308c67 tempest-VolumeTypesAccessTest-1135540033 None] deleting rbd volume volume-90a86d59-a116-4f9c-b000-f13ded0f5133 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:12:29.207652 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-55fa58ee-b770-465c-a913-9c8beb11aeec tempest-VolumesBackupsTest-1881101193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:12:29.227912 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-55fa58ee-b770-465c-a913-9c8beb11aeec tempest-VolumesBackupsTest-1881101193 None] Flow 'volume_create_manager' (d9bc9d89-5523-4a90-a977-e2bc6a650c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:12:29.234982 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-55fa58ee-b770-465c-a913-9c8beb11aeec tempest-VolumesBackupsTest-1881101193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4400d654-4f36-4c5b-b577-83677f4af575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:29.259713 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-55fa58ee-b770-465c-a913-9c8beb11aeec tempest-VolumesBackupsTest-1881101193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4400d654-4f36-4c5b-b577-83677f4af575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-274803358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c5d2f8ab-7872-4061-be6c-5b1930fc0017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bd28da6b23940dc816d678fc6f2b9db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:12:29Z,use_quota=True,user_id='74311b56951549df8388565bff4a5499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:29.266337 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-55fa58ee-b770-465c-a913-9c8beb11aeec tempest-VolumesBackupsTest-1881101193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e57542d2-ced0-4581-bdc4-467a8510320c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:29.271128 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-55fa58ee-b770-465c-a913-9c8beb11aeec tempest-VolumesBackupsTest-1881101193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e57542d2-ced0-4581-bdc4-467a8510320c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:29.276660 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-55fa58ee-b770-465c-a913-9c8beb11aeec tempest-VolumesBackupsTest-1881101193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96c5fa94-13aa-40ab-a70f-20775d4268c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:29.281357 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-55fa58ee-b770-465c-a913-9c8beb11aeec tempest-VolumesBackupsTest-1881101193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96c5fa94-13aa-40ab-a70f-20775d4268c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5d2f8ab-7872-4061-be6c-5b1930fc0017', 'volume_name': 'volume-c5d2f8ab-7872-4061-be6c-5b1930fc0017', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:29.286758 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-55fa58ee-b770-465c-a913-9c8beb11aeec tempest-VolumesBackupsTest-1881101193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29ed4f64-c6e5-4ce8-af6f-6ca015919966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:29.291034 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-55fa58ee-b770-465c-a913-9c8beb11aeec tempest-VolumesBackupsTest-1881101193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29ed4f64-c6e5-4ce8-af6f-6ca015919966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:29.296793 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-55fa58ee-b770-465c-a913-9c8beb11aeec tempest-VolumesBackupsTest-1881101193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6407d97-0d2a-4e11-b6d0-190a016d2b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:29.298030 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-55fa58ee-b770-465c-a913-9c8beb11aeec tempest-VolumesBackupsTest-1881101193 None] Volume c5d2f8ab-7872-4061-be6c-5b1930fc0017: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5d2f8ab-7872-4061-be6c-5b1930fc0017', 'volume_size': 1} Apr 09 21:12:29.298423 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-55fa58ee-b770-465c-a913-9c8beb11aeec tempest-VolumesBackupsTest-1881101193 None] creating volume 'volume-c5d2f8ab-7872-4061-be6c-5b1930fc0017' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:12:29.299113 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-55fa58ee-b770-465c-a913-9c8beb11aeec tempest-VolumesBackupsTest-1881101193 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:29.342270 ncdv-master-1 cinder-volume[135002]: WARNING cinder.quota [None req-0d9a3596-a493-4860-b420-b60bc5308c67 tempest-VolumeTypesAccessTest-1135540033 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-724520833 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-724520833, it is now deprecated. Please use the default quota class for default quota. Apr 09 21:12:29.343096 ncdv-master-1 cinder-volume[135002]: WARNING cinder.quota [None req-0d9a3596-a493-4860-b420-b60bc5308c67 tempest-VolumeTypesAccessTest-1135540033 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-724520833 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-724520833, it is now deprecated. Please use the default quota class for default quota. Apr 09 21:12:29.360161 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-0d9a3596-a493-4860-b420-b60bc5308c67 tempest-VolumeTypesAccessTest-1135540033 None] Created reservations ['34bb3349-6227-43bb-98d2-4e008f37e37f', '99f5ca86-63b9-4fdf-b554-89403b60123f', '1b32b3a8-d693-4e8e-8bf7-6008f51d8bdd', 'c045802b-3da0-4c8b-a4d6-48166cdf81ad'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:12:29.387170 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-55fa58ee-b770-465c-a913-9c8beb11aeec tempest-VolumesBackupsTest-1881101193 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:12:29.387667 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-55fa58ee-b770-465c-a913-9c8beb11aeec tempest-VolumesBackupsTest-1881101193 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:12:29.391853 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-55fa58ee-b770-465c-a913-9c8beb11aeec tempest-VolumesBackupsTest-1881101193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6407d97-0d2a-4e11-b6d0-190a016d2b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5d2f8ab-7872-4061-be6c-5b1930fc0017', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:29.396807 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-55fa58ee-b770-465c-a913-9c8beb11aeec tempest-VolumesBackupsTest-1881101193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e2ec30a-17f9-4c35-b09b-f8c6fb3c187c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:29.408361 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-55fa58ee-b770-465c-a913-9c8beb11aeec tempest-VolumesBackupsTest-1881101193 None] Volume volume-c5d2f8ab-7872-4061-be6c-5b1930fc0017 (c5d2f8ab-7872-4061-be6c-5b1930fc0017): created successfully Apr 09 21:12:29.412901 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-55fa58ee-b770-465c-a913-9c8beb11aeec tempest-VolumesBackupsTest-1881101193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e2ec30a-17f9-4c35-b09b-f8c6fb3c187c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:29.418954 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-55fa58ee-b770-465c-a913-9c8beb11aeec tempest-VolumesBackupsTest-1881101193 None] Flow 'volume_create_manager' (d9bc9d89-5523-4a90-a977-e2bc6a650c88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:12:29.446834 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-55fa58ee-b770-465c-a913-9c8beb11aeec tempest-VolumesBackupsTest-1881101193 None] Created volume successfully. Apr 09 21:12:29.463359 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-0d9a3596-a493-4860-b420-b60bc5308c67 tempest-VolumeTypesAccessTest-1135540033 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:29.494709 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-0d9a3596-a493-4860-b420-b60bc5308c67 tempest-VolumeTypesAccessTest-1135540033 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:29.524516 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-0d9a3596-a493-4860-b420-b60bc5308c67 tempest-VolumeTypesAccessTest-1135540033 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:12:29.529080 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-0d9a3596-a493-4860-b420-b60bc5308c67 tempest-VolumeTypesAccessTest-1135540033 None] Deleted volume successfully. Apr 09 21:12:29.544125 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-0d9a3596-a493-4860-b420-b60bc5308c67 tempest-VolumeTypesAccessTest-1135540033 None] Lock "b'cinder-90a86d59-a116-4f9c-b000-f13ded0f5133-delete_volume'" released by "delete_volume" :: held 0.900s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:12:33.949745 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-92be21e2-d8c2-44d3-a85e-3c5b486dd261 tempest-VolumesMetadataTest-1960678415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:12:33.972371 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-92be21e2-d8c2-44d3-a85e-3c5b486dd261 tempest-VolumesMetadataTest-1960678415 None] Flow 'volume_create_manager' (d2ff9b47-52b6-4b00-b4b6-1bb758dc7e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:12:33.980552 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-92be21e2-d8c2-44d3-a85e-3c5b486dd261 tempest-VolumesMetadataTest-1960678415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (160fe21e-e26b-47eb-9b01-207143dc96aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:33.999365 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-92be21e2-d8c2-44d3-a85e-3c5b486dd261 tempest-VolumesMetadataTest-1960678415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (160fe21e-e26b-47eb-9b01-207143dc96aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1349246305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7927bf58-2172-460a-b14a-115f13c4be2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487e539dbf284bd18ee411802104bee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:12:34Z,use_quota=True,user_id='4abe80c63e90475ba494707ab88d675c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:34.006430 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-92be21e2-d8c2-44d3-a85e-3c5b486dd261 tempest-VolumesMetadataTest-1960678415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35c75936-41ab-49ca-ab5a-b9ffd604a466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:34.011389 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-92be21e2-d8c2-44d3-a85e-3c5b486dd261 tempest-VolumesMetadataTest-1960678415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35c75936-41ab-49ca-ab5a-b9ffd604a466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:34.017878 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-92be21e2-d8c2-44d3-a85e-3c5b486dd261 tempest-VolumesMetadataTest-1960678415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d44a9a4f-d3bd-45cb-8ce8-d425af8387f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:34.022534 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-92be21e2-d8c2-44d3-a85e-3c5b486dd261 tempest-VolumesMetadataTest-1960678415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d44a9a4f-d3bd-45cb-8ce8-d425af8387f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7927bf58-2172-460a-b14a-115f13c4be2b', 'volume_name': 'volume-7927bf58-2172-460a-b14a-115f13c4be2b', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:34.027986 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-92be21e2-d8c2-44d3-a85e-3c5b486dd261 tempest-VolumesMetadataTest-1960678415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2cadb6e-10b7-45cc-9cea-5379c3f3b2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:34.032411 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-92be21e2-d8c2-44d3-a85e-3c5b486dd261 tempest-VolumesMetadataTest-1960678415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2cadb6e-10b7-45cc-9cea-5379c3f3b2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:34.039583 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-92be21e2-d8c2-44d3-a85e-3c5b486dd261 tempest-VolumesMetadataTest-1960678415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313d27c0-293e-495f-911a-aa201f393fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:34.039583 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-92be21e2-d8c2-44d3-a85e-3c5b486dd261 tempest-VolumesMetadataTest-1960678415 None] Volume 7927bf58-2172-460a-b14a-115f13c4be2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7927bf58-2172-460a-b14a-115f13c4be2b', 'volume_size': 1} Apr 09 21:12:34.039583 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-92be21e2-d8c2-44d3-a85e-3c5b486dd261 tempest-VolumesMetadataTest-1960678415 None] creating volume 'volume-7927bf58-2172-460a-b14a-115f13c4be2b' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:12:34.039583 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-92be21e2-d8c2-44d3-a85e-3c5b486dd261 tempest-VolumesMetadataTest-1960678415 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:34.142092 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-92be21e2-d8c2-44d3-a85e-3c5b486dd261 tempest-VolumesMetadataTest-1960678415 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:12:34.143885 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-92be21e2-d8c2-44d3-a85e-3c5b486dd261 tempest-VolumesMetadataTest-1960678415 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:12:34.148578 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-92be21e2-d8c2-44d3-a85e-3c5b486dd261 tempest-VolumesMetadataTest-1960678415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313d27c0-293e-495f-911a-aa201f393fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7927bf58-2172-460a-b14a-115f13c4be2b', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:34.155779 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-92be21e2-d8c2-44d3-a85e-3c5b486dd261 tempest-VolumesMetadataTest-1960678415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48e7d1bf-1760-48a5-9cd8-d9553138a19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:34.176832 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-92be21e2-d8c2-44d3-a85e-3c5b486dd261 tempest-VolumesMetadataTest-1960678415 None] Volume volume-7927bf58-2172-460a-b14a-115f13c4be2b (7927bf58-2172-460a-b14a-115f13c4be2b): created successfully Apr 09 21:12:34.181146 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-92be21e2-d8c2-44d3-a85e-3c5b486dd261 tempest-VolumesMetadataTest-1960678415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48e7d1bf-1760-48a5-9cd8-d9553138a19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:34.187902 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-92be21e2-d8c2-44d3-a85e-3c5b486dd261 tempest-VolumesMetadataTest-1960678415 None] Flow 'volume_create_manager' (d2ff9b47-52b6-4b00-b4b6-1bb758dc7e2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:12:34.201436 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-92be21e2-d8c2-44d3-a85e-3c5b486dd261 tempest-VolumesMetadataTest-1960678415 None] Created volume successfully. Apr 09 21:12:35.880078 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-311e3475-d107-40ea-b3cc-4b99cdbe00ff tempest-VolumesMetadataTest-1960678415 None] Lock "b'cinder-7927bf58-2172-460a-b14a-115f13c4be2b-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:12:35.927280 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-311e3475-d107-40ea-b3cc-4b99cdbe00ff tempest-VolumesMetadataTest-1960678415 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:35.987691 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-311e3475-d107-40ea-b3cc-4b99cdbe00ff tempest-VolumesMetadataTest-1960678415 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:12:35.988135 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-311e3475-d107-40ea-b3cc-4b99cdbe00ff tempest-VolumesMetadataTest-1960678415 None] Volume volume-7927bf58-2172-460a-b14a-115f13c4be2b is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:12:35.998664 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-311e3475-d107-40ea-b3cc-4b99cdbe00ff tempest-VolumesMetadataTest-1960678415 None] deleting rbd volume volume-7927bf58-2172-460a-b14a-115f13c4be2b {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:12:36.244087 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-311e3475-d107-40ea-b3cc-4b99cdbe00ff tempest-VolumesMetadataTest-1960678415 None] Created reservations ['2359ff6b-b55e-45ca-be6f-1c3311a35b32', '665011a8-714e-4825-8fcb-98dfb20e1c59', '6bbb5780-0c36-40a7-8208-d20f8557140c', '7df02a2b-18b6-48d4-834a-0e5671877e4a'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:12:36.291155 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-311e3475-d107-40ea-b3cc-4b99cdbe00ff tempest-VolumesMetadataTest-1960678415 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:36.314967 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-311e3475-d107-40ea-b3cc-4b99cdbe00ff tempest-VolumesMetadataTest-1960678415 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:36.339890 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-311e3475-d107-40ea-b3cc-4b99cdbe00ff tempest-VolumesMetadataTest-1960678415 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:12:36.343893 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-311e3475-d107-40ea-b3cc-4b99cdbe00ff tempest-VolumesMetadataTest-1960678415 None] Deleted volume successfully. Apr 09 21:12:36.358002 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-311e3475-d107-40ea-b3cc-4b99cdbe00ff tempest-VolumesMetadataTest-1960678415 None] Lock "b'cinder-7927bf58-2172-460a-b14a-115f13c4be2b-delete_volume'" released by "delete_volume" :: held 0.478s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:12:39.423164 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-894ff89b-e7f1-42b3-a6ad-f7738614e854 tempest-VolumesCloneTest-852504020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:12:39.444918 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-894ff89b-e7f1-42b3-a6ad-f7738614e854 tempest-VolumesCloneTest-852504020 None] Flow 'volume_create_manager' (986ec05d-8235-4ff7-9264-b6d9fa49a377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:12:39.453010 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-894ff89b-e7f1-42b3-a6ad-f7738614e854 tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cec4d59e-35bb-46db-be26-6100c7746e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:39.470180 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-894ff89b-e7f1-42b3-a6ad-f7738614e854 tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cec4d59e-35bb-46db-be26-6100c7746e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1691019395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8d6c6b9d-3102-4eb5-bb44-9f40f7424722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8a833a07344c0890674bc22b729623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:12:39Z,use_quota=True,user_id='be5f36a679a34676ad49fe542972166c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:39.478356 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-894ff89b-e7f1-42b3-a6ad-f7738614e854 tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23dcfc4a-8b2d-4878-b878-31ba1a2c5ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:39.482993 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-894ff89b-e7f1-42b3-a6ad-f7738614e854 tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23dcfc4a-8b2d-4878-b878-31ba1a2c5ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:39.494819 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-894ff89b-e7f1-42b3-a6ad-f7738614e854 tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01a2da50-7934-423a-a796-931e32af2814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:39.573407 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-894ff89b-e7f1-42b3-a6ad-f7738614e854 tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01a2da50-7934-423a-a796-931e32af2814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8d6c6b9d-3102-4eb5-bb44-9f40f7424722', 'volume_name': 'volume-8d6c6b9d-3102-4eb5-bb44-9f40f7424722', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:39.578576 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-894ff89b-e7f1-42b3-a6ad-f7738614e854 tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d43a211c-2892-4056-9228-e3407912aad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:39.582618 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-894ff89b-e7f1-42b3-a6ad-f7738614e854 tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d43a211c-2892-4056-9228-e3407912aad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:39.588319 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-894ff89b-e7f1-42b3-a6ad-f7738614e854 tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7962584e-315b-4b9a-9d08-6938d5971e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:39.588618 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-894ff89b-e7f1-42b3-a6ad-f7738614e854 tempest-VolumesCloneTest-852504020 None] Volume 8d6c6b9d-3102-4eb5-bb44-9f40f7424722: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8d6c6b9d-3102-4eb5-bb44-9f40f7424722', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 09 21:12:39.589233 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-894ff89b-e7f1-42b3-a6ad-f7738614e854 tempest-VolumesCloneTest-852504020 None] Cloning 8d6c6b9d-3102-4eb5-bb44-9f40f7424722 from image b539c48b-3400-4aa4-9226-8be5a3d07b36 at location (None, None). {{(pid=135002) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Apr 09 21:12:39.599744 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-894ff89b-e7f1-42b3-a6ad-f7738614e854 tempest-VolumesCloneTest-852504020 None] Lock "b'cinder-b539c48b-3400-4aa4-9226-8be5a3d07b36'" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:12:39.610947 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-894ff89b-e7f1-42b3-a6ad-f7738614e854 tempest-VolumesCloneTest-852504020 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'volume_id': 'd35656e2-d293-4904-aeae-3113202bb314', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36), 'last_used': datetime.datetime(2022, 4, 9, 21, 12, 39, 604193)}. {{(pid=135002) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 09 21:12:39.618711 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-894ff89b-e7f1-42b3-a6ad-f7738614e854 tempest-VolumesCloneTest-852504020 None] Image-volume cache entry image_update_at = 2022-04-09 20:45:36+00:00, requested image updated_at = 2022-04-09 20:45:36+00:00. {{(pid=135002) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 09 21:12:39.618711 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-894ff89b-e7f1-42b3-a6ad-f7738614e854 tempest-VolumesCloneTest-852504020 None] Found cache entry for image = b539c48b-3400-4aa4-9226-8be5a3d07b36 on host ncdv-master-1@ceph#ceph. {{(pid=135002) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Apr 09 21:12:39.622883 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-894ff89b-e7f1-42b3-a6ad-f7738614e854 tempest-VolumesCloneTest-852504020 None] Lock "b'cinder-b539c48b-3400-4aa4-9226-8be5a3d07b36'" released by "_prepare_image_cache_entry" :: held 0.023s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:12:39.623890 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-894ff89b-e7f1-42b3-a6ad-f7738614e854 tempest-VolumesCloneTest-852504020 None] Attempting to retrieve cache entry for image = b539c48b-3400-4aa4-9226-8be5a3d07b36 on host ncdv-master-1@ceph#ceph. {{(pid=135002) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Apr 09 21:12:39.629789 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-894ff89b-e7f1-42b3-a6ad-f7738614e854 tempest-VolumesCloneTest-852504020 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'volume_id': 'd35656e2-d293-4904-aeae-3113202bb314', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36), 'last_used': datetime.datetime(2022, 4, 9, 21, 12, 39, 627529)}. {{(pid=135002) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 09 21:12:39.630210 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-894ff89b-e7f1-42b3-a6ad-f7738614e854 tempest-VolumesCloneTest-852504020 None] Image-volume cache entry image_update_at = 2022-04-09 20:45:36+00:00, requested image updated_at = 2022-04-09 20:45:36+00:00. {{(pid=135002) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 09 21:12:39.630600 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-894ff89b-e7f1-42b3-a6ad-f7738614e854 tempest-VolumesCloneTest-852504020 None] Creating from source image-volume d35656e2-d293-4904-aeae-3113202bb314 {{(pid=135002) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Apr 09 21:12:39.642039 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-894ff89b-e7f1-42b3-a6ad-f7738614e854 tempest-VolumesCloneTest-852504020 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:39.725238 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-894ff89b-e7f1-42b3-a6ad-f7738614e854 tempest-VolumesCloneTest-852504020 None] creating snapshot='volume-8d6c6b9d-3102-4eb5-bb44-9f40f7424722.clone_snap' {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Apr 09 21:12:40.670208 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-894ff89b-e7f1-42b3-a6ad-f7738614e854 tempest-VolumesCloneTest-852504020 None] cloning 'volume-d35656e2-d293-4904-aeae-3113202bb314@volume-8d6c6b9d-3102-4eb5-bb44-9f40f7424722.clone_snap' to 'volume-8d6c6b9d-3102-4eb5-bb44-9f40f7424722' {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Apr 09 21:12:40.687044 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-c032a6dc-5203-4006-b3be-44278a3252fe req-30cdf383-b186-41eb-8435-953a3411f3a3 tempest-ServerRescueNegativeTestJSON-1017505455 None] Terminate volume connection completed successfully. Apr 09 21:12:40.687886 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-c032a6dc-5203-4006-b3be-44278a3252fe req-30cdf383-b186-41eb-8435-953a3411f3a3 tempest-ServerRescueNegativeTestJSON-1017505455 None] Deleting attachment b0711f46-1d01-44fa-a33f-e39f5bd758cb. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 21:12:40.831730 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-894ff89b-e7f1-42b3-a6ad-f7738614e854 tempest-VolumesCloneTest-852504020 None] Volume volume-6d815065-063f-4887-9bc8-5808837868ff.deleted is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:12:40.833605 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-894ff89b-e7f1-42b3-a6ad-f7738614e854 tempest-VolumesCloneTest-852504020 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:12:40.834082 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-894ff89b-e7f1-42b3-a6ad-f7738614e854 tempest-VolumesCloneTest-852504020 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:12:40.853838 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-894ff89b-e7f1-42b3-a6ad-f7738614e854 tempest-VolumesCloneTest-852504020 None] clone created successfully {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Apr 09 21:12:40.854548 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.volume_utils [None req-894ff89b-e7f1-42b3-a6ad-f7738614e854 tempest-VolumesCloneTest-852504020 None] Marking volume 8d6c6b9d-3102-4eb5-bb44-9f40f7424722 as bootable. {{(pid=135002) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Apr 09 21:12:40.863732 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-894ff89b-e7f1-42b3-a6ad-f7738614e854 tempest-VolumesCloneTest-852504020 None] Copying metadata from image b539c48b-3400-4aa4-9226-8be5a3d07b36 to 8d6c6b9d-3102-4eb5-bb44-9f40f7424722. {{(pid=135002) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Apr 09 21:12:40.864099 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-894ff89b-e7f1-42b3-a6ad-f7738614e854 tempest-VolumesCloneTest-852504020 None] Creating volume glance metadata for volume 8d6c6b9d-3102-4eb5-bb44-9f40f7424722 backed by image b539c48b-3400-4aa4-9226-8be5a3d07b36 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=135002) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Apr 09 21:12:40.926652 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-894ff89b-e7f1-42b3-a6ad-f7738614e854 tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7962584e-315b-4b9a-9d08-6938d5971e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d6c6b9d-3102-4eb5-bb44-9f40f7424722', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:40.935977 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-894ff89b-e7f1-42b3-a6ad-f7738614e854 tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c130425e-0856-47dc-a079-e8a084bcad60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:40.952744 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-894ff89b-e7f1-42b3-a6ad-f7738614e854 tempest-VolumesCloneTest-852504020 None] Volume volume-8d6c6b9d-3102-4eb5-bb44-9f40f7424722 (8d6c6b9d-3102-4eb5-bb44-9f40f7424722): created successfully Apr 09 21:12:40.972491 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-894ff89b-e7f1-42b3-a6ad-f7738614e854 tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c130425e-0856-47dc-a079-e8a084bcad60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:40.991543 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-894ff89b-e7f1-42b3-a6ad-f7738614e854 tempest-VolumesCloneTest-852504020 None] Flow 'volume_create_manager' (986ec05d-8235-4ff7-9264-b6d9fa49a377) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:12:41.002927 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-894ff89b-e7f1-42b3-a6ad-f7738614e854 tempest-VolumesCloneTest-852504020 None] Created volume successfully. Apr 09 21:12:41.996886 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bc20c38-5184-4097-98ee-340e6718d9b4 tempest-VolumesCloneTest-852504020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:12:42.025814 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5bc20c38-5184-4097-98ee-340e6718d9b4 tempest-VolumesCloneTest-852504020 None] Flow 'volume_create_manager' (eea3cb1a-147b-47e4-9a6d-8f4b15ecb772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:12:42.032719 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5bc20c38-5184-4097-98ee-340e6718d9b4 tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9210eb9d-b7f5-4ba6-8d46-b38115f96a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:42.049323 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5bc20c38-5184-4097-98ee-340e6718d9b4 tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9210eb9d-b7f5-4ba6-8d46-b38115f96a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-39401563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9d243041-a7b2-4613-9d38-1c224bb193c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8a833a07344c0890674bc22b729623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:12:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=8d6c6b9d-3102-4eb5-bb44-9f40f7424722,status='creating',terminated_at=None,updated_at=2022-04-09T21:12:42Z,use_quota=True,user_id='be5f36a679a34676ad49fe542972166c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:42.054969 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5bc20c38-5184-4097-98ee-340e6718d9b4 tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731411d6-c621-4ccb-8d9d-c09b1cf2a785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:42.059265 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5bc20c38-5184-4097-98ee-340e6718d9b4 tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731411d6-c621-4ccb-8d9d-c09b1cf2a785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:42.066125 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5bc20c38-5184-4097-98ee-340e6718d9b4 tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (422e4e7a-f429-484e-a45b-acb9e013e1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:42.081863 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5bc20c38-5184-4097-98ee-340e6718d9b4 tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (422e4e7a-f429-484e-a45b-acb9e013e1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9d243041-a7b2-4613-9d38-1c224bb193c7', 'volume_name': 'volume-9d243041-a7b2-4613-9d38-1c224bb193c7', 'volume_size': 1, 'source_volid': '8d6c6b9d-3102-4eb5-bb44-9f40f7424722', 'source_volstatus': 'available'}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:42.087052 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5bc20c38-5184-4097-98ee-340e6718d9b4 tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d79db0f-071c-4741-ad0f-1f10fb92480d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:42.091169 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5bc20c38-5184-4097-98ee-340e6718d9b4 tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d79db0f-071c-4741-ad0f-1f10fb92480d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:42.096156 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5bc20c38-5184-4097-98ee-340e6718d9b4 tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f19c6d-c503-499a-a7fc-b079114e52e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:42.097336 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-5bc20c38-5184-4097-98ee-340e6718d9b4 tempest-VolumesCloneTest-852504020 None] Volume 9d243041-a7b2-4613-9d38-1c224bb193c7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9d243041-a7b2-4613-9d38-1c224bb193c7', 'volume_size': 1, 'source_volid': '8d6c6b9d-3102-4eb5-bb44-9f40f7424722', 'source_volstatus': 'available'} Apr 09 21:12:42.110516 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5bc20c38-5184-4097-98ee-340e6718d9b4 tempest-VolumesCloneTest-852504020 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:42.185391 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5bc20c38-5184-4097-98ee-340e6718d9b4 tempest-VolumesCloneTest-852504020 None] creating snapshot='volume-9d243041-a7b2-4613-9d38-1c224bb193c7.clone_snap' {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Apr 09 21:12:42.719398 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5bc20c38-5184-4097-98ee-340e6718d9b4 tempest-VolumesCloneTest-852504020 None] cloning 'volume-8d6c6b9d-3102-4eb5-bb44-9f40f7424722@volume-9d243041-a7b2-4613-9d38-1c224bb193c7.clone_snap' to 'volume-9d243041-a7b2-4613-9d38-1c224bb193c7' {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Apr 09 21:12:42.990443 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5bc20c38-5184-4097-98ee-340e6718d9b4 tempest-VolumesCloneTest-852504020 None] Volume volume-6d815065-063f-4887-9bc8-5808837868ff.deleted is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:12:42.991479 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5bc20c38-5184-4097-98ee-340e6718d9b4 tempest-VolumesCloneTest-852504020 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:12:42.991848 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5bc20c38-5184-4097-98ee-340e6718d9b4 tempest-VolumesCloneTest-852504020 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:12:43.041971 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5bc20c38-5184-4097-98ee-340e6718d9b4 tempest-VolumesCloneTest-852504020 None] clone created successfully {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Apr 09 21:12:43.042641 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.volume_utils [None req-5bc20c38-5184-4097-98ee-340e6718d9b4 tempest-VolumesCloneTest-852504020 None] Marking volume 9d243041-a7b2-4613-9d38-1c224bb193c7 as bootable. {{(pid=135002) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Apr 09 21:12:43.057471 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bc20c38-5184-4097-98ee-340e6718d9b4 tempest-VolumesCloneTest-852504020 None] Copying metadata from source volume 8d6c6b9d-3102-4eb5-bb44-9f40f7424722 to 9d243041-a7b2-4613-9d38-1c224bb193c7. {{(pid=135002) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:436}} Apr 09 21:12:43.092232 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5bc20c38-5184-4097-98ee-340e6718d9b4 tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f19c6d-c503-499a-a7fc-b079114e52e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d243041-a7b2-4613-9d38-1c224bb193c7', 'volume_size': 1, 'source_volid': '8d6c6b9d-3102-4eb5-bb44-9f40f7424722', 'source_volstatus': 'available'}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:43.097460 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5bc20c38-5184-4097-98ee-340e6718d9b4 tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddea0c61-dbe6-4c72-b399-9f988659afc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:43.113014 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-5bc20c38-5184-4097-98ee-340e6718d9b4 tempest-VolumesCloneTest-852504020 None] Volume volume-9d243041-a7b2-4613-9d38-1c224bb193c7 (9d243041-a7b2-4613-9d38-1c224bb193c7): created successfully Apr 09 21:12:43.118049 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5bc20c38-5184-4097-98ee-340e6718d9b4 tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddea0c61-dbe6-4c72-b399-9f988659afc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:43.124119 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5bc20c38-5184-4097-98ee-340e6718d9b4 tempest-VolumesCloneTest-852504020 None] Flow 'volume_create_manager' (eea3cb1a-147b-47e4-9a6d-8f4b15ecb772) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:12:43.137819 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-5bc20c38-5184-4097-98ee-340e6718d9b4 tempest-VolumesCloneTest-852504020 None] Created volume successfully. Apr 09 21:12:44.588982 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ef35239-8ee8-4858-a455-ca98957d602d tempest-VolumesCloneTest-852504020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:12:44.618139 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9ef35239-8ee8-4858-a455-ca98957d602d tempest-VolumesCloneTest-852504020 None] Flow 'volume_create_manager' (f6e9a794-8dcb-4c60-aa0c-ebc8b056cf6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:12:44.624853 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9ef35239-8ee8-4858-a455-ca98957d602d tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (302f448e-eda6-444a-b227-d71008950931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:44.644736 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9ef35239-8ee8-4858-a455-ca98957d602d tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (302f448e-eda6-444a-b227-d71008950931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1784500987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4a6e4887-b066-4d73-8ffe-d4dc6fd11c29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8a833a07344c0890674bc22b729623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:12:45Z,use_quota=True,user_id='be5f36a679a34676ad49fe542972166c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:44.651769 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9ef35239-8ee8-4858-a455-ca98957d602d tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a67e14a-e6f0-4c7d-99fe-e4d1abec5869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:44.658572 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9ef35239-8ee8-4858-a455-ca98957d602d tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a67e14a-e6f0-4c7d-99fe-e4d1abec5869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:44.665416 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9ef35239-8ee8-4858-a455-ca98957d602d tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a278ee9-cbb1-4756-8f39-735eca278cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:44.671666 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9ef35239-8ee8-4858-a455-ca98957d602d tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a278ee9-cbb1-4756-8f39-735eca278cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a6e4887-b066-4d73-8ffe-d4dc6fd11c29', 'volume_name': 'volume-4a6e4887-b066-4d73-8ffe-d4dc6fd11c29', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:44.678410 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9ef35239-8ee8-4858-a455-ca98957d602d tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a64ab3aa-316c-4e4b-861d-fb4ec61345be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:44.682817 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9ef35239-8ee8-4858-a455-ca98957d602d tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a64ab3aa-316c-4e4b-861d-fb4ec61345be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:44.688882 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9ef35239-8ee8-4858-a455-ca98957d602d tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99fdcd23-4d96-497d-9433-1f108fb82def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:44.690108 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-9ef35239-8ee8-4858-a455-ca98957d602d tempest-VolumesCloneTest-852504020 None] Volume 4a6e4887-b066-4d73-8ffe-d4dc6fd11c29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a6e4887-b066-4d73-8ffe-d4dc6fd11c29', 'volume_size': 1} Apr 09 21:12:44.690731 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9ef35239-8ee8-4858-a455-ca98957d602d tempest-VolumesCloneTest-852504020 None] creating volume 'volume-4a6e4887-b066-4d73-8ffe-d4dc6fd11c29' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:12:44.691928 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9ef35239-8ee8-4858-a455-ca98957d602d tempest-VolumesCloneTest-852504020 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:44.826794 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9ef35239-8ee8-4858-a455-ca98957d602d tempest-VolumesCloneTest-852504020 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:12:44.827265 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9ef35239-8ee8-4858-a455-ca98957d602d tempest-VolumesCloneTest-852504020 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:12:44.831243 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9ef35239-8ee8-4858-a455-ca98957d602d tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99fdcd23-4d96-497d-9433-1f108fb82def) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a6e4887-b066-4d73-8ffe-d4dc6fd11c29', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:44.844102 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9ef35239-8ee8-4858-a455-ca98957d602d tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d36bee51-6378-4a17-9018-06e8aab6de42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:44.869624 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-9ef35239-8ee8-4858-a455-ca98957d602d tempest-VolumesCloneTest-852504020 None] Volume volume-4a6e4887-b066-4d73-8ffe-d4dc6fd11c29 (4a6e4887-b066-4d73-8ffe-d4dc6fd11c29): created successfully Apr 09 21:12:44.873782 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9ef35239-8ee8-4858-a455-ca98957d602d tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d36bee51-6378-4a17-9018-06e8aab6de42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:44.879499 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9ef35239-8ee8-4858-a455-ca98957d602d tempest-VolumesCloneTest-852504020 None] Flow 'volume_create_manager' (f6e9a794-8dcb-4c60-aa0c-ebc8b056cf6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:12:44.892429 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-9ef35239-8ee8-4858-a455-ca98957d602d tempest-VolumesCloneTest-852504020 None] Created volume successfully. Apr 09 21:12:44.971204 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-15678c64-8206-4db1-92f3-b93e76431bf5 req-f2e6bd8e-c531-4d1e-afda-6f3608e834d3 tempest-VolumesBackupsTest-1881101193 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:12:45.773613 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-15678c64-8206-4db1-92f3-b93e76431bf5 req-f2e6bd8e-c531-4d1e-afda-6f3608e834d3 tempest-VolumesBackupsTest-1881101193 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.802s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:12:45.774436 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-15678c64-8206-4db1-92f3-b93e76431bf5 req-f2e6bd8e-c531-4d1e-afda-6f3608e834d3 tempest-VolumesBackupsTest-1881101193 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c5d2f8ab-7872-4061-be6c-5b1930fc0017', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': 'c5d2f8ab-7872-4061-be6c-5b1930fc0017', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:12:45.822461 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-15678c64-8206-4db1-92f3-b93e76431bf5 req-f2e6bd8e-c531-4d1e-afda-6f3608e834d3 tempest-VolumesBackupsTest-1881101193 None] Connection info returned from driver {'name': 'volumes/volume-c5d2f8ab-7872-4061-be6c-5b1930fc0017', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c5d2f8ab-7872-4061-be6c-5b1930fc0017', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ee21b0c8-4f9d-4c9d-a66a-a48b3cd21455'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 21:12:45.890410 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-15678c64-8206-4db1-92f3-b93e76431bf5 req-f2e6bd8e-c531-4d1e-afda-6f3608e834d3 tempest-VolumesBackupsTest-1881101193 None] attachment_update completed successfully. Apr 09 21:12:46.285690 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-796143aa-dd3a-42a5-aba5-a4b15ed525d3 tempest-VolumesCloneTest-852504020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:12:46.347611 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-796143aa-dd3a-42a5-aba5-a4b15ed525d3 tempest-VolumesCloneTest-852504020 None] Flow 'volume_create_manager' (a2e08604-8028-4333-a820-90a926f01255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:12:46.357101 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-796143aa-dd3a-42a5-aba5-a4b15ed525d3 tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8afc939-eda4-4588-841f-25cedf2becb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:46.386207 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-796143aa-dd3a-42a5-aba5-a4b15ed525d3 tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8afc939-eda4-4588-841f-25cedf2becb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-732639914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=40227c4e-8b78-4d4c-870e-74ae4ea16b77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8a833a07344c0890674bc22b729623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:12:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=4a6e4887-b066-4d73-8ffe-d4dc6fd11c29,status='creating',terminated_at=None,updated_at=2022-04-09T21:12:46Z,use_quota=True,user_id='be5f36a679a34676ad49fe542972166c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:46.402257 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-796143aa-dd3a-42a5-aba5-a4b15ed525d3 tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b54ecfa6-5a78-400f-8f31-5510537c4a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:46.408088 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-796143aa-dd3a-42a5-aba5-a4b15ed525d3 tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b54ecfa6-5a78-400f-8f31-5510537c4a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:46.423127 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-796143aa-dd3a-42a5-aba5-a4b15ed525d3 tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bc4cc18-db3e-4108-9761-e6c8eab045ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:46.465180 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-796143aa-dd3a-42a5-aba5-a4b15ed525d3 tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bc4cc18-db3e-4108-9761-e6c8eab045ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '40227c4e-8b78-4d4c-870e-74ae4ea16b77', 'volume_name': 'volume-40227c4e-8b78-4d4c-870e-74ae4ea16b77', 'volume_size': 2, 'source_volid': '4a6e4887-b066-4d73-8ffe-d4dc6fd11c29', 'source_volstatus': 'available'}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:46.474643 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-796143aa-dd3a-42a5-aba5-a4b15ed525d3 tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8775c3f7-bcdf-4ece-bb93-1acb8553517e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:46.481429 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-796143aa-dd3a-42a5-aba5-a4b15ed525d3 tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8775c3f7-bcdf-4ece-bb93-1acb8553517e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:46.486962 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-796143aa-dd3a-42a5-aba5-a4b15ed525d3 tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee52b44d-eed5-4675-9e9a-d05e839a4633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:46.488177 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-796143aa-dd3a-42a5-aba5-a4b15ed525d3 tempest-VolumesCloneTest-852504020 None] Volume 40227c4e-8b78-4d4c-870e-74ae4ea16b77: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-40227c4e-8b78-4d4c-870e-74ae4ea16b77', 'volume_size': 2, 'source_volid': '4a6e4887-b066-4d73-8ffe-d4dc6fd11c29', 'source_volstatus': 'available'} Apr 09 21:12:46.507155 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-796143aa-dd3a-42a5-aba5-a4b15ed525d3 tempest-VolumesCloneTest-852504020 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:46.580223 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-796143aa-dd3a-42a5-aba5-a4b15ed525d3 tempest-VolumesCloneTest-852504020 None] creating snapshot='volume-40227c4e-8b78-4d4c-870e-74ae4ea16b77.clone_snap' {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Apr 09 21:12:46.846006 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-796143aa-dd3a-42a5-aba5-a4b15ed525d3 tempest-VolumesCloneTest-852504020 None] cloning 'volume-4a6e4887-b066-4d73-8ffe-d4dc6fd11c29@volume-40227c4e-8b78-4d4c-870e-74ae4ea16b77.clone_snap' to 'volume-40227c4e-8b78-4d4c-870e-74ae4ea16b77' {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Apr 09 21:12:46.996707 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-796143aa-dd3a-42a5-aba5-a4b15ed525d3 tempest-VolumesCloneTest-852504020 None] Volume volume-4a6e4887-b066-4d73-8ffe-d4dc6fd11c29 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:12:47.001394 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-796143aa-dd3a-42a5-aba5-a4b15ed525d3 tempest-VolumesCloneTest-852504020 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:12:47.002740 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-796143aa-dd3a-42a5-aba5-a4b15ed525d3 tempest-VolumesCloneTest-852504020 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:12:47.036450 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-796143aa-dd3a-42a5-aba5-a4b15ed525d3 tempest-VolumesCloneTest-852504020 None] resize volume 'volume-40227c4e-8b78-4d4c-870e-74ae4ea16b77' from 1 to 2 {{(pid=135002) _extend_if_required /opt/stack/cinder/cinder/volume/drivers/rbd.py:742}} Apr 09 21:12:47.037498 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-796143aa-dd3a-42a5-aba5-a4b15ed525d3 tempest-VolumesCloneTest-852504020 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:47.242103 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-796143aa-dd3a-42a5-aba5-a4b15ed525d3 tempest-VolumesCloneTest-852504020 None] clone created successfully {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Apr 09 21:12:47.249183 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-796143aa-dd3a-42a5-aba5-a4b15ed525d3 tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee52b44d-eed5-4675-9e9a-d05e839a4633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40227c4e-8b78-4d4c-870e-74ae4ea16b77', 'volume_size': 2, 'source_volid': '4a6e4887-b066-4d73-8ffe-d4dc6fd11c29', 'source_volstatus': 'available'}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:47.278079 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-796143aa-dd3a-42a5-aba5-a4b15ed525d3 tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9584c673-d818-4972-82e0-de0b9cb6db84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:12:47.296219 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-796143aa-dd3a-42a5-aba5-a4b15ed525d3 tempest-VolumesCloneTest-852504020 None] Volume volume-40227c4e-8b78-4d4c-870e-74ae4ea16b77 (40227c4e-8b78-4d4c-870e-74ae4ea16b77): created successfully Apr 09 21:12:47.300795 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-796143aa-dd3a-42a5-aba5-a4b15ed525d3 tempest-VolumesCloneTest-852504020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9584c673-d818-4972-82e0-de0b9cb6db84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:12:47.306648 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-796143aa-dd3a-42a5-aba5-a4b15ed525d3 tempest-VolumesCloneTest-852504020 None] Flow 'volume_create_manager' (a2e08604-8028-4333-a820-90a926f01255) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:12:47.339476 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-796143aa-dd3a-42a5-aba5-a4b15ed525d3 tempest-VolumesCloneTest-852504020 None] Created volume successfully. Apr 09 21:12:48.443783 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-ef068608-d893-4615-879b-ef952166d7f5 tempest-VolumesCloneTest-852504020 None] Lock "b'cinder-40227c4e-8b78-4d4c-870e-74ae4ea16b77-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:12:48.528025 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ef068608-d893-4615-879b-ef952166d7f5 tempest-VolumesCloneTest-852504020 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:48.632842 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ef068608-d893-4615-879b-ef952166d7f5 tempest-VolumesCloneTest-852504020 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:12:48.651077 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ef068608-d893-4615-879b-ef952166d7f5 tempest-VolumesCloneTest-852504020 None] deleting rbd volume volume-40227c4e-8b78-4d4c-870e-74ae4ea16b77 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:12:48.692655 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-b11ae8eb-0c1d-49f5-88fb-bb45efc8813a tempest-VolumesBackupsTest-1881101193 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-04-09T21:12:48Z,data_timestamp=2022-04-09T21:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-231773288',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=b0ffc5f3-dc5c-4e8d-afcd-3f0084df16c6,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='9bd28da6b23940dc816d678fc6f2b9db',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='74311b56951549df8388565bff4a5499',volume_id=c5d2f8ab-7872-4061-be6c-5b1930fc0017) Apr 09 21:12:48.720221 ncdv-master-1 cinder-volume[135002]: INFO cinder.rpc [None req-b11ae8eb-0c1d-49f5-88fb-bb45efc8813a tempest-VolumesBackupsTest-1881101193 None] Automatically selected cinder-backup objects version 1.39 as minimum service version. Apr 09 21:12:48.733083 ncdv-master-1 cinder-volume[135002]: INFO cinder.rpc [None req-b11ae8eb-0c1d-49f5-88fb-bb45efc8813a tempest-VolumesBackupsTest-1881101193 None] Automatically selected cinder-backup RPC version 2.3 as minimum service version. Apr 09 21:12:48.734258 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.backup.rpcapi [None req-b11ae8eb-0c1d-49f5-88fb-bb45efc8813a tempest-VolumesBackupsTest-1881101193 None] continue_backup in rpcapi backup_id b0ffc5f3-dc5c-4e8d-afcd-3f0084df16c6 {{(pid=135002) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Apr 09 21:12:49.143135 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ef068608-d893-4615-879b-ef952166d7f5 tempest-VolumesCloneTest-852504020 None] volume is a clone so cleaning references {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Apr 09 21:12:49.170962 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ef068608-d893-4615-879b-ef952166d7f5 tempest-VolumesCloneTest-852504020 None] Volume volume-4a6e4887-b066-4d73-8ffe-d4dc6fd11c29 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:12:49.171469 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ef068608-d893-4615-879b-ef952166d7f5 tempest-VolumesCloneTest-852504020 None] deleting parent snapshot volume-40227c4e-8b78-4d4c-870e-74ae4ea16b77.clone_snap {{(pid=135002) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Apr 09 21:12:49.870830 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:12:49.872787 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:49.935991 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:49.981411 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:12:50.009518 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-03e32310-578a-4521-a7e5-b5d5012b9bd0 tempest-ServerRescueNegativeTestJSON-1017505455 None] Lock "b'cinder-4b07460f-352b-42de-aaa6-13f4befc338a-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:12:50.054836 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-ef068608-d893-4615-879b-ef952166d7f5 tempest-VolumesCloneTest-852504020 None] Created reservations ['1865436d-8313-4932-b56c-d439f257de55', '52205beb-3c66-4081-900d-430dae8b521b', '7ad00743-3700-423a-bd71-dd00da3537fe', '08f47465-320e-4509-a557-0344c8169965'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:12:50.061349 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-03e32310-578a-4521-a7e5-b5d5012b9bd0 tempest-ServerRescueNegativeTestJSON-1017505455 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:50.129204 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-03e32310-578a-4521-a7e5-b5d5012b9bd0 tempest-ServerRescueNegativeTestJSON-1017505455 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:12:50.130142 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-03e32310-578a-4521-a7e5-b5d5012b9bd0 tempest-ServerRescueNegativeTestJSON-1017505455 None] Volume volume-4b07460f-352b-42de-aaa6-13f4befc338a is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:12:50.140756 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-03e32310-578a-4521-a7e5-b5d5012b9bd0 tempest-ServerRescueNegativeTestJSON-1017505455 None] deleting rbd volume volume-4b07460f-352b-42de-aaa6-13f4befc338a {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:12:50.219190 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ef068608-d893-4615-879b-ef952166d7f5 tempest-VolumesCloneTest-852504020 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:50.288650 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ef068608-d893-4615-879b-ef952166d7f5 tempest-VolumesCloneTest-852504020 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:50.355954 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-ef068608-d893-4615-879b-ef952166d7f5 tempest-VolumesCloneTest-852504020 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:12:50.367068 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-ef068608-d893-4615-879b-ef952166d7f5 tempest-VolumesCloneTest-852504020 None] Deleted volume successfully. Apr 09 21:12:50.390607 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-ef068608-d893-4615-879b-ef952166d7f5 tempest-VolumesCloneTest-852504020 None] Lock "b'cinder-40227c4e-8b78-4d4c-870e-74ae4ea16b77-delete_volume'" released by "delete_volume" :: held 1.947s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:12:50.508104 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-03e32310-578a-4521-a7e5-b5d5012b9bd0 tempest-ServerRescueNegativeTestJSON-1017505455 None] Created reservations ['4eabf1a3-472c-46fb-af30-de2170ca4ba4', '73aec6cc-06a2-4571-9ac0-dcdd5cedcc8a', 'a90e01b3-adbf-4519-abff-877f5929ea9c', '55d7b37f-1251-4e03-a636-42d2a1dad340'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:12:50.596915 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-03e32310-578a-4521-a7e5-b5d5012b9bd0 tempest-ServerRescueNegativeTestJSON-1017505455 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:50.646798 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-03e32310-578a-4521-a7e5-b5d5012b9bd0 tempest-ServerRescueNegativeTestJSON-1017505455 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:50.741125 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-03e32310-578a-4521-a7e5-b5d5012b9bd0 tempest-ServerRescueNegativeTestJSON-1017505455 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:12:50.747002 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-03e32310-578a-4521-a7e5-b5d5012b9bd0 tempest-ServerRescueNegativeTestJSON-1017505455 None] Deleted volume successfully. Apr 09 21:12:50.794651 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-ec29e1ff-3e42-4dd9-868f-c1688c7e0399 tempest-VolumesCloneTest-852504020 None] Lock "b'cinder-4a6e4887-b066-4d73-8ffe-d4dc6fd11c29-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:12:50.801851 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-03e32310-578a-4521-a7e5-b5d5012b9bd0 tempest-ServerRescueNegativeTestJSON-1017505455 None] Lock "b'cinder-4b07460f-352b-42de-aaa6-13f4befc338a-delete_volume'" released by "delete_volume" :: held 0.792s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:12:50.871046 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ec29e1ff-3e42-4dd9-868f-c1688c7e0399 tempest-VolumesCloneTest-852504020 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:50.990717 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ec29e1ff-3e42-4dd9-868f-c1688c7e0399 tempest-VolumesCloneTest-852504020 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:12:50.991230 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ec29e1ff-3e42-4dd9-868f-c1688c7e0399 tempest-VolumesCloneTest-852504020 None] Volume volume-4a6e4887-b066-4d73-8ffe-d4dc6fd11c29 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:12:50.999056 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ec29e1ff-3e42-4dd9-868f-c1688c7e0399 tempest-VolumesCloneTest-852504020 None] deleting rbd volume volume-4a6e4887-b066-4d73-8ffe-d4dc6fd11c29 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:12:51.027641 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-55f00d8d-d54f-41e5-9170-c30ec848f035 tempest-ServerRescueNegativeTestJSON-1017505455 None] Lock "b'cinder-08e25379-e4c4-487a-824c-200bb454843f-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:12:51.073753 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-55f00d8d-d54f-41e5-9170-c30ec848f035 tempest-ServerRescueNegativeTestJSON-1017505455 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:51.131245 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-55f00d8d-d54f-41e5-9170-c30ec848f035 tempest-ServerRescueNegativeTestJSON-1017505455 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:12:51.132256 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-55f00d8d-d54f-41e5-9170-c30ec848f035 tempest-ServerRescueNegativeTestJSON-1017505455 None] Volume volume-08e25379-e4c4-487a-824c-200bb454843f is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:12:51.141592 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-55f00d8d-d54f-41e5-9170-c30ec848f035 tempest-ServerRescueNegativeTestJSON-1017505455 None] deleting rbd volume volume-08e25379-e4c4-487a-824c-200bb454843f {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:12:51.420334 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-ec29e1ff-3e42-4dd9-868f-c1688c7e0399 tempest-VolumesCloneTest-852504020 None] Created reservations ['4791d57b-7a10-4419-beb6-35aa6c67cf30', '7799bf33-c612-4a34-81a0-e767fb17b42e', '0a61b375-61ec-469c-b0e7-6f5c1311ae40', '9268bbde-45b3-49f3-aa70-81f0d317e62b'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:12:51.508691 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ec29e1ff-3e42-4dd9-868f-c1688c7e0399 tempest-VolumesCloneTest-852504020 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:51.536828 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ec29e1ff-3e42-4dd9-868f-c1688c7e0399 tempest-VolumesCloneTest-852504020 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:51.605910 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-ec29e1ff-3e42-4dd9-868f-c1688c7e0399 tempest-VolumesCloneTest-852504020 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:12:51.612896 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-ec29e1ff-3e42-4dd9-868f-c1688c7e0399 tempest-VolumesCloneTest-852504020 None] Deleted volume successfully. Apr 09 21:12:51.643881 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-ec29e1ff-3e42-4dd9-868f-c1688c7e0399 tempest-VolumesCloneTest-852504020 None] Lock "b'cinder-4a6e4887-b066-4d73-8ffe-d4dc6fd11c29-delete_volume'" released by "delete_volume" :: held 0.851s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:12:51.652005 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-55f00d8d-d54f-41e5-9170-c30ec848f035 tempest-ServerRescueNegativeTestJSON-1017505455 None] Created reservations ['32de3ad1-9e67-4205-a53d-71225e6e9286', '624511a0-d4ea-46cf-8f21-b103d3b12838', '0aceebc3-6517-4c16-8f65-fbbb9aeab10e', '742eee23-cff7-4c1c-98d7-d3989afbf99e'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:12:51.715912 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-55f00d8d-d54f-41e5-9170-c30ec848f035 tempest-ServerRescueNegativeTestJSON-1017505455 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:51.775176 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-55f00d8d-d54f-41e5-9170-c30ec848f035 tempest-ServerRescueNegativeTestJSON-1017505455 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:51.843240 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-55f00d8d-d54f-41e5-9170-c30ec848f035 tempest-ServerRescueNegativeTestJSON-1017505455 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:12:51.847052 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-55f00d8d-d54f-41e5-9170-c30ec848f035 tempest-ServerRescueNegativeTestJSON-1017505455 None] Deleted volume successfully. Apr 09 21:12:51.874989 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-55f00d8d-d54f-41e5-9170-c30ec848f035 tempest-ServerRescueNegativeTestJSON-1017505455 None] Lock "b'cinder-08e25379-e4c4-487a-824c-200bb454843f-delete_volume'" released by "delete_volume" :: held 0.846s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:12:51.994012 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-6a6e1f13-6dc7-4011-844d-0faa7040aeb5 tempest-VolumesCloneTest-852504020 None] Lock "b'cinder-9d243041-a7b2-4613-9d38-1c224bb193c7-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:12:52.043292 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-6a6e1f13-6dc7-4011-844d-0faa7040aeb5 tempest-VolumesCloneTest-852504020 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:52.162423 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-6a6e1f13-6dc7-4011-844d-0faa7040aeb5 tempest-VolumesCloneTest-852504020 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:12:52.176186 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-6a6e1f13-6dc7-4011-844d-0faa7040aeb5 tempest-VolumesCloneTest-852504020 None] deleting rbd volume volume-9d243041-a7b2-4613-9d38-1c224bb193c7 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:12:52.558502 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-6a6e1f13-6dc7-4011-844d-0faa7040aeb5 tempest-VolumesCloneTest-852504020 None] volume is a clone so cleaning references {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Apr 09 21:12:52.610132 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-6a6e1f13-6dc7-4011-844d-0faa7040aeb5 tempest-VolumesCloneTest-852504020 None] deleting parent snapshot volume-9d243041-a7b2-4613-9d38-1c224bb193c7.clone_snap {{(pid=135002) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Apr 09 21:12:53.025844 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-6a6e1f13-6dc7-4011-844d-0faa7040aeb5 tempest-VolumesCloneTest-852504020 None] Created reservations ['97b6ea32-1757-422d-b61d-2ee175e7fd9c', 'd7926de4-63f7-433c-b4f7-b92d6b90c47c', '36d31f25-d2fa-4430-9053-160648dbd79e', 'ae8c2959-9001-4bfb-85c8-e3338f2fd5c0'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:12:53.141133 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-6a6e1f13-6dc7-4011-844d-0faa7040aeb5 tempest-VolumesCloneTest-852504020 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:53.234199 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-6a6e1f13-6dc7-4011-844d-0faa7040aeb5 tempest-VolumesCloneTest-852504020 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:53.298185 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-6a6e1f13-6dc7-4011-844d-0faa7040aeb5 tempest-VolumesCloneTest-852504020 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:12:53.319928 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-6a6e1f13-6dc7-4011-844d-0faa7040aeb5 tempest-VolumesCloneTest-852504020 None] Deleted volume successfully. Apr 09 21:12:53.358162 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-f418e637-b5e5-4d3e-a1f6-9f2d1a487d0c tempest-VolumesCloneTest-852504020 None] Lock "b'cinder-8d6c6b9d-3102-4eb5-bb44-9f40f7424722-delete_volume'" acquired by "delete_volume" :: waited 0.049s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:12:53.383520 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-6a6e1f13-6dc7-4011-844d-0faa7040aeb5 tempest-VolumesCloneTest-852504020 None] Lock "b'cinder-9d243041-a7b2-4613-9d38-1c224bb193c7-delete_volume'" released by "delete_volume" :: held 1.390s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:12:53.407322 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f418e637-b5e5-4d3e-a1f6-9f2d1a487d0c tempest-VolumesCloneTest-852504020 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:53.529436 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f418e637-b5e5-4d3e-a1f6-9f2d1a487d0c tempest-VolumesCloneTest-852504020 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:12:53.543078 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f418e637-b5e5-4d3e-a1f6-9f2d1a487d0c tempest-VolumesCloneTest-852504020 None] deleting rbd volume volume-8d6c6b9d-3102-4eb5-bb44-9f40f7424722 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:12:53.922571 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f418e637-b5e5-4d3e-a1f6-9f2d1a487d0c tempest-VolumesCloneTest-852504020 None] volume is a clone so cleaning references {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Apr 09 21:12:53.960252 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f418e637-b5e5-4d3e-a1f6-9f2d1a487d0c tempest-VolumesCloneTest-852504020 None] deleting parent snapshot volume-8d6c6b9d-3102-4eb5-bb44-9f40f7424722.clone_snap {{(pid=135002) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Apr 09 21:12:55.038687 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-f418e637-b5e5-4d3e-a1f6-9f2d1a487d0c tempest-VolumesCloneTest-852504020 None] Created reservations ['47bb27ff-33f8-48d2-8cde-4157fc017b24', 'f247b148-71de-4040-b899-b9d58c948582', '825eb470-ee92-47c3-a8db-49cfd0fd87fc', '7a0b0b35-4dee-4b62-943a-66543244445b'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:12:55.282048 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f418e637-b5e5-4d3e-a1f6-9f2d1a487d0c tempest-VolumesCloneTest-852504020 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:55.351585 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f418e637-b5e5-4d3e-a1f6-9f2d1a487d0c tempest-VolumesCloneTest-852504020 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:12:55.430780 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-f418e637-b5e5-4d3e-a1f6-9f2d1a487d0c tempest-VolumesCloneTest-852504020 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:12:55.446904 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-f418e637-b5e5-4d3e-a1f6-9f2d1a487d0c tempest-VolumesCloneTest-852504020 None] Deleted volume successfully. Apr 09 21:12:55.467865 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-f418e637-b5e5-4d3e-a1f6-9f2d1a487d0c tempest-VolumesCloneTest-852504020 None] Lock "b'cinder-8d6c6b9d-3102-4eb5-bb44-9f40f7424722-delete_volume'" released by "delete_volume" :: held 2.109s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:12:55.615188 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [None req-b11ae8eb-0c1d-49f5-88fb-bb45efc8813a tempest-VolumesBackupsTest-1881101193 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:12:56.493938 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [None req-b11ae8eb-0c1d-49f5-88fb-bb45efc8813a tempest-VolumesBackupsTest-1881101193 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.878s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:12:56.494826 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b11ae8eb-0c1d-49f5-88fb-bb45efc8813a tempest-VolumesBackupsTest-1881101193 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c5d2f8ab-7872-4061-be6c-5b1930fc0017', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': 'c5d2f8ab-7872-4061-be6c-5b1930fc0017', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:12:56.526702 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-b11ae8eb-0c1d-49f5-88fb-bb45efc8813a tempest-VolumesBackupsTest-1881101193 None] Initialize volume connection completed successfully. Apr 09 21:13:00.281307 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-b11ae8eb-0c1d-49f5-88fb-bb45efc8813a tempest-VolumesBackupsTest-1881101193 None] Terminate volume connection completed successfully. Apr 09 21:13:00.318026 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-b11ae8eb-0c1d-49f5-88fb-bb45efc8813a tempest-VolumesBackupsTest-1881101193 None] Remove volume export completed successfully. Apr 09 21:13:04.371978 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-b8b14caf-e180-4965-9613-c76e9b0b2546 req-2bd8ae3c-2955-4406-9ef9-95a313ce5fd9 tempest-VolumesBackupsTest-1881101193 None] Terminate volume connection completed successfully. Apr 09 21:13:04.373441 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-b8b14caf-e180-4965-9613-c76e9b0b2546 req-2bd8ae3c-2955-4406-9ef9-95a313ce5fd9 tempest-VolumesBackupsTest-1881101193 None] Deleting attachment ee21b0c8-4f9d-4c9d-a66a-a48b3cd21455. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 21:13:10.150392 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-8053bf8e-4d7e-43ee-9c30-9b928fb44308 tempest-VolumesBackupsTest-1881101193 None] Lock "b'cinder-c5d2f8ab-7872-4061-be6c-5b1930fc0017-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:13:10.207013 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-8053bf8e-4d7e-43ee-9c30-9b928fb44308 tempest-VolumesBackupsTest-1881101193 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:13:11.201689 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-8053bf8e-4d7e-43ee-9c30-9b928fb44308 tempest-VolumesBackupsTest-1881101193 None] Volume volume-c5d2f8ab-7872-4061-be6c-5b1930fc0017 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:13:11.242441 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-8053bf8e-4d7e-43ee-9c30-9b928fb44308 tempest-VolumesBackupsTest-1881101193 None] deleting rbd volume volume-c5d2f8ab-7872-4061-be6c-5b1930fc0017 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:13:11.784217 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-8053bf8e-4d7e-43ee-9c30-9b928fb44308 tempest-VolumesBackupsTest-1881101193 None] Created reservations ['6ff06025-512b-4d6e-9070-5b0e65e4fc2f', '69302214-dbb7-4a91-ba0a-f115c01b4acc', 'e74d4bac-b980-4089-8f99-48628a95e338', '5dcc13a4-7c4a-463b-b76c-2ae9c7ca96e6'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:13:11.874852 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-8053bf8e-4d7e-43ee-9c30-9b928fb44308 tempest-VolumesBackupsTest-1881101193 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:13:11.940512 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-8053bf8e-4d7e-43ee-9c30-9b928fb44308 tempest-VolumesBackupsTest-1881101193 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:13:12.014661 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-8053bf8e-4d7e-43ee-9c30-9b928fb44308 tempest-VolumesBackupsTest-1881101193 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:13:12.029812 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-8053bf8e-4d7e-43ee-9c30-9b928fb44308 tempest-VolumesBackupsTest-1881101193 None] Deleted volume successfully. Apr 09 21:13:12.065317 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-8053bf8e-4d7e-43ee-9c30-9b928fb44308 tempest-VolumesBackupsTest-1881101193 None] Lock "b'cinder-c5d2f8ab-7872-4061-be6c-5b1930fc0017-delete_volume'" released by "delete_volume" :: held 1.915s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:13:12.591752 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-6b1db7b1-7df9-4a29-9c63-d80332119cfe req-05640e80-5ccc-407b-9448-9bca5f822929 tempest-AttachVolumeShelveTestJSON-1751174024 None] Terminate volume connection completed successfully. Apr 09 21:13:12.595043 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-6b1db7b1-7df9-4a29-9c63-d80332119cfe req-05640e80-5ccc-407b-9448-9bca5f822929 tempest-AttachVolumeShelveTestJSON-1751174024 None] Deleting attachment f200cf4b-62b6-4010-9fe4-a64d5316d8f9. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 21:13:13.490397 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-b79f9b7b-ac74-4162-82c1-a98a1871bc9c tempest-VolumesBackupsTest-1881101193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:13:13.515914 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b79f9b7b-ac74-4162-82c1-a98a1871bc9c tempest-VolumesBackupsTest-1881101193 None] Flow 'volume_create_manager' (fc669f72-4cd3-45f5-b7e7-8432a50779b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:13:13.523036 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b79f9b7b-ac74-4162-82c1-a98a1871bc9c tempest-VolumesBackupsTest-1881101193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5fd845d-c73c-4f02-94da-6106cf6e4eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:13:13.592837 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b79f9b7b-ac74-4162-82c1-a98a1871bc9c tempest-VolumesBackupsTest-1881101193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5fd845d-c73c-4f02-94da-6106cf6e4eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1876374504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7fc9428d-ac71-4320-a6b2-4e0c1283dd81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bd28da6b23940dc816d678fc6f2b9db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:13:13Z,use_quota=True,user_id='74311b56951549df8388565bff4a5499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:13:13.601417 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b79f9b7b-ac74-4162-82c1-a98a1871bc9c tempest-VolumesBackupsTest-1881101193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26c8eb9c-5d69-4c79-ad12-11a4576a54f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:13:13.606114 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b79f9b7b-ac74-4162-82c1-a98a1871bc9c tempest-VolumesBackupsTest-1881101193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26c8eb9c-5d69-4c79-ad12-11a4576a54f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:13:13.614840 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b79f9b7b-ac74-4162-82c1-a98a1871bc9c tempest-VolumesBackupsTest-1881101193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3019b371-2bb5-4ebc-938d-f3677fbdd61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:13:13.758107 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b79f9b7b-ac74-4162-82c1-a98a1871bc9c tempest-VolumesBackupsTest-1881101193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3019b371-2bb5-4ebc-938d-f3677fbdd61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7fc9428d-ac71-4320-a6b2-4e0c1283dd81', 'volume_name': 'volume-7fc9428d-ac71-4320-a6b2-4e0c1283dd81', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:13:13.773762 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b79f9b7b-ac74-4162-82c1-a98a1871bc9c tempest-VolumesBackupsTest-1881101193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01f1f021-ad83-4baa-a2c7-e06a8ee797cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:13:13.785897 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b79f9b7b-ac74-4162-82c1-a98a1871bc9c tempest-VolumesBackupsTest-1881101193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01f1f021-ad83-4baa-a2c7-e06a8ee797cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:13:13.802249 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b79f9b7b-ac74-4162-82c1-a98a1871bc9c tempest-VolumesBackupsTest-1881101193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (811fe71b-965c-43d6-ac8b-51e21690b66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:13:13.804106 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-b79f9b7b-ac74-4162-82c1-a98a1871bc9c tempest-VolumesBackupsTest-1881101193 None] Volume 7fc9428d-ac71-4320-a6b2-4e0c1283dd81: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7fc9428d-ac71-4320-a6b2-4e0c1283dd81', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 09 21:13:13.805781 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-b79f9b7b-ac74-4162-82c1-a98a1871bc9c tempest-VolumesBackupsTest-1881101193 None] Cloning 7fc9428d-ac71-4320-a6b2-4e0c1283dd81 from image b539c48b-3400-4aa4-9226-8be5a3d07b36 at location (None, None). {{(pid=135002) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Apr 09 21:13:13.826826 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-b79f9b7b-ac74-4162-82c1-a98a1871bc9c tempest-VolumesBackupsTest-1881101193 None] Lock "b'cinder-b539c48b-3400-4aa4-9226-8be5a3d07b36'" acquired by "_prepare_image_cache_entry" :: waited 0.020s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:13:13.846458 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-b79f9b7b-ac74-4162-82c1-a98a1871bc9c tempest-VolumesBackupsTest-1881101193 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'volume_id': 'd35656e2-d293-4904-aeae-3113202bb314', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36), 'last_used': datetime.datetime(2022, 4, 9, 21, 13, 13, 834270)}. {{(pid=135002) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 09 21:13:13.846983 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-b79f9b7b-ac74-4162-82c1-a98a1871bc9c tempest-VolumesBackupsTest-1881101193 None] Image-volume cache entry image_update_at = 2022-04-09 20:45:36+00:00, requested image updated_at = 2022-04-09 20:45:36+00:00. {{(pid=135002) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 09 21:13:13.847488 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-b79f9b7b-ac74-4162-82c1-a98a1871bc9c tempest-VolumesBackupsTest-1881101193 None] Found cache entry for image = b539c48b-3400-4aa4-9226-8be5a3d07b36 on host ncdv-master-1@ceph#ceph. {{(pid=135002) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Apr 09 21:13:13.856855 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-b79f9b7b-ac74-4162-82c1-a98a1871bc9c tempest-VolumesBackupsTest-1881101193 None] Lock "b'cinder-b539c48b-3400-4aa4-9226-8be5a3d07b36'" released by "_prepare_image_cache_entry" :: held 0.030s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:13:13.862334 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-b79f9b7b-ac74-4162-82c1-a98a1871bc9c tempest-VolumesBackupsTest-1881101193 None] Attempting to retrieve cache entry for image = b539c48b-3400-4aa4-9226-8be5a3d07b36 on host ncdv-master-1@ceph#ceph. {{(pid=135002) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Apr 09 21:13:13.875834 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-b79f9b7b-ac74-4162-82c1-a98a1871bc9c tempest-VolumesBackupsTest-1881101193 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'volume_id': 'd35656e2-d293-4904-aeae-3113202bb314', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36), 'last_used': datetime.datetime(2022, 4, 9, 21, 13, 13, 869453)}. {{(pid=135002) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 09 21:13:13.876167 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-b79f9b7b-ac74-4162-82c1-a98a1871bc9c tempest-VolumesBackupsTest-1881101193 None] Image-volume cache entry image_update_at = 2022-04-09 20:45:36+00:00, requested image updated_at = 2022-04-09 20:45:36+00:00. {{(pid=135002) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 09 21:13:13.879478 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-b79f9b7b-ac74-4162-82c1-a98a1871bc9c tempest-VolumesBackupsTest-1881101193 None] Creating from source image-volume d35656e2-d293-4904-aeae-3113202bb314 {{(pid=135002) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Apr 09 21:13:13.923818 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b79f9b7b-ac74-4162-82c1-a98a1871bc9c tempest-VolumesBackupsTest-1881101193 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:13:14.036588 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b79f9b7b-ac74-4162-82c1-a98a1871bc9c tempest-VolumesBackupsTest-1881101193 None] creating snapshot='volume-7fc9428d-ac71-4320-a6b2-4e0c1283dd81.clone_snap' {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Apr 09 21:13:14.358863 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b79f9b7b-ac74-4162-82c1-a98a1871bc9c tempest-VolumesBackupsTest-1881101193 None] cloning 'volume-d35656e2-d293-4904-aeae-3113202bb314@volume-7fc9428d-ac71-4320-a6b2-4e0c1283dd81.clone_snap' to 'volume-7fc9428d-ac71-4320-a6b2-4e0c1283dd81' {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Apr 09 21:13:14.623898 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b79f9b7b-ac74-4162-82c1-a98a1871bc9c tempest-VolumesBackupsTest-1881101193 None] Volume volume-6d815065-063f-4887-9bc8-5808837868ff.deleted is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:13:14.627049 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b79f9b7b-ac74-4162-82c1-a98a1871bc9c tempest-VolumesBackupsTest-1881101193 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:13:14.628089 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b79f9b7b-ac74-4162-82c1-a98a1871bc9c tempest-VolumesBackupsTest-1881101193 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:13:14.687754 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b79f9b7b-ac74-4162-82c1-a98a1871bc9c tempest-VolumesBackupsTest-1881101193 None] clone created successfully {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Apr 09 21:13:14.693982 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.volume_utils [None req-b79f9b7b-ac74-4162-82c1-a98a1871bc9c tempest-VolumesBackupsTest-1881101193 None] Marking volume 7fc9428d-ac71-4320-a6b2-4e0c1283dd81 as bootable. {{(pid=135002) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Apr 09 21:13:14.711148 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-b79f9b7b-ac74-4162-82c1-a98a1871bc9c tempest-VolumesBackupsTest-1881101193 None] Copying metadata from image b539c48b-3400-4aa4-9226-8be5a3d07b36 to 7fc9428d-ac71-4320-a6b2-4e0c1283dd81. {{(pid=135002) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Apr 09 21:13:14.711662 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-b79f9b7b-ac74-4162-82c1-a98a1871bc9c tempest-VolumesBackupsTest-1881101193 None] Creating volume glance metadata for volume 7fc9428d-ac71-4320-a6b2-4e0c1283dd81 backed by image b539c48b-3400-4aa4-9226-8be5a3d07b36 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=135002) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Apr 09 21:13:14.979345 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b79f9b7b-ac74-4162-82c1-a98a1871bc9c tempest-VolumesBackupsTest-1881101193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (811fe71b-965c-43d6-ac8b-51e21690b66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fc9428d-ac71-4320-a6b2-4e0c1283dd81', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:13:15.015126 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b79f9b7b-ac74-4162-82c1-a98a1871bc9c tempest-VolumesBackupsTest-1881101193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ba47c44-51a2-4d3e-96b4-5b78247613c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:13:15.050493 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-b79f9b7b-ac74-4162-82c1-a98a1871bc9c tempest-VolumesBackupsTest-1881101193 None] Volume volume-7fc9428d-ac71-4320-a6b2-4e0c1283dd81 (7fc9428d-ac71-4320-a6b2-4e0c1283dd81): created successfully Apr 09 21:13:15.074377 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b79f9b7b-ac74-4162-82c1-a98a1871bc9c tempest-VolumesBackupsTest-1881101193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ba47c44-51a2-4d3e-96b4-5b78247613c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:13:15.093380 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b79f9b7b-ac74-4162-82c1-a98a1871bc9c tempest-VolumesBackupsTest-1881101193 None] Flow 'volume_create_manager' (fc669f72-4cd3-45f5-b7e7-8432a50779b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:13:15.124168 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-b79f9b7b-ac74-4162-82c1-a98a1871bc9c tempest-VolumesBackupsTest-1881101193 None] Created volume successfully. Apr 09 21:13:16.108655 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-053e0114-efdb-45ba-b450-81ce989c98f5 tempest-VolumesBackupsTest-1881101193 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-04-09T21:13:15Z,data_timestamp=2022-04-09T21:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1530849055',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=2a613956-d142-4205-b578-5cec6949c9c2,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='9bd28da6b23940dc816d678fc6f2b9db',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='74311b56951549df8388565bff4a5499',volume_id=7fc9428d-ac71-4320-a6b2-4e0c1283dd81) Apr 09 21:13:16.113549 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.backup.rpcapi [None req-053e0114-efdb-45ba-b450-81ce989c98f5 tempest-VolumesBackupsTest-1881101193 None] continue_backup in rpcapi backup_id 2a613956-d142-4205-b578-5cec6949c9c2 {{(pid=135002) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Apr 09 21:13:16.487481 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [None req-053e0114-efdb-45ba-b450-81ce989c98f5 tempest-VolumesBackupsTest-1881101193 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:13:17.791630 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [None req-053e0114-efdb-45ba-b450-81ce989c98f5 tempest-VolumesBackupsTest-1881101193 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.304s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:13:17.792728 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-053e0114-efdb-45ba-b450-81ce989c98f5 tempest-VolumesBackupsTest-1881101193 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7fc9428d-ac71-4320-a6b2-4e0c1283dd81', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': '7fc9428d-ac71-4320-a6b2-4e0c1283dd81', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:13:17.816331 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-053e0114-efdb-45ba-b450-81ce989c98f5 tempest-VolumesBackupsTest-1881101193 None] Initialize volume connection completed successfully. Apr 09 21:13:23.820810 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-67763275-e8ff-4c3b-955e-1157b3180dda req-2166ace4-92cd-4085-a5af-af685b127d6c tempest-AttachVolumeTestJSON-873042647 None] Terminate volume connection completed successfully. Apr 09 21:13:23.820810 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-67763275-e8ff-4c3b-955e-1157b3180dda req-2166ace4-92cd-4085-a5af-af685b127d6c tempest-AttachVolumeTestJSON-873042647 None] Deleting attachment 9a9f15e7-1d8f-4836-83db-70862db80b54. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 21:13:28.717120 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-053e0114-efdb-45ba-b450-81ce989c98f5 tempest-VolumesBackupsTest-1881101193 None] Terminate volume connection completed successfully. Apr 09 21:13:28.737358 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-053e0114-efdb-45ba-b450-81ce989c98f5 tempest-VolumesBackupsTest-1881101193 None] Remove volume export completed successfully. Apr 09 21:13:30.328003 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-277d8d57-c1d6-4a88-9050-fb3b303bc8ff tempest-VolumesBackupsTest-1881101193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:13:30.358468 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-277d8d57-c1d6-4a88-9050-fb3b303bc8ff tempest-VolumesBackupsTest-1881101193 None] Flow 'volume_create_manager' (7885e594-a795-42ab-98df-602089579ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:13:30.366386 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-277d8d57-c1d6-4a88-9050-fb3b303bc8ff tempest-VolumesBackupsTest-1881101193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa2f2883-7e3d-41ba-b799-e46609389c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:13:30.409760 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-277d8d57-c1d6-4a88-9050-fb3b303bc8ff tempest-VolumesBackupsTest-1881101193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa2f2883-7e3d-41ba-b799-e46609389c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:13:30Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_2a613956-d142-4205-b578-5cec6949c9c2',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=42ab02bf-5053-4db7-a4de-c9a00ccd3537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bd28da6b23940dc816d678fc6f2b9db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:13:30Z,use_quota=True,user_id='74311b56951549df8388565bff4a5499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:13:30.420900 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-277d8d57-c1d6-4a88-9050-fb3b303bc8ff tempest-VolumesBackupsTest-1881101193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (216f1203-4226-4fde-81df-ffdec16c21d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:13:30.439769 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-277d8d57-c1d6-4a88-9050-fb3b303bc8ff tempest-VolumesBackupsTest-1881101193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (216f1203-4226-4fde-81df-ffdec16c21d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:13:30.457881 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-277d8d57-c1d6-4a88-9050-fb3b303bc8ff tempest-VolumesBackupsTest-1881101193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f95c914-6395-4753-8ee0-a015d1ab7c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:13:30.467737 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-277d8d57-c1d6-4a88-9050-fb3b303bc8ff tempest-VolumesBackupsTest-1881101193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f95c914-6395-4753-8ee0-a015d1ab7c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42ab02bf-5053-4db7-a4de-c9a00ccd3537', 'volume_name': 'volume-42ab02bf-5053-4db7-a4de-c9a00ccd3537', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:13:30.478193 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-277d8d57-c1d6-4a88-9050-fb3b303bc8ff tempest-VolumesBackupsTest-1881101193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (708dd765-107e-406c-84ab-e85c86d105de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:13:30.482910 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-277d8d57-c1d6-4a88-9050-fb3b303bc8ff tempest-VolumesBackupsTest-1881101193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (708dd765-107e-406c-84ab-e85c86d105de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:13:30.495392 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-277d8d57-c1d6-4a88-9050-fb3b303bc8ff tempest-VolumesBackupsTest-1881101193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1c7296a-33e7-48b2-be64-a5597d179133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:13:30.498788 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-277d8d57-c1d6-4a88-9050-fb3b303bc8ff tempest-VolumesBackupsTest-1881101193 None] Volume 42ab02bf-5053-4db7-a4de-c9a00ccd3537: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42ab02bf-5053-4db7-a4de-c9a00ccd3537', 'volume_size': 1} Apr 09 21:13:30.501866 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-277d8d57-c1d6-4a88-9050-fb3b303bc8ff tempest-VolumesBackupsTest-1881101193 None] creating volume 'volume-42ab02bf-5053-4db7-a4de-c9a00ccd3537' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:13:30.503316 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-277d8d57-c1d6-4a88-9050-fb3b303bc8ff tempest-VolumesBackupsTest-1881101193 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:13:30.662456 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-277d8d57-c1d6-4a88-9050-fb3b303bc8ff tempest-VolumesBackupsTest-1881101193 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:13:30.662948 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-277d8d57-c1d6-4a88-9050-fb3b303bc8ff tempest-VolumesBackupsTest-1881101193 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:13:30.667303 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-277d8d57-c1d6-4a88-9050-fb3b303bc8ff tempest-VolumesBackupsTest-1881101193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1c7296a-33e7-48b2-be64-a5597d179133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42ab02bf-5053-4db7-a4de-c9a00ccd3537', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:13:30.677467 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-277d8d57-c1d6-4a88-9050-fb3b303bc8ff tempest-VolumesBackupsTest-1881101193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b72d7cac-ba21-41c4-bea3-db9268b44ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:13:30.698354 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-277d8d57-c1d6-4a88-9050-fb3b303bc8ff tempest-VolumesBackupsTest-1881101193 None] Volume volume-42ab02bf-5053-4db7-a4de-c9a00ccd3537 (42ab02bf-5053-4db7-a4de-c9a00ccd3537): created successfully Apr 09 21:13:30.702510 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-277d8d57-c1d6-4a88-9050-fb3b303bc8ff tempest-VolumesBackupsTest-1881101193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b72d7cac-ba21-41c4-bea3-db9268b44ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:13:30.713270 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-277d8d57-c1d6-4a88-9050-fb3b303bc8ff tempest-VolumesBackupsTest-1881101193 None] Flow 'volume_create_manager' (7885e594-a795-42ab-98df-602089579ec5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:13:30.747937 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-277d8d57-c1d6-4a88-9050-fb3b303bc8ff tempest-VolumesBackupsTest-1881101193 None] Created volume successfully. Apr 09 21:13:31.543938 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [None req-277d8d57-c1d6-4a88-9050-fb3b303bc8ff tempest-VolumesBackupsTest-1881101193 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:13:32.779095 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [None req-277d8d57-c1d6-4a88-9050-fb3b303bc8ff tempest-VolumesBackupsTest-1881101193 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.235s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:13:32.781440 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-277d8d57-c1d6-4a88-9050-fb3b303bc8ff tempest-VolumesBackupsTest-1881101193 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-42ab02bf-5053-4db7-a4de-c9a00ccd3537', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': '42ab02bf-5053-4db7-a4de-c9a00ccd3537', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:13:32.838023 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-277d8d57-c1d6-4a88-9050-fb3b303bc8ff tempest-VolumesBackupsTest-1881101193 None] Initialize volume connection completed successfully. Apr 09 21:13:36.816549 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-9e435d29-0ff4-4c81-b869-ac099e79a453 req-a49c695e-c834-4a20-9e5c-7d734f939132 tempest-AttachVolumeNegativeTest-1154334807 None] Terminate volume connection completed successfully. Apr 09 21:13:36.818170 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-9e435d29-0ff4-4c81-b869-ac099e79a453 req-a49c695e-c834-4a20-9e5c-7d734f939132 tempest-AttachVolumeNegativeTest-1154334807 None] Deleting attachment c00a45e8-866e-410e-8c38-306b2288540e. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 21:13:42.096133 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-277d8d57-c1d6-4a88-9050-fb3b303bc8ff tempest-VolumesBackupsTest-1881101193 None] Terminate volume connection completed successfully. Apr 09 21:13:42.126366 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-277d8d57-c1d6-4a88-9050-fb3b303bc8ff tempest-VolumesBackupsTest-1881101193 None] Remove volume export completed successfully. Apr 09 21:13:43.070010 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-b619479d-06b5-4612-acea-4e17dd2ca17d tempest-VolumesBackupsTest-1881101193 None] Lock "b'cinder-42ab02bf-5053-4db7-a4de-c9a00ccd3537-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:13:43.151086 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b619479d-06b5-4612-acea-4e17dd2ca17d tempest-VolumesBackupsTest-1881101193 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:13:44.447301 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b619479d-06b5-4612-acea-4e17dd2ca17d tempest-VolumesBackupsTest-1881101193 None] Volume volume-42ab02bf-5053-4db7-a4de-c9a00ccd3537 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:13:44.494430 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b619479d-06b5-4612-acea-4e17dd2ca17d tempest-VolumesBackupsTest-1881101193 None] deleting rbd volume volume-42ab02bf-5053-4db7-a4de-c9a00ccd3537 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:13:45.749514 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-b619479d-06b5-4612-acea-4e17dd2ca17d tempest-VolumesBackupsTest-1881101193 None] Created reservations ['bbb21ac5-39e6-408a-b48b-9826382834cb', 'b95db25b-151c-4a17-9c26-37d6bf5dbf43', '31feec4b-f610-4479-8ac2-a585b354922b', '94bdcacb-9d42-4d1c-b763-6094c618fee3'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:13:45.824398 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b619479d-06b5-4612-acea-4e17dd2ca17d tempest-VolumesBackupsTest-1881101193 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:13:45.900678 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b619479d-06b5-4612-acea-4e17dd2ca17d tempest-VolumesBackupsTest-1881101193 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:13:45.961586 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-b619479d-06b5-4612-acea-4e17dd2ca17d tempest-VolumesBackupsTest-1881101193 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:13:45.976741 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-b619479d-06b5-4612-acea-4e17dd2ca17d tempest-VolumesBackupsTest-1881101193 None] Deleted volume successfully. Apr 09 21:13:46.000888 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-b619479d-06b5-4612-acea-4e17dd2ca17d tempest-VolumesBackupsTest-1881101193 None] Lock "b'cinder-42ab02bf-5053-4db7-a4de-c9a00ccd3537-delete_volume'" released by "delete_volume" :: held 2.922s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:13:49.852930 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-19845a17-5809-4794-a27b-a5454d46f6ae tempest-VolumesBackupsTest-1881101193 None] Lock "b'cinder-7fc9428d-ac71-4320-a6b2-4e0c1283dd81-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:13:49.875241 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:13:49.878328 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:13:49.958075 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:13:50.012257 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:13:50.059660 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-19845a17-5809-4794-a27b-a5454d46f6ae tempest-VolumesBackupsTest-1881101193 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:13:50.378119 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-19845a17-5809-4794-a27b-a5454d46f6ae tempest-VolumesBackupsTest-1881101193 None] deleting rbd volume volume-7fc9428d-ac71-4320-a6b2-4e0c1283dd81 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:13:50.745271 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-19845a17-5809-4794-a27b-a5454d46f6ae tempest-VolumesBackupsTest-1881101193 None] volume is a clone so cleaning references {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Apr 09 21:13:50.788171 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-19845a17-5809-4794-a27b-a5454d46f6ae tempest-VolumesBackupsTest-1881101193 None] deleting parent snapshot volume-7fc9428d-ac71-4320-a6b2-4e0c1283dd81.clone_snap {{(pid=135002) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Apr 09 21:13:51.837519 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-19845a17-5809-4794-a27b-a5454d46f6ae tempest-VolumesBackupsTest-1881101193 None] Created reservations ['0502d499-4177-4da9-bad7-ccba868cb194', 'c8cdbed0-0ccb-4d2f-a669-cf82b11157f5', 'd72ff6e9-16d6-4a67-8698-edd26ce1ea7d', '8e9ffa6b-4c89-4167-b08e-6c6b5eff511e'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:13:51.905304 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-19845a17-5809-4794-a27b-a5454d46f6ae tempest-VolumesBackupsTest-1881101193 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:13:51.985751 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-19845a17-5809-4794-a27b-a5454d46f6ae tempest-VolumesBackupsTest-1881101193 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:13:52.057702 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-19845a17-5809-4794-a27b-a5454d46f6ae tempest-VolumesBackupsTest-1881101193 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:13:52.062088 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-19845a17-5809-4794-a27b-a5454d46f6ae tempest-VolumesBackupsTest-1881101193 None] Deleted volume successfully. Apr 09 21:13:52.080901 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-19845a17-5809-4794-a27b-a5454d46f6ae tempest-VolumesBackupsTest-1881101193 None] Lock "b'cinder-7fc9428d-ac71-4320-a6b2-4e0c1283dd81-delete_volume'" released by "delete_volume" :: held 2.229s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:13:56.812541 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2674933-a7a9-4b17-9dcb-5e4c169f217c tempest-VolumesSnapshotNegativeTestJSON-786268299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:13:56.839431 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2674933-a7a9-4b17-9dcb-5e4c169f217c tempest-VolumesSnapshotNegativeTestJSON-786268299 None] Flow 'volume_create_manager' (e3ddc4c9-3123-4976-b2fd-6b7dc33fe554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:13:56.849186 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2674933-a7a9-4b17-9dcb-5e4c169f217c tempest-VolumesSnapshotNegativeTestJSON-786268299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9937fa72-927d-4b4a-8cd7-1cb6ef408f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:13:56.868429 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2674933-a7a9-4b17-9dcb-5e4c169f217c tempest-VolumesSnapshotNegativeTestJSON-786268299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9937fa72-927d-4b4a-8cd7-1cb6ef408f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1089225003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=61573eb6-17b3-4c9e-bf63-72c1ffd8a43f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a99dd8eb54240c69d3976399e19d953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:13:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:13:57Z,use_quota=True,user_id='db0c3b4e104d4040bf14e1e200deb2be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:13:56.875375 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2674933-a7a9-4b17-9dcb-5e4c169f217c tempest-VolumesSnapshotNegativeTestJSON-786268299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1e50974-1f90-450c-8b2b-17d6f5bc2054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:13:56.882052 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2674933-a7a9-4b17-9dcb-5e4c169f217c tempest-VolumesSnapshotNegativeTestJSON-786268299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1e50974-1f90-450c-8b2b-17d6f5bc2054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:13:56.889631 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2674933-a7a9-4b17-9dcb-5e4c169f217c tempest-VolumesSnapshotNegativeTestJSON-786268299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2570144f-2c53-4071-9dcf-133041485cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:13:56.895055 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2674933-a7a9-4b17-9dcb-5e4c169f217c tempest-VolumesSnapshotNegativeTestJSON-786268299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2570144f-2c53-4071-9dcf-133041485cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61573eb6-17b3-4c9e-bf63-72c1ffd8a43f', 'volume_name': 'volume-61573eb6-17b3-4c9e-bf63-72c1ffd8a43f', 'volume_size': 2}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:13:56.900942 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2674933-a7a9-4b17-9dcb-5e4c169f217c tempest-VolumesSnapshotNegativeTestJSON-786268299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56623a97-0e88-44af-b049-d75b1d89ddf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:13:56.905816 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2674933-a7a9-4b17-9dcb-5e4c169f217c tempest-VolumesSnapshotNegativeTestJSON-786268299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56623a97-0e88-44af-b049-d75b1d89ddf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:13:56.917628 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2674933-a7a9-4b17-9dcb-5e4c169f217c tempest-VolumesSnapshotNegativeTestJSON-786268299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c3410f7-fc34-4f7a-a60b-4711bc682496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:13:56.919795 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-e2674933-a7a9-4b17-9dcb-5e4c169f217c tempest-VolumesSnapshotNegativeTestJSON-786268299 None] Volume 61573eb6-17b3-4c9e-bf63-72c1ffd8a43f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61573eb6-17b3-4c9e-bf63-72c1ffd8a43f', 'volume_size': 2} Apr 09 21:13:56.920864 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-e2674933-a7a9-4b17-9dcb-5e4c169f217c tempest-VolumesSnapshotNegativeTestJSON-786268299 None] creating volume 'volume-61573eb6-17b3-4c9e-bf63-72c1ffd8a43f' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:13:56.921961 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-e2674933-a7a9-4b17-9dcb-5e4c169f217c tempest-VolumesSnapshotNegativeTestJSON-786268299 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:13:57.067797 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-e2674933-a7a9-4b17-9dcb-5e4c169f217c tempest-VolumesSnapshotNegativeTestJSON-786268299 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:13:57.068326 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-e2674933-a7a9-4b17-9dcb-5e4c169f217c tempest-VolumesSnapshotNegativeTestJSON-786268299 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:13:57.076662 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2674933-a7a9-4b17-9dcb-5e4c169f217c tempest-VolumesSnapshotNegativeTestJSON-786268299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c3410f7-fc34-4f7a-a60b-4711bc682496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61573eb6-17b3-4c9e-bf63-72c1ffd8a43f', 'volume_size': 2}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:13:57.086427 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2674933-a7a9-4b17-9dcb-5e4c169f217c tempest-VolumesSnapshotNegativeTestJSON-786268299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (814b8819-9d31-4635-b004-203bb7a05547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:13:57.108293 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-e2674933-a7a9-4b17-9dcb-5e4c169f217c tempest-VolumesSnapshotNegativeTestJSON-786268299 None] Volume volume-61573eb6-17b3-4c9e-bf63-72c1ffd8a43f (61573eb6-17b3-4c9e-bf63-72c1ffd8a43f): created successfully Apr 09 21:13:57.112378 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2674933-a7a9-4b17-9dcb-5e4c169f217c tempest-VolumesSnapshotNegativeTestJSON-786268299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (814b8819-9d31-4635-b004-203bb7a05547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:13:57.118105 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2674933-a7a9-4b17-9dcb-5e4c169f217c tempest-VolumesSnapshotNegativeTestJSON-786268299 None] Flow 'volume_create_manager' (e3ddc4c9-3123-4976-b2fd-6b7dc33fe554) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:13:57.151158 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-e2674933-a7a9-4b17-9dcb-5e4c169f217c tempest-VolumesSnapshotNegativeTestJSON-786268299 None] Created volume successfully. Apr 09 21:13:58.062914 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d6d63559-7d7c-478f-be36-8e31ef8de1d5 tempest-VolumesSnapshotNegativeTestJSON-786268299 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:13:58.886900 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-d6d63559-7d7c-478f-be36-8e31ef8de1d5 tempest-VolumesSnapshotNegativeTestJSON-786268299 None] Create snapshot completed successfully Apr 09 21:13:59.255694 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-4d693fa8-e2ab-47e3-899b-be57446c31f1 tempest-VolumesSnapshotNegativeTestJSON-786268299 None] Lock "b'cinder-e59a9ff4-7c84-4777-8306-24e090030450-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:13:59.262791 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-4d693fa8-e2ab-47e3-899b-be57446c31f1 tempest-VolumesSnapshotNegativeTestJSON-786268299 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:13:59.951682 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-4d693fa8-e2ab-47e3-899b-be57446c31f1 tempest-VolumesSnapshotNegativeTestJSON-786268299 None] Created reservations ['383631aa-318b-4315-adee-a1de54963a29', '585041ed-22da-4b4a-8a1e-f1664bbea544', '55561069-33c9-4716-8cb1-713bf21c02bd', '2c5d2370-aebc-444c-8c6f-7313b6947c33'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:13:59.999337 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-4d693fa8-e2ab-47e3-899b-be57446c31f1 tempest-VolumesSnapshotNegativeTestJSON-786268299 None] Delete snapshot completed successfully. Apr 09 21:14:00.015203 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-4d693fa8-e2ab-47e3-899b-be57446c31f1 tempest-VolumesSnapshotNegativeTestJSON-786268299 None] Lock "b'cinder-e59a9ff4-7c84-4777-8306-24e090030450-delete_snapshot'" released by "delete_snapshot" :: held 0.760s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:14:00.391801 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-4c16f950-be7b-4b41-a358-be4f8a8a9e27 tempest-VolumesSnapshotNegativeTestJSON-786268299 None] Lock "b'cinder-61573eb6-17b3-4c9e-bf63-72c1ffd8a43f-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:14:00.459649 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-4c16f950-be7b-4b41-a358-be4f8a8a9e27 tempest-VolumesSnapshotNegativeTestJSON-786268299 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:14:00.536223 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-4c16f950-be7b-4b41-a358-be4f8a8a9e27 tempest-VolumesSnapshotNegativeTestJSON-786268299 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:14:00.536645 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-4c16f950-be7b-4b41-a358-be4f8a8a9e27 tempest-VolumesSnapshotNegativeTestJSON-786268299 None] Volume volume-61573eb6-17b3-4c9e-bf63-72c1ffd8a43f is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:14:00.546643 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-4c16f950-be7b-4b41-a358-be4f8a8a9e27 tempest-VolumesSnapshotNegativeTestJSON-786268299 None] deleting rbd volume volume-61573eb6-17b3-4c9e-bf63-72c1ffd8a43f {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:14:00.937380 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-4c16f950-be7b-4b41-a358-be4f8a8a9e27 tempest-VolumesSnapshotNegativeTestJSON-786268299 None] Created reservations ['099b5987-91ac-40ec-b19b-a4f6f9be25a0', 'f512bfd9-455b-423e-8a12-6e28e91beda7', 'd07ed544-ef92-42fc-b931-3ba485772c57', '4d8ecda3-8b21-4cc7-ab3d-6c8c1999de51'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:14:00.998540 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-4c16f950-be7b-4b41-a358-be4f8a8a9e27 tempest-VolumesSnapshotNegativeTestJSON-786268299 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:14:01.070283 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-4c16f950-be7b-4b41-a358-be4f8a8a9e27 tempest-VolumesSnapshotNegativeTestJSON-786268299 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:14:01.146596 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-4c16f950-be7b-4b41-a358-be4f8a8a9e27 tempest-VolumesSnapshotNegativeTestJSON-786268299 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:14:01.152233 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-4c16f950-be7b-4b41-a358-be4f8a8a9e27 tempest-VolumesSnapshotNegativeTestJSON-786268299 None] Deleted volume successfully. Apr 09 21:14:01.164846 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-4c16f950-be7b-4b41-a358-be4f8a8a9e27 tempest-VolumesSnapshotNegativeTestJSON-786268299 None] Lock "b'cinder-61573eb6-17b3-4c9e-bf63-72c1ffd8a43f-delete_volume'" released by "delete_volume" :: held 0.773s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:14:46.482684 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-28faddb2-77ac-4113-8d92-46d40e8f0fda tempest-AttachVolumeNegativeTest-1154334807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:14:46.504755 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-28faddb2-77ac-4113-8d92-46d40e8f0fda tempest-AttachVolumeNegativeTest-1154334807 None] Flow 'volume_create_manager' (71470295-72e3-4981-9930-07d4e3b1ad22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:14:46.511644 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-28faddb2-77ac-4113-8d92-46d40e8f0fda tempest-AttachVolumeNegativeTest-1154334807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52a7e188-fb74-4dd6-902d-583feca0596f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:14:46.535828 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-28faddb2-77ac-4113-8d92-46d40e8f0fda tempest-AttachVolumeNegativeTest-1154334807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52a7e188-fb74-4dd6-902d-583feca0596f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1023541091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=eced0af0-a8c1-464c-9b1d-5ed1898e863c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92f38b2c41e34e73bd6baa83478dddfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:14:46Z,use_quota=True,user_id='a6dcb8344fde4e4580e73efc09e633a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:14:46.542830 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-28faddb2-77ac-4113-8d92-46d40e8f0fda tempest-AttachVolumeNegativeTest-1154334807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e0d273b-9774-44cb-ae2a-a94cf9aebc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:14:46.547446 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-28faddb2-77ac-4113-8d92-46d40e8f0fda tempest-AttachVolumeNegativeTest-1154334807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e0d273b-9774-44cb-ae2a-a94cf9aebc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:14:46.554373 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-28faddb2-77ac-4113-8d92-46d40e8f0fda tempest-AttachVolumeNegativeTest-1154334807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (533d4815-2c65-4018-bcfe-715b12eca16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:14:46.558873 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-28faddb2-77ac-4113-8d92-46d40e8f0fda tempest-AttachVolumeNegativeTest-1154334807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (533d4815-2c65-4018-bcfe-715b12eca16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eced0af0-a8c1-464c-9b1d-5ed1898e863c', 'volume_name': 'volume-eced0af0-a8c1-464c-9b1d-5ed1898e863c', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:14:46.564740 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-28faddb2-77ac-4113-8d92-46d40e8f0fda tempest-AttachVolumeNegativeTest-1154334807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b72a16-0445-403e-bddc-646450099764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:14:46.569051 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-28faddb2-77ac-4113-8d92-46d40e8f0fda tempest-AttachVolumeNegativeTest-1154334807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b72a16-0445-403e-bddc-646450099764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:14:46.576597 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-28faddb2-77ac-4113-8d92-46d40e8f0fda tempest-AttachVolumeNegativeTest-1154334807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c2bc736-de66-4003-bd13-2639cb55c6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:14:46.578135 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-28faddb2-77ac-4113-8d92-46d40e8f0fda tempest-AttachVolumeNegativeTest-1154334807 None] Volume eced0af0-a8c1-464c-9b1d-5ed1898e863c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eced0af0-a8c1-464c-9b1d-5ed1898e863c', 'volume_size': 1} Apr 09 21:14:46.579055 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-28faddb2-77ac-4113-8d92-46d40e8f0fda tempest-AttachVolumeNegativeTest-1154334807 None] creating volume 'volume-eced0af0-a8c1-464c-9b1d-5ed1898e863c' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:14:46.580637 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-28faddb2-77ac-4113-8d92-46d40e8f0fda tempest-AttachVolumeNegativeTest-1154334807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:14:46.709079 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-28faddb2-77ac-4113-8d92-46d40e8f0fda tempest-AttachVolumeNegativeTest-1154334807 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:14:46.709598 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-28faddb2-77ac-4113-8d92-46d40e8f0fda tempest-AttachVolumeNegativeTest-1154334807 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:14:46.714965 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-28faddb2-77ac-4113-8d92-46d40e8f0fda tempest-AttachVolumeNegativeTest-1154334807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c2bc736-de66-4003-bd13-2639cb55c6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eced0af0-a8c1-464c-9b1d-5ed1898e863c', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:14:46.724343 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-28faddb2-77ac-4113-8d92-46d40e8f0fda tempest-AttachVolumeNegativeTest-1154334807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9604c615-8fce-463d-b538-16438d2a7ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:14:46.741496 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-28faddb2-77ac-4113-8d92-46d40e8f0fda tempest-AttachVolumeNegativeTest-1154334807 None] Volume volume-eced0af0-a8c1-464c-9b1d-5ed1898e863c (eced0af0-a8c1-464c-9b1d-5ed1898e863c): created successfully Apr 09 21:14:46.746160 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-28faddb2-77ac-4113-8d92-46d40e8f0fda tempest-AttachVolumeNegativeTest-1154334807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9604c615-8fce-463d-b538-16438d2a7ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:14:46.753578 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-28faddb2-77ac-4113-8d92-46d40e8f0fda tempest-AttachVolumeNegativeTest-1154334807 None] Flow 'volume_create_manager' (71470295-72e3-4981-9930-07d4e3b1ad22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:14:46.766024 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-28faddb2-77ac-4113-8d92-46d40e8f0fda tempest-AttachVolumeNegativeTest-1154334807 None] Created volume successfully. Apr 09 21:14:48.388853 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-de8ba8db-e6e6-4618-b93b-096ea3601b03 req-a966ba1a-4106-4e55-bc59-c03e73601994 tempest-AttachVolumeNegativeTest-1154334807 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:14:49.572025 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-de8ba8db-e6e6-4618-b93b-096ea3601b03 req-a966ba1a-4106-4e55-bc59-c03e73601994 tempest-AttachVolumeNegativeTest-1154334807 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.183s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:14:49.572877 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-de8ba8db-e6e6-4618-b93b-096ea3601b03 req-a966ba1a-4106-4e55-bc59-c03e73601994 tempest-AttachVolumeNegativeTest-1154334807 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-eced0af0-a8c1-464c-9b1d-5ed1898e863c', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': 'eced0af0-a8c1-464c-9b1d-5ed1898e863c', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:14:49.606075 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-de8ba8db-e6e6-4618-b93b-096ea3601b03 req-a966ba1a-4106-4e55-bc59-c03e73601994 tempest-AttachVolumeNegativeTest-1154334807 None] Connection info returned from driver {'name': 'volumes/volume-eced0af0-a8c1-464c-9b1d-5ed1898e863c', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'eced0af0-a8c1-464c-9b1d-5ed1898e863c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f44547b2-b759-47f3-8fbb-93c7948a9f71'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 21:14:49.712843 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-de8ba8db-e6e6-4618-b93b-096ea3601b03 req-a966ba1a-4106-4e55-bc59-c03e73601994 tempest-AttachVolumeNegativeTest-1154334807 None] attachment_update completed successfully. Apr 09 21:14:49.876215 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:14:49.878711 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:14:49.947977 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:14:49.990792 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:14:51.328881 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-22ed3bfd-f5fa-4c3b-be9e-73d6f7ece43d req-a4f1c40e-113b-42d3-9bd2-1a6f2c3ff1b0 tempest-TaggedBootDevicesTest_v242-429285116 None] Terminate volume connection completed successfully. Apr 09 21:14:51.331006 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-22ed3bfd-f5fa-4c3b-be9e-73d6f7ece43d req-a4f1c40e-113b-42d3-9bd2-1a6f2c3ff1b0 tempest-TaggedBootDevicesTest_v242-429285116 None] Deleting attachment b514c2d3-d924-4399-a0ba-547481bde82f. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 21:14:51.603824 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-22ed3bfd-f5fa-4c3b-be9e-73d6f7ece43d req-55fab41e-3138-4ecf-ad20-cc39513a6f19 tempest-TaggedBootDevicesTest_v242-429285116 None] Terminate volume connection completed successfully. Apr 09 21:14:51.604274 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-22ed3bfd-f5fa-4c3b-be9e-73d6f7ece43d req-55fab41e-3138-4ecf-ad20-cc39513a6f19 tempest-TaggedBootDevicesTest_v242-429285116 None] Deleting attachment de452355-6246-496f-9604-ae8a67cab89d. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 21:14:51.793188 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-22ed3bfd-f5fa-4c3b-be9e-73d6f7ece43d req-29fe98e9-a3b2-4d42-a151-939b15d8325b tempest-TaggedBootDevicesTest_v242-429285116 None] Terminate volume connection completed successfully. Apr 09 21:14:51.794949 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-22ed3bfd-f5fa-4c3b-be9e-73d6f7ece43d req-29fe98e9-a3b2-4d42-a151-939b15d8325b tempest-TaggedBootDevicesTest_v242-429285116 None] Deleting attachment 75220b00-d03c-41dc-8233-5cae456c67cd. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 21:14:52.912003 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-7aa0df99-b239-431a-9a13-1b6071033c0b req-766acab8-0218-4d8a-b5ed-9a96ae97425b tempest-AttachVolumeNegativeTest-1154334807 None] Terminate volume connection completed successfully. Apr 09 21:14:52.915128 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-7aa0df99-b239-431a-9a13-1b6071033c0b req-766acab8-0218-4d8a-b5ed-9a96ae97425b tempest-AttachVolumeNegativeTest-1154334807 None] Deleting attachment f44547b2-b759-47f3-8fbb-93c7948a9f71. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 21:15:00.015423 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfc76aa7-e4ee-4015-a17c-746ff17da747 tempest-AttachVolumeShelveTestJSON-1751174024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:15:00.060879 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-cfc76aa7-e4ee-4015-a17c-746ff17da747 tempest-AttachVolumeShelveTestJSON-1751174024 None] Flow 'volume_create_manager' (9442f955-794d-4a1f-9d67-ef3ff9fc9241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:15:00.093838 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-cfc76aa7-e4ee-4015-a17c-746ff17da747 tempest-AttachVolumeShelveTestJSON-1751174024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a0773a7-a86d-4ed6-8c77-26028fa8c89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:15:00.135761 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-cfc76aa7-e4ee-4015-a17c-746ff17da747 tempest-AttachVolumeShelveTestJSON-1751174024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a0773a7-a86d-4ed6-8c77-26028fa8c89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-207713590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f4e2ef7c-1f94-4c30-8c14-8c01141e174a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a1102e4f4e441b947116441b3e330d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:15:00Z,use_quota=True,user_id='f2809b3bcbea4d2eb9ab6b360669fc67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:15:00.148677 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-cfc76aa7-e4ee-4015-a17c-746ff17da747 tempest-AttachVolumeShelveTestJSON-1751174024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d360c73a-a20a-4181-920f-def406e11ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:15:00.161079 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-cfc76aa7-e4ee-4015-a17c-746ff17da747 tempest-AttachVolumeShelveTestJSON-1751174024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d360c73a-a20a-4181-920f-def406e11ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:15:00.178437 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-cfc76aa7-e4ee-4015-a17c-746ff17da747 tempest-AttachVolumeShelveTestJSON-1751174024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7ad159e-f5ea-4f9b-b690-22c57d65e91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:15:00.189857 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-cfc76aa7-e4ee-4015-a17c-746ff17da747 tempest-AttachVolumeShelveTestJSON-1751174024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7ad159e-f5ea-4f9b-b690-22c57d65e91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4e2ef7c-1f94-4c30-8c14-8c01141e174a', 'volume_name': 'volume-f4e2ef7c-1f94-4c30-8c14-8c01141e174a', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:15:00.207281 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-cfc76aa7-e4ee-4015-a17c-746ff17da747 tempest-AttachVolumeShelveTestJSON-1751174024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (921f02a6-bfd6-4f75-919a-04a947b1289f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:15:00.217826 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-cfc76aa7-e4ee-4015-a17c-746ff17da747 tempest-AttachVolumeShelveTestJSON-1751174024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (921f02a6-bfd6-4f75-919a-04a947b1289f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:15:00.225166 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-cfc76aa7-e4ee-4015-a17c-746ff17da747 tempest-AttachVolumeShelveTestJSON-1751174024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10538284-2e0c-4f1b-853d-964cd2411b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:15:00.228086 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-cfc76aa7-e4ee-4015-a17c-746ff17da747 tempest-AttachVolumeShelveTestJSON-1751174024 None] Volume f4e2ef7c-1f94-4c30-8c14-8c01141e174a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4e2ef7c-1f94-4c30-8c14-8c01141e174a', 'volume_size': 1} Apr 09 21:15:00.228507 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cfc76aa7-e4ee-4015-a17c-746ff17da747 tempest-AttachVolumeShelveTestJSON-1751174024 None] creating volume 'volume-f4e2ef7c-1f94-4c30-8c14-8c01141e174a' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:15:00.229259 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cfc76aa7-e4ee-4015-a17c-746ff17da747 tempest-AttachVolumeShelveTestJSON-1751174024 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:15:00.387825 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cfc76aa7-e4ee-4015-a17c-746ff17da747 tempest-AttachVolumeShelveTestJSON-1751174024 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:15:00.388342 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cfc76aa7-e4ee-4015-a17c-746ff17da747 tempest-AttachVolumeShelveTestJSON-1751174024 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:15:00.393184 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-cfc76aa7-e4ee-4015-a17c-746ff17da747 tempest-AttachVolumeShelveTestJSON-1751174024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10538284-2e0c-4f1b-853d-964cd2411b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4e2ef7c-1f94-4c30-8c14-8c01141e174a', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:15:00.404345 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-cfc76aa7-e4ee-4015-a17c-746ff17da747 tempest-AttachVolumeShelveTestJSON-1751174024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff08fe7-cd5d-46dd-a936-d475cb27cb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:15:00.432983 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-cfc76aa7-e4ee-4015-a17c-746ff17da747 tempest-AttachVolumeShelveTestJSON-1751174024 None] Volume volume-f4e2ef7c-1f94-4c30-8c14-8c01141e174a (f4e2ef7c-1f94-4c30-8c14-8c01141e174a): created successfully Apr 09 21:15:00.446255 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-cfc76aa7-e4ee-4015-a17c-746ff17da747 tempest-AttachVolumeShelveTestJSON-1751174024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff08fe7-cd5d-46dd-a936-d475cb27cb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:15:00.462329 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-cfc76aa7-e4ee-4015-a17c-746ff17da747 tempest-AttachVolumeShelveTestJSON-1751174024 None] Flow 'volume_create_manager' (9442f955-794d-4a1f-9d67-ef3ff9fc9241) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:15:00.482988 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-cfc76aa7-e4ee-4015-a17c-746ff17da747 tempest-AttachVolumeShelveTestJSON-1751174024 None] Created volume successfully. Apr 09 21:15:08.897579 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-251dc91f-cfe4-49a1-80ee-7ac75d424ed1 tempest-TaggedBootDevicesTest_v242-429285116 None] Lock "b'cinder-62419bbe-a53e-46ce-b201-23fb7182945c-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:15:08.961932 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-251dc91f-cfe4-49a1-80ee-7ac75d424ed1 tempest-TaggedBootDevicesTest_v242-429285116 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:15:09.051915 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-251dc91f-cfe4-49a1-80ee-7ac75d424ed1 tempest-TaggedBootDevicesTest_v242-429285116 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:15:09.052573 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-251dc91f-cfe4-49a1-80ee-7ac75d424ed1 tempest-TaggedBootDevicesTest_v242-429285116 None] Volume volume-62419bbe-a53e-46ce-b201-23fb7182945c is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:15:09.063685 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-251dc91f-cfe4-49a1-80ee-7ac75d424ed1 tempest-TaggedBootDevicesTest_v242-429285116 None] deleting rbd volume volume-62419bbe-a53e-46ce-b201-23fb7182945c {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:15:09.567314 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-251dc91f-cfe4-49a1-80ee-7ac75d424ed1 tempest-TaggedBootDevicesTest_v242-429285116 None] Created reservations ['556c7891-4ca6-40d0-9947-99e65c0c1b9f', '8586e145-9293-45ac-ba71-7c0ac73de7c2', 'ce089084-ddae-4529-834d-8222298fa1d9', 'a0a327ca-7f3d-4178-852d-eb8d00e2d6bf'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:15:09.685171 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-251dc91f-cfe4-49a1-80ee-7ac75d424ed1 tempest-TaggedBootDevicesTest_v242-429285116 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:15:09.779067 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-251dc91f-cfe4-49a1-80ee-7ac75d424ed1 tempest-TaggedBootDevicesTest_v242-429285116 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:15:09.844579 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-251dc91f-cfe4-49a1-80ee-7ac75d424ed1 tempest-TaggedBootDevicesTest_v242-429285116 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:15:09.858039 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-251dc91f-cfe4-49a1-80ee-7ac75d424ed1 tempest-TaggedBootDevicesTest_v242-429285116 None] Deleted volume successfully. Apr 09 21:15:09.878000 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-251dc91f-cfe4-49a1-80ee-7ac75d424ed1 tempest-TaggedBootDevicesTest_v242-429285116 None] Lock "b'cinder-62419bbe-a53e-46ce-b201-23fb7182945c-delete_volume'" released by "delete_volume" :: held 0.980s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:15:10.092151 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-724c11bc-dab0-4ae9-a86b-41a8d9f16a04 tempest-TaggedBootDevicesTest_v242-429285116 None] Lock "b'cinder-b029c091-ed41-4629-909c-273feb0867db-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:15:10.138583 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-724c11bc-dab0-4ae9-a86b-41a8d9f16a04 tempest-TaggedBootDevicesTest_v242-429285116 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:15:10.220867 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-724c11bc-dab0-4ae9-a86b-41a8d9f16a04 tempest-TaggedBootDevicesTest_v242-429285116 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:15:10.221391 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-724c11bc-dab0-4ae9-a86b-41a8d9f16a04 tempest-TaggedBootDevicesTest_v242-429285116 None] Volume volume-b029c091-ed41-4629-909c-273feb0867db is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:15:10.240269 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-724c11bc-dab0-4ae9-a86b-41a8d9f16a04 tempest-TaggedBootDevicesTest_v242-429285116 None] deleting rbd volume volume-b029c091-ed41-4629-909c-273feb0867db {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:15:10.807300 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-724c11bc-dab0-4ae9-a86b-41a8d9f16a04 tempest-TaggedBootDevicesTest_v242-429285116 None] Created reservations ['cae38064-5706-4d30-a6d5-e6a7f7e4cf71', '3262a1fa-de14-44dc-a26c-de73ccad4bef', '9fcdada5-f0c4-43e8-a269-9c08375cd39c', '361cd6ed-6232-464d-84ef-d646b053bf1c'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:15:10.890585 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-724c11bc-dab0-4ae9-a86b-41a8d9f16a04 tempest-TaggedBootDevicesTest_v242-429285116 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:15:10.970155 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-724c11bc-dab0-4ae9-a86b-41a8d9f16a04 tempest-TaggedBootDevicesTest_v242-429285116 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:15:11.039185 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-724c11bc-dab0-4ae9-a86b-41a8d9f16a04 tempest-TaggedBootDevicesTest_v242-429285116 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:15:11.043230 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-724c11bc-dab0-4ae9-a86b-41a8d9f16a04 tempest-TaggedBootDevicesTest_v242-429285116 None] Deleted volume successfully. Apr 09 21:15:11.057138 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-724c11bc-dab0-4ae9-a86b-41a8d9f16a04 tempest-TaggedBootDevicesTest_v242-429285116 None] Lock "b'cinder-b029c091-ed41-4629-909c-273feb0867db-delete_volume'" released by "delete_volume" :: held 0.965s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:15:11.260900 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-b4ac5eae-998f-4833-ad08-b0c8463b3749 tempest-TaggedBootDevicesTest_v242-429285116 None] Lock "b'cinder-bbcf93e0-b776-46ad-9196-c4638c713502-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:15:11.356228 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b4ac5eae-998f-4833-ad08-b0c8463b3749 tempest-TaggedBootDevicesTest_v242-429285116 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:15:11.484501 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b4ac5eae-998f-4833-ad08-b0c8463b3749 tempest-TaggedBootDevicesTest_v242-429285116 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:15:11.502449 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b4ac5eae-998f-4833-ad08-b0c8463b3749 tempest-TaggedBootDevicesTest_v242-429285116 None] deleting rbd volume volume-bbcf93e0-b776-46ad-9196-c4638c713502 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:15:12.132660 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b4ac5eae-998f-4833-ad08-b0c8463b3749 tempest-TaggedBootDevicesTest_v242-429285116 None] volume is a clone so cleaning references {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Apr 09 21:15:12.191564 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b4ac5eae-998f-4833-ad08-b0c8463b3749 tempest-TaggedBootDevicesTest_v242-429285116 None] deleting parent snapshot volume-bbcf93e0-b776-46ad-9196-c4638c713502.clone_snap {{(pid=135002) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Apr 09 21:15:12.970812 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-b4ac5eae-998f-4833-ad08-b0c8463b3749 tempest-TaggedBootDevicesTest_v242-429285116 None] Created reservations ['2753308b-7559-4ad7-9172-5dfd2f1a868b', '6e18f22a-26aa-4702-abee-7feeee4fc977', '36a2f495-1338-4e03-8f3b-d858dcd4d7cb', '190c3157-f49a-499f-9477-7103d37f6423'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:15:13.068808 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b4ac5eae-998f-4833-ad08-b0c8463b3749 tempest-TaggedBootDevicesTest_v242-429285116 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:15:13.128010 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b4ac5eae-998f-4833-ad08-b0c8463b3749 tempest-TaggedBootDevicesTest_v242-429285116 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:15:13.211810 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-b4ac5eae-998f-4833-ad08-b0c8463b3749 tempest-TaggedBootDevicesTest_v242-429285116 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:15:13.223102 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-b4ac5eae-998f-4833-ad08-b0c8463b3749 tempest-TaggedBootDevicesTest_v242-429285116 None] Deleted volume successfully. Apr 09 21:15:13.245304 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-b4ac5eae-998f-4833-ad08-b0c8463b3749 tempest-TaggedBootDevicesTest_v242-429285116 None] Lock "b'cinder-bbcf93e0-b776-46ad-9196-c4638c713502-delete_volume'" released by "delete_volume" :: held 1.985s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:15:20.440449 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-45dd1a42-c02e-4a89-a3e8-3d6015e758fc tempest-TestVolumeBackupRestore-1877640871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:15:20.516161 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-45dd1a42-c02e-4a89-a3e8-3d6015e758fc tempest-TestVolumeBackupRestore-1877640871 None] Flow 'volume_create_manager' (5cb0d69e-53c6-4b97-bfaa-984639040126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:15:20.534443 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-45dd1a42-c02e-4a89-a3e8-3d6015e758fc tempest-TestVolumeBackupRestore-1877640871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a761cab-ec8f-4d33-b020-023ab2dc3a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:15:20.569667 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-45dd1a42-c02e-4a89-a3e8-3d6015e758fc tempest-TestVolumeBackupRestore-1877640871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a761cab-ec8f-4d33-b020-023ab2dc3a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-828943705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3a4a0854-8b3f-4537-abf3-52b0cc5e779a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e537a0863d43df811118a31e20609c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:15:20Z,use_quota=True,user_id='8303163dfe6c44dc8552919975c72eba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:15:20.580078 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-45dd1a42-c02e-4a89-a3e8-3d6015e758fc tempest-TestVolumeBackupRestore-1877640871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d287f64b-f336-46af-86cc-01bf4d2fd5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:15:20.594579 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-45dd1a42-c02e-4a89-a3e8-3d6015e758fc tempest-TestVolumeBackupRestore-1877640871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d287f64b-f336-46af-86cc-01bf4d2fd5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:15:20.601219 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-45dd1a42-c02e-4a89-a3e8-3d6015e758fc tempest-TestVolumeBackupRestore-1877640871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf9c144-9b23-4b42-83bc-5446e931a532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:15:20.773435 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-45dd1a42-c02e-4a89-a3e8-3d6015e758fc tempest-TestVolumeBackupRestore-1877640871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf9c144-9b23-4b42-83bc-5446e931a532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3a4a0854-8b3f-4537-abf3-52b0cc5e779a', 'volume_name': 'volume-3a4a0854-8b3f-4537-abf3-52b0cc5e779a', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:15:20.784206 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-45dd1a42-c02e-4a89-a3e8-3d6015e758fc tempest-TestVolumeBackupRestore-1877640871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdefef99-9f67-4d71-a810-34aca9f5565d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:15:20.796695 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-45dd1a42-c02e-4a89-a3e8-3d6015e758fc tempest-TestVolumeBackupRestore-1877640871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdefef99-9f67-4d71-a810-34aca9f5565d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:15:20.821212 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-45dd1a42-c02e-4a89-a3e8-3d6015e758fc tempest-TestVolumeBackupRestore-1877640871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c063bbfb-da7c-41da-a412-b459a5e91c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:15:20.825676 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-45dd1a42-c02e-4a89-a3e8-3d6015e758fc tempest-TestVolumeBackupRestore-1877640871 None] Volume 3a4a0854-8b3f-4537-abf3-52b0cc5e779a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3a4a0854-8b3f-4537-abf3-52b0cc5e779a', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 09 21:15:20.837948 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-45dd1a42-c02e-4a89-a3e8-3d6015e758fc tempest-TestVolumeBackupRestore-1877640871 None] Cloning 3a4a0854-8b3f-4537-abf3-52b0cc5e779a from image b539c48b-3400-4aa4-9226-8be5a3d07b36 at location (None, None). {{(pid=135002) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Apr 09 21:15:20.852769 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-45dd1a42-c02e-4a89-a3e8-3d6015e758fc tempest-TestVolumeBackupRestore-1877640871 None] Lock "b'cinder-b539c48b-3400-4aa4-9226-8be5a3d07b36'" acquired by "_prepare_image_cache_entry" :: waited 0.014s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:15:20.875177 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-45dd1a42-c02e-4a89-a3e8-3d6015e758fc tempest-TestVolumeBackupRestore-1877640871 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'volume_id': 'd35656e2-d293-4904-aeae-3113202bb314', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36), 'last_used': datetime.datetime(2022, 4, 9, 21, 15, 20, 864634)}. {{(pid=135002) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 09 21:15:20.875764 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-45dd1a42-c02e-4a89-a3e8-3d6015e758fc tempest-TestVolumeBackupRestore-1877640871 None] Image-volume cache entry image_update_at = 2022-04-09 20:45:36+00:00, requested image updated_at = 2022-04-09 20:45:36+00:00. {{(pid=135002) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 09 21:15:20.876247 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-45dd1a42-c02e-4a89-a3e8-3d6015e758fc tempest-TestVolumeBackupRestore-1877640871 None] Found cache entry for image = b539c48b-3400-4aa4-9226-8be5a3d07b36 on host ncdv-master-1@ceph#ceph. {{(pid=135002) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Apr 09 21:15:20.881784 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-45dd1a42-c02e-4a89-a3e8-3d6015e758fc tempest-TestVolumeBackupRestore-1877640871 None] Lock "b'cinder-b539c48b-3400-4aa4-9226-8be5a3d07b36'" released by "_prepare_image_cache_entry" :: held 0.029s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:15:20.882975 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-45dd1a42-c02e-4a89-a3e8-3d6015e758fc tempest-TestVolumeBackupRestore-1877640871 None] Attempting to retrieve cache entry for image = b539c48b-3400-4aa4-9226-8be5a3d07b36 on host ncdv-master-1@ceph#ceph. {{(pid=135002) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Apr 09 21:15:20.895916 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-45dd1a42-c02e-4a89-a3e8-3d6015e758fc tempest-TestVolumeBackupRestore-1877640871 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'volume_id': 'd35656e2-d293-4904-aeae-3113202bb314', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36), 'last_used': datetime.datetime(2022, 4, 9, 21, 15, 20, 888451)}. {{(pid=135002) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 09 21:15:20.896681 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-45dd1a42-c02e-4a89-a3e8-3d6015e758fc tempest-TestVolumeBackupRestore-1877640871 None] Image-volume cache entry image_update_at = 2022-04-09 20:45:36+00:00, requested image updated_at = 2022-04-09 20:45:36+00:00. {{(pid=135002) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 09 21:15:20.897292 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-45dd1a42-c02e-4a89-a3e8-3d6015e758fc tempest-TestVolumeBackupRestore-1877640871 None] Creating from source image-volume d35656e2-d293-4904-aeae-3113202bb314 {{(pid=135002) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Apr 09 21:15:20.917382 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-45dd1a42-c02e-4a89-a3e8-3d6015e758fc tempest-TestVolumeBackupRestore-1877640871 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:15:21.037354 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-45dd1a42-c02e-4a89-a3e8-3d6015e758fc tempest-TestVolumeBackupRestore-1877640871 None] creating snapshot='volume-3a4a0854-8b3f-4537-abf3-52b0cc5e779a.clone_snap' {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Apr 09 21:15:21.628623 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-45dd1a42-c02e-4a89-a3e8-3d6015e758fc tempest-TestVolumeBackupRestore-1877640871 None] cloning 'volume-d35656e2-d293-4904-aeae-3113202bb314@volume-3a4a0854-8b3f-4537-abf3-52b0cc5e779a.clone_snap' to 'volume-3a4a0854-8b3f-4537-abf3-52b0cc5e779a' {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Apr 09 21:15:21.877634 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-45dd1a42-c02e-4a89-a3e8-3d6015e758fc tempest-TestVolumeBackupRestore-1877640871 None] Volume volume-6d815065-063f-4887-9bc8-5808837868ff.deleted is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:15:21.879918 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-45dd1a42-c02e-4a89-a3e8-3d6015e758fc tempest-TestVolumeBackupRestore-1877640871 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:15:21.881543 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-45dd1a42-c02e-4a89-a3e8-3d6015e758fc tempest-TestVolumeBackupRestore-1877640871 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:15:21.922377 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-45dd1a42-c02e-4a89-a3e8-3d6015e758fc tempest-TestVolumeBackupRestore-1877640871 None] clone created successfully {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Apr 09 21:15:21.923001 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.volume_utils [None req-45dd1a42-c02e-4a89-a3e8-3d6015e758fc tempest-TestVolumeBackupRestore-1877640871 None] Marking volume 3a4a0854-8b3f-4537-abf3-52b0cc5e779a as bootable. {{(pid=135002) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Apr 09 21:15:21.935545 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-45dd1a42-c02e-4a89-a3e8-3d6015e758fc tempest-TestVolumeBackupRestore-1877640871 None] Copying metadata from image b539c48b-3400-4aa4-9226-8be5a3d07b36 to 3a4a0854-8b3f-4537-abf3-52b0cc5e779a. {{(pid=135002) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Apr 09 21:15:21.936075 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-45dd1a42-c02e-4a89-a3e8-3d6015e758fc tempest-TestVolumeBackupRestore-1877640871 None] Creating volume glance metadata for volume 3a4a0854-8b3f-4537-abf3-52b0cc5e779a backed by image b539c48b-3400-4aa4-9226-8be5a3d07b36 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=135002) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Apr 09 21:15:22.101000 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-45dd1a42-c02e-4a89-a3e8-3d6015e758fc tempest-TestVolumeBackupRestore-1877640871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c063bbfb-da7c-41da-a412-b459a5e91c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a4a0854-8b3f-4537-abf3-52b0cc5e779a', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:15:22.119852 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-45dd1a42-c02e-4a89-a3e8-3d6015e758fc tempest-TestVolumeBackupRestore-1877640871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68209942-2ad6-4341-a66e-675297bb4e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:15:22.139279 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-45dd1a42-c02e-4a89-a3e8-3d6015e758fc tempest-TestVolumeBackupRestore-1877640871 None] Volume volume-3a4a0854-8b3f-4537-abf3-52b0cc5e779a (3a4a0854-8b3f-4537-abf3-52b0cc5e779a): created successfully Apr 09 21:15:22.147636 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-45dd1a42-c02e-4a89-a3e8-3d6015e758fc tempest-TestVolumeBackupRestore-1877640871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68209942-2ad6-4341-a66e-675297bb4e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:15:22.177835 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-45dd1a42-c02e-4a89-a3e8-3d6015e758fc tempest-TestVolumeBackupRestore-1877640871 None] Flow 'volume_create_manager' (5cb0d69e-53c6-4b97-bfaa-984639040126) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:15:22.206552 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-45dd1a42-c02e-4a89-a3e8-3d6015e758fc tempest-TestVolumeBackupRestore-1877640871 None] Created volume successfully. Apr 09 21:15:23.067807 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-6be3d951-d3c0-42d8-8a72-15c745b943c5 tempest-TestVolumeBackupRestore-1877640871 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-04-09T21:15:22Z,data_timestamp=2022-04-09T21:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=c4667eed-7f57-4744-985f-03f4b9dec074,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='a2e537a0863d43df811118a31e20609c',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='8303163dfe6c44dc8552919975c72eba',volume_id=3a4a0854-8b3f-4537-abf3-52b0cc5e779a) Apr 09 21:15:23.070525 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.backup.rpcapi [None req-6be3d951-d3c0-42d8-8a72-15c745b943c5 tempest-TestVolumeBackupRestore-1877640871 None] continue_backup in rpcapi backup_id c4667eed-7f57-4744-985f-03f4b9dec074 {{(pid=135002) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Apr 09 21:15:23.382305 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [None req-6be3d951-d3c0-42d8-8a72-15c745b943c5 tempest-TestVolumeBackupRestore-1877640871 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:15:25.165811 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [None req-6be3d951-d3c0-42d8-8a72-15c745b943c5 tempest-TestVolumeBackupRestore-1877640871 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.782s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:15:25.167046 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-6be3d951-d3c0-42d8-8a72-15c745b943c5 tempest-TestVolumeBackupRestore-1877640871 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3a4a0854-8b3f-4537-abf3-52b0cc5e779a', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': '3a4a0854-8b3f-4537-abf3-52b0cc5e779a', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:15:25.211791 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-6be3d951-d3c0-42d8-8a72-15c745b943c5 tempest-TestVolumeBackupRestore-1877640871 None] Initialize volume connection completed successfully. Apr 09 21:15:36.254466 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-6be3d951-d3c0-42d8-8a72-15c745b943c5 tempest-TestVolumeBackupRestore-1877640871 None] Terminate volume connection completed successfully. Apr 09 21:15:36.286546 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-6be3d951-d3c0-42d8-8a72-15c745b943c5 tempest-TestVolumeBackupRestore-1877640871 None] Remove volume export completed successfully. Apr 09 21:15:37.541939 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-757492c6-7efc-4c22-8582-5fa1b5125fa0 tempest-TestVolumeBackupRestore-1877640871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:15:37.579505 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-757492c6-7efc-4c22-8582-5fa1b5125fa0 tempest-TestVolumeBackupRestore-1877640871 None] Flow 'volume_create_manager' (27ab10dc-2f2b-42f0-830e-3ffcea24b9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:15:37.591651 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-757492c6-7efc-4c22-8582-5fa1b5125fa0 tempest-TestVolumeBackupRestore-1877640871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a11db55-c315-499e-8e7c-cab176b48ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:15:37.628932 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-757492c6-7efc-4c22-8582-5fa1b5125fa0 tempest-TestVolumeBackupRestore-1877640871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a11db55-c315-499e-8e7c-cab176b48ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:15:37Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_c4667eed-7f57-4744-985f-03f4b9dec074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=77d8a986-eb34-4d3a-9ad7-5ad1b19954dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e537a0863d43df811118a31e20609c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:15:37Z,use_quota=True,user_id='8303163dfe6c44dc8552919975c72eba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:15:37.651742 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-757492c6-7efc-4c22-8582-5fa1b5125fa0 tempest-TestVolumeBackupRestore-1877640871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5abde508-4785-4311-880e-9a9309c26476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:15:37.665857 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-757492c6-7efc-4c22-8582-5fa1b5125fa0 tempest-TestVolumeBackupRestore-1877640871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5abde508-4785-4311-880e-9a9309c26476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:15:37.681243 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-757492c6-7efc-4c22-8582-5fa1b5125fa0 tempest-TestVolumeBackupRestore-1877640871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a5ef7ff-8972-4abc-80f2-6f7b6b0077b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:15:37.694393 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-757492c6-7efc-4c22-8582-5fa1b5125fa0 tempest-TestVolumeBackupRestore-1877640871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a5ef7ff-8972-4abc-80f2-6f7b6b0077b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77d8a986-eb34-4d3a-9ad7-5ad1b19954dd', 'volume_name': 'volume-77d8a986-eb34-4d3a-9ad7-5ad1b19954dd', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:15:37.707140 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-757492c6-7efc-4c22-8582-5fa1b5125fa0 tempest-TestVolumeBackupRestore-1877640871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f02e6c7a-5235-4ea5-9e6f-62f35e7902b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:15:37.719017 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-757492c6-7efc-4c22-8582-5fa1b5125fa0 tempest-TestVolumeBackupRestore-1877640871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f02e6c7a-5235-4ea5-9e6f-62f35e7902b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:15:37.734861 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-757492c6-7efc-4c22-8582-5fa1b5125fa0 tempest-TestVolumeBackupRestore-1877640871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86619cab-bb3d-4a8d-a20a-d0f5a5fab79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:15:37.736012 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-757492c6-7efc-4c22-8582-5fa1b5125fa0 tempest-TestVolumeBackupRestore-1877640871 None] Volume 77d8a986-eb34-4d3a-9ad7-5ad1b19954dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77d8a986-eb34-4d3a-9ad7-5ad1b19954dd', 'volume_size': 1} Apr 09 21:15:37.741354 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-757492c6-7efc-4c22-8582-5fa1b5125fa0 tempest-TestVolumeBackupRestore-1877640871 None] creating volume 'volume-77d8a986-eb34-4d3a-9ad7-5ad1b19954dd' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:15:37.745350 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-757492c6-7efc-4c22-8582-5fa1b5125fa0 tempest-TestVolumeBackupRestore-1877640871 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:15:37.925619 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-757492c6-7efc-4c22-8582-5fa1b5125fa0 tempest-TestVolumeBackupRestore-1877640871 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:15:37.926124 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-757492c6-7efc-4c22-8582-5fa1b5125fa0 tempest-TestVolumeBackupRestore-1877640871 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:15:37.930402 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-757492c6-7efc-4c22-8582-5fa1b5125fa0 tempest-TestVolumeBackupRestore-1877640871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86619cab-bb3d-4a8d-a20a-d0f5a5fab79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77d8a986-eb34-4d3a-9ad7-5ad1b19954dd', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:15:37.938956 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-757492c6-7efc-4c22-8582-5fa1b5125fa0 tempest-TestVolumeBackupRestore-1877640871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a714deec-88ff-472e-95d2-d4ad99bf676f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:15:37.960578 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-757492c6-7efc-4c22-8582-5fa1b5125fa0 tempest-TestVolumeBackupRestore-1877640871 None] Volume volume-77d8a986-eb34-4d3a-9ad7-5ad1b19954dd (77d8a986-eb34-4d3a-9ad7-5ad1b19954dd): created successfully Apr 09 21:15:37.965330 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-757492c6-7efc-4c22-8582-5fa1b5125fa0 tempest-TestVolumeBackupRestore-1877640871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a714deec-88ff-472e-95d2-d4ad99bf676f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:15:37.973354 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-757492c6-7efc-4c22-8582-5fa1b5125fa0 tempest-TestVolumeBackupRestore-1877640871 None] Flow 'volume_create_manager' (27ab10dc-2f2b-42f0-830e-3ffcea24b9af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:15:37.999496 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-757492c6-7efc-4c22-8582-5fa1b5125fa0 tempest-TestVolumeBackupRestore-1877640871 None] Created volume successfully. Apr 09 21:15:38.803690 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [None req-757492c6-7efc-4c22-8582-5fa1b5125fa0 tempest-TestVolumeBackupRestore-1877640871 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:15:40.667622 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [None req-757492c6-7efc-4c22-8582-5fa1b5125fa0 tempest-TestVolumeBackupRestore-1877640871 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.864s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:15:40.668598 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-757492c6-7efc-4c22-8582-5fa1b5125fa0 tempest-TestVolumeBackupRestore-1877640871 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-77d8a986-eb34-4d3a-9ad7-5ad1b19954dd', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': '77d8a986-eb34-4d3a-9ad7-5ad1b19954dd', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:15:40.703362 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-757492c6-7efc-4c22-8582-5fa1b5125fa0 tempest-TestVolumeBackupRestore-1877640871 None] Initialize volume connection completed successfully. Apr 09 21:15:48.405660 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-668ff037-5461-4cc7-a4c8-93c668360b92 tempest-AttachVolumeTestJSON-873042647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:15:48.475315 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-668ff037-5461-4cc7-a4c8-93c668360b92 tempest-AttachVolumeTestJSON-873042647 None] Flow 'volume_create_manager' (676b5e22-42a0-4273-a5af-0069740a073b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:15:48.498017 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-668ff037-5461-4cc7-a4c8-93c668360b92 tempest-AttachVolumeTestJSON-873042647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de870a5-cf42-4af0-a98e-cb0546edbd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:15:48.539256 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-668ff037-5461-4cc7-a4c8-93c668360b92 tempest-AttachVolumeTestJSON-873042647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de870a5-cf42-4af0-a98e-cb0546edbd2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2001804729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=87a4f7ac-5834-4bfb-aca8-28b95fd56bdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd53d98faf74d6a92cdfabace62b088',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:15:48Z,use_quota=True,user_id='7ce296c1004c4976930f46de34be880d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:15:48.551525 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-668ff037-5461-4cc7-a4c8-93c668360b92 tempest-AttachVolumeTestJSON-873042647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4e1e9ce-1ffc-44f5-9cab-871d9a0f475a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:15:48.562982 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-668ff037-5461-4cc7-a4c8-93c668360b92 tempest-AttachVolumeTestJSON-873042647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4e1e9ce-1ffc-44f5-9cab-871d9a0f475a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:15:48.582455 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-668ff037-5461-4cc7-a4c8-93c668360b92 tempest-AttachVolumeTestJSON-873042647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a6716c6-27ee-4f56-9a0c-69fd7c988325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:15:48.593898 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-668ff037-5461-4cc7-a4c8-93c668360b92 tempest-AttachVolumeTestJSON-873042647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a6716c6-27ee-4f56-9a0c-69fd7c988325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87a4f7ac-5834-4bfb-aca8-28b95fd56bdb', 'volume_name': 'volume-87a4f7ac-5834-4bfb-aca8-28b95fd56bdb', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:15:48.607708 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-668ff037-5461-4cc7-a4c8-93c668360b92 tempest-AttachVolumeTestJSON-873042647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7432c74d-70df-4026-87c4-0ff6c67a981b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:15:48.615966 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-668ff037-5461-4cc7-a4c8-93c668360b92 tempest-AttachVolumeTestJSON-873042647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7432c74d-70df-4026-87c4-0ff6c67a981b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:15:48.637302 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-668ff037-5461-4cc7-a4c8-93c668360b92 tempest-AttachVolumeTestJSON-873042647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6c5c0c-67ed-40dd-ad40-8a1f2ed4640e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:15:48.638542 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-668ff037-5461-4cc7-a4c8-93c668360b92 tempest-AttachVolumeTestJSON-873042647 None] Volume 87a4f7ac-5834-4bfb-aca8-28b95fd56bdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87a4f7ac-5834-4bfb-aca8-28b95fd56bdb', 'volume_size': 1} Apr 09 21:15:48.638956 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-668ff037-5461-4cc7-a4c8-93c668360b92 tempest-AttachVolumeTestJSON-873042647 None] creating volume 'volume-87a4f7ac-5834-4bfb-aca8-28b95fd56bdb' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:15:48.640105 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-668ff037-5461-4cc7-a4c8-93c668360b92 tempest-AttachVolumeTestJSON-873042647 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:15:48.798425 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-668ff037-5461-4cc7-a4c8-93c668360b92 tempest-AttachVolumeTestJSON-873042647 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:15:48.799043 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-668ff037-5461-4cc7-a4c8-93c668360b92 tempest-AttachVolumeTestJSON-873042647 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:15:48.804794 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-668ff037-5461-4cc7-a4c8-93c668360b92 tempest-AttachVolumeTestJSON-873042647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6c5c0c-67ed-40dd-ad40-8a1f2ed4640e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87a4f7ac-5834-4bfb-aca8-28b95fd56bdb', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:15:48.811034 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-668ff037-5461-4cc7-a4c8-93c668360b92 tempest-AttachVolumeTestJSON-873042647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d13fcc98-660d-4443-9ab8-83b66371d69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:15:48.825298 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-668ff037-5461-4cc7-a4c8-93c668360b92 tempest-AttachVolumeTestJSON-873042647 None] Volume volume-87a4f7ac-5834-4bfb-aca8-28b95fd56bdb (87a4f7ac-5834-4bfb-aca8-28b95fd56bdb): created successfully Apr 09 21:15:48.836617 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-668ff037-5461-4cc7-a4c8-93c668360b92 tempest-AttachVolumeTestJSON-873042647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d13fcc98-660d-4443-9ab8-83b66371d69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:15:48.850093 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-668ff037-5461-4cc7-a4c8-93c668360b92 tempest-AttachVolumeTestJSON-873042647 None] Flow 'volume_create_manager' (676b5e22-42a0-4273-a5af-0069740a073b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:15:48.873830 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-668ff037-5461-4cc7-a4c8-93c668360b92 tempest-AttachVolumeTestJSON-873042647 None] Created volume successfully. Apr 09 21:15:49.515187 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-757492c6-7efc-4c22-8582-5fa1b5125fa0 tempest-TestVolumeBackupRestore-1877640871 None] Terminate volume connection completed successfully. Apr 09 21:15:49.557228 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-757492c6-7efc-4c22-8582-5fa1b5125fa0 tempest-TestVolumeBackupRestore-1877640871 None] Remove volume export completed successfully. Apr 09 21:15:49.876649 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:15:49.877866 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:15:49.945635 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:15:50.007686 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:15:50.072513 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-36aac146-0eaf-4184-83c5-19d9df969ba5 req-d6f9dd20-b369-4537-b9ae-4ec4f49213b0 tempest-AttachVolumeTestJSON-873042647 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:15:51.315128 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-36aac146-0eaf-4184-83c5-19d9df969ba5 req-d6f9dd20-b369-4537-b9ae-4ec4f49213b0 tempest-AttachVolumeTestJSON-873042647 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.242s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:15:51.316183 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-36aac146-0eaf-4184-83c5-19d9df969ba5 req-d6f9dd20-b369-4537-b9ae-4ec4f49213b0 tempest-AttachVolumeTestJSON-873042647 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-87a4f7ac-5834-4bfb-aca8-28b95fd56bdb', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': '87a4f7ac-5834-4bfb-aca8-28b95fd56bdb', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:15:51.353074 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-36aac146-0eaf-4184-83c5-19d9df969ba5 req-d6f9dd20-b369-4537-b9ae-4ec4f49213b0 tempest-AttachVolumeTestJSON-873042647 None] Connection info returned from driver {'name': 'volumes/volume-87a4f7ac-5834-4bfb-aca8-28b95fd56bdb', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '87a4f7ac-5834-4bfb-aca8-28b95fd56bdb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c5c2d2d6-9185-4856-9aeb-834591289015'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 21:15:51.454233 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-36aac146-0eaf-4184-83c5-19d9df969ba5 req-d6f9dd20-b369-4537-b9ae-4ec4f49213b0 tempest-AttachVolumeTestJSON-873042647 None] attachment_update completed successfully. Apr 09 21:15:53.712835 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-fdcc5b41-76dd-4e2d-ba17-da903274c629 req-4d952dd2-5b3e-4f0c-b040-4f6ac1829562 tempest-AttachVolumeShelveTestJSON-1751174024 None] No connector for attachment 11d97e57-6e63-4763-93b3-96bec5426d31; skipping storage backend terminate_connection call. {{(pid=135002) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4908}} Apr 09 21:15:53.714559 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-fdcc5b41-76dd-4e2d-ba17-da903274c629 req-4d952dd2-5b3e-4f0c-b040-4f6ac1829562 tempest-AttachVolumeShelveTestJSON-1751174024 None] Deleting attachment 11d97e57-6e63-4763-93b3-96bec5426d31. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 21:15:53.975626 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dadb54b-be77-46b4-a574-0b9420de9d00 tempest-AttachVolumeTestJSON-873042647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:15:54.014262 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-2dadb54b-be77-46b4-a574-0b9420de9d00 tempest-AttachVolumeTestJSON-873042647 None] Flow 'volume_create_manager' (9655ff89-0a90-4ec3-969f-6d5a4baced3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:15:54.022705 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-2dadb54b-be77-46b4-a574-0b9420de9d00 tempest-AttachVolumeTestJSON-873042647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6a2d9d3-f067-4db7-8d69-e47d9cba2005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:15:54.046449 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-2dadb54b-be77-46b4-a574-0b9420de9d00 tempest-AttachVolumeTestJSON-873042647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6a2d9d3-f067-4db7-8d69-e47d9cba2005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1857578052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=bec28885-9341-45d2-8167-2a84ee06888a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd53d98faf74d6a92cdfabace62b088',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:15:54Z,use_quota=True,user_id='7ce296c1004c4976930f46de34be880d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:15:54.056697 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-2dadb54b-be77-46b4-a574-0b9420de9d00 tempest-AttachVolumeTestJSON-873042647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (701680f5-db8e-4655-afba-4dec4fe6715d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:15:54.064269 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-2dadb54b-be77-46b4-a574-0b9420de9d00 tempest-AttachVolumeTestJSON-873042647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (701680f5-db8e-4655-afba-4dec4fe6715d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:15:54.073307 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-2dadb54b-be77-46b4-a574-0b9420de9d00 tempest-AttachVolumeTestJSON-873042647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c982b72-e710-4a2f-9b35-9dda21401f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:15:54.082380 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-2dadb54b-be77-46b4-a574-0b9420de9d00 tempest-AttachVolumeTestJSON-873042647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c982b72-e710-4a2f-9b35-9dda21401f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bec28885-9341-45d2-8167-2a84ee06888a', 'volume_name': 'volume-bec28885-9341-45d2-8167-2a84ee06888a', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:15:54.088792 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-2dadb54b-be77-46b4-a574-0b9420de9d00 tempest-AttachVolumeTestJSON-873042647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72152c19-062b-4a11-8a03-c9e2761dc250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:15:54.093722 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-2dadb54b-be77-46b4-a574-0b9420de9d00 tempest-AttachVolumeTestJSON-873042647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72152c19-062b-4a11-8a03-c9e2761dc250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:15:54.100375 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-2dadb54b-be77-46b4-a574-0b9420de9d00 tempest-AttachVolumeTestJSON-873042647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9f2d0cd-4981-4e3e-81cd-339f16607b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:15:54.103154 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-2dadb54b-be77-46b4-a574-0b9420de9d00 tempest-AttachVolumeTestJSON-873042647 None] Volume bec28885-9341-45d2-8167-2a84ee06888a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bec28885-9341-45d2-8167-2a84ee06888a', 'volume_size': 1} Apr 09 21:15:54.103854 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2dadb54b-be77-46b4-a574-0b9420de9d00 tempest-AttachVolumeTestJSON-873042647 None] creating volume 'volume-bec28885-9341-45d2-8167-2a84ee06888a' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:15:54.105193 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2dadb54b-be77-46b4-a574-0b9420de9d00 tempest-AttachVolumeTestJSON-873042647 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:15:54.260463 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2dadb54b-be77-46b4-a574-0b9420de9d00 tempest-AttachVolumeTestJSON-873042647 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:15:54.260885 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2dadb54b-be77-46b4-a574-0b9420de9d00 tempest-AttachVolumeTestJSON-873042647 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:15:54.271131 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-2dadb54b-be77-46b4-a574-0b9420de9d00 tempest-AttachVolumeTestJSON-873042647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9f2d0cd-4981-4e3e-81cd-339f16607b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bec28885-9341-45d2-8167-2a84ee06888a', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:15:54.286579 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-2dadb54b-be77-46b4-a574-0b9420de9d00 tempest-AttachVolumeTestJSON-873042647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fabeca3-91b9-4a3a-bff1-a2fca034acd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:15:54.311432 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-2dadb54b-be77-46b4-a574-0b9420de9d00 tempest-AttachVolumeTestJSON-873042647 None] Volume volume-bec28885-9341-45d2-8167-2a84ee06888a (bec28885-9341-45d2-8167-2a84ee06888a): created successfully Apr 09 21:15:54.321492 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-2dadb54b-be77-46b4-a574-0b9420de9d00 tempest-AttachVolumeTestJSON-873042647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fabeca3-91b9-4a3a-bff1-a2fca034acd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:15:54.332501 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-2dadb54b-be77-46b4-a574-0b9420de9d00 tempest-AttachVolumeTestJSON-873042647 None] Flow 'volume_create_manager' (9655ff89-0a90-4ec3-969f-6d5a4baced3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:15:54.349690 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-2dadb54b-be77-46b4-a574-0b9420de9d00 tempest-AttachVolumeTestJSON-873042647 None] Created volume successfully. Apr 09 21:15:56.056364 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-1e19e7a3-8a0f-4759-9dff-425827a726bc req-f6abc7ca-75df-4651-8225-58b9d1d5e5f4 tempest-AttachVolumeTestJSON-873042647 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:15:57.164716 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-1e19e7a3-8a0f-4759-9dff-425827a726bc req-f6abc7ca-75df-4651-8225-58b9d1d5e5f4 tempest-AttachVolumeTestJSON-873042647 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.110s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:15:57.165539 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-1e19e7a3-8a0f-4759-9dff-425827a726bc req-f6abc7ca-75df-4651-8225-58b9d1d5e5f4 tempest-AttachVolumeTestJSON-873042647 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-bec28885-9341-45d2-8167-2a84ee06888a', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': 'bec28885-9341-45d2-8167-2a84ee06888a', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:15:57.191799 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-1e19e7a3-8a0f-4759-9dff-425827a726bc req-f6abc7ca-75df-4651-8225-58b9d1d5e5f4 tempest-AttachVolumeTestJSON-873042647 None] Connection info returned from driver {'name': 'volumes/volume-bec28885-9341-45d2-8167-2a84ee06888a', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'bec28885-9341-45d2-8167-2a84ee06888a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '90f4e823-d072-4ea0-a36b-b8eb542700cf'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 21:15:57.271455 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-1e19e7a3-8a0f-4759-9dff-425827a726bc req-f6abc7ca-75df-4651-8225-58b9d1d5e5f4 tempest-AttachVolumeTestJSON-873042647 None] attachment_update completed successfully. Apr 09 21:16:00.689753 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-41ee141e-524f-4a81-9a5a-1099c72fc255 req-d6fec6e2-c36f-48df-8e11-0220ba42fd48 tempest-AttachVolumeTestJSON-873042647 None] Terminate volume connection completed successfully. Apr 09 21:16:00.691446 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-41ee141e-524f-4a81-9a5a-1099c72fc255 req-d6fec6e2-c36f-48df-8e11-0220ba42fd48 tempest-AttachVolumeTestJSON-873042647 None] Deleting attachment c5c2d2d6-9185-4856-9aeb-834591289015. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 21:16:01.313945 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-dbed85a8-28d6-47b4-b0de-6c7e8ae965e8 req-1adff98e-c86f-457a-bfda-2707734b5e1b tempest-TestVolumeBackupRestore-1877640871 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:16:02.206526 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-dbed85a8-28d6-47b4-b0de-6c7e8ae965e8 req-1adff98e-c86f-457a-bfda-2707734b5e1b tempest-TestVolumeBackupRestore-1877640871 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.892s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:16:02.207847 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-dbed85a8-28d6-47b4-b0de-6c7e8ae965e8 req-1adff98e-c86f-457a-bfda-2707734b5e1b tempest-TestVolumeBackupRestore-1877640871 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-77d8a986-eb34-4d3a-9ad7-5ad1b19954dd', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': '77d8a986-eb34-4d3a-9ad7-5ad1b19954dd', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:16:02.238945 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-dbed85a8-28d6-47b4-b0de-6c7e8ae965e8 req-1adff98e-c86f-457a-bfda-2707734b5e1b tempest-TestVolumeBackupRestore-1877640871 None] Connection info returned from driver {'name': 'volumes/volume-77d8a986-eb34-4d3a-9ad7-5ad1b19954dd', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '77d8a986-eb34-4d3a-9ad7-5ad1b19954dd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9fc63eb6-bd17-4653-86c9-572cfdc2bdad'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 21:16:02.303725 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-dbed85a8-28d6-47b4-b0de-6c7e8ae965e8 req-1adff98e-c86f-457a-bfda-2707734b5e1b tempest-TestVolumeBackupRestore-1877640871 None] attachment_update completed successfully. Apr 09 21:16:02.449414 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-43f3611d-abe2-405f-b67b-291475a2b3da req-c73798db-cfc6-4fab-b081-484954cd5aa7 tempest-AttachVolumeTestJSON-873042647 None] Terminate volume connection completed successfully. Apr 09 21:16:02.450031 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-43f3611d-abe2-405f-b67b-291475a2b3da req-c73798db-cfc6-4fab-b081-484954cd5aa7 tempest-AttachVolumeTestJSON-873042647 None] Deleting attachment 90f4e823-d072-4ea0-a36b-b8eb542700cf. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 21:16:17.234133 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-64950964-7a01-4349-be63-0222d4e62904 tempest-AttachVolumeTestJSON-873042647 None] Lock "b'cinder-bec28885-9341-45d2-8167-2a84ee06888a-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:16:17.277561 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-64950964-7a01-4349-be63-0222d4e62904 tempest-AttachVolumeTestJSON-873042647 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:16:17.379525 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-64950964-7a01-4349-be63-0222d4e62904 tempest-AttachVolumeTestJSON-873042647 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:16:17.380072 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-64950964-7a01-4349-be63-0222d4e62904 tempest-AttachVolumeTestJSON-873042647 None] Volume volume-bec28885-9341-45d2-8167-2a84ee06888a is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:16:17.391181 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-64950964-7a01-4349-be63-0222d4e62904 tempest-AttachVolumeTestJSON-873042647 None] deleting rbd volume volume-bec28885-9341-45d2-8167-2a84ee06888a {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:16:17.884877 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-64950964-7a01-4349-be63-0222d4e62904 tempest-AttachVolumeTestJSON-873042647 None] Created reservations ['689479dd-dd40-40e3-af59-09526c4b5b7c', '503e1a10-70da-42cf-8c7f-a0e324af6130', 'f2f293c9-675d-43e0-9eae-1d842a3f7e22', '72fb0fbc-08cb-4a6e-94ef-4ba7a79c205f'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:16:17.980244 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-64950964-7a01-4349-be63-0222d4e62904 tempest-AttachVolumeTestJSON-873042647 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:16:18.057388 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-64950964-7a01-4349-be63-0222d4e62904 tempest-AttachVolumeTestJSON-873042647 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:16:18.148322 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-64950964-7a01-4349-be63-0222d4e62904 tempest-AttachVolumeTestJSON-873042647 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:16:18.155120 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-64950964-7a01-4349-be63-0222d4e62904 tempest-AttachVolumeTestJSON-873042647 None] Deleted volume successfully. Apr 09 21:16:18.174967 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-64950964-7a01-4349-be63-0222d4e62904 tempest-AttachVolumeTestJSON-873042647 None] Lock "b'cinder-bec28885-9341-45d2-8167-2a84ee06888a-delete_volume'" released by "delete_volume" :: held 0.941s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:16:18.474430 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-17e5208b-81b4-4a91-a79e-5639c657a71b tempest-AttachVolumeTestJSON-873042647 None] Lock "b'cinder-87a4f7ac-5834-4bfb-aca8-28b95fd56bdb-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:16:18.587192 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-17e5208b-81b4-4a91-a79e-5639c657a71b tempest-AttachVolumeTestJSON-873042647 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:16:18.715021 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-17e5208b-81b4-4a91-a79e-5639c657a71b tempest-AttachVolumeTestJSON-873042647 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:16:18.715458 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-17e5208b-81b4-4a91-a79e-5639c657a71b tempest-AttachVolumeTestJSON-873042647 None] Volume volume-87a4f7ac-5834-4bfb-aca8-28b95fd56bdb is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:16:18.730279 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-17e5208b-81b4-4a91-a79e-5639c657a71b tempest-AttachVolumeTestJSON-873042647 None] deleting rbd volume volume-87a4f7ac-5834-4bfb-aca8-28b95fd56bdb {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:16:19.375849 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-17e5208b-81b4-4a91-a79e-5639c657a71b tempest-AttachVolumeTestJSON-873042647 None] Created reservations ['304a7468-845d-4d67-a32e-e6e5e29281d4', '245b2593-64d8-4a15-9062-60898d6aea79', '810d38b8-4e47-429a-91c5-1c971e9f45cb', 'ed21ad76-f9ca-4f57-9dbf-d64a09a223d6'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:16:19.558114 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-17e5208b-81b4-4a91-a79e-5639c657a71b tempest-AttachVolumeTestJSON-873042647 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:16:19.684611 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-17e5208b-81b4-4a91-a79e-5639c657a71b tempest-AttachVolumeTestJSON-873042647 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:16:19.781138 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-17e5208b-81b4-4a91-a79e-5639c657a71b tempest-AttachVolumeTestJSON-873042647 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:16:19.788995 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-17e5208b-81b4-4a91-a79e-5639c657a71b tempest-AttachVolumeTestJSON-873042647 None] Deleted volume successfully. Apr 09 21:16:19.809529 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-17e5208b-81b4-4a91-a79e-5639c657a71b tempest-AttachVolumeTestJSON-873042647 None] Lock "b'cinder-87a4f7ac-5834-4bfb-aca8-28b95fd56bdb-delete_volume'" released by "delete_volume" :: held 1.336s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:16:19.947723 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-af1b0ad6-c24c-4cff-8d8b-55e41d03e5b8 tempest-AttachVolumeTestJSON-873042647 None] Lock "b'cinder-1a4f83a5-a376-4491-abce-9211e77574a6-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:16:20.020399 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-af1b0ad6-c24c-4cff-8d8b-55e41d03e5b8 tempest-AttachVolumeTestJSON-873042647 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:16:20.176704 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-af1b0ad6-c24c-4cff-8d8b-55e41d03e5b8 tempest-AttachVolumeTestJSON-873042647 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:16:20.177173 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-af1b0ad6-c24c-4cff-8d8b-55e41d03e5b8 tempest-AttachVolumeTestJSON-873042647 None] Volume volume-1a4f83a5-a376-4491-abce-9211e77574a6 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:16:20.194382 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-af1b0ad6-c24c-4cff-8d8b-55e41d03e5b8 tempest-AttachVolumeTestJSON-873042647 None] deleting rbd volume volume-1a4f83a5-a376-4491-abce-9211e77574a6 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:16:20.826324 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-af1b0ad6-c24c-4cff-8d8b-55e41d03e5b8 tempest-AttachVolumeTestJSON-873042647 None] Created reservations ['b1e21208-14c6-498b-a594-9397a3e9da9c', '9cdd13e6-6953-4a79-8438-abcac2b454cb', '6c691737-133f-4fa8-9705-1b7099aaad3d', '8542a454-9495-4a56-a178-a1e95d5705b5'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:16:20.952941 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-af1b0ad6-c24c-4cff-8d8b-55e41d03e5b8 tempest-AttachVolumeTestJSON-873042647 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:16:21.059691 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-af1b0ad6-c24c-4cff-8d8b-55e41d03e5b8 tempest-AttachVolumeTestJSON-873042647 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:16:21.166969 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-af1b0ad6-c24c-4cff-8d8b-55e41d03e5b8 tempest-AttachVolumeTestJSON-873042647 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:16:21.184186 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-af1b0ad6-c24c-4cff-8d8b-55e41d03e5b8 tempest-AttachVolumeTestJSON-873042647 None] Deleted volume successfully. Apr 09 21:16:21.210717 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-af1b0ad6-c24c-4cff-8d8b-55e41d03e5b8 tempest-AttachVolumeTestJSON-873042647 None] Lock "b'cinder-1a4f83a5-a376-4491-abce-9211e77574a6-delete_volume'" released by "delete_volume" :: held 1.264s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:16:26.114247 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-7b375a36-799a-4d56-90e0-2018b2b7b041 tempest-BackendsCapabilitiesAdminTestsJSON-198535790 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:1192182f-c1ed-4d7f-89e2-8dd1c9abc163:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=135002) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4731}} Apr 09 21:16:26.178357 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-b8014365-dc79-4a95-aac8-ae03e93bf4f3 tempest-BackendsCapabilitiesAdminTestsJSON-198535790 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:1192182f-c1ed-4d7f-89e2-8dd1c9abc163:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=135002) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4731}} Apr 09 21:16:33.587297 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-6abb00ae-b7b3-41a5-be32-06da518f8cf1 tempest-SnapshotsActionsTest-1204632347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:16:33.656442 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6abb00ae-b7b3-41a5-be32-06da518f8cf1 tempest-SnapshotsActionsTest-1204632347 None] Flow 'volume_create_manager' (187c5d9c-8a35-4166-8cd2-5a21b0d78f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:16:33.688637 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6abb00ae-b7b3-41a5-be32-06da518f8cf1 tempest-SnapshotsActionsTest-1204632347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c39e7ced-2b24-4651-98d6-88282bf9b159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:16:33.714004 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6abb00ae-b7b3-41a5-be32-06da518f8cf1 tempest-SnapshotsActionsTest-1204632347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c39e7ced-2b24-4651-98d6-88282bf9b159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2096880239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0f80a22e-9e30-4463-9c72-7a8c47186778,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab125314b81b4857adcc9feb375aee7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:16:34Z,use_quota=True,user_id='55f5b5f4f9834b349cbd3beec29d88a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:16:33.722390 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6abb00ae-b7b3-41a5-be32-06da518f8cf1 tempest-SnapshotsActionsTest-1204632347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21929745-acc8-4f90-b5f0-ce44db69e27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:16:33.732781 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6abb00ae-b7b3-41a5-be32-06da518f8cf1 tempest-SnapshotsActionsTest-1204632347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21929745-acc8-4f90-b5f0-ce44db69e27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:16:33.740104 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6abb00ae-b7b3-41a5-be32-06da518f8cf1 tempest-SnapshotsActionsTest-1204632347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (402f426a-06f8-4db6-8fb0-7e73d0013ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:16:33.759735 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6abb00ae-b7b3-41a5-be32-06da518f8cf1 tempest-SnapshotsActionsTest-1204632347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (402f426a-06f8-4db6-8fb0-7e73d0013ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f80a22e-9e30-4463-9c72-7a8c47186778', 'volume_name': 'volume-0f80a22e-9e30-4463-9c72-7a8c47186778', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:16:33.777075 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6abb00ae-b7b3-41a5-be32-06da518f8cf1 tempest-SnapshotsActionsTest-1204632347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cc1be92-5b5f-4689-9441-4a6a56278b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:16:33.800643 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6abb00ae-b7b3-41a5-be32-06da518f8cf1 tempest-SnapshotsActionsTest-1204632347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cc1be92-5b5f-4689-9441-4a6a56278b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:16:33.827704 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6abb00ae-b7b3-41a5-be32-06da518f8cf1 tempest-SnapshotsActionsTest-1204632347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13b0f7db-ed41-4534-8e47-b3e86a417b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:16:33.834916 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-6abb00ae-b7b3-41a5-be32-06da518f8cf1 tempest-SnapshotsActionsTest-1204632347 None] Volume 0f80a22e-9e30-4463-9c72-7a8c47186778: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f80a22e-9e30-4463-9c72-7a8c47186778', 'volume_size': 1} Apr 09 21:16:33.836116 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-6abb00ae-b7b3-41a5-be32-06da518f8cf1 tempest-SnapshotsActionsTest-1204632347 None] creating volume 'volume-0f80a22e-9e30-4463-9c72-7a8c47186778' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:16:33.839100 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-6abb00ae-b7b3-41a5-be32-06da518f8cf1 tempest-SnapshotsActionsTest-1204632347 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:16:34.039655 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-6abb00ae-b7b3-41a5-be32-06da518f8cf1 tempest-SnapshotsActionsTest-1204632347 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:16:34.040337 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-6abb00ae-b7b3-41a5-be32-06da518f8cf1 tempest-SnapshotsActionsTest-1204632347 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:16:34.044376 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6abb00ae-b7b3-41a5-be32-06da518f8cf1 tempest-SnapshotsActionsTest-1204632347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13b0f7db-ed41-4534-8e47-b3e86a417b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f80a22e-9e30-4463-9c72-7a8c47186778', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:16:34.053020 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6abb00ae-b7b3-41a5-be32-06da518f8cf1 tempest-SnapshotsActionsTest-1204632347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (313ce348-cb77-4421-b91e-647d5fc411e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:16:34.078316 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-6abb00ae-b7b3-41a5-be32-06da518f8cf1 tempest-SnapshotsActionsTest-1204632347 None] Volume volume-0f80a22e-9e30-4463-9c72-7a8c47186778 (0f80a22e-9e30-4463-9c72-7a8c47186778): created successfully Apr 09 21:16:34.082876 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6abb00ae-b7b3-41a5-be32-06da518f8cf1 tempest-SnapshotsActionsTest-1204632347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (313ce348-cb77-4421-b91e-647d5fc411e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:16:34.091897 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-6abb00ae-b7b3-41a5-be32-06da518f8cf1 tempest-SnapshotsActionsTest-1204632347 None] Flow 'volume_create_manager' (187c5d9c-8a35-4166-8cd2-5a21b0d78f5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:16:34.115614 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-6abb00ae-b7b3-41a5-be32-06da518f8cf1 tempest-SnapshotsActionsTest-1204632347 None] Created volume successfully. Apr 09 21:16:35.001735 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2fc6ed31-4b7b-45e7-9658-33aa0b3abe6b tempest-SnapshotsActionsTest-1204632347 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:16:35.953295 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-2fc6ed31-4b7b-45e7-9658-33aa0b3abe6b tempest-SnapshotsActionsTest-1204632347 None] Create snapshot completed successfully Apr 09 21:16:37.001349 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-034fc9a8-a2ed-4fa3-b850-71a2d2c73bd0 tempest-SnapshotsActionsTest-1204632347 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:16:37.993479 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-034fc9a8-a2ed-4fa3-b850-71a2d2c73bd0 tempest-SnapshotsActionsTest-1204632347 None] Create snapshot completed successfully Apr 09 21:16:38.324041 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-bb74962e-1fa1-4285-8c00-12a70b780b85 tempest-SnapshotsActionsTest-833982281 None] Lock "b'cinder-8894f06b-c0a0-49fd-b79a-b7d939dd5c01-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.026s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:16:38.328638 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-bb74962e-1fa1-4285-8c00-12a70b780b85 tempest-SnapshotsActionsTest-833982281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:16:39.090874 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-bb74962e-1fa1-4285-8c00-12a70b780b85 tempest-SnapshotsActionsTest-833982281 None] Created reservations ['d28c733e-3e83-4cc8-92a0-35e93a6c25a6', '7333fd2d-1c5d-4561-8836-a854da9ccbcc', 'a1a5aebc-7520-42e4-971c-3278ad193ba6', 'b3f66880-a36b-43f6-b819-11c6b7ba4320'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:16:39.167267 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-bb74962e-1fa1-4285-8c00-12a70b780b85 tempest-SnapshotsActionsTest-833982281 None] Delete snapshot completed successfully. Apr 09 21:16:39.173531 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-bb74962e-1fa1-4285-8c00-12a70b780b85 tempest-SnapshotsActionsTest-833982281 None] Lock "b'cinder-8894f06b-c0a0-49fd-b79a-b7d939dd5c01-delete_snapshot'" released by "delete_snapshot" :: held 0.850s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:16:40.060238 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-8e222b50-d818-4ecb-86a4-6933c7e98e92 tempest-SnapshotsActionsTest-1204632347 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:16:41.089690 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-8e222b50-d818-4ecb-86a4-6933c7e98e92 tempest-SnapshotsActionsTest-1204632347 None] Create snapshot completed successfully Apr 09 21:16:42.316913 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-3b989e4c-95a0-411a-9eec-9ab991904b96 tempest-SnapshotsActionsTest-833982281 None] Lock "b'cinder-eb7eb68c-edff-47d0-9335-d9f427ef5e1e-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:16:42.319521 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-3b989e4c-95a0-411a-9eec-9ab991904b96 tempest-SnapshotsActionsTest-833982281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:16:43.106279 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-3b989e4c-95a0-411a-9eec-9ab991904b96 tempest-SnapshotsActionsTest-833982281 None] Created reservations ['5ee0ebbe-41a5-4df9-a90f-23fd1dddef5a', '638892ee-0baa-4aa4-9099-ab145e7b2486', '5dea1d65-16a0-45cf-94bd-20ce8925ca8c', 'a30d5a1a-ae9d-4641-a1af-9f406e65ebf6'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:16:43.148975 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-3b989e4c-95a0-411a-9eec-9ab991904b96 tempest-SnapshotsActionsTest-833982281 None] Delete snapshot completed successfully. Apr 09 21:16:43.157964 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-3b989e4c-95a0-411a-9eec-9ab991904b96 tempest-SnapshotsActionsTest-833982281 None] Lock "b'cinder-eb7eb68c-edff-47d0-9335-d9f427ef5e1e-delete_snapshot'" released by "delete_snapshot" :: held 0.841s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:16:43.819482 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-562cf3f9-da0d-406d-8d38-4063572247de tempest-SnapshotsActionsTest-1204632347 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:16:44.123204 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-562cf3f9-da0d-406d-8d38-4063572247de tempest-SnapshotsActionsTest-1204632347 None] Create snapshot completed successfully Apr 09 21:16:45.046339 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-ce40bc66-acfd-427a-95e0-c1ab0c2c3938 tempest-SnapshotsActionsTest-833982281 None] Lock "b'cinder-04b3063a-f440-4bee-9dfd-621a8461ebc6-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.026s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:16:45.052909 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ce40bc66-acfd-427a-95e0-c1ab0c2c3938 tempest-SnapshotsActionsTest-833982281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:16:45.859196 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-ce40bc66-acfd-427a-95e0-c1ab0c2c3938 tempest-SnapshotsActionsTest-833982281 None] Created reservations ['84c72026-929f-4e40-b4a4-65a9c831958e', 'd39b5d62-dcc0-4027-8024-7ef7f20a1aed', '5fbce630-7c30-46dc-86b8-e244a7b4ed47', 'e4c2a2b5-8a86-45e9-b0b7-f67cc2248853'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:16:45.945569 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-ce40bc66-acfd-427a-95e0-c1ab0c2c3938 tempest-SnapshotsActionsTest-833982281 None] Delete snapshot completed successfully. Apr 09 21:16:45.954332 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-ce40bc66-acfd-427a-95e0-c1ab0c2c3938 tempest-SnapshotsActionsTest-833982281 None] Lock "b'cinder-04b3063a-f440-4bee-9dfd-621a8461ebc6-delete_snapshot'" released by "delete_snapshot" :: held 0.907s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:16:46.596923 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-4d59ef8a-ac45-4926-ab87-1e9ddd83a3ed tempest-SnapshotsActionsTest-1204632347 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:16:47.162799 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-4d59ef8a-ac45-4926-ab87-1e9ddd83a3ed tempest-SnapshotsActionsTest-1204632347 None] Create snapshot completed successfully Apr 09 21:16:47.816332 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7b00af8-2d7c-4aaa-8f7b-05055b8faa0e tempest-AttachVolumeNegativeTest-1154334807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:16:47.866137 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e7b00af8-2d7c-4aaa-8f7b-05055b8faa0e tempest-AttachVolumeNegativeTest-1154334807 None] Flow 'volume_create_manager' (34436562-5791-4fec-ae6b-36a2ece2b70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:16:47.876670 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e7b00af8-2d7c-4aaa-8f7b-05055b8faa0e tempest-AttachVolumeNegativeTest-1154334807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80d38d96-5f0c-46a2-9fb9-7a56d78b5770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:16:47.899756 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e7b00af8-2d7c-4aaa-8f7b-05055b8faa0e tempest-AttachVolumeNegativeTest-1154334807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80d38d96-5f0c-46a2-9fb9-7a56d78b5770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1566967282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=abddb649-a500-4b6c-b59b-522751fd34a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92f38b2c41e34e73bd6baa83478dddfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:16:48Z,use_quota=True,user_id='a6dcb8344fde4e4580e73efc09e633a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:16:47.908662 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e7b00af8-2d7c-4aaa-8f7b-05055b8faa0e tempest-AttachVolumeNegativeTest-1154334807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfd30a06-4225-4ef0-9172-c8df34965ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:16:47.914678 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e7b00af8-2d7c-4aaa-8f7b-05055b8faa0e tempest-AttachVolumeNegativeTest-1154334807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfd30a06-4225-4ef0-9172-c8df34965ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:16:47.921543 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e7b00af8-2d7c-4aaa-8f7b-05055b8faa0e tempest-AttachVolumeNegativeTest-1154334807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (123abe6b-1780-4b99-9e8b-0576e9a13fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:16:47.927168 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e7b00af8-2d7c-4aaa-8f7b-05055b8faa0e tempest-AttachVolumeNegativeTest-1154334807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (123abe6b-1780-4b99-9e8b-0576e9a13fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abddb649-a500-4b6c-b59b-522751fd34a8', 'volume_name': 'volume-abddb649-a500-4b6c-b59b-522751fd34a8', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:16:47.934992 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e7b00af8-2d7c-4aaa-8f7b-05055b8faa0e tempest-AttachVolumeNegativeTest-1154334807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c9c8359-1232-4773-b09b-e5b037bc6da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:16:47.945603 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e7b00af8-2d7c-4aaa-8f7b-05055b8faa0e tempest-AttachVolumeNegativeTest-1154334807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c9c8359-1232-4773-b09b-e5b037bc6da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:16:47.951256 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e7b00af8-2d7c-4aaa-8f7b-05055b8faa0e tempest-AttachVolumeNegativeTest-1154334807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c20342f-31a8-4beb-8374-e7e31755d7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:16:47.952831 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-e7b00af8-2d7c-4aaa-8f7b-05055b8faa0e tempest-AttachVolumeNegativeTest-1154334807 None] Volume abddb649-a500-4b6c-b59b-522751fd34a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abddb649-a500-4b6c-b59b-522751fd34a8', 'volume_size': 1} Apr 09 21:16:47.954401 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-e7b00af8-2d7c-4aaa-8f7b-05055b8faa0e tempest-AttachVolumeNegativeTest-1154334807 None] creating volume 'volume-abddb649-a500-4b6c-b59b-522751fd34a8' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:16:47.955591 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-e7b00af8-2d7c-4aaa-8f7b-05055b8faa0e tempest-AttachVolumeNegativeTest-1154334807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:16:48.014226 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-bcc6894f-7a5b-478a-92a6-7ac674e14157 tempest-SnapshotsActionsTest-833982281 None] Lock "b'cinder-b5758cdc-45fa-43b4-b15f-0b5bb1b5fcb8-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.018s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:16:48.018608 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-bcc6894f-7a5b-478a-92a6-7ac674e14157 tempest-SnapshotsActionsTest-833982281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:16:48.087291 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-e7b00af8-2d7c-4aaa-8f7b-05055b8faa0e tempest-AttachVolumeNegativeTest-1154334807 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:16:48.088074 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-e7b00af8-2d7c-4aaa-8f7b-05055b8faa0e tempest-AttachVolumeNegativeTest-1154334807 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:16:48.096330 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e7b00af8-2d7c-4aaa-8f7b-05055b8faa0e tempest-AttachVolumeNegativeTest-1154334807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c20342f-31a8-4beb-8374-e7e31755d7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abddb649-a500-4b6c-b59b-522751fd34a8', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:16:48.107256 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e7b00af8-2d7c-4aaa-8f7b-05055b8faa0e tempest-AttachVolumeNegativeTest-1154334807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (077e23cc-abde-492b-b627-01e89e4a8edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:16:48.133874 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-e7b00af8-2d7c-4aaa-8f7b-05055b8faa0e tempest-AttachVolumeNegativeTest-1154334807 None] Volume volume-abddb649-a500-4b6c-b59b-522751fd34a8 (abddb649-a500-4b6c-b59b-522751fd34a8): created successfully Apr 09 21:16:48.137997 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e7b00af8-2d7c-4aaa-8f7b-05055b8faa0e tempest-AttachVolumeNegativeTest-1154334807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (077e23cc-abde-492b-b627-01e89e4a8edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:16:48.149225 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e7b00af8-2d7c-4aaa-8f7b-05055b8faa0e tempest-AttachVolumeNegativeTest-1154334807 None] Flow 'volume_create_manager' (34436562-5791-4fec-ae6b-36a2ece2b70d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:16:48.193345 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-e7b00af8-2d7c-4aaa-8f7b-05055b8faa0e tempest-AttachVolumeNegativeTest-1154334807 None] Created volume successfully. Apr 09 21:16:48.524039 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-bcc6894f-7a5b-478a-92a6-7ac674e14157 tempest-SnapshotsActionsTest-833982281 None] Created reservations ['0e174abb-e36d-48bf-81bd-12c4cee8d885', 'bc2c4c56-d78a-4c2e-b4ec-39f7b121ab00', 'b7e0939c-e057-4357-b8f8-9cdce627097f', '748897af-46bb-4f65-b091-53dc040d61e4'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:16:48.627355 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-bcc6894f-7a5b-478a-92a6-7ac674e14157 tempest-SnapshotsActionsTest-833982281 None] Delete snapshot completed successfully. Apr 09 21:16:48.634514 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-bcc6894f-7a5b-478a-92a6-7ac674e14157 tempest-SnapshotsActionsTest-833982281 None] Lock "b'cinder-b5758cdc-45fa-43b4-b15f-0b5bb1b5fcb8-delete_snapshot'" released by "delete_snapshot" :: held 0.620s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:16:49.811624 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-e7d6c9ef-7ab4-4f5c-a758-1b8ccba516d5 req-a7920188-2156-4343-87da-de93323f4230 tempest-AttachVolumeNegativeTest-1154334807 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:16:49.866415 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-1f113e2a-5d1c-4d69-8396-a3bee46b97d0 tempest-SnapshotsActionsTest-1204632347 None] Lock "b'cinder-40a7e626-08f7-4308-9a01-22b02c1c01b7-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.068s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:16:49.871760 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1f113e2a-5d1c-4d69-8396-a3bee46b97d0 tempest-SnapshotsActionsTest-1204632347 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:16:49.989462 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:16:49.990643 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:16:50.073786 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:16:50.180358 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:16:50.622903 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-1f113e2a-5d1c-4d69-8396-a3bee46b97d0 tempest-SnapshotsActionsTest-1204632347 None] Created reservations ['308e1bae-22ee-4b82-9385-1f17a9030b1f', '8852b216-fbf9-4be6-bfbd-48fdae033921', '10d510cc-ce2a-4e7c-b43f-ac02b80e451e', '157795d3-9ea0-412b-a2eb-8a4171e344a7'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:16:50.716643 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-1f113e2a-5d1c-4d69-8396-a3bee46b97d0 tempest-SnapshotsActionsTest-1204632347 None] Delete snapshot completed successfully. Apr 09 21:16:50.729918 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-1f113e2a-5d1c-4d69-8396-a3bee46b97d0 tempest-SnapshotsActionsTest-1204632347 None] Lock "b'cinder-40a7e626-08f7-4308-9a01-22b02c1c01b7-delete_snapshot'" released by "delete_snapshot" :: held 0.864s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:16:50.994619 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-e84b2717-8c56-4676-a9bc-54f10d8fc461 tempest-SnapshotsActionsTest-1204632347 None] Lock "b'cinder-0f80a22e-9e30-4463-9c72-7a8c47186778-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:16:51.034765 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-e7d6c9ef-7ab4-4f5c-a758-1b8ccba516d5 req-a7920188-2156-4343-87da-de93323f4230 tempest-AttachVolumeNegativeTest-1154334807 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.223s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:16:51.038620 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-e7d6c9ef-7ab4-4f5c-a758-1b8ccba516d5 req-a7920188-2156-4343-87da-de93323f4230 tempest-AttachVolumeNegativeTest-1154334807 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-abddb649-a500-4b6c-b59b-522751fd34a8', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': 'abddb649-a500-4b6c-b59b-522751fd34a8', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:16:51.131593 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-e84b2717-8c56-4676-a9bc-54f10d8fc461 tempest-SnapshotsActionsTest-1204632347 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:16:51.238631 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-e84b2717-8c56-4676-a9bc-54f10d8fc461 tempest-SnapshotsActionsTest-1204632347 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:16:51.239087 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-e84b2717-8c56-4676-a9bc-54f10d8fc461 tempest-SnapshotsActionsTest-1204632347 None] Volume volume-0f80a22e-9e30-4463-9c72-7a8c47186778 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:16:51.254615 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-e84b2717-8c56-4676-a9bc-54f10d8fc461 tempest-SnapshotsActionsTest-1204632347 None] deleting rbd volume volume-0f80a22e-9e30-4463-9c72-7a8c47186778 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:16:51.278526 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-e7d6c9ef-7ab4-4f5c-a758-1b8ccba516d5 req-a7920188-2156-4343-87da-de93323f4230 tempest-AttachVolumeNegativeTest-1154334807 None] Connection info returned from driver {'name': 'volumes/volume-abddb649-a500-4b6c-b59b-522751fd34a8', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'abddb649-a500-4b6c-b59b-522751fd34a8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c1b29525-b01d-42f5-8614-e11414486684'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 21:16:51.359218 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-e7d6c9ef-7ab4-4f5c-a758-1b8ccba516d5 req-a7920188-2156-4343-87da-de93323f4230 tempest-AttachVolumeNegativeTest-1154334807 None] attachment_update completed successfully. Apr 09 21:16:51.834389 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-e84b2717-8c56-4676-a9bc-54f10d8fc461 tempest-SnapshotsActionsTest-1204632347 None] Created reservations ['c74327fd-6939-4a46-8ded-56bc41276701', '6af5c932-abd8-48f4-afea-4e8b01b7e636', '8b23e5a9-1239-4627-9f3f-12c270b1efba', '95929858-a83b-49a4-adb6-3bfaea47550e'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:16:51.915751 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-e84b2717-8c56-4676-a9bc-54f10d8fc461 tempest-SnapshotsActionsTest-1204632347 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:16:51.969636 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-e84b2717-8c56-4676-a9bc-54f10d8fc461 tempest-SnapshotsActionsTest-1204632347 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:16:52.015923 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-e84b2717-8c56-4676-a9bc-54f10d8fc461 tempest-SnapshotsActionsTest-1204632347 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:16:52.033933 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-e84b2717-8c56-4676-a9bc-54f10d8fc461 tempest-SnapshotsActionsTest-1204632347 None] Deleted volume successfully. Apr 09 21:16:52.054248 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-e84b2717-8c56-4676-a9bc-54f10d8fc461 tempest-SnapshotsActionsTest-1204632347 None] Lock "b'cinder-0f80a22e-9e30-4463-9c72-7a8c47186778-delete_volume'" released by "delete_volume" :: held 1.059s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:16:55.267414 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-f2f664bf-00a6-4788-9038-1b87eb580835 req-df8ed612-95b8-408d-86ea-e735337b855c tempest-AttachVolumeNegativeTest-1154334807 None] Terminate volume connection completed successfully. Apr 09 21:16:55.268110 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-f2f664bf-00a6-4788-9038-1b87eb580835 req-df8ed612-95b8-408d-86ea-e735337b855c tempest-AttachVolumeNegativeTest-1154334807 None] Deleting attachment c1b29525-b01d-42f5-8614-e11414486684. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 21:17:05.348801 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-1cf30acd-76fa-4e8b-912f-9663da2ae404 tempest-AttachVolumeNegativeTest-1154334807 None] Lock "b'cinder-abddb649-a500-4b6c-b59b-522751fd34a8-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:17:05.411721 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1cf30acd-76fa-4e8b-912f-9663da2ae404 tempest-AttachVolumeNegativeTest-1154334807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:05.551040 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1cf30acd-76fa-4e8b-912f-9663da2ae404 tempest-AttachVolumeNegativeTest-1154334807 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:17:05.551982 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1cf30acd-76fa-4e8b-912f-9663da2ae404 tempest-AttachVolumeNegativeTest-1154334807 None] Volume volume-abddb649-a500-4b6c-b59b-522751fd34a8 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:17:05.582785 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1cf30acd-76fa-4e8b-912f-9663da2ae404 tempest-AttachVolumeNegativeTest-1154334807 None] deleting rbd volume volume-abddb649-a500-4b6c-b59b-522751fd34a8 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:17:06.194241 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-1cf30acd-76fa-4e8b-912f-9663da2ae404 tempest-AttachVolumeNegativeTest-1154334807 None] Created reservations ['8b502806-71ac-4a60-b3b4-5470f78cce03', '6899d196-9bce-46c3-a9f3-d1ce0e855ba8', '3a71a24b-2237-4065-9514-515091444a0a', '5dc6f0d8-159d-4775-b18c-d00d9c059d50'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:17:06.297221 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1cf30acd-76fa-4e8b-912f-9663da2ae404 tempest-AttachVolumeNegativeTest-1154334807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:06.353574 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1cf30acd-76fa-4e8b-912f-9663da2ae404 tempest-AttachVolumeNegativeTest-1154334807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:06.388529 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-1cf30acd-76fa-4e8b-912f-9663da2ae404 tempest-AttachVolumeNegativeTest-1154334807 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:17:06.394345 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-1cf30acd-76fa-4e8b-912f-9663da2ae404 tempest-AttachVolumeNegativeTest-1154334807 None] Deleted volume successfully. Apr 09 21:17:06.414968 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-1cf30acd-76fa-4e8b-912f-9663da2ae404 tempest-AttachVolumeNegativeTest-1154334807 None] Lock "b'cinder-abddb649-a500-4b6c-b59b-522751fd34a8-delete_volume'" released by "delete_volume" :: held 1.066s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:17:06.749803 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-b7d38ee1-46ea-47c7-95f0-d4c56bf600c5 tempest-AttachVolumeNegativeTest-1154334807 None] Lock "b'cinder-eced0af0-a8c1-464c-9b1d-5ed1898e863c-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:17:06.801862 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b7d38ee1-46ea-47c7-95f0-d4c56bf600c5 tempest-AttachVolumeNegativeTest-1154334807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:06.897408 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b7d38ee1-46ea-47c7-95f0-d4c56bf600c5 tempest-AttachVolumeNegativeTest-1154334807 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:17:06.898408 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b7d38ee1-46ea-47c7-95f0-d4c56bf600c5 tempest-AttachVolumeNegativeTest-1154334807 None] Volume volume-eced0af0-a8c1-464c-9b1d-5ed1898e863c is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:17:06.915611 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b7d38ee1-46ea-47c7-95f0-d4c56bf600c5 tempest-AttachVolumeNegativeTest-1154334807 None] deleting rbd volume volume-eced0af0-a8c1-464c-9b1d-5ed1898e863c {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:17:07.503238 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-b7d38ee1-46ea-47c7-95f0-d4c56bf600c5 tempest-AttachVolumeNegativeTest-1154334807 None] Created reservations ['ca05078c-6298-492f-99c3-b13c07cfac4b', '210e87be-5591-4273-8bb4-178152613365', 'cd09ae9b-6f25-42b4-b266-2880f09a9aa0', '15725b2a-1e5e-41d0-9c93-4631bb1841b0'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:17:07.606907 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b7d38ee1-46ea-47c7-95f0-d4c56bf600c5 tempest-AttachVolumeNegativeTest-1154334807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:07.672460 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b7d38ee1-46ea-47c7-95f0-d4c56bf600c5 tempest-AttachVolumeNegativeTest-1154334807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:07.746366 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-b7d38ee1-46ea-47c7-95f0-d4c56bf600c5 tempest-AttachVolumeNegativeTest-1154334807 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:17:07.750969 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-b7d38ee1-46ea-47c7-95f0-d4c56bf600c5 tempest-AttachVolumeNegativeTest-1154334807 None] Deleted volume successfully. Apr 09 21:17:07.774512 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-b7d38ee1-46ea-47c7-95f0-d4c56bf600c5 tempest-AttachVolumeNegativeTest-1154334807 None] Lock "b'cinder-eced0af0-a8c1-464c-9b1d-5ed1898e863c-delete_volume'" released by "delete_volume" :: held 1.025s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:17:08.148779 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-277666d4-d8ce-4520-8575-c72da686caf5 tempest-VolumesExtendTest-270512364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:17:08.207971 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-277666d4-d8ce-4520-8575-c72da686caf5 tempest-VolumesExtendTest-270512364 None] Flow 'volume_create_manager' (9a3cb75e-0c09-4984-a1f3-62b48f335a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:17:08.227977 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-277666d4-d8ce-4520-8575-c72da686caf5 tempest-VolumesExtendTest-270512364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d910e2b-4ad4-44ee-be2b-2cb7c83c8326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:17:08.274672 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-277666d4-d8ce-4520-8575-c72da686caf5 tempest-VolumesExtendTest-270512364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d910e2b-4ad4-44ee-be2b-2cb7c83c8326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1492294803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a46ce6fb-dcfb-4f55-ba07-343f43b9527b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e98e94619914b85b016c86eb40f5420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:17:08Z,use_quota=True,user_id='27b4fa7216b7461f90cdc072fb0885ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:17:08.284261 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-277666d4-d8ce-4520-8575-c72da686caf5 tempest-VolumesExtendTest-270512364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61daa7eb-8d33-47f4-801c-1fdea995a923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:17:08.303225 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-277666d4-d8ce-4520-8575-c72da686caf5 tempest-VolumesExtendTest-270512364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61daa7eb-8d33-47f4-801c-1fdea995a923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:17:08.319921 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-277666d4-d8ce-4520-8575-c72da686caf5 tempest-VolumesExtendTest-270512364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b60a84-e87f-46ff-b5f6-42c423e0f4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:17:08.381143 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-af5c61ae-ee56-4ca9-aa42-8f1d34b92a76 tempest-AttachVolumeNegativeTest-1154334807 None] Lock "b'cinder-bfadbca7-6ec2-4a80-84f2-c2e391afc3f4-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:17:08.487006 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-af5c61ae-ee56-4ca9-aa42-8f1d34b92a76 tempest-AttachVolumeNegativeTest-1154334807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:08.575945 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-af5c61ae-ee56-4ca9-aa42-8f1d34b92a76 tempest-AttachVolumeNegativeTest-1154334807 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:17:08.576595 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-af5c61ae-ee56-4ca9-aa42-8f1d34b92a76 tempest-AttachVolumeNegativeTest-1154334807 None] Volume volume-bfadbca7-6ec2-4a80-84f2-c2e391afc3f4 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:17:08.586441 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-af5c61ae-ee56-4ca9-aa42-8f1d34b92a76 tempest-AttachVolumeNegativeTest-1154334807 None] deleting rbd volume volume-bfadbca7-6ec2-4a80-84f2-c2e391afc3f4 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:17:08.627196 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-277666d4-d8ce-4520-8575-c72da686caf5 tempest-VolumesExtendTest-270512364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b60a84-e87f-46ff-b5f6-42c423e0f4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a46ce6fb-dcfb-4f55-ba07-343f43b9527b', 'volume_name': 'volume-a46ce6fb-dcfb-4f55-ba07-343f43b9527b', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:17:08.642931 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-277666d4-d8ce-4520-8575-c72da686caf5 tempest-VolumesExtendTest-270512364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05182aa5-dcac-40c0-8a8a-b4cecb98ffdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:17:08.652753 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-277666d4-d8ce-4520-8575-c72da686caf5 tempest-VolumesExtendTest-270512364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05182aa5-dcac-40c0-8a8a-b4cecb98ffdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:17:08.662376 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-277666d4-d8ce-4520-8575-c72da686caf5 tempest-VolumesExtendTest-270512364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29358449-0a1e-4f3d-a183-80be42b4ff41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:17:08.663952 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-277666d4-d8ce-4520-8575-c72da686caf5 tempest-VolumesExtendTest-270512364 None] Volume a46ce6fb-dcfb-4f55-ba07-343f43b9527b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a46ce6fb-dcfb-4f55-ba07-343f43b9527b', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 09 21:17:08.675647 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-277666d4-d8ce-4520-8575-c72da686caf5 tempest-VolumesExtendTest-270512364 None] Cloning a46ce6fb-dcfb-4f55-ba07-343f43b9527b from image b539c48b-3400-4aa4-9226-8be5a3d07b36 at location (None, None). {{(pid=135002) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Apr 09 21:17:08.688041 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-277666d4-d8ce-4520-8575-c72da686caf5 tempest-VolumesExtendTest-270512364 None] Lock "b'cinder-b539c48b-3400-4aa4-9226-8be5a3d07b36'" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:17:08.725717 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-277666d4-d8ce-4520-8575-c72da686caf5 tempest-VolumesExtendTest-270512364 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'volume_id': 'd35656e2-d293-4904-aeae-3113202bb314', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36), 'last_used': datetime.datetime(2022, 4, 9, 21, 17, 8, 692569)}. {{(pid=135002) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 09 21:17:08.727477 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-277666d4-d8ce-4520-8575-c72da686caf5 tempest-VolumesExtendTest-270512364 None] Image-volume cache entry image_update_at = 2022-04-09 20:45:36+00:00, requested image updated_at = 2022-04-09 20:45:36+00:00. {{(pid=135002) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 09 21:17:08.728830 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-277666d4-d8ce-4520-8575-c72da686caf5 tempest-VolumesExtendTest-270512364 None] Found cache entry for image = b539c48b-3400-4aa4-9226-8be5a3d07b36 on host ncdv-master-1@ceph#ceph. {{(pid=135002) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Apr 09 21:17:08.741898 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-277666d4-d8ce-4520-8575-c72da686caf5 tempest-VolumesExtendTest-270512364 None] Lock "b'cinder-b539c48b-3400-4aa4-9226-8be5a3d07b36'" released by "_prepare_image_cache_entry" :: held 0.054s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:17:08.745161 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-277666d4-d8ce-4520-8575-c72da686caf5 tempest-VolumesExtendTest-270512364 None] Attempting to retrieve cache entry for image = b539c48b-3400-4aa4-9226-8be5a3d07b36 on host ncdv-master-1@ceph#ceph. {{(pid=135002) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Apr 09 21:17:08.763824 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-277666d4-d8ce-4520-8575-c72da686caf5 tempest-VolumesExtendTest-270512364 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'volume_id': 'd35656e2-d293-4904-aeae-3113202bb314', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36), 'last_used': datetime.datetime(2022, 4, 9, 21, 17, 8, 756298)}. {{(pid=135002) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 09 21:17:08.764879 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-277666d4-d8ce-4520-8575-c72da686caf5 tempest-VolumesExtendTest-270512364 None] Image-volume cache entry image_update_at = 2022-04-09 20:45:36+00:00, requested image updated_at = 2022-04-09 20:45:36+00:00. {{(pid=135002) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 09 21:17:08.766871 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-277666d4-d8ce-4520-8575-c72da686caf5 tempest-VolumesExtendTest-270512364 None] Creating from source image-volume d35656e2-d293-4904-aeae-3113202bb314 {{(pid=135002) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Apr 09 21:17:08.794178 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-277666d4-d8ce-4520-8575-c72da686caf5 tempest-VolumesExtendTest-270512364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:08.921975 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-277666d4-d8ce-4520-8575-c72da686caf5 tempest-VolumesExtendTest-270512364 None] creating snapshot='volume-a46ce6fb-dcfb-4f55-ba07-343f43b9527b.clone_snap' {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Apr 09 21:17:10.072854 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-277666d4-d8ce-4520-8575-c72da686caf5 tempest-VolumesExtendTest-270512364 None] cloning 'volume-d35656e2-d293-4904-aeae-3113202bb314@volume-a46ce6fb-dcfb-4f55-ba07-343f43b9527b.clone_snap' to 'volume-a46ce6fb-dcfb-4f55-ba07-343f43b9527b' {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Apr 09 21:17:10.164455 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-af5c61ae-ee56-4ca9-aa42-8f1d34b92a76 tempest-AttachVolumeNegativeTest-1154334807 None] Created reservations ['62184eca-763c-40c3-9608-3b8059992a19', '4b2bc171-d82c-4cf5-8e8a-671030baef18', '84fa5dea-6f4f-45dc-821d-90ed0ba28349', '78d22f35-57d5-4896-adae-c1d2e9518627'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:17:10.246210 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-af5c61ae-ee56-4ca9-aa42-8f1d34b92a76 tempest-AttachVolumeNegativeTest-1154334807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:10.312199 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-af5c61ae-ee56-4ca9-aa42-8f1d34b92a76 tempest-AttachVolumeNegativeTest-1154334807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:10.355148 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-af5c61ae-ee56-4ca9-aa42-8f1d34b92a76 tempest-AttachVolumeNegativeTest-1154334807 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:17:10.409377 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-277666d4-d8ce-4520-8575-c72da686caf5 tempest-VolumesExtendTest-270512364 None] Volume volume-6d815065-063f-4887-9bc8-5808837868ff.deleted is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:17:10.412091 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-277666d4-d8ce-4520-8575-c72da686caf5 tempest-VolumesExtendTest-270512364 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:17:10.412935 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-277666d4-d8ce-4520-8575-c72da686caf5 tempest-VolumesExtendTest-270512364 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:17:10.485021 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-277666d4-d8ce-4520-8575-c72da686caf5 tempest-VolumesExtendTest-270512364 None] clone created successfully {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Apr 09 21:17:10.485846 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.volume_utils [None req-277666d4-d8ce-4520-8575-c72da686caf5 tempest-VolumesExtendTest-270512364 None] Marking volume a46ce6fb-dcfb-4f55-ba07-343f43b9527b as bootable. {{(pid=135002) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Apr 09 21:17:10.500867 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-af5c61ae-ee56-4ca9-aa42-8f1d34b92a76 tempest-AttachVolumeNegativeTest-1154334807 None] Deleted volume successfully. Apr 09 21:17:10.508105 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-277666d4-d8ce-4520-8575-c72da686caf5 tempest-VolumesExtendTest-270512364 None] Copying metadata from image b539c48b-3400-4aa4-9226-8be5a3d07b36 to a46ce6fb-dcfb-4f55-ba07-343f43b9527b. {{(pid=135002) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Apr 09 21:17:10.508828 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-277666d4-d8ce-4520-8575-c72da686caf5 tempest-VolumesExtendTest-270512364 None] Creating volume glance metadata for volume a46ce6fb-dcfb-4f55-ba07-343f43b9527b backed by image b539c48b-3400-4aa4-9226-8be5a3d07b36 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=135002) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Apr 09 21:17:10.626758 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-af5c61ae-ee56-4ca9-aa42-8f1d34b92a76 tempest-AttachVolumeNegativeTest-1154334807 None] Lock "b'cinder-bfadbca7-6ec2-4a80-84f2-c2e391afc3f4-delete_volume'" released by "delete_volume" :: held 2.245s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:17:10.654527 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-277666d4-d8ce-4520-8575-c72da686caf5 tempest-VolumesExtendTest-270512364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29358449-0a1e-4f3d-a183-80be42b4ff41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a46ce6fb-dcfb-4f55-ba07-343f43b9527b', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:17:10.668215 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-277666d4-d8ce-4520-8575-c72da686caf5 tempest-VolumesExtendTest-270512364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dcc1c0e-e5d5-4e74-85e7-45f3ea0b6b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:17:10.701085 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-277666d4-d8ce-4520-8575-c72da686caf5 tempest-VolumesExtendTest-270512364 None] Volume volume-a46ce6fb-dcfb-4f55-ba07-343f43b9527b (a46ce6fb-dcfb-4f55-ba07-343f43b9527b): created successfully Apr 09 21:17:10.708663 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-277666d4-d8ce-4520-8575-c72da686caf5 tempest-VolumesExtendTest-270512364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dcc1c0e-e5d5-4e74-85e7-45f3ea0b6b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:17:10.724097 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-277666d4-d8ce-4520-8575-c72da686caf5 tempest-VolumesExtendTest-270512364 None] Flow 'volume_create_manager' (9a3cb75e-0c09-4984-a1f3-62b48f335a76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:17:10.746580 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-277666d4-d8ce-4520-8575-c72da686caf5 tempest-VolumesExtendTest-270512364 None] Created volume successfully. Apr 09 21:17:11.476640 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5e0a7d27-687e-4522-944c-b25cdbbf8485 tempest-VolumesExtendTest-270512364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:11.817992 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5e0a7d27-687e-4522-944c-b25cdbbf8485 tempest-VolumesExtendTest-270512364 None] Extend volume from 1 GB to 2 GB. {{(pid=135002) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1874}} Apr 09 21:17:11.865217 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-5e0a7d27-687e-4522-944c-b25cdbbf8485 tempest-VolumesExtendTest-270512364 None] Extend volume completed successfully. Apr 09 21:17:13.590134 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeba0375-0b13-408f-bc53-ec77eff68d49 tempest-VolumesExtendTest-270512364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:17:13.663486 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eeba0375-0b13-408f-bc53-ec77eff68d49 tempest-VolumesExtendTest-270512364 None] Flow 'volume_create_manager' (d346b868-09a2-4584-b47e-0594015dc054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:17:13.671115 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eeba0375-0b13-408f-bc53-ec77eff68d49 tempest-VolumesExtendTest-270512364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc31c2eb-8394-48c4-8923-70828812b848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:17:13.716018 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eeba0375-0b13-408f-bc53-ec77eff68d49 tempest-VolumesExtendTest-270512364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc31c2eb-8394-48c4-8923-70828812b848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1286737290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=16b79c9e-f23b-48d0-89f8-1682aef9c2a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e98e94619914b85b016c86eb40f5420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:17:14Z,use_quota=True,user_id='27b4fa7216b7461f90cdc072fb0885ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:17:13.730141 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eeba0375-0b13-408f-bc53-ec77eff68d49 tempest-VolumesExtendTest-270512364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425749db-b5b4-499e-86d8-292d8f731e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:17:13.742172 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eeba0375-0b13-408f-bc53-ec77eff68d49 tempest-VolumesExtendTest-270512364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425749db-b5b4-499e-86d8-292d8f731e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:17:13.751443 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eeba0375-0b13-408f-bc53-ec77eff68d49 tempest-VolumesExtendTest-270512364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4c94c65-3df6-4d24-8a7a-9573736954e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:17:13.784226 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eeba0375-0b13-408f-bc53-ec77eff68d49 tempest-VolumesExtendTest-270512364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4c94c65-3df6-4d24-8a7a-9573736954e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16b79c9e-f23b-48d0-89f8-1682aef9c2a9', 'volume_name': 'volume-16b79c9e-f23b-48d0-89f8-1682aef9c2a9', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:17:13.790293 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eeba0375-0b13-408f-bc53-ec77eff68d49 tempest-VolumesExtendTest-270512364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d05aa7f-ccd9-43a6-80d4-c6607e8b0a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:17:13.795063 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eeba0375-0b13-408f-bc53-ec77eff68d49 tempest-VolumesExtendTest-270512364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d05aa7f-ccd9-43a6-80d4-c6607e8b0a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:17:13.800580 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eeba0375-0b13-408f-bc53-ec77eff68d49 tempest-VolumesExtendTest-270512364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f61c9ba5-407e-47b7-9180-6da075473817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:17:13.802181 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-eeba0375-0b13-408f-bc53-ec77eff68d49 tempest-VolumesExtendTest-270512364 None] Volume 16b79c9e-f23b-48d0-89f8-1682aef9c2a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16b79c9e-f23b-48d0-89f8-1682aef9c2a9', 'volume_size': 1} Apr 09 21:17:13.802830 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-eeba0375-0b13-408f-bc53-ec77eff68d49 tempest-VolumesExtendTest-270512364 None] creating volume 'volume-16b79c9e-f23b-48d0-89f8-1682aef9c2a9' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:17:13.803934 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-eeba0375-0b13-408f-bc53-ec77eff68d49 tempest-VolumesExtendTest-270512364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:13.956964 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-eeba0375-0b13-408f-bc53-ec77eff68d49 tempest-VolumesExtendTest-270512364 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:17:13.958560 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-eeba0375-0b13-408f-bc53-ec77eff68d49 tempest-VolumesExtendTest-270512364 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:17:13.966003 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eeba0375-0b13-408f-bc53-ec77eff68d49 tempest-VolumesExtendTest-270512364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f61c9ba5-407e-47b7-9180-6da075473817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16b79c9e-f23b-48d0-89f8-1682aef9c2a9', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:17:13.979448 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eeba0375-0b13-408f-bc53-ec77eff68d49 tempest-VolumesExtendTest-270512364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45c5fe36-afbd-4013-92f4-1df7e8995d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:17:14.006893 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-eeba0375-0b13-408f-bc53-ec77eff68d49 tempest-VolumesExtendTest-270512364 None] Volume volume-16b79c9e-f23b-48d0-89f8-1682aef9c2a9 (16b79c9e-f23b-48d0-89f8-1682aef9c2a9): created successfully Apr 09 21:17:14.014197 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eeba0375-0b13-408f-bc53-ec77eff68d49 tempest-VolumesExtendTest-270512364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45c5fe36-afbd-4013-92f4-1df7e8995d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:17:14.036736 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eeba0375-0b13-408f-bc53-ec77eff68d49 tempest-VolumesExtendTest-270512364 None] Flow 'volume_create_manager' (d346b868-09a2-4584-b47e-0594015dc054) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:17:14.052248 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-eeba0375-0b13-408f-bc53-ec77eff68d49 tempest-VolumesExtendTest-270512364 None] Created volume successfully. Apr 09 21:17:15.173679 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-0e077398-e168-487f-a789-dfaf793de70a tempest-VolumesExtendTest-270512364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:15.933954 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-0e077398-e168-487f-a789-dfaf793de70a tempest-VolumesExtendTest-270512364 None] Create snapshot completed successfully Apr 09 21:17:16.463625 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d07c77b4-f4b5-4f64-a9bb-52774fcfebb9 tempest-VolumesExtendTest-270512364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:16.878912 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d07c77b4-f4b5-4f64-a9bb-52774fcfebb9 tempest-VolumesExtendTest-270512364 None] Extend volume from 1 GB to 2 GB. {{(pid=135002) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1874}} Apr 09 21:17:16.932377 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-d07c77b4-f4b5-4f64-a9bb-52774fcfebb9 tempest-VolumesExtendTest-270512364 None] Extend volume completed successfully. Apr 09 21:17:17.950784 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-8a567f7f-7347-47bd-aebf-1c3e19c626c0 tempest-VolumesExtendTest-270512364 None] Lock "b'cinder-882ab2dd-275e-438d-8ef8-ed0ac65c7bee-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.029s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:17:17.961315 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-8a567f7f-7347-47bd-aebf-1c3e19c626c0 tempest-VolumesExtendTest-270512364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:19.088928 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-8a567f7f-7347-47bd-aebf-1c3e19c626c0 tempest-VolumesExtendTest-270512364 None] Created reservations ['fb513010-5b84-4946-8701-4e161105e8ad', 'd605c948-be5c-4a92-a31e-1eea424fad18', '3a918229-8e0e-4631-a0b0-a774ec39492b', '6621fcf4-57cb-48a9-bd7e-9499896caa24'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:17:19.183589 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-8a567f7f-7347-47bd-aebf-1c3e19c626c0 tempest-VolumesExtendTest-270512364 None] Delete snapshot completed successfully. Apr 09 21:17:19.190590 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-8a567f7f-7347-47bd-aebf-1c3e19c626c0 tempest-VolumesExtendTest-270512364 None] Lock "b'cinder-882ab2dd-275e-438d-8ef8-ed0ac65c7bee-delete_snapshot'" released by "delete_snapshot" :: held 1.240s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:17:20.298961 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-14abc53f-20fb-4060-a0f6-8e5a9d4289bf tempest-VolumesExtendTest-270512364 None] Lock "b'cinder-16b79c9e-f23b-48d0-89f8-1682aef9c2a9-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:17:20.355930 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-14abc53f-20fb-4060-a0f6-8e5a9d4289bf tempest-VolumesExtendTest-270512364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:20.488441 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-14abc53f-20fb-4060-a0f6-8e5a9d4289bf tempest-VolumesExtendTest-270512364 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:17:20.488880 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-14abc53f-20fb-4060-a0f6-8e5a9d4289bf tempest-VolumesExtendTest-270512364 None] Volume volume-16b79c9e-f23b-48d0-89f8-1682aef9c2a9 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:17:20.509072 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-14abc53f-20fb-4060-a0f6-8e5a9d4289bf tempest-VolumesExtendTest-270512364 None] deleting rbd volume volume-16b79c9e-f23b-48d0-89f8-1682aef9c2a9 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:17:21.130840 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-104be6bd-db80-423e-8acc-bc27e3d2c6e3 tempest-AttachVolumeShelveTestJSON-1751174024 None] Lock "b'cinder-f4e2ef7c-1f94-4c30-8c14-8c01141e174a-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:17:21.214538 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-104be6bd-db80-423e-8acc-bc27e3d2c6e3 tempest-AttachVolumeShelveTestJSON-1751174024 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:21.293675 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-104be6bd-db80-423e-8acc-bc27e3d2c6e3 tempest-AttachVolumeShelveTestJSON-1751174024 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:17:21.294348 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-104be6bd-db80-423e-8acc-bc27e3d2c6e3 tempest-AttachVolumeShelveTestJSON-1751174024 None] Volume volume-f4e2ef7c-1f94-4c30-8c14-8c01141e174a is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:17:21.312730 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-104be6bd-db80-423e-8acc-bc27e3d2c6e3 tempest-AttachVolumeShelveTestJSON-1751174024 None] deleting rbd volume volume-f4e2ef7c-1f94-4c30-8c14-8c01141e174a {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:17:21.425615 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-14abc53f-20fb-4060-a0f6-8e5a9d4289bf tempest-VolumesExtendTest-270512364 None] Created reservations ['04d93546-2758-482a-8f80-04e4c1269e23', '1c7fe6e8-8a4f-4755-9076-ba1278d69400', '6f734bd1-8cc1-4eb2-af52-c32579dbae17', 'a9ff8944-fb64-4e9b-8db9-98eb195727c9'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:17:21.591198 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-14abc53f-20fb-4060-a0f6-8e5a9d4289bf tempest-VolumesExtendTest-270512364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:21.683805 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-14abc53f-20fb-4060-a0f6-8e5a9d4289bf tempest-VolumesExtendTest-270512364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:21.784273 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-14abc53f-20fb-4060-a0f6-8e5a9d4289bf tempest-VolumesExtendTest-270512364 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:17:21.794596 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-14abc53f-20fb-4060-a0f6-8e5a9d4289bf tempest-VolumesExtendTest-270512364 None] Deleted volume successfully. Apr 09 21:17:21.818738 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-14abc53f-20fb-4060-a0f6-8e5a9d4289bf tempest-VolumesExtendTest-270512364 None] Lock "b'cinder-16b79c9e-f23b-48d0-89f8-1682aef9c2a9-delete_volume'" released by "delete_volume" :: held 1.520s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:17:22.209705 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-104be6bd-db80-423e-8acc-bc27e3d2c6e3 tempest-AttachVolumeShelveTestJSON-1751174024 None] Created reservations ['46737332-b08f-415a-b903-146df5c81a8e', 'ca2fd101-cf36-4ce5-9c99-f90233b9bc4d', 'a36f59df-c100-4972-aa44-35b1809ee436', '5187003d-df3f-4de0-a114-154bdc3b88e5'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:17:22.322510 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-104be6bd-db80-423e-8acc-bc27e3d2c6e3 tempest-AttachVolumeShelveTestJSON-1751174024 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:22.418846 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-104be6bd-db80-423e-8acc-bc27e3d2c6e3 tempest-AttachVolumeShelveTestJSON-1751174024 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:22.521772 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-104be6bd-db80-423e-8acc-bc27e3d2c6e3 tempest-AttachVolumeShelveTestJSON-1751174024 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:17:22.526482 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-104be6bd-db80-423e-8acc-bc27e3d2c6e3 tempest-AttachVolumeShelveTestJSON-1751174024 None] Deleted volume successfully. Apr 09 21:17:22.553355 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-104be6bd-db80-423e-8acc-bc27e3d2c6e3 tempest-AttachVolumeShelveTestJSON-1751174024 None] Lock "b'cinder-f4e2ef7c-1f94-4c30-8c14-8c01141e174a-delete_volume'" released by "delete_volume" :: held 1.422s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:17:22.598716 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-cb02d3d8-7f09-4db2-91b3-6bb227795cfd tempest-AttachVolumeShelveTestJSON-1751174024 None] Lock "b'cinder-2c7031ef-4247-461a-a5ca-e53470449307-delete_volume'" acquired by "delete_volume" :: waited 0.045s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:17:22.698893 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb02d3d8-7f09-4db2-91b3-6bb227795cfd tempest-AttachVolumeShelveTestJSON-1751174024 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:22.834946 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb02d3d8-7f09-4db2-91b3-6bb227795cfd tempest-AttachVolumeShelveTestJSON-1751174024 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:17:22.835597 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb02d3d8-7f09-4db2-91b3-6bb227795cfd tempest-AttachVolumeShelveTestJSON-1751174024 None] Volume volume-2c7031ef-4247-461a-a5ca-e53470449307 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:17:22.854353 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb02d3d8-7f09-4db2-91b3-6bb227795cfd tempest-AttachVolumeShelveTestJSON-1751174024 None] deleting rbd volume volume-2c7031ef-4247-461a-a5ca-e53470449307 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:17:22.877570 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-2c0cd5fe-45f6-49b4-84ae-546f4ce71e73 tempest-VolumesExtendTest-270512364 None] Lock "b'cinder-a46ce6fb-dcfb-4f55-ba07-343f43b9527b-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:17:22.955628 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2c0cd5fe-45f6-49b4-84ae-546f4ce71e73 tempest-VolumesExtendTest-270512364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:23.093335 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2c0cd5fe-45f6-49b4-84ae-546f4ce71e73 tempest-VolumesExtendTest-270512364 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:17:23.125289 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2c0cd5fe-45f6-49b4-84ae-546f4ce71e73 tempest-VolumesExtendTest-270512364 None] deleting rbd volume volume-a46ce6fb-dcfb-4f55-ba07-343f43b9527b {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:17:23.637730 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-cb02d3d8-7f09-4db2-91b3-6bb227795cfd tempest-AttachVolumeShelveTestJSON-1751174024 None] Created reservations ['3163b205-a0d2-43c2-8f7f-8340d7985db0', '21945b0c-67a1-4cd1-a604-779c428fc2c3', 'e98ee209-2d94-4937-b97d-d4bfb091dbae', '675f769d-c9df-404b-ae3c-ef49c075dda2'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:17:23.817049 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2c0cd5fe-45f6-49b4-84ae-546f4ce71e73 tempest-VolumesExtendTest-270512364 None] volume is a clone so cleaning references {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Apr 09 21:17:23.887414 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2c0cd5fe-45f6-49b4-84ae-546f4ce71e73 tempest-VolumesExtendTest-270512364 None] deleting parent snapshot volume-a46ce6fb-dcfb-4f55-ba07-343f43b9527b.clone_snap {{(pid=135002) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Apr 09 21:17:25.095546 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb02d3d8-7f09-4db2-91b3-6bb227795cfd tempest-AttachVolumeShelveTestJSON-1751174024 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:25.186800 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb02d3d8-7f09-4db2-91b3-6bb227795cfd tempest-AttachVolumeShelveTestJSON-1751174024 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:25.256999 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb02d3d8-7f09-4db2-91b3-6bb227795cfd tempest-AttachVolumeShelveTestJSON-1751174024 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:17:25.277639 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-cb02d3d8-7f09-4db2-91b3-6bb227795cfd tempest-AttachVolumeShelveTestJSON-1751174024 None] Deleted volume successfully. Apr 09 21:17:25.324646 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-cb02d3d8-7f09-4db2-91b3-6bb227795cfd tempest-AttachVolumeShelveTestJSON-1751174024 None] Lock "b'cinder-2c7031ef-4247-461a-a5ca-e53470449307-delete_volume'" released by "delete_volume" :: held 2.729s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:17:25.394303 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-2c0cd5fe-45f6-49b4-84ae-546f4ce71e73 tempest-VolumesExtendTest-270512364 None] Created reservations ['8bd69dd2-2a76-43f2-8b77-c46395342324', '7370e3aa-26df-4e75-95aa-bbfeb879f29e', 'e5e647b4-e206-4ce7-8555-17761d672eec', '58d5789a-b948-40dd-a2ed-d742c3614286'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:17:25.497187 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2c0cd5fe-45f6-49b4-84ae-546f4ce71e73 tempest-VolumesExtendTest-270512364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:25.560775 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2c0cd5fe-45f6-49b4-84ae-546f4ce71e73 tempest-VolumesExtendTest-270512364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:25.635596 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-2c0cd5fe-45f6-49b4-84ae-546f4ce71e73 tempest-VolumesExtendTest-270512364 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:17:25.643660 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-2c0cd5fe-45f6-49b4-84ae-546f4ce71e73 tempest-VolumesExtendTest-270512364 None] Deleted volume successfully. Apr 09 21:17:25.664044 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-2c0cd5fe-45f6-49b4-84ae-546f4ce71e73 tempest-VolumesExtendTest-270512364 None] Lock "b'cinder-a46ce6fb-dcfb-4f55-ba07-343f43b9527b-delete_volume'" released by "delete_volume" :: held 2.786s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:17:31.845154 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-29f3bc29-7600-41b2-a56f-46e10b7e03b6 tempest-VolumesListTestJSON-338310979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:17:31.902997 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-29f3bc29-7600-41b2-a56f-46e10b7e03b6 tempest-VolumesListTestJSON-338310979 None] Flow 'volume_create_manager' (1fbe7802-8710-4174-8898-ea987e1a0718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:17:31.912712 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-29f3bc29-7600-41b2-a56f-46e10b7e03b6 tempest-VolumesListTestJSON-338310979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2af007f-87b2-498b-89c7-0cac9d0c2d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:17:31.936048 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-29f3bc29-7600-41b2-a56f-46e10b7e03b6 tempest-VolumesListTestJSON-338310979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2af007f-87b2-498b-89c7-0cac9d0c2d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:17:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2029700157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0e1c71ca-4810-4f79-bcaa-430e0927c414,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9a1f1000df0b4a299ab837512be51843',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:17:32Z,use_quota=True,user_id='48ff1f8139f84d7880e22265a16379f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:17:31.945344 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-29f3bc29-7600-41b2-a56f-46e10b7e03b6 tempest-VolumesListTestJSON-338310979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33409f2b-eb70-4c90-9c85-628a6279a29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:17:31.950624 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-29f3bc29-7600-41b2-a56f-46e10b7e03b6 tempest-VolumesListTestJSON-338310979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33409f2b-eb70-4c90-9c85-628a6279a29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:17:31.956712 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-29f3bc29-7600-41b2-a56f-46e10b7e03b6 tempest-VolumesListTestJSON-338310979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5fe8c6d-4933-4ad7-9ba2-2b6dd3fc8acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:17:31.961909 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-29f3bc29-7600-41b2-a56f-46e10b7e03b6 tempest-VolumesListTestJSON-338310979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5fe8c6d-4933-4ad7-9ba2-2b6dd3fc8acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e1c71ca-4810-4f79-bcaa-430e0927c414', 'volume_name': 'volume-0e1c71ca-4810-4f79-bcaa-430e0927c414', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:17:31.967748 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-29f3bc29-7600-41b2-a56f-46e10b7e03b6 tempest-VolumesListTestJSON-338310979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07887642-b299-4edf-b60c-73c75b1ddfe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:17:31.972530 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-29f3bc29-7600-41b2-a56f-46e10b7e03b6 tempest-VolumesListTestJSON-338310979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07887642-b299-4edf-b60c-73c75b1ddfe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:17:31.978301 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-29f3bc29-7600-41b2-a56f-46e10b7e03b6 tempest-VolumesListTestJSON-338310979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba184284-b18b-4996-a8af-ecdbe773f23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:17:31.979523 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-29f3bc29-7600-41b2-a56f-46e10b7e03b6 tempest-VolumesListTestJSON-338310979 None] Volume 0e1c71ca-4810-4f79-bcaa-430e0927c414: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e1c71ca-4810-4f79-bcaa-430e0927c414', 'volume_size': 1} Apr 09 21:17:31.980268 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-29f3bc29-7600-41b2-a56f-46e10b7e03b6 tempest-VolumesListTestJSON-338310979 None] creating volume 'volume-0e1c71ca-4810-4f79-bcaa-430e0927c414' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:17:31.981251 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-29f3bc29-7600-41b2-a56f-46e10b7e03b6 tempest-VolumesListTestJSON-338310979 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:32.171291 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-29f3bc29-7600-41b2-a56f-46e10b7e03b6 tempest-VolumesListTestJSON-338310979 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:17:32.171682 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-29f3bc29-7600-41b2-a56f-46e10b7e03b6 tempest-VolumesListTestJSON-338310979 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:17:32.176112 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-29f3bc29-7600-41b2-a56f-46e10b7e03b6 tempest-VolumesListTestJSON-338310979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba184284-b18b-4996-a8af-ecdbe773f23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e1c71ca-4810-4f79-bcaa-430e0927c414', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:17:32.191920 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-29f3bc29-7600-41b2-a56f-46e10b7e03b6 tempest-VolumesListTestJSON-338310979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a5ed2e9-c6c5-4cb4-af18-9dc1698bbb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:17:32.213602 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-29f3bc29-7600-41b2-a56f-46e10b7e03b6 tempest-VolumesListTestJSON-338310979 None] Volume volume-0e1c71ca-4810-4f79-bcaa-430e0927c414 (0e1c71ca-4810-4f79-bcaa-430e0927c414): created successfully Apr 09 21:17:32.222696 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-29f3bc29-7600-41b2-a56f-46e10b7e03b6 tempest-VolumesListTestJSON-338310979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a5ed2e9-c6c5-4cb4-af18-9dc1698bbb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:17:32.240153 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-29f3bc29-7600-41b2-a56f-46e10b7e03b6 tempest-VolumesListTestJSON-338310979 None] Flow 'volume_create_manager' (1fbe7802-8710-4174-8898-ea987e1a0718) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:17:32.263710 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-29f3bc29-7600-41b2-a56f-46e10b7e03b6 tempest-VolumesListTestJSON-338310979 None] Created volume successfully. Apr 09 21:17:33.335008 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac1b5935-17ce-48d3-872f-86ce0a9fd802 tempest-VolumesListTestJSON-338310979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:17:33.364203 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ac1b5935-17ce-48d3-872f-86ce0a9fd802 tempest-VolumesListTestJSON-338310979 None] Flow 'volume_create_manager' (482aec1f-489f-4584-a814-ed948c61c891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:17:33.389418 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ac1b5935-17ce-48d3-872f-86ce0a9fd802 tempest-VolumesListTestJSON-338310979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f034345c-1f33-4373-ad40-105b866f590a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:17:33.406952 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ac1b5935-17ce-48d3-872f-86ce0a9fd802 tempest-VolumesListTestJSON-338310979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f034345c-1f33-4373-ad40-105b866f590a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1116683647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=810699b9-bd34-4fcb-bbf9-3a984792ee77,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9a1f1000df0b4a299ab837512be51843',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:17:33Z,use_quota=True,user_id='48ff1f8139f84d7880e22265a16379f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:17:33.413666 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ac1b5935-17ce-48d3-872f-86ce0a9fd802 tempest-VolumesListTestJSON-338310979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (878a22ab-c476-4c54-b320-c38616b6b83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:17:33.419102 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ac1b5935-17ce-48d3-872f-86ce0a9fd802 tempest-VolumesListTestJSON-338310979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (878a22ab-c476-4c54-b320-c38616b6b83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:17:33.427062 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ac1b5935-17ce-48d3-872f-86ce0a9fd802 tempest-VolumesListTestJSON-338310979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbba7ee9-cbfd-4fd4-8973-b25164bc3ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:17:33.433529 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ac1b5935-17ce-48d3-872f-86ce0a9fd802 tempest-VolumesListTestJSON-338310979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbba7ee9-cbfd-4fd4-8973-b25164bc3ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '810699b9-bd34-4fcb-bbf9-3a984792ee77', 'volume_name': 'volume-810699b9-bd34-4fcb-bbf9-3a984792ee77', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:17:33.439951 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ac1b5935-17ce-48d3-872f-86ce0a9fd802 tempest-VolumesListTestJSON-338310979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff907169-d10a-45f4-88c3-17cfd1a14330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:17:33.445820 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ac1b5935-17ce-48d3-872f-86ce0a9fd802 tempest-VolumesListTestJSON-338310979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff907169-d10a-45f4-88c3-17cfd1a14330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:17:33.451947 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ac1b5935-17ce-48d3-872f-86ce0a9fd802 tempest-VolumesListTestJSON-338310979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43a5b726-f7c9-4ae1-8b15-b0c39bd7a866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:17:33.453462 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-ac1b5935-17ce-48d3-872f-86ce0a9fd802 tempest-VolumesListTestJSON-338310979 None] Volume 810699b9-bd34-4fcb-bbf9-3a984792ee77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-810699b9-bd34-4fcb-bbf9-3a984792ee77', 'volume_size': 1} Apr 09 21:17:33.454046 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ac1b5935-17ce-48d3-872f-86ce0a9fd802 tempest-VolumesListTestJSON-338310979 None] creating volume 'volume-810699b9-bd34-4fcb-bbf9-3a984792ee77' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:17:33.455038 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ac1b5935-17ce-48d3-872f-86ce0a9fd802 tempest-VolumesListTestJSON-338310979 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:33.612183 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ac1b5935-17ce-48d3-872f-86ce0a9fd802 tempest-VolumesListTestJSON-338310979 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:17:33.612947 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ac1b5935-17ce-48d3-872f-86ce0a9fd802 tempest-VolumesListTestJSON-338310979 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:17:33.620518 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ac1b5935-17ce-48d3-872f-86ce0a9fd802 tempest-VolumesListTestJSON-338310979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43a5b726-f7c9-4ae1-8b15-b0c39bd7a866) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-810699b9-bd34-4fcb-bbf9-3a984792ee77', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:17:33.626321 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ac1b5935-17ce-48d3-872f-86ce0a9fd802 tempest-VolumesListTestJSON-338310979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eb2599c-a5e3-412a-9513-35e621a6def9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:17:33.640676 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-ac1b5935-17ce-48d3-872f-86ce0a9fd802 tempest-VolumesListTestJSON-338310979 None] Volume volume-810699b9-bd34-4fcb-bbf9-3a984792ee77 (810699b9-bd34-4fcb-bbf9-3a984792ee77): created successfully Apr 09 21:17:33.646375 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ac1b5935-17ce-48d3-872f-86ce0a9fd802 tempest-VolumesListTestJSON-338310979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eb2599c-a5e3-412a-9513-35e621a6def9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:17:33.653596 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ac1b5935-17ce-48d3-872f-86ce0a9fd802 tempest-VolumesListTestJSON-338310979 None] Flow 'volume_create_manager' (482aec1f-489f-4584-a814-ed948c61c891) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:17:33.664236 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-ac1b5935-17ce-48d3-872f-86ce0a9fd802 tempest-VolumesListTestJSON-338310979 None] Created volume successfully. Apr 09 21:17:34.812370 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bef2688-185f-45db-a81a-43a7465cf9fd tempest-VolumesListTestJSON-338310979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:17:34.840183 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-7bef2688-185f-45db-a81a-43a7465cf9fd tempest-VolumesListTestJSON-338310979 None] Flow 'volume_create_manager' (28c53803-d280-4943-af6b-6666e916fef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:17:34.850680 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-7bef2688-185f-45db-a81a-43a7465cf9fd tempest-VolumesListTestJSON-338310979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94947fbe-f56c-491e-9b66-bad01169702f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:17:34.871525 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-7bef2688-185f-45db-a81a-43a7465cf9fd tempest-VolumesListTestJSON-338310979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94947fbe-f56c-491e-9b66-bad01169702f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-259133807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d3f1be0c-6542-4865-ac18-3f7dd9b0d1fc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9a1f1000df0b4a299ab837512be51843',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:17:35Z,use_quota=True,user_id='48ff1f8139f84d7880e22265a16379f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:17:34.877348 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-7bef2688-185f-45db-a81a-43a7465cf9fd tempest-VolumesListTestJSON-338310979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e21ecff-240e-4d39-a3dc-528e3d79530f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:17:34.882914 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-7bef2688-185f-45db-a81a-43a7465cf9fd tempest-VolumesListTestJSON-338310979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e21ecff-240e-4d39-a3dc-528e3d79530f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:17:34.889254 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-7bef2688-185f-45db-a81a-43a7465cf9fd tempest-VolumesListTestJSON-338310979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (571fea93-0e64-4d4e-8e1c-384b49a235af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:17:34.894782 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-7bef2688-185f-45db-a81a-43a7465cf9fd tempest-VolumesListTestJSON-338310979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (571fea93-0e64-4d4e-8e1c-384b49a235af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3f1be0c-6542-4865-ac18-3f7dd9b0d1fc', 'volume_name': 'volume-d3f1be0c-6542-4865-ac18-3f7dd9b0d1fc', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:17:34.901657 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-7bef2688-185f-45db-a81a-43a7465cf9fd tempest-VolumesListTestJSON-338310979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b9c2094-23bc-4877-b711-ec8e35126c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:17:34.907240 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-7bef2688-185f-45db-a81a-43a7465cf9fd tempest-VolumesListTestJSON-338310979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b9c2094-23bc-4877-b711-ec8e35126c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:17:34.913873 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-7bef2688-185f-45db-a81a-43a7465cf9fd tempest-VolumesListTestJSON-338310979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae79973-4eae-468a-9440-1a453c6967d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:17:34.915172 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-7bef2688-185f-45db-a81a-43a7465cf9fd tempest-VolumesListTestJSON-338310979 None] Volume d3f1be0c-6542-4865-ac18-3f7dd9b0d1fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3f1be0c-6542-4865-ac18-3f7dd9b0d1fc', 'volume_size': 1} Apr 09 21:17:34.916323 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-7bef2688-185f-45db-a81a-43a7465cf9fd tempest-VolumesListTestJSON-338310979 None] creating volume 'volume-d3f1be0c-6542-4865-ac18-3f7dd9b0d1fc' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:17:34.917472 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-7bef2688-185f-45db-a81a-43a7465cf9fd tempest-VolumesListTestJSON-338310979 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:35.073910 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-7bef2688-185f-45db-a81a-43a7465cf9fd tempest-VolumesListTestJSON-338310979 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:17:35.073910 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-7bef2688-185f-45db-a81a-43a7465cf9fd tempest-VolumesListTestJSON-338310979 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:17:35.077956 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-7bef2688-185f-45db-a81a-43a7465cf9fd tempest-VolumesListTestJSON-338310979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae79973-4eae-468a-9440-1a453c6967d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3f1be0c-6542-4865-ac18-3f7dd9b0d1fc', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:17:35.101577 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-7bef2688-185f-45db-a81a-43a7465cf9fd tempest-VolumesListTestJSON-338310979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5da7a00-6079-46d4-873f-c92409f7bd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:17:35.127684 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-7bef2688-185f-45db-a81a-43a7465cf9fd tempest-VolumesListTestJSON-338310979 None] Volume volume-d3f1be0c-6542-4865-ac18-3f7dd9b0d1fc (d3f1be0c-6542-4865-ac18-3f7dd9b0d1fc): created successfully Apr 09 21:17:35.134621 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-7bef2688-185f-45db-a81a-43a7465cf9fd tempest-VolumesListTestJSON-338310979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5da7a00-6079-46d4-873f-c92409f7bd1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:17:35.150536 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-7bef2688-185f-45db-a81a-43a7465cf9fd tempest-VolumesListTestJSON-338310979 None] Flow 'volume_create_manager' (28c53803-d280-4943-af6b-6666e916fef9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:17:35.177653 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-7bef2688-185f-45db-a81a-43a7465cf9fd tempest-VolumesListTestJSON-338310979 None] Created volume successfully. Apr 09 21:17:39.723842 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-5cb30bd0-9ed0-4aa9-8fa7-d3f881a5614d req-fd4b98c4-2290-4685-8995-27ae97218040 tempest-TestVolumeBackupRestore-1877640871 None] Terminate volume connection completed successfully. Apr 09 21:17:39.727539 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-5cb30bd0-9ed0-4aa9-8fa7-d3f881a5614d req-fd4b98c4-2290-4685-8995-27ae97218040 tempest-TestVolumeBackupRestore-1877640871 None] Deleting attachment 9fc63eb6-bd17-4653-86c9-572cfdc2bdad. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 21:17:40.616074 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-835a4965-3397-44c8-bad4-e0b7a8563550 tempest-VolumesListTestJSON-338310979 None] Lock "b'cinder-d3f1be0c-6542-4865-ac18-3f7dd9b0d1fc-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:17:40.707783 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-835a4965-3397-44c8-bad4-e0b7a8563550 tempest-VolumesListTestJSON-338310979 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:40.810524 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-835a4965-3397-44c8-bad4-e0b7a8563550 tempest-VolumesListTestJSON-338310979 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:17:40.815910 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-835a4965-3397-44c8-bad4-e0b7a8563550 tempest-VolumesListTestJSON-338310979 None] Volume volume-d3f1be0c-6542-4865-ac18-3f7dd9b0d1fc is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:17:40.835239 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-835a4965-3397-44c8-bad4-e0b7a8563550 tempest-VolumesListTestJSON-338310979 None] deleting rbd volume volume-d3f1be0c-6542-4865-ac18-3f7dd9b0d1fc {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:17:41.472798 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-835a4965-3397-44c8-bad4-e0b7a8563550 tempest-VolumesListTestJSON-338310979 None] Created reservations ['896f8af9-8eb2-4f20-a89a-a4f157412f6c', 'be298909-de48-410b-b2a9-c176da7222cc', '00c79f50-fae2-46b2-9b2b-5e038eb2a55d', 'fbd0579e-4027-42e5-ac47-08fa308d700f'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:17:41.602666 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-835a4965-3397-44c8-bad4-e0b7a8563550 tempest-VolumesListTestJSON-338310979 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:41.684900 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-835a4965-3397-44c8-bad4-e0b7a8563550 tempest-VolumesListTestJSON-338310979 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:41.791716 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-835a4965-3397-44c8-bad4-e0b7a8563550 tempest-VolumesListTestJSON-338310979 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:17:41.797300 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-835a4965-3397-44c8-bad4-e0b7a8563550 tempest-VolumesListTestJSON-338310979 None] Deleted volume successfully. Apr 09 21:17:41.832556 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-835a4965-3397-44c8-bad4-e0b7a8563550 tempest-VolumesListTestJSON-338310979 None] Lock "b'cinder-d3f1be0c-6542-4865-ac18-3f7dd9b0d1fc-delete_volume'" released by "delete_volume" :: held 1.214s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:17:41.948614 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-5fe56ad4-7aeb-41ed-8ad7-ae92e47bd0f0 tempest-VolumesListTestJSON-338310979 None] Lock "b'cinder-810699b9-bd34-4fcb-bbf9-3a984792ee77-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:17:42.133499 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-1b095a4b-68b6-4f95-9c41-2a4db26e06bf tempest-TestVolumeBackupRestore-1877640871 None] Lock "b'cinder-77d8a986-eb34-4d3a-9ad7-5ad1b19954dd-delete_volume'" acquired by "delete_volume" :: waited 0.146s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:17:42.144796 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5fe56ad4-7aeb-41ed-8ad7-ae92e47bd0f0 tempest-VolumesListTestJSON-338310979 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:42.315442 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5fe56ad4-7aeb-41ed-8ad7-ae92e47bd0f0 tempest-VolumesListTestJSON-338310979 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:17:42.315867 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5fe56ad4-7aeb-41ed-8ad7-ae92e47bd0f0 tempest-VolumesListTestJSON-338310979 None] Volume volume-810699b9-bd34-4fcb-bbf9-3a984792ee77 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:17:42.323019 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5fe56ad4-7aeb-41ed-8ad7-ae92e47bd0f0 tempest-VolumesListTestJSON-338310979 None] deleting rbd volume volume-810699b9-bd34-4fcb-bbf9-3a984792ee77 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:17:42.348396 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-fd5f2186-a136-4e3f-82d0-c338c1fa953c tempest-TestVolumeBackupRestore-1877640871 None] Lock "b'cinder-3a4a0854-8b3f-4537-abf3-52b0cc5e779a-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:17:42.457893 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1b095a4b-68b6-4f95-9c41-2a4db26e06bf tempest-TestVolumeBackupRestore-1877640871 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:43.101915 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1b095a4b-68b6-4f95-9c41-2a4db26e06bf tempest-TestVolumeBackupRestore-1877640871 None] Volume volume-77d8a986-eb34-4d3a-9ad7-5ad1b19954dd is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:17:43.169973 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1b095a4b-68b6-4f95-9c41-2a4db26e06bf tempest-TestVolumeBackupRestore-1877640871 None] deleting rbd volume volume-77d8a986-eb34-4d3a-9ad7-5ad1b19954dd {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:17:43.225473 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-fd5f2186-a136-4e3f-82d0-c338c1fa953c tempest-TestVolumeBackupRestore-1877640871 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:44.231792 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-fd5f2186-a136-4e3f-82d0-c338c1fa953c tempest-TestVolumeBackupRestore-1877640871 None] deleting rbd volume volume-3a4a0854-8b3f-4537-abf3-52b0cc5e779a {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:17:44.281751 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-5fe56ad4-7aeb-41ed-8ad7-ae92e47bd0f0 tempest-VolumesListTestJSON-338310979 None] Created reservations ['8fb3184d-ff49-42aa-afd7-a22e45755e29', '75d31841-e8f1-417c-9159-412b5374a108', '4f747909-9f68-462c-80f5-b7988ed8c516', 'c6822f24-452f-442d-9fba-619540204e40'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:17:44.387470 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5fe56ad4-7aeb-41ed-8ad7-ae92e47bd0f0 tempest-VolumesListTestJSON-338310979 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:44.481915 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5fe56ad4-7aeb-41ed-8ad7-ae92e47bd0f0 tempest-VolumesListTestJSON-338310979 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:44.544473 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-5fe56ad4-7aeb-41ed-8ad7-ae92e47bd0f0 tempest-VolumesListTestJSON-338310979 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:17:44.549435 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-5fe56ad4-7aeb-41ed-8ad7-ae92e47bd0f0 tempest-VolumesListTestJSON-338310979 None] Deleted volume successfully. Apr 09 21:17:44.574349 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-5fe56ad4-7aeb-41ed-8ad7-ae92e47bd0f0 tempest-VolumesListTestJSON-338310979 None] Lock "b'cinder-810699b9-bd34-4fcb-bbf9-3a984792ee77-delete_volume'" released by "delete_volume" :: held 2.626s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:17:44.661066 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-1b095a4b-68b6-4f95-9c41-2a4db26e06bf tempest-TestVolumeBackupRestore-1877640871 None] Created reservations ['9ec24ff7-d54d-44e1-b4cb-318cc39ac719', 'ae42b068-c023-4359-bf2a-b2b74da8c4cc', 'c5f77e67-e878-4d12-915b-f4495cb9dca7', 'c7651743-85e8-4191-a4f3-86291d66e98c'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:17:44.774688 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1b095a4b-68b6-4f95-9c41-2a4db26e06bf tempest-TestVolumeBackupRestore-1877640871 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:44.850727 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1b095a4b-68b6-4f95-9c41-2a4db26e06bf tempest-TestVolumeBackupRestore-1877640871 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:44.911859 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-1b095a4b-68b6-4f95-9c41-2a4db26e06bf tempest-TestVolumeBackupRestore-1877640871 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:17:44.918507 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-fd5f2186-a136-4e3f-82d0-c338c1fa953c tempest-TestVolumeBackupRestore-1877640871 None] volume is a clone so cleaning references {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Apr 09 21:17:44.960439 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-fd5f2186-a136-4e3f-82d0-c338c1fa953c tempest-TestVolumeBackupRestore-1877640871 None] deleting parent snapshot volume-3a4a0854-8b3f-4537-abf3-52b0cc5e779a.clone_snap {{(pid=135002) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Apr 09 21:17:45.147392 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-1b095a4b-68b6-4f95-9c41-2a4db26e06bf tempest-TestVolumeBackupRestore-1877640871 None] Deleted volume successfully. Apr 09 21:17:45.208803 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-1b095a4b-68b6-4f95-9c41-2a4db26e06bf tempest-TestVolumeBackupRestore-1877640871 None] Lock "b'cinder-77d8a986-eb34-4d3a-9ad7-5ad1b19954dd-delete_volume'" released by "delete_volume" :: held 3.078s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:17:45.212192 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-fd5f2186-a136-4e3f-82d0-c338c1fa953c tempest-TestVolumeBackupRestore-1877640871 None] Created reservations ['1fd4b8ef-dfac-4c58-9230-6a8c481f78ce', '5643aebd-854d-4007-8745-07eded279e15', '85945403-38ac-488d-9722-aebc2a83eed5', '12841144-dd57-4ea3-9004-558c90353a4c'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:17:45.358009 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-fd5f2186-a136-4e3f-82d0-c338c1fa953c tempest-TestVolumeBackupRestore-1877640871 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:45.449801 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-fd5f2186-a136-4e3f-82d0-c338c1fa953c tempest-TestVolumeBackupRestore-1877640871 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:45.520089 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-fd5f2186-a136-4e3f-82d0-c338c1fa953c tempest-TestVolumeBackupRestore-1877640871 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:17:45.528604 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-fd5f2186-a136-4e3f-82d0-c338c1fa953c tempest-TestVolumeBackupRestore-1877640871 None] Deleted volume successfully. Apr 09 21:17:45.540097 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-f1bc4717-e292-4815-a24f-57f7421cef9d tempest-VolumesListTestJSON-338310979 None] Lock "b'cinder-0e1c71ca-4810-4f79-bcaa-430e0927c414-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:17:45.577071 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-fd5f2186-a136-4e3f-82d0-c338c1fa953c tempest-TestVolumeBackupRestore-1877640871 None] Lock "b'cinder-3a4a0854-8b3f-4537-abf3-52b0cc5e779a-delete_volume'" released by "delete_volume" :: held 3.229s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:17:45.645385 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f1bc4717-e292-4815-a24f-57f7421cef9d tempest-VolumesListTestJSON-338310979 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:45.724931 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f1bc4717-e292-4815-a24f-57f7421cef9d tempest-VolumesListTestJSON-338310979 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:17:45.725515 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f1bc4717-e292-4815-a24f-57f7421cef9d tempest-VolumesListTestJSON-338310979 None] Volume volume-0e1c71ca-4810-4f79-bcaa-430e0927c414 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:17:45.737749 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f1bc4717-e292-4815-a24f-57f7421cef9d tempest-VolumesListTestJSON-338310979 None] deleting rbd volume volume-0e1c71ca-4810-4f79-bcaa-430e0927c414 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:17:46.294457 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-f1bc4717-e292-4815-a24f-57f7421cef9d tempest-VolumesListTestJSON-338310979 None] Created reservations ['c2825a16-bf15-4899-a2d9-695cfef5a1c2', 'f130436f-9b89-42e4-9b9d-e9fb61d53d1e', '671ae021-7498-4d83-af5c-94c2c73552ab', '5a8210ad-64c8-437c-a9db-6bff27a12706'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:17:46.427723 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f1bc4717-e292-4815-a24f-57f7421cef9d tempest-VolumesListTestJSON-338310979 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:46.502954 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f1bc4717-e292-4815-a24f-57f7421cef9d tempest-VolumesListTestJSON-338310979 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:46.587312 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-f1bc4717-e292-4815-a24f-57f7421cef9d tempest-VolumesListTestJSON-338310979 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:17:46.592487 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-f1bc4717-e292-4815-a24f-57f7421cef9d tempest-VolumesListTestJSON-338310979 None] Deleted volume successfully. Apr 09 21:17:46.616712 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-f1bc4717-e292-4815-a24f-57f7421cef9d tempest-VolumesListTestJSON-338310979 None] Lock "b'cinder-0e1c71ca-4810-4f79-bcaa-430e0927c414-delete_volume'" released by "delete_volume" :: held 1.077s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:17:49.986805 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:17:49.989238 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:50.042302 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:50.150315 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:17:53.308954 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-44c32d96-c7cb-4a3b-85fc-98dceebb25da tempest-VolumesNegativeTest-1076657774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:17:53.356191 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-44c32d96-c7cb-4a3b-85fc-98dceebb25da tempest-VolumesNegativeTest-1076657774 None] Flow 'volume_create_manager' (64430a91-a3ef-46e9-8fa6-0a4717a5d852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:17:53.377161 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-44c32d96-c7cb-4a3b-85fc-98dceebb25da tempest-VolumesNegativeTest-1076657774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44b05ab1-e3e3-4a93-9263-7bc7e27736c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:17:53.412299 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-44c32d96-c7cb-4a3b-85fc-98dceebb25da tempest-VolumesNegativeTest-1076657774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44b05ab1-e3e3-4a93-9263-7bc7e27736c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-702760085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=eed83264-a850-4feb-a41c-8914fbb6f414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55bfa8219d074eb1b2e1f2469053cd8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:17:53Z,use_quota=True,user_id='10418f53ef434172ba24367322166d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:17:53.429243 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-44c32d96-c7cb-4a3b-85fc-98dceebb25da tempest-VolumesNegativeTest-1076657774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (188494d7-327c-41e7-ace7-b3fd6409c254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:17:53.440277 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-44c32d96-c7cb-4a3b-85fc-98dceebb25da tempest-VolumesNegativeTest-1076657774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (188494d7-327c-41e7-ace7-b3fd6409c254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:17:53.452004 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-44c32d96-c7cb-4a3b-85fc-98dceebb25da tempest-VolumesNegativeTest-1076657774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05060aa5-71a1-4dfa-9e0b-91a81f64697b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:17:53.466154 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-44c32d96-c7cb-4a3b-85fc-98dceebb25da tempest-VolumesNegativeTest-1076657774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05060aa5-71a1-4dfa-9e0b-91a81f64697b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eed83264-a850-4feb-a41c-8914fbb6f414', 'volume_name': 'volume-eed83264-a850-4feb-a41c-8914fbb6f414', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:17:53.471716 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-44c32d96-c7cb-4a3b-85fc-98dceebb25da tempest-VolumesNegativeTest-1076657774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f3205d-ff56-4d8e-b244-93dd1f508ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:17:53.476236 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-44c32d96-c7cb-4a3b-85fc-98dceebb25da tempest-VolumesNegativeTest-1076657774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f3205d-ff56-4d8e-b244-93dd1f508ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:17:53.501698 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-44c32d96-c7cb-4a3b-85fc-98dceebb25da tempest-VolumesNegativeTest-1076657774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc133a2b-f760-4b32-9139-c51598999bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:17:53.502819 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-44c32d96-c7cb-4a3b-85fc-98dceebb25da tempest-VolumesNegativeTest-1076657774 None] Volume eed83264-a850-4feb-a41c-8914fbb6f414: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eed83264-a850-4feb-a41c-8914fbb6f414', 'volume_size': 1} Apr 09 21:17:53.503625 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-44c32d96-c7cb-4a3b-85fc-98dceebb25da tempest-VolumesNegativeTest-1076657774 None] creating volume 'volume-eed83264-a850-4feb-a41c-8914fbb6f414' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:17:53.504448 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-44c32d96-c7cb-4a3b-85fc-98dceebb25da tempest-VolumesNegativeTest-1076657774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:17:53.667731 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-44c32d96-c7cb-4a3b-85fc-98dceebb25da tempest-VolumesNegativeTest-1076657774 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:17:53.668285 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-44c32d96-c7cb-4a3b-85fc-98dceebb25da tempest-VolumesNegativeTest-1076657774 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:17:53.672571 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-44c32d96-c7cb-4a3b-85fc-98dceebb25da tempest-VolumesNegativeTest-1076657774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc133a2b-f760-4b32-9139-c51598999bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eed83264-a850-4feb-a41c-8914fbb6f414', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:17:53.677412 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-44c32d96-c7cb-4a3b-85fc-98dceebb25da tempest-VolumesNegativeTest-1076657774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf5af356-6911-405b-95a6-5250564145e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:17:53.697873 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-44c32d96-c7cb-4a3b-85fc-98dceebb25da tempest-VolumesNegativeTest-1076657774 None] Volume volume-eed83264-a850-4feb-a41c-8914fbb6f414 (eed83264-a850-4feb-a41c-8914fbb6f414): created successfully Apr 09 21:17:53.702584 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-44c32d96-c7cb-4a3b-85fc-98dceebb25da tempest-VolumesNegativeTest-1076657774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf5af356-6911-405b-95a6-5250564145e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:17:53.722498 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-44c32d96-c7cb-4a3b-85fc-98dceebb25da tempest-VolumesNegativeTest-1076657774 None] Flow 'volume_create_manager' (64430a91-a3ef-46e9-8fa6-0a4717a5d852) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:17:53.741700 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-44c32d96-c7cb-4a3b-85fc-98dceebb25da tempest-VolumesNegativeTest-1076657774 None] Created volume successfully. Apr 09 21:18:30.432635 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-13255f60-70a5-4a7f-a351-ab92f1b143fd tempest-VolumesNegativeTest-1076657774 None] Lock "b'cinder-eed83264-a850-4feb-a41c-8914fbb6f414-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:18:30.491962 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-13255f60-70a5-4a7f-a351-ab92f1b143fd tempest-VolumesNegativeTest-1076657774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:18:30.581265 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-13255f60-70a5-4a7f-a351-ab92f1b143fd tempest-VolumesNegativeTest-1076657774 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:18:30.581615 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-13255f60-70a5-4a7f-a351-ab92f1b143fd tempest-VolumesNegativeTest-1076657774 None] Volume volume-eed83264-a850-4feb-a41c-8914fbb6f414 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:18:30.591595 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-13255f60-70a5-4a7f-a351-ab92f1b143fd tempest-VolumesNegativeTest-1076657774 None] deleting rbd volume volume-eed83264-a850-4feb-a41c-8914fbb6f414 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:18:30.957666 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-13255f60-70a5-4a7f-a351-ab92f1b143fd tempest-VolumesNegativeTest-1076657774 None] Created reservations ['4b052322-d546-461a-b87e-140e313b83af', '6124d7c5-4c13-4aa7-b41c-386b7e42dc31', '994ed584-21e4-497a-bf39-31fb5eed6b7f', '1319734d-ff11-41d0-a3b8-4a1be4c590db'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:18:31.033400 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-13255f60-70a5-4a7f-a351-ab92f1b143fd tempest-VolumesNegativeTest-1076657774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:18:31.099326 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-13255f60-70a5-4a7f-a351-ab92f1b143fd tempest-VolumesNegativeTest-1076657774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:18:31.167831 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-13255f60-70a5-4a7f-a351-ab92f1b143fd tempest-VolumesNegativeTest-1076657774 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:18:31.178750 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-13255f60-70a5-4a7f-a351-ab92f1b143fd tempest-VolumesNegativeTest-1076657774 None] Deleted volume successfully. Apr 09 21:18:31.194811 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-13255f60-70a5-4a7f-a351-ab92f1b143fd tempest-VolumesNegativeTest-1076657774 None] Lock "b'cinder-eed83264-a850-4feb-a41c-8914fbb6f414-delete_volume'" released by "delete_volume" :: held 0.762s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:18:49.985779 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:18:49.986657 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:18:50.089904 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:18:50.175772 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:19:49.991521 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:19:49.992302 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:19:50.074085 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:19:50.161333 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:20:46.514421 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-da7918c5-6370-4a60-bbbe-29b6e5ff7aa3 tempest-GroupSnapshotsV319Test-1635647316 None] Group tempest-GroupSnapshotsV319Test-Group-799884675: creating Apr 09 21:20:46.534085 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-da7918c5-6370-4a60-bbbe-29b6e5ff7aa3 tempest-GroupSnapshotsV319Test-1635647316 None] Group tempest-GroupSnapshotsV319Test-Group-799884675: created successfully Apr 09 21:20:46.544259 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-da7918c5-6370-4a60-bbbe-29b6e5ff7aa3 tempest-GroupSnapshotsV319Test-1635647316 None] Create group completed successfully. Apr 09 21:20:48.223553 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-d85421a5-ef24-4b16-b680-82d69ca172e1 tempest-GroupSnapshotsV319Test-1635647316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:20:48.256809 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d85421a5-ef24-4b16-b680-82d69ca172e1 tempest-GroupSnapshotsV319Test-1635647316 None] Flow 'volume_create_manager' (9e9c7e78-4d74-4842-8f1d-5bdc009e0b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:20:48.265994 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d85421a5-ef24-4b16-b680-82d69ca172e1 tempest-GroupSnapshotsV319Test-1635647316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f69e06a2-7e5c-4c6f-b118-40ef5d026311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:20:48.289656 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d85421a5-ef24-4b16-b680-82d69ca172e1 tempest-GroupSnapshotsV319Test-1635647316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f69e06a2-7e5c-4c6f-b118-40ef5d026311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsV319Test-Volume-565108406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=231ca19c-6e33-46d0-bebf-9e08eb3bedf5,host='ncdv-master-1@ceph#ceph',id=297dd0b7-97ae-4f38-b702-7d9b6443ffaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c996c1b9ebd2483795ec8b2e1f0a1f3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:20:48Z,use_quota=True,user_id='1f261964ad654e2db25d97a5c26147a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1641b69a-2aca-4185-a111-d6501c272921),volume_type_id=1641b69a-2aca-4185-a111-d6501c272921)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:20:48.303530 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d85421a5-ef24-4b16-b680-82d69ca172e1 tempest-GroupSnapshotsV319Test-1635647316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fefac790-49c1-4ec9-a7f9-fed82bf3c2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:20:48.311371 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d85421a5-ef24-4b16-b680-82d69ca172e1 tempest-GroupSnapshotsV319Test-1635647316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fefac790-49c1-4ec9-a7f9-fed82bf3c2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:20:48.342322 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d85421a5-ef24-4b16-b680-82d69ca172e1 tempest-GroupSnapshotsV319Test-1635647316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5fdf054-7e03-4f53-94a3-b61307a8cc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:20:48.374197 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d85421a5-ef24-4b16-b680-82d69ca172e1 tempest-GroupSnapshotsV319Test-1635647316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5fdf054-7e03-4f53-94a3-b61307a8cc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '297dd0b7-97ae-4f38-b702-7d9b6443ffaa', 'volume_name': 'volume-297dd0b7-97ae-4f38-b702-7d9b6443ffaa', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:20:48.387951 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d85421a5-ef24-4b16-b680-82d69ca172e1 tempest-GroupSnapshotsV319Test-1635647316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ad1bf8f-f960-4a5f-95cd-bc72e206c217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:20:48.398254 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d85421a5-ef24-4b16-b680-82d69ca172e1 tempest-GroupSnapshotsV319Test-1635647316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ad1bf8f-f960-4a5f-95cd-bc72e206c217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:20:48.405073 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d85421a5-ef24-4b16-b680-82d69ca172e1 tempest-GroupSnapshotsV319Test-1635647316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b9b0089-a726-45f8-b3b2-09829d609ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:20:48.411474 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-d85421a5-ef24-4b16-b680-82d69ca172e1 tempest-GroupSnapshotsV319Test-1635647316 None] Volume 297dd0b7-97ae-4f38-b702-7d9b6443ffaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-297dd0b7-97ae-4f38-b702-7d9b6443ffaa', 'volume_size': 1} Apr 09 21:20:48.416181 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d85421a5-ef24-4b16-b680-82d69ca172e1 tempest-GroupSnapshotsV319Test-1635647316 None] creating volume 'volume-297dd0b7-97ae-4f38-b702-7d9b6443ffaa' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:20:48.417266 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d85421a5-ef24-4b16-b680-82d69ca172e1 tempest-GroupSnapshotsV319Test-1635647316 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:20:48.573242 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d85421a5-ef24-4b16-b680-82d69ca172e1 tempest-GroupSnapshotsV319Test-1635647316 None] extra_specs: {} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:20:48.574384 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d85421a5-ef24-4b16-b680-82d69ca172e1 tempest-GroupSnapshotsV319Test-1635647316 None] extra_specs: {} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:20:48.579101 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d85421a5-ef24-4b16-b680-82d69ca172e1 tempest-GroupSnapshotsV319Test-1635647316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b9b0089-a726-45f8-b3b2-09829d609ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-297dd0b7-97ae-4f38-b702-7d9b6443ffaa', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:20:48.588682 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d85421a5-ef24-4b16-b680-82d69ca172e1 tempest-GroupSnapshotsV319Test-1635647316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (618c6b8b-f678-4295-aeed-2c6c65bf3a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:20:48.607763 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-d85421a5-ef24-4b16-b680-82d69ca172e1 tempest-GroupSnapshotsV319Test-1635647316 None] Volume volume-297dd0b7-97ae-4f38-b702-7d9b6443ffaa (297dd0b7-97ae-4f38-b702-7d9b6443ffaa): created successfully Apr 09 21:20:48.614491 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d85421a5-ef24-4b16-b680-82d69ca172e1 tempest-GroupSnapshotsV319Test-1635647316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (618c6b8b-f678-4295-aeed-2c6c65bf3a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:20:48.628242 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d85421a5-ef24-4b16-b680-82d69ca172e1 tempest-GroupSnapshotsV319Test-1635647316 None] Flow 'volume_create_manager' (9e9c7e78-4d74-4842-8f1d-5bdc009e0b5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:20:48.647211 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-d85421a5-ef24-4b16-b680-82d69ca172e1 tempest-GroupSnapshotsV319Test-1635647316 None] Created volume successfully. Apr 09 21:20:49.546678 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-4de377c2-cb91-40ed-a194-88a8141ae31a tempest-GroupSnapshotsV319Test-1635647316 None] GroupSnapshot 0085732b-0298-47c4-bd7d-5e7f22e37e21: creating. Apr 09 21:20:49.562006 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-4de377c2-cb91-40ed-a194-88a8141ae31a tempest-GroupSnapshotsV319Test-1635647316 None] Group snapshot 0085732b-0298-47c4-bd7d-5e7f22e37e21: creating. {{(pid=135002) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4076}} Apr 09 21:20:49.578096 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-4de377c2-cb91-40ed-a194-88a8141ae31a tempest-GroupSnapshotsV319Test-1635647316 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:20:49.852109 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-4de377c2-cb91-40ed-a194-88a8141ae31a tempest-GroupSnapshotsV319Test-1635647316 None] group_snapshot 0085732b-0298-47c4-bd7d-5e7f22e37e21: created successfully Apr 09 21:20:49.987293 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:20:49.988000 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:20:50.043920 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:20:50.102553 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:20:51.080709 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-c1dd44f3-c354-4b19-82fb-8d4f6651a8fd tempest-GroupSnapshotsV319Test-1635647316 None] group_snapshot 0085732b-0298-47c4-bd7d-5e7f22e37e21: deleting Apr 09 21:20:51.127497 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-c1dd44f3-c354-4b19-82fb-8d4f6651a8fd tempest-GroupSnapshotsV319Test-1635647316 None] group_snapshot 0085732b-0298-47c4-bd7d-5e7f22e37e21: deleting {{(pid=135002) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4251}} Apr 09 21:20:51.184142 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-c1dd44f3-c354-4b19-82fb-8d4f6651a8fd tempest-GroupSnapshotsV319Test-1635647316 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:20:52.380115 ncdv-master-1 cinder-volume[135002]: WARNING cinder.quota [None req-c1dd44f3-c354-4b19-82fb-8d4f6651a8fd tempest-GroupSnapshotsV319Test-1635647316 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1046741197 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1046741197, it is now deprecated. Please use the default quota class for default quota. Apr 09 21:20:52.385947 ncdv-master-1 cinder-volume[135002]: WARNING cinder.quota [None req-c1dd44f3-c354-4b19-82fb-8d4f6651a8fd tempest-GroupSnapshotsV319Test-1635647316 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1046741197 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1046741197, it is now deprecated. Please use the default quota class for default quota. Apr 09 21:20:52.419102 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-c1dd44f3-c354-4b19-82fb-8d4f6651a8fd tempest-GroupSnapshotsV319Test-1635647316 None] Created reservations ['c603c7a8-f937-44f3-a73c-ed4da5c188e7', 'ed83a033-f3ba-439f-acad-a94314c81c05', '9371d405-338f-45ae-a21d-a0bfd0f6ee91', '7fdcd19b-8407-4b32-9464-96776e112fd2'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:20:52.554724 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-c1dd44f3-c354-4b19-82fb-8d4f6651a8fd tempest-GroupSnapshotsV319Test-1635647316 None] group_snapshot 0085732b-0298-47c4-bd7d-5e7f22e37e21: deleted successfully Apr 09 21:20:52.790056 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-7adaa2ee-5d09-499f-a4f2-90b9f68a0638 tempest-GroupsV320Test-670608790 None] Group tempest-GroupsV320Test-Group-918626560: creating Apr 09 21:20:52.839534 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-7adaa2ee-5d09-499f-a4f2-90b9f68a0638 tempest-GroupsV320Test-670608790 None] Group tempest-GroupsV320Test-Group-918626560: created successfully Apr 09 21:20:52.861989 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-7adaa2ee-5d09-499f-a4f2-90b9f68a0638 tempest-GroupsV320Test-670608790 None] Create group completed successfully. Apr 09 21:20:53.767393 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-de4f66d2-3171-4ce9-99ca-7c9d6bc9fe1e tempest-GroupSnapshotsV319Test-1635647316 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:20:53.866579 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-de4f66d2-3171-4ce9-99ca-7c9d6bc9fe1e tempest-GroupSnapshotsV319Test-1635647316 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:20:53.867515 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-de4f66d2-3171-4ce9-99ca-7c9d6bc9fe1e tempest-GroupSnapshotsV319Test-1635647316 None] Volume volume-297dd0b7-97ae-4f38-b702-7d9b6443ffaa is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:20:53.884879 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-de4f66d2-3171-4ce9-99ca-7c9d6bc9fe1e tempest-GroupSnapshotsV319Test-1635647316 None] deleting rbd volume volume-297dd0b7-97ae-4f38-b702-7d9b6443ffaa {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:20:54.465639 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-de4f66d2-3171-4ce9-99ca-7c9d6bc9fe1e tempest-GroupSnapshotsV319Test-1635647316 None] Created reservations ['50f48324-cc41-4cdb-885a-1c04ddf8a98f'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:20:54.568595 ncdv-master-1 cinder-volume[135002]: WARNING cinder.quota [None req-de4f66d2-3171-4ce9-99ca-7c9d6bc9fe1e tempest-GroupSnapshotsV319Test-1635647316 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1046741197 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1046741197, it is now deprecated. Please use the default quota class for default quota. Apr 09 21:20:54.596515 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-de4f66d2-3171-4ce9-99ca-7c9d6bc9fe1e tempest-GroupSnapshotsV319Test-1635647316 None] Created reservations ['1cb48168-d339-4c00-8dc0-9d0add3e04a6', '473e5054-8774-4ad5-90f7-ce3cb7b89964', '93da5519-07dc-4cf2-94fb-e792cbc1b32f', '9170cb0e-9739-4980-b1e8-9bebd5f27c5b'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:20:54.604798 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-5af92941-7b50-4058-9923-d1aec589de61 tempest-GroupsV320Test-670608790 None] Created reservations ['5c791e31-1c9c-49f0-9da6-f330982fb9eb'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:20:54.680198 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5af92941-7b50-4058-9923-d1aec589de61 tempest-GroupsV320Test-670608790 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:20:54.757062 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5af92941-7b50-4058-9923-d1aec589de61 tempest-GroupsV320Test-670608790 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:20:54.850360 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-5af92941-7b50-4058-9923-d1aec589de61 tempest-GroupsV320Test-670608790 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:20:54.862826 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-5af92941-7b50-4058-9923-d1aec589de61 tempest-GroupsV320Test-670608790 None] Delete group completed successfully. Apr 09 21:20:55.000575 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-de4f66d2-3171-4ce9-99ca-7c9d6bc9fe1e tempest-GroupSnapshotsV319Test-1635647316 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:20:55.087353 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-de4f66d2-3171-4ce9-99ca-7c9d6bc9fe1e tempest-GroupSnapshotsV319Test-1635647316 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:20:55.159802 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-de4f66d2-3171-4ce9-99ca-7c9d6bc9fe1e tempest-GroupSnapshotsV319Test-1635647316 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:20:55.163876 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-de4f66d2-3171-4ce9-99ca-7c9d6bc9fe1e tempest-GroupSnapshotsV319Test-1635647316 None] Delete group completed successfully. Apr 09 21:21:08.213017 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-2fd3dc8f-ed9b-4bf2-b78e-9c6ca4f90c40 tempest-GroupsTest-1221822312 None] Group tempest-Group1-573504131: creating Apr 09 21:21:08.238573 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-2fd3dc8f-ed9b-4bf2-b78e-9c6ca4f90c40 tempest-GroupsTest-1221822312 None] Group tempest-Group1-573504131: created successfully Apr 09 21:21:08.261666 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-2fd3dc8f-ed9b-4bf2-b78e-9c6ca4f90c40 tempest-GroupsTest-1221822312 None] Create group completed successfully. Apr 09 21:21:09.537503 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-908ae439-f0ba-48e9-aa73-cd03d359780d tempest-GroupsTest-1221822312 None] Group tempest-Group2-48299389: creating Apr 09 21:21:09.583436 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-908ae439-f0ba-48e9-aa73-cd03d359780d tempest-GroupsTest-1221822312 None] Group tempest-Group2-48299389: created successfully Apr 09 21:21:09.602005 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-908ae439-f0ba-48e9-aa73-cd03d359780d tempest-GroupsTest-1221822312 None] Create group completed successfully. Apr 09 21:21:10.065725 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d06532d-4eaf-4e66-84a0-24d72a205952 tempest-VolumesTransfersV355Test-631747875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:21:10.089294 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-7d06532d-4eaf-4e66-84a0-24d72a205952 tempest-VolumesTransfersV355Test-631747875 None] Flow 'volume_create_manager' (61012f82-856f-4223-a2c3-c29268f914fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:21:10.097481 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-7d06532d-4eaf-4e66-84a0-24d72a205952 tempest-VolumesTransfersV355Test-631747875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3b2ef2c-3d0e-4913-a2bb-277cccd3309f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:10.113341 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-7d06532d-4eaf-4e66-84a0-24d72a205952 tempest-VolumesTransfersV355Test-631747875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3b2ef2c-3d0e-4913-a2bb-277cccd3309f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1783222963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3081d9a2-22ef-4918-a8f0-7f200a2f9b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51d17312a294b8780c7d9e30a923dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:21:10Z,use_quota=True,user_id='a9d526cdb4f5487f85452e3bb9e49e2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:10.119151 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-7d06532d-4eaf-4e66-84a0-24d72a205952 tempest-VolumesTransfersV355Test-631747875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c02442d3-8e86-4539-8020-caa4c13981b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:10.123964 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-7d06532d-4eaf-4e66-84a0-24d72a205952 tempest-VolumesTransfersV355Test-631747875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c02442d3-8e86-4539-8020-caa4c13981b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:10.129028 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-7d06532d-4eaf-4e66-84a0-24d72a205952 tempest-VolumesTransfersV355Test-631747875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3af13128-82cb-4d8f-8b56-b11451e91f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:10.133391 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-7d06532d-4eaf-4e66-84a0-24d72a205952 tempest-VolumesTransfersV355Test-631747875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3af13128-82cb-4d8f-8b56-b11451e91f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3081d9a2-22ef-4918-a8f0-7f200a2f9b9d', 'volume_name': 'volume-3081d9a2-22ef-4918-a8f0-7f200a2f9b9d', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:10.138791 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-7d06532d-4eaf-4e66-84a0-24d72a205952 tempest-VolumesTransfersV355Test-631747875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05001ad1-fbc7-4d3c-9734-cb6d43ec9eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:10.142823 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-7d06532d-4eaf-4e66-84a0-24d72a205952 tempest-VolumesTransfersV355Test-631747875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05001ad1-fbc7-4d3c-9734-cb6d43ec9eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:10.147690 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-7d06532d-4eaf-4e66-84a0-24d72a205952 tempest-VolumesTransfersV355Test-631747875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c09e64ac-c5dc-41a0-9393-589969d29fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:10.149011 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-7d06532d-4eaf-4e66-84a0-24d72a205952 tempest-VolumesTransfersV355Test-631747875 None] Volume 3081d9a2-22ef-4918-a8f0-7f200a2f9b9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3081d9a2-22ef-4918-a8f0-7f200a2f9b9d', 'volume_size': 1} Apr 09 21:21:10.149317 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-7d06532d-4eaf-4e66-84a0-24d72a205952 tempest-VolumesTransfersV355Test-631747875 None] creating volume 'volume-3081d9a2-22ef-4918-a8f0-7f200a2f9b9d' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:21:10.150172 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-7d06532d-4eaf-4e66-84a0-24d72a205952 tempest-VolumesTransfersV355Test-631747875 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:21:10.258247 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-7d06532d-4eaf-4e66-84a0-24d72a205952 tempest-VolumesTransfersV355Test-631747875 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:21:10.258919 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-7d06532d-4eaf-4e66-84a0-24d72a205952 tempest-VolumesTransfersV355Test-631747875 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:21:10.263553 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-7d06532d-4eaf-4e66-84a0-24d72a205952 tempest-VolumesTransfersV355Test-631747875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c09e64ac-c5dc-41a0-9393-589969d29fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3081d9a2-22ef-4918-a8f0-7f200a2f9b9d', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:10.268756 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-7d06532d-4eaf-4e66-84a0-24d72a205952 tempest-VolumesTransfersV355Test-631747875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9541f9f5-36b9-4394-9940-9e7593a722dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:10.279674 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-7d06532d-4eaf-4e66-84a0-24d72a205952 tempest-VolumesTransfersV355Test-631747875 None] Volume volume-3081d9a2-22ef-4918-a8f0-7f200a2f9b9d (3081d9a2-22ef-4918-a8f0-7f200a2f9b9d): created successfully Apr 09 21:21:10.283359 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-7d06532d-4eaf-4e66-84a0-24d72a205952 tempest-VolumesTransfersV355Test-631747875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9541f9f5-36b9-4394-9940-9e7593a722dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:10.289102 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-7d06532d-4eaf-4e66-84a0-24d72a205952 tempest-VolumesTransfersV355Test-631747875 None] Flow 'volume_create_manager' (61012f82-856f-4223-a2c3-c29268f914fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:21:10.298928 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-7d06532d-4eaf-4e66-84a0-24d72a205952 tempest-VolumesTransfersV355Test-631747875 None] Created volume successfully. Apr 09 21:21:11.231304 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8224341-1d36-4975-980b-48c5cedae6c9 tempest-GroupsTest-1221822312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:21:11.309222 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e8224341-1d36-4975-980b-48c5cedae6c9 tempest-GroupsTest-1221822312 None] Flow 'volume_create_manager' (45ab4b03-d0f0-47d6-ab25-fd354c6de843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:21:11.316332 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e8224341-1d36-4975-980b-48c5cedae6c9 tempest-GroupsTest-1221822312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c884b2a-8ba4-42f8-862a-818ebd57d687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:11.337412 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e8224341-1d36-4975-980b-48c5cedae6c9 tempest-GroupsTest-1221822312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c884b2a-8ba4-42f8-862a-818ebd57d687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-793309742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cbdc8dfb-f2d2-4a54-ba20-8a6f0f949a38,host='ncdv-master-1@ceph#ceph',id=fe3b74e1-2b5c-4493-985f-5b6940aed586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e726719fade492e816cc49974e26ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:21:11Z,use_quota=True,user_id='f72c06de101549b2894b2313b4844997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb2d9eeb-a394-49a8-bd27-13f027f40123),volume_type_id=bb2d9eeb-a394-49a8-bd27-13f027f40123)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:11.343613 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e8224341-1d36-4975-980b-48c5cedae6c9 tempest-GroupsTest-1221822312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01802795-be21-4391-aa94-f89d94970fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:11.348381 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e8224341-1d36-4975-980b-48c5cedae6c9 tempest-GroupsTest-1221822312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01802795-be21-4391-aa94-f89d94970fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:11.359714 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e8224341-1d36-4975-980b-48c5cedae6c9 tempest-GroupsTest-1221822312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44b4ad64-0f74-4200-893a-e75054e5c5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:11.364012 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e8224341-1d36-4975-980b-48c5cedae6c9 tempest-GroupsTest-1221822312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44b4ad64-0f74-4200-893a-e75054e5c5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe3b74e1-2b5c-4493-985f-5b6940aed586', 'volume_name': 'volume-fe3b74e1-2b5c-4493-985f-5b6940aed586', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:11.374233 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e8224341-1d36-4975-980b-48c5cedae6c9 tempest-GroupsTest-1221822312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6e0a783-db7d-4b65-a2e6-a649d29e8221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:11.393730 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e8224341-1d36-4975-980b-48c5cedae6c9 tempest-GroupsTest-1221822312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6e0a783-db7d-4b65-a2e6-a649d29e8221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:11.403347 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e8224341-1d36-4975-980b-48c5cedae6c9 tempest-GroupsTest-1221822312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce6f19cd-ddde-4950-86cd-af1e87b5ee0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:11.404907 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-e8224341-1d36-4975-980b-48c5cedae6c9 tempest-GroupsTest-1221822312 None] Volume fe3b74e1-2b5c-4493-985f-5b6940aed586: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe3b74e1-2b5c-4493-985f-5b6940aed586', 'volume_size': 1} Apr 09 21:21:11.405939 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-e8224341-1d36-4975-980b-48c5cedae6c9 tempest-GroupsTest-1221822312 None] creating volume 'volume-fe3b74e1-2b5c-4493-985f-5b6940aed586' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:21:11.406804 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-e8224341-1d36-4975-980b-48c5cedae6c9 tempest-GroupsTest-1221822312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:21:11.523398 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-e8224341-1d36-4975-980b-48c5cedae6c9 tempest-GroupsTest-1221822312 None] extra_specs: {} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:21:11.525263 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-e8224341-1d36-4975-980b-48c5cedae6c9 tempest-GroupsTest-1221822312 None] extra_specs: {} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:21:11.532015 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e8224341-1d36-4975-980b-48c5cedae6c9 tempest-GroupsTest-1221822312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce6f19cd-ddde-4950-86cd-af1e87b5ee0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe3b74e1-2b5c-4493-985f-5b6940aed586', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:11.540921 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e8224341-1d36-4975-980b-48c5cedae6c9 tempest-GroupsTest-1221822312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5191be19-9598-4cc6-a687-6199d260a00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:11.555053 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-e8224341-1d36-4975-980b-48c5cedae6c9 tempest-GroupsTest-1221822312 None] Volume volume-fe3b74e1-2b5c-4493-985f-5b6940aed586 (fe3b74e1-2b5c-4493-985f-5b6940aed586): created successfully Apr 09 21:21:11.568039 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e8224341-1d36-4975-980b-48c5cedae6c9 tempest-GroupsTest-1221822312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5191be19-9598-4cc6-a687-6199d260a00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:11.576736 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e8224341-1d36-4975-980b-48c5cedae6c9 tempest-GroupsTest-1221822312 None] Flow 'volume_create_manager' (45ab4b03-d0f0-47d6-ab25-fd354c6de843) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:21:11.595476 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-e8224341-1d36-4975-980b-48c5cedae6c9 tempest-GroupsTest-1221822312 None] Created volume successfully. Apr 09 21:21:11.879678 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-3ab647eb-6bdc-4c1b-918d-39fef8bc4d77 tempest-VolumesTransfersV355Test-1568605738 None] Transfer volume completed successfully. Apr 09 21:21:12.524503 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-b32ff33f-b368-4ee7-915a-21857540d78a tempest-VolumesTransfersV355Test-1881056764 None] Lock "b'cinder-3081d9a2-22ef-4918-a8f0-7f200a2f9b9d-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:21:12.594316 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b32ff33f-b368-4ee7-915a-21857540d78a tempest-VolumesTransfersV355Test-1881056764 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:21:12.702588 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b32ff33f-b368-4ee7-915a-21857540d78a tempest-VolumesTransfersV355Test-1881056764 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:21:12.704719 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b32ff33f-b368-4ee7-915a-21857540d78a tempest-VolumesTransfersV355Test-1881056764 None] Volume volume-3081d9a2-22ef-4918-a8f0-7f200a2f9b9d is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:21:12.720440 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b32ff33f-b368-4ee7-915a-21857540d78a tempest-VolumesTransfersV355Test-1881056764 None] deleting rbd volume volume-3081d9a2-22ef-4918-a8f0-7f200a2f9b9d {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:21:13.211755 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-6c337fd6-e517-4c2f-a9f0-875d55fea6eb tempest-GroupsTest-1221822312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:21:13.299291 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-6c337fd6-e517-4c2f-a9f0-875d55fea6eb tempest-GroupsTest-1221822312 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:21:13.299957 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-6c337fd6-e517-4c2f-a9f0-875d55fea6eb tempest-GroupsTest-1221822312 None] Volume volume-fe3b74e1-2b5c-4493-985f-5b6940aed586 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:21:13.321023 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-6c337fd6-e517-4c2f-a9f0-875d55fea6eb tempest-GroupsTest-1221822312 None] deleting rbd volume volume-fe3b74e1-2b5c-4493-985f-5b6940aed586 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:21:13.402319 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-b32ff33f-b368-4ee7-915a-21857540d78a tempest-VolumesTransfersV355Test-1881056764 None] Created reservations ['d70fda6f-7680-43e5-83dd-71e7ac4de512', '4ada2560-4723-4935-a0f1-7bb1112e8db7', '3df89e4f-2768-4b10-9a9b-2d572edaebd5', '98243b4d-4b53-4f57-a897-559d144ac8c4'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:21:13.482407 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b32ff33f-b368-4ee7-915a-21857540d78a tempest-VolumesTransfersV355Test-1881056764 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:21:13.541551 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b32ff33f-b368-4ee7-915a-21857540d78a tempest-VolumesTransfersV355Test-1881056764 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:21:13.606336 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-b32ff33f-b368-4ee7-915a-21857540d78a tempest-VolumesTransfersV355Test-1881056764 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:21:13.635522 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-b32ff33f-b368-4ee7-915a-21857540d78a tempest-VolumesTransfersV355Test-1881056764 None] Deleted volume successfully. Apr 09 21:21:13.662800 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-b32ff33f-b368-4ee7-915a-21857540d78a tempest-VolumesTransfersV355Test-1881056764 None] Lock "b'cinder-3081d9a2-22ef-4918-a8f0-7f200a2f9b9d-delete_volume'" released by "delete_volume" :: held 1.141s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:21:13.764527 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-6c337fd6-e517-4c2f-a9f0-875d55fea6eb tempest-GroupsTest-1221822312 None] Created reservations ['928bfc0a-7ea6-4d12-8e14-112596cfe07d'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:21:13.802368 ncdv-master-1 cinder-volume[135002]: WARNING cinder.quota [None req-6c337fd6-e517-4c2f-a9f0-875d55fea6eb tempest-GroupsTest-1221822312 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1338417937 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1338417937, it is now deprecated. Please use the default quota class for default quota. Apr 09 21:21:13.806734 ncdv-master-1 cinder-volume[135002]: WARNING cinder.quota [None req-6c337fd6-e517-4c2f-a9f0-875d55fea6eb tempest-GroupsTest-1221822312 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1338417937 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1338417937, it is now deprecated. Please use the default quota class for default quota. Apr 09 21:21:13.830361 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-6c337fd6-e517-4c2f-a9f0-875d55fea6eb tempest-GroupsTest-1221822312 None] Created reservations ['229876f2-9f82-4bb1-9455-10abf240064b', '325d4d50-bb1f-4a90-9ea5-25bc1bd34178', 'ef37b9b3-74db-492a-87f2-d6ac84123c37', 'e354118a-4264-4976-8424-b9d963975ba8'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:21:13.976773 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-6c337fd6-e517-4c2f-a9f0-875d55fea6eb tempest-GroupsTest-1221822312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:21:14.037797 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-6c337fd6-e517-4c2f-a9f0-875d55fea6eb tempest-GroupsTest-1221822312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:21:14.120911 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-6c337fd6-e517-4c2f-a9f0-875d55fea6eb tempest-GroupsTest-1221822312 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:21:14.127267 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-6c337fd6-e517-4c2f-a9f0-875d55fea6eb tempest-GroupsTest-1221822312 None] Delete group completed successfully. Apr 09 21:21:14.257085 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-9281c216-9b11-4d1f-be55-f0faae67298f tempest-VolumesTransfersV355Test-631747875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:21:14.275906 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9281c216-9b11-4d1f-be55-f0faae67298f tempest-VolumesTransfersV355Test-631747875 None] Flow 'volume_create_manager' (19e4a5cf-836f-49a5-8586-b22806868fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:21:14.283224 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9281c216-9b11-4d1f-be55-f0faae67298f tempest-VolumesTransfersV355Test-631747875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c5250d3-aeee-4148-9595-2790f990109c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:14.299645 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9281c216-9b11-4d1f-be55-f0faae67298f tempest-VolumesTransfersV355Test-631747875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c5250d3-aeee-4148-9595-2790f990109c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1057300448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e8f2f1bc-6ef5-43d8-b372-fb347db006d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51d17312a294b8780c7d9e30a923dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:21:14Z,use_quota=True,user_id='a9d526cdb4f5487f85452e3bb9e49e2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:14.304436 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9281c216-9b11-4d1f-be55-f0faae67298f tempest-VolumesTransfersV355Test-631747875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (303098ca-3196-428c-b828-249222fe6215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:14.308682 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9281c216-9b11-4d1f-be55-f0faae67298f tempest-VolumesTransfersV355Test-631747875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (303098ca-3196-428c-b828-249222fe6215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:14.314178 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9281c216-9b11-4d1f-be55-f0faae67298f tempest-VolumesTransfersV355Test-631747875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c18c257-86d9-44e4-b2f4-08c152f5fbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:14.318852 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9281c216-9b11-4d1f-be55-f0faae67298f tempest-VolumesTransfersV355Test-631747875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c18c257-86d9-44e4-b2f4-08c152f5fbca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8f2f1bc-6ef5-43d8-b372-fb347db006d1', 'volume_name': 'volume-e8f2f1bc-6ef5-43d8-b372-fb347db006d1', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:14.325403 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9281c216-9b11-4d1f-be55-f0faae67298f tempest-VolumesTransfersV355Test-631747875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a52f998-a6f4-4875-b1ba-d0ef404a31ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:14.328355 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9281c216-9b11-4d1f-be55-f0faae67298f tempest-VolumesTransfersV355Test-631747875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a52f998-a6f4-4875-b1ba-d0ef404a31ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:14.333074 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9281c216-9b11-4d1f-be55-f0faae67298f tempest-VolumesTransfersV355Test-631747875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a203eb-a70e-4486-8252-77e4a8e54ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:14.334780 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-9281c216-9b11-4d1f-be55-f0faae67298f tempest-VolumesTransfersV355Test-631747875 None] Volume e8f2f1bc-6ef5-43d8-b372-fb347db006d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8f2f1bc-6ef5-43d8-b372-fb347db006d1', 'volume_size': 1} Apr 09 21:21:14.334780 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9281c216-9b11-4d1f-be55-f0faae67298f tempest-VolumesTransfersV355Test-631747875 None] creating volume 'volume-e8f2f1bc-6ef5-43d8-b372-fb347db006d1' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:21:14.335481 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9281c216-9b11-4d1f-be55-f0faae67298f tempest-VolumesTransfersV355Test-631747875 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:21:14.431073 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9281c216-9b11-4d1f-be55-f0faae67298f tempest-VolumesTransfersV355Test-631747875 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:21:14.431628 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9281c216-9b11-4d1f-be55-f0faae67298f tempest-VolumesTransfersV355Test-631747875 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:21:14.439360 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9281c216-9b11-4d1f-be55-f0faae67298f tempest-VolumesTransfersV355Test-631747875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a203eb-a70e-4486-8252-77e4a8e54ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8f2f1bc-6ef5-43d8-b372-fb347db006d1', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:14.445531 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9281c216-9b11-4d1f-be55-f0faae67298f tempest-VolumesTransfersV355Test-631747875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4998bda-d3b2-470d-99b3-73402fe51ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:14.461837 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-9281c216-9b11-4d1f-be55-f0faae67298f tempest-VolumesTransfersV355Test-631747875 None] Volume volume-e8f2f1bc-6ef5-43d8-b372-fb347db006d1 (e8f2f1bc-6ef5-43d8-b372-fb347db006d1): created successfully Apr 09 21:21:14.467020 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9281c216-9b11-4d1f-be55-f0faae67298f tempest-VolumesTransfersV355Test-631747875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4998bda-d3b2-470d-99b3-73402fe51ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:14.474216 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9281c216-9b11-4d1f-be55-f0faae67298f tempest-VolumesTransfersV355Test-631747875 None] Flow 'volume_create_manager' (19e4a5cf-836f-49a5-8586-b22806868fff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:21:14.517079 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-9281c216-9b11-4d1f-be55-f0faae67298f tempest-VolumesTransfersV355Test-631747875 None] Created volume successfully. Apr 09 21:21:14.548061 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-cc8ab722-a7ed-4142-8aed-8e6e543cacd0 tempest-GroupsTest-1221822312 None] Created reservations ['5fbb0132-b211-4e1a-bcca-73fc92078e09'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:21:14.585400 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cc8ab722-a7ed-4142-8aed-8e6e543cacd0 tempest-GroupsTest-1221822312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:21:14.612623 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cc8ab722-a7ed-4142-8aed-8e6e543cacd0 tempest-GroupsTest-1221822312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:21:14.636258 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cc8ab722-a7ed-4142-8aed-8e6e543cacd0 tempest-GroupsTest-1221822312 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:21:14.640276 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-cc8ab722-a7ed-4142-8aed-8e6e543cacd0 tempest-GroupsTest-1221822312 None] Delete group completed successfully. Apr 09 21:21:15.702690 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-ccc59e5c-252c-44ca-9968-dc7a0ee9b63c tempest-VolumesTransfersV355Test-1881056764 None] Lock "b'cinder-e8f2f1bc-6ef5-43d8-b372-fb347db006d1-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:21:15.756152 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ccc59e5c-252c-44ca-9968-dc7a0ee9b63c tempest-VolumesTransfersV355Test-1881056764 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:21:15.852751 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ccc59e5c-252c-44ca-9968-dc7a0ee9b63c tempest-VolumesTransfersV355Test-1881056764 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:21:15.853229 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ccc59e5c-252c-44ca-9968-dc7a0ee9b63c tempest-VolumesTransfersV355Test-1881056764 None] Volume volume-e8f2f1bc-6ef5-43d8-b372-fb347db006d1 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:21:15.868097 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ccc59e5c-252c-44ca-9968-dc7a0ee9b63c tempest-VolumesTransfersV355Test-1881056764 None] deleting rbd volume volume-e8f2f1bc-6ef5-43d8-b372-fb347db006d1 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:21:16.146416 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-f52912b9-f5ca-4149-bea5-a51eb30676bb tempest-GroupsTest-1221822312 None] Group tempest-GroupsTest-Group-1477306578: creating Apr 09 21:21:16.167682 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-f52912b9-f5ca-4149-bea5-a51eb30676bb tempest-GroupsTest-1221822312 None] Group tempest-GroupsTest-Group-1477306578: created successfully Apr 09 21:21:16.178894 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-f52912b9-f5ca-4149-bea5-a51eb30676bb tempest-GroupsTest-1221822312 None] Create group completed successfully. Apr 09 21:21:16.281216 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-ccc59e5c-252c-44ca-9968-dc7a0ee9b63c tempest-VolumesTransfersV355Test-1881056764 None] Created reservations ['80dae934-dec2-4866-b683-ecb001af0e3a', 'c9cedcad-3401-4ee1-8ebb-63f0ee97483a', '5f64d6b0-979b-4ef1-962a-18f7b8660570', '75b47e2d-1755-45e6-8820-7e388728fde6'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:21:16.326982 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ccc59e5c-252c-44ca-9968-dc7a0ee9b63c tempest-VolumesTransfersV355Test-1881056764 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:21:16.356152 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ccc59e5c-252c-44ca-9968-dc7a0ee9b63c tempest-VolumesTransfersV355Test-1881056764 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:21:16.391952 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-ccc59e5c-252c-44ca-9968-dc7a0ee9b63c tempest-VolumesTransfersV355Test-1881056764 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:21:16.401743 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-ccc59e5c-252c-44ca-9968-dc7a0ee9b63c tempest-VolumesTransfersV355Test-1881056764 None] Deleted volume successfully. Apr 09 21:21:16.416380 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-ccc59e5c-252c-44ca-9968-dc7a0ee9b63c tempest-VolumesTransfersV355Test-1881056764 None] Lock "b'cinder-e8f2f1bc-6ef5-43d8-b372-fb347db006d1-delete_volume'" released by "delete_volume" :: held 0.714s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:21:17.869672 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-838d7054-db96-4858-a7bd-d561dd815d18 tempest-GroupsTest-1221822312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:21:17.925294 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-838d7054-db96-4858-a7bd-d561dd815d18 tempest-GroupsTest-1221822312 None] Flow 'volume_create_manager' (6f70e2fa-0788-4c89-9510-f6af6ff84f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:21:17.934013 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-838d7054-db96-4858-a7bd-d561dd815d18 tempest-GroupsTest-1221822312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df61c437-3649-41e0-abcf-437f7e53edf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:17.966086 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-838d7054-db96-4858-a7bd-d561dd815d18 tempest-GroupsTest-1221822312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df61c437-3649-41e0-abcf-437f7e53edf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-1523929440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=419741bc-1617-484d-aca7-3c3396725fd7,host='ncdv-master-1@ceph#ceph',id=4378e0fd-7fc1-4202-9b8f-d56ea782342f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e726719fade492e816cc49974e26ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:21:18Z,use_quota=True,user_id='f72c06de101549b2894b2313b4844997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ec97313-d288-474c-b16e-83ad54eb904a),volume_type_id=5ec97313-d288-474c-b16e-83ad54eb904a)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:17.982831 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-838d7054-db96-4858-a7bd-d561dd815d18 tempest-GroupsTest-1221822312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82bff493-a743-47fc-8c51-a98bbbc37036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:17.991277 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-838d7054-db96-4858-a7bd-d561dd815d18 tempest-GroupsTest-1221822312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82bff493-a743-47fc-8c51-a98bbbc37036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:18.005769 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-838d7054-db96-4858-a7bd-d561dd815d18 tempest-GroupsTest-1221822312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb23e6e-d9ac-40ff-9f81-a8d981748784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:18.022815 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-838d7054-db96-4858-a7bd-d561dd815d18 tempest-GroupsTest-1221822312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb23e6e-d9ac-40ff-9f81-a8d981748784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4378e0fd-7fc1-4202-9b8f-d56ea782342f', 'volume_name': 'volume-4378e0fd-7fc1-4202-9b8f-d56ea782342f', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:18.033594 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-838d7054-db96-4858-a7bd-d561dd815d18 tempest-GroupsTest-1221822312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace048d5-36ed-4ddd-8432-9e96ddfd5fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:18.052788 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-838d7054-db96-4858-a7bd-d561dd815d18 tempest-GroupsTest-1221822312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace048d5-36ed-4ddd-8432-9e96ddfd5fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:18.067625 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-838d7054-db96-4858-a7bd-d561dd815d18 tempest-GroupsTest-1221822312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87fccb62-038a-4b00-9869-dfb6dd0e2e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:18.074211 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-838d7054-db96-4858-a7bd-d561dd815d18 tempest-GroupsTest-1221822312 None] Volume 4378e0fd-7fc1-4202-9b8f-d56ea782342f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4378e0fd-7fc1-4202-9b8f-d56ea782342f', 'volume_size': 1} Apr 09 21:21:18.076788 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-838d7054-db96-4858-a7bd-d561dd815d18 tempest-GroupsTest-1221822312 None] creating volume 'volume-4378e0fd-7fc1-4202-9b8f-d56ea782342f' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:21:18.077882 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-838d7054-db96-4858-a7bd-d561dd815d18 tempest-GroupsTest-1221822312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:21:18.228511 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-838d7054-db96-4858-a7bd-d561dd815d18 tempest-GroupsTest-1221822312 None] extra_specs: {} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:21:18.230461 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-838d7054-db96-4858-a7bd-d561dd815d18 tempest-GroupsTest-1221822312 None] extra_specs: {} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:21:18.237939 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-838d7054-db96-4858-a7bd-d561dd815d18 tempest-GroupsTest-1221822312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87fccb62-038a-4b00-9869-dfb6dd0e2e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4378e0fd-7fc1-4202-9b8f-d56ea782342f', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:18.244920 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-838d7054-db96-4858-a7bd-d561dd815d18 tempest-GroupsTest-1221822312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80db7d39-b9a4-48d4-94c1-0e256033b89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:18.260498 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-838d7054-db96-4858-a7bd-d561dd815d18 tempest-GroupsTest-1221822312 None] Volume volume-4378e0fd-7fc1-4202-9b8f-d56ea782342f (4378e0fd-7fc1-4202-9b8f-d56ea782342f): created successfully Apr 09 21:21:18.266487 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-838d7054-db96-4858-a7bd-d561dd815d18 tempest-GroupsTest-1221822312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80db7d39-b9a4-48d4-94c1-0e256033b89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:18.279570 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-838d7054-db96-4858-a7bd-d561dd815d18 tempest-GroupsTest-1221822312 None] Flow 'volume_create_manager' (6f70e2fa-0788-4c89-9510-f6af6ff84f32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:21:18.298272 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-838d7054-db96-4858-a7bd-d561dd815d18 tempest-GroupsTest-1221822312 None] Created volume successfully. Apr 09 21:21:19.617232 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-24d7271a-c72d-46a3-a804-7f813df66f10 tempest-GroupsTest-1221822312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:21:19.672747 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-24d7271a-c72d-46a3-a804-7f813df66f10 tempest-GroupsTest-1221822312 None] Flow 'volume_create_manager' (39d25915-385a-4157-9a75-c7d691553f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:21:19.684334 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-24d7271a-c72d-46a3-a804-7f813df66f10 tempest-GroupsTest-1221822312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a5b25d7-6e8d-45e1-911d-ee2c1534bafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:19.716974 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-24d7271a-c72d-46a3-a804-7f813df66f10 tempest-GroupsTest-1221822312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a5b25d7-6e8d-45e1-911d-ee2c1534bafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-916543760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=419741bc-1617-484d-aca7-3c3396725fd7,host='ncdv-master-1@ceph#ceph',id=b601fdce-2b08-4df8-83e2-9aae6b6f2895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e726719fade492e816cc49974e26ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:21:20Z,use_quota=True,user_id='f72c06de101549b2894b2313b4844997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ec97313-d288-474c-b16e-83ad54eb904a),volume_type_id=5ec97313-d288-474c-b16e-83ad54eb904a)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:19.730218 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-24d7271a-c72d-46a3-a804-7f813df66f10 tempest-GroupsTest-1221822312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3696db08-3c0f-48ff-8eea-3ecdf3bd56c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:19.741133 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-24d7271a-c72d-46a3-a804-7f813df66f10 tempest-GroupsTest-1221822312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3696db08-3c0f-48ff-8eea-3ecdf3bd56c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:19.751540 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-24d7271a-c72d-46a3-a804-7f813df66f10 tempest-GroupsTest-1221822312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (884d69e1-7222-40e2-900c-68ea3e638f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:19.776770 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-24d7271a-c72d-46a3-a804-7f813df66f10 tempest-GroupsTest-1221822312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (884d69e1-7222-40e2-900c-68ea3e638f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b601fdce-2b08-4df8-83e2-9aae6b6f2895', 'volume_name': 'volume-b601fdce-2b08-4df8-83e2-9aae6b6f2895', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:19.783411 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-24d7271a-c72d-46a3-a804-7f813df66f10 tempest-GroupsTest-1221822312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19b1f39a-867c-4c2e-bccc-6cb71556a7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:19.790351 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-24d7271a-c72d-46a3-a804-7f813df66f10 tempest-GroupsTest-1221822312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19b1f39a-867c-4c2e-bccc-6cb71556a7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:19.803181 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-24d7271a-c72d-46a3-a804-7f813df66f10 tempest-GroupsTest-1221822312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (063ef6b7-b568-486e-bff2-175e60d27150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:19.805355 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-24d7271a-c72d-46a3-a804-7f813df66f10 tempest-GroupsTest-1221822312 None] Volume b601fdce-2b08-4df8-83e2-9aae6b6f2895: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b601fdce-2b08-4df8-83e2-9aae6b6f2895', 'volume_size': 1} Apr 09 21:21:19.806352 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-24d7271a-c72d-46a3-a804-7f813df66f10 tempest-GroupsTest-1221822312 None] creating volume 'volume-b601fdce-2b08-4df8-83e2-9aae6b6f2895' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:21:19.807556 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-24d7271a-c72d-46a3-a804-7f813df66f10 tempest-GroupsTest-1221822312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:21:19.930279 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-24d7271a-c72d-46a3-a804-7f813df66f10 tempest-GroupsTest-1221822312 None] extra_specs: {} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:21:19.930656 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-24d7271a-c72d-46a3-a804-7f813df66f10 tempest-GroupsTest-1221822312 None] extra_specs: {} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:21:19.936054 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-24d7271a-c72d-46a3-a804-7f813df66f10 tempest-GroupsTest-1221822312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (063ef6b7-b568-486e-bff2-175e60d27150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b601fdce-2b08-4df8-83e2-9aae6b6f2895', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:19.943000 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-24d7271a-c72d-46a3-a804-7f813df66f10 tempest-GroupsTest-1221822312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d15752f-1430-456b-8275-b1fa62287d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:19.959318 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-24d7271a-c72d-46a3-a804-7f813df66f10 tempest-GroupsTest-1221822312 None] Volume volume-b601fdce-2b08-4df8-83e2-9aae6b6f2895 (b601fdce-2b08-4df8-83e2-9aae6b6f2895): created successfully Apr 09 21:21:19.965517 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-24d7271a-c72d-46a3-a804-7f813df66f10 tempest-GroupsTest-1221822312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d15752f-1430-456b-8275-b1fa62287d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:19.978564 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-24d7271a-c72d-46a3-a804-7f813df66f10 tempest-GroupsTest-1221822312 None] Flow 'volume_create_manager' (39d25915-385a-4157-9a75-c7d691553f21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:21:20.000032 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-24d7271a-c72d-46a3-a804-7f813df66f10 tempest-GroupsTest-1221822312 None] Created volume successfully. Apr 09 21:21:20.838924 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-8c8a55e9-0ecd-46dd-af06-f800d3aa26f9 tempest-GroupsTest-1221822312 None] Update group completed successfully. Apr 09 21:21:22.167530 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-70114e50-208c-4720-ae47-dadabc46f25c tempest-VolumesCloneNegativeTest-912024447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:21:22.189871 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-70114e50-208c-4720-ae47-dadabc46f25c tempest-VolumesCloneNegativeTest-912024447 None] Flow 'volume_create_manager' (cbda9de7-8bbd-49e0-bd6f-bd05d02c79a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:21:22.197157 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-70114e50-208c-4720-ae47-dadabc46f25c tempest-VolumesCloneNegativeTest-912024447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (496b5a5a-e1f6-4912-8722-d896b378578c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:22.217112 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-70114e50-208c-4720-ae47-dadabc46f25c tempest-VolumesCloneNegativeTest-912024447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (496b5a5a-e1f6-4912-8722-d896b378578c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-60036185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e224be41-e491-4bc8-8fa1-e451ab8b3649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7173de83c5d48818793cbd7d5358eac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:21:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:21:22Z,use_quota=True,user_id='009e2cbc98054372a77e75f7d4f81085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:22.231528 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-70114e50-208c-4720-ae47-dadabc46f25c tempest-VolumesCloneNegativeTest-912024447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20c04877-428e-4dfc-bedb-60d9812f798b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:22.240057 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-70114e50-208c-4720-ae47-dadabc46f25c tempest-VolumesCloneNegativeTest-912024447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20c04877-428e-4dfc-bedb-60d9812f798b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:22.248803 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-70114e50-208c-4720-ae47-dadabc46f25c tempest-VolumesCloneNegativeTest-912024447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb7d7097-4bf3-405b-a61b-6407fd620f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:22.253148 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-70114e50-208c-4720-ae47-dadabc46f25c tempest-VolumesCloneNegativeTest-912024447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb7d7097-4bf3-405b-a61b-6407fd620f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e224be41-e491-4bc8-8fa1-e451ab8b3649', 'volume_name': 'volume-e224be41-e491-4bc8-8fa1-e451ab8b3649', 'volume_size': 2}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:22.258807 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-70114e50-208c-4720-ae47-dadabc46f25c tempest-VolumesCloneNegativeTest-912024447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dea4a18-535c-46ac-b0b2-1637175f5f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:22.272544 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-70114e50-208c-4720-ae47-dadabc46f25c tempest-VolumesCloneNegativeTest-912024447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dea4a18-535c-46ac-b0b2-1637175f5f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:22.282482 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-70114e50-208c-4720-ae47-dadabc46f25c tempest-VolumesCloneNegativeTest-912024447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8417039-a9b4-4c31-b92d-83aea6db0588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:22.283920 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-70114e50-208c-4720-ae47-dadabc46f25c tempest-VolumesCloneNegativeTest-912024447 None] Volume e224be41-e491-4bc8-8fa1-e451ab8b3649: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e224be41-e491-4bc8-8fa1-e451ab8b3649', 'volume_size': 2} Apr 09 21:21:22.284560 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-70114e50-208c-4720-ae47-dadabc46f25c tempest-VolumesCloneNegativeTest-912024447 None] creating volume 'volume-e224be41-e491-4bc8-8fa1-e451ab8b3649' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:21:22.286435 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-70114e50-208c-4720-ae47-dadabc46f25c tempest-VolumesCloneNegativeTest-912024447 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:21:22.410884 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-70114e50-208c-4720-ae47-dadabc46f25c tempest-VolumesCloneNegativeTest-912024447 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:21:22.411307 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-70114e50-208c-4720-ae47-dadabc46f25c tempest-VolumesCloneNegativeTest-912024447 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:21:22.415176 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-70114e50-208c-4720-ae47-dadabc46f25c tempest-VolumesCloneNegativeTest-912024447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8417039-a9b4-4c31-b92d-83aea6db0588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e224be41-e491-4bc8-8fa1-e451ab8b3649', 'volume_size': 2}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:22.426261 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-70114e50-208c-4720-ae47-dadabc46f25c tempest-VolumesCloneNegativeTest-912024447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32ab3777-faf5-4caf-9b6d-c969fd65e14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:22.459491 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-70114e50-208c-4720-ae47-dadabc46f25c tempest-VolumesCloneNegativeTest-912024447 None] Volume volume-e224be41-e491-4bc8-8fa1-e451ab8b3649 (e224be41-e491-4bc8-8fa1-e451ab8b3649): created successfully Apr 09 21:21:22.466199 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-70114e50-208c-4720-ae47-dadabc46f25c tempest-VolumesCloneNegativeTest-912024447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32ab3777-faf5-4caf-9b6d-c969fd65e14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:22.472458 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-70114e50-208c-4720-ae47-dadabc46f25c tempest-VolumesCloneNegativeTest-912024447 None] Flow 'volume_create_manager' (cbda9de7-8bbd-49e0-bd6f-bd05d02c79a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:21:22.489181 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-a02e853c-6347-4a71-aeee-e167cb4398ba tempest-GroupsTest-1221822312 None] Update group completed successfully. Apr 09 21:21:22.496403 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-70114e50-208c-4720-ae47-dadabc46f25c tempest-VolumesCloneNegativeTest-912024447 None] Created volume successfully. Apr 09 21:21:23.545891 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-96c9f96a-0fed-4d1c-bb5d-9cbc2b3a495e tempest-VolumesCloneNegativeTest-912024447 None] Lock "b'cinder-e224be41-e491-4bc8-8fa1-e451ab8b3649-delete_volume'" acquired by "delete_volume" :: waited 0.039s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:21:23.644657 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-96c9f96a-0fed-4d1c-bb5d-9cbc2b3a495e tempest-VolumesCloneNegativeTest-912024447 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:21:23.789863 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-96c9f96a-0fed-4d1c-bb5d-9cbc2b3a495e tempest-VolumesCloneNegativeTest-912024447 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:21:23.790289 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-96c9f96a-0fed-4d1c-bb5d-9cbc2b3a495e tempest-VolumesCloneNegativeTest-912024447 None] Volume volume-e224be41-e491-4bc8-8fa1-e451ab8b3649 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:21:23.806849 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-96c9f96a-0fed-4d1c-bb5d-9cbc2b3a495e tempest-VolumesCloneNegativeTest-912024447 None] deleting rbd volume volume-e224be41-e491-4bc8-8fa1-e451ab8b3649 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:21:24.216244 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-47e61579-40c3-48b4-9f96-e8afef4eff70 tempest-GroupsTest-1221822312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:21:24.318988 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-47e61579-40c3-48b4-9f96-e8afef4eff70 tempest-GroupsTest-1221822312 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:21:24.320043 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-47e61579-40c3-48b4-9f96-e8afef4eff70 tempest-GroupsTest-1221822312 None] Volume volume-4378e0fd-7fc1-4202-9b8f-d56ea782342f is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:21:24.337134 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-47e61579-40c3-48b4-9f96-e8afef4eff70 tempest-GroupsTest-1221822312 None] deleting rbd volume volume-4378e0fd-7fc1-4202-9b8f-d56ea782342f {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:21:24.402279 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-96c9f96a-0fed-4d1c-bb5d-9cbc2b3a495e tempest-VolumesCloneNegativeTest-912024447 None] Created reservations ['1b9dbc12-1283-4564-a39c-17a008c54f16', 'abdf4300-a01c-48d9-bb29-0c825bb3e597', 'a8f5f308-b79a-4fa1-9907-ed3b228d8f79', 'a9b51e3c-4f63-4f24-952c-6deb48a67aa3'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:21:24.522756 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-96c9f96a-0fed-4d1c-bb5d-9cbc2b3a495e tempest-VolumesCloneNegativeTest-912024447 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:21:24.579157 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-96c9f96a-0fed-4d1c-bb5d-9cbc2b3a495e tempest-VolumesCloneNegativeTest-912024447 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:21:24.641265 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-96c9f96a-0fed-4d1c-bb5d-9cbc2b3a495e tempest-VolumesCloneNegativeTest-912024447 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:21:24.646545 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-96c9f96a-0fed-4d1c-bb5d-9cbc2b3a495e tempest-VolumesCloneNegativeTest-912024447 None] Deleted volume successfully. Apr 09 21:21:24.674120 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-96c9f96a-0fed-4d1c-bb5d-9cbc2b3a495e tempest-VolumesCloneNegativeTest-912024447 None] Lock "b'cinder-e224be41-e491-4bc8-8fa1-e451ab8b3649-delete_volume'" released by "delete_volume" :: held 1.127s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:21:24.775539 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-47e61579-40c3-48b4-9f96-e8afef4eff70 tempest-GroupsTest-1221822312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:21:24.902642 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-47e61579-40c3-48b4-9f96-e8afef4eff70 tempest-GroupsTest-1221822312 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:21:24.903071 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-47e61579-40c3-48b4-9f96-e8afef4eff70 tempest-GroupsTest-1221822312 None] Volume volume-b601fdce-2b08-4df8-83e2-9aae6b6f2895 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:21:24.921237 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-47e61579-40c3-48b4-9f96-e8afef4eff70 tempest-GroupsTest-1221822312 None] deleting rbd volume volume-b601fdce-2b08-4df8-83e2-9aae6b6f2895 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:21:25.485790 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-47e61579-40c3-48b4-9f96-e8afef4eff70 tempest-GroupsTest-1221822312 None] Created reservations ['ba9daedf-c10d-494f-920f-1f021c2098a3'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:21:25.510027 ncdv-master-1 cinder-volume[135002]: WARNING cinder.quota [None req-47e61579-40c3-48b4-9f96-e8afef4eff70 tempest-GroupsTest-1221822312 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-754652070 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-754652070, it is now deprecated. Please use the default quota class for default quota. Apr 09 21:21:25.510832 ncdv-master-1 cinder-volume[135002]: WARNING cinder.quota [None req-47e61579-40c3-48b4-9f96-e8afef4eff70 tempest-GroupsTest-1221822312 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-754652070 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-754652070, it is now deprecated. Please use the default quota class for default quota. Apr 09 21:21:25.526691 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-47e61579-40c3-48b4-9f96-e8afef4eff70 tempest-GroupsTest-1221822312 None] Created reservations ['8430c12c-7718-478f-8f74-3d3e2b787612', 'e94dc490-4a97-404c-9bbe-6dba7b2a5596', '8e95b190-1dbc-4b80-82be-7687966c6865', 'fb0b726c-c088-4398-afba-df20ce1ff604'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:21:25.698473 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-47e61579-40c3-48b4-9f96-e8afef4eff70 tempest-GroupsTest-1221822312 None] Created reservations ['50da1cd3-4cb6-41cf-bf7f-34da41be79c6', 'c26c4e0b-c211-4750-89fc-0b0dc92734df', 'f2188e33-b282-41a7-a0d2-fd21419dabde', '697aa2d7-bad4-4f04-8009-781792cebee8'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:21:25.820695 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-47e61579-40c3-48b4-9f96-e8afef4eff70 tempest-GroupsTest-1221822312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:21:25.865577 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-47e61579-40c3-48b4-9f96-e8afef4eff70 tempest-GroupsTest-1221822312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:21:25.925868 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-47e61579-40c3-48b4-9f96-e8afef4eff70 tempest-GroupsTest-1221822312 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:21:25.932934 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-47e61579-40c3-48b4-9f96-e8afef4eff70 tempest-GroupsTest-1221822312 None] Delete group completed successfully. Apr 09 21:21:46.017441 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1ed3bb8-0fde-403e-bbb9-fc6fd4f38993 tempest-SnapshotMetadataTestJSON-1020952461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:21:46.070457 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e1ed3bb8-0fde-403e-bbb9-fc6fd4f38993 tempest-SnapshotMetadataTestJSON-1020952461 None] Flow 'volume_create_manager' (82118f23-95a0-4db6-8447-fcac18c22658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:21:46.099576 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e1ed3bb8-0fde-403e-bbb9-fc6fd4f38993 tempest-SnapshotMetadataTestJSON-1020952461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29083585-1a0f-4b41-ac14-ca24014ecdec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:46.133601 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e1ed3bb8-0fde-403e-bbb9-fc6fd4f38993 tempest-SnapshotMetadataTestJSON-1020952461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29083585-1a0f-4b41-ac14-ca24014ecdec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1051704589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3f59fc2d-3347-4110-b430-2bba9c51527a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e474926f8b344cb9bcf1b43e9786c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:21:46Z,use_quota=True,user_id='2d47aaedd20946d7b05386bab7d80563',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:46.148500 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e1ed3bb8-0fde-403e-bbb9-fc6fd4f38993 tempest-SnapshotMetadataTestJSON-1020952461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ace59d8-4e8a-408d-a2af-2f94b3745df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:46.153970 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e1ed3bb8-0fde-403e-bbb9-fc6fd4f38993 tempest-SnapshotMetadataTestJSON-1020952461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ace59d8-4e8a-408d-a2af-2f94b3745df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:46.168659 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e1ed3bb8-0fde-403e-bbb9-fc6fd4f38993 tempest-SnapshotMetadataTestJSON-1020952461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d48f58f-c9b1-4fa8-808e-cb5373ca959f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:46.183951 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e1ed3bb8-0fde-403e-bbb9-fc6fd4f38993 tempest-SnapshotMetadataTestJSON-1020952461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d48f58f-c9b1-4fa8-808e-cb5373ca959f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f59fc2d-3347-4110-b430-2bba9c51527a', 'volume_name': 'volume-3f59fc2d-3347-4110-b430-2bba9c51527a', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:46.196918 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e1ed3bb8-0fde-403e-bbb9-fc6fd4f38993 tempest-SnapshotMetadataTestJSON-1020952461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (742ae53d-329f-44b6-a3e1-ab23ecdc6ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:46.207070 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e1ed3bb8-0fde-403e-bbb9-fc6fd4f38993 tempest-SnapshotMetadataTestJSON-1020952461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (742ae53d-329f-44b6-a3e1-ab23ecdc6ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:46.215628 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e1ed3bb8-0fde-403e-bbb9-fc6fd4f38993 tempest-SnapshotMetadataTestJSON-1020952461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (539838dd-3cf7-4ca2-a505-2d63ff64bae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:46.216748 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-e1ed3bb8-0fde-403e-bbb9-fc6fd4f38993 tempest-SnapshotMetadataTestJSON-1020952461 None] Volume 3f59fc2d-3347-4110-b430-2bba9c51527a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f59fc2d-3347-4110-b430-2bba9c51527a', 'volume_size': 1} Apr 09 21:21:46.217155 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-e1ed3bb8-0fde-403e-bbb9-fc6fd4f38993 tempest-SnapshotMetadataTestJSON-1020952461 None] creating volume 'volume-3f59fc2d-3347-4110-b430-2bba9c51527a' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:21:46.217952 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-e1ed3bb8-0fde-403e-bbb9-fc6fd4f38993 tempest-SnapshotMetadataTestJSON-1020952461 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:21:46.381270 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-e1ed3bb8-0fde-403e-bbb9-fc6fd4f38993 tempest-SnapshotMetadataTestJSON-1020952461 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:21:46.381697 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-e1ed3bb8-0fde-403e-bbb9-fc6fd4f38993 tempest-SnapshotMetadataTestJSON-1020952461 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:21:46.386762 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e1ed3bb8-0fde-403e-bbb9-fc6fd4f38993 tempest-SnapshotMetadataTestJSON-1020952461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (539838dd-3cf7-4ca2-a505-2d63ff64bae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f59fc2d-3347-4110-b430-2bba9c51527a', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:46.397009 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e1ed3bb8-0fde-403e-bbb9-fc6fd4f38993 tempest-SnapshotMetadataTestJSON-1020952461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d36f5480-a5a4-407e-9c60-db255202a6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:46.422805 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-e1ed3bb8-0fde-403e-bbb9-fc6fd4f38993 tempest-SnapshotMetadataTestJSON-1020952461 None] Volume volume-3f59fc2d-3347-4110-b430-2bba9c51527a (3f59fc2d-3347-4110-b430-2bba9c51527a): created successfully Apr 09 21:21:46.430402 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e1ed3bb8-0fde-403e-bbb9-fc6fd4f38993 tempest-SnapshotMetadataTestJSON-1020952461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d36f5480-a5a4-407e-9c60-db255202a6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:46.443605 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e1ed3bb8-0fde-403e-bbb9-fc6fd4f38993 tempest-SnapshotMetadataTestJSON-1020952461 None] Flow 'volume_create_manager' (82118f23-95a0-4db6-8447-fcac18c22658) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:21:46.467692 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-e1ed3bb8-0fde-403e-bbb9-fc6fd4f38993 tempest-SnapshotMetadataTestJSON-1020952461 None] Created volume successfully. Apr 09 21:21:47.418686 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b3091e0b-6974-40c0-a76e-2c29f4d55267 tempest-SnapshotMetadataTestJSON-1020952461 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:21:48.529550 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-b3091e0b-6974-40c0-a76e-2c29f4d55267 tempest-SnapshotMetadataTestJSON-1020952461 None] Create snapshot completed successfully Apr 09 21:21:49.989239 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:21:49.990582 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:21:50.051653 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:21:50.121395 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:21:50.372690 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-82e00371-97a4-4d1b-87a0-5300e79d0f16 tempest-VolumesActionsTest-9294775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:21:50.402546 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-82e00371-97a4-4d1b-87a0-5300e79d0f16 tempest-VolumesActionsTest-9294775 None] Flow 'volume_create_manager' (281f84f7-fa64-416f-b0f5-66d436fedb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:21:50.410562 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-82e00371-97a4-4d1b-87a0-5300e79d0f16 tempest-VolumesActionsTest-9294775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9800e4eb-4530-4e9a-99ec-84dd05137c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:50.428279 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-82e00371-97a4-4d1b-87a0-5300e79d0f16 tempest-VolumesActionsTest-9294775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9800e4eb-4530-4e9a-99ec-84dd05137c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-459865922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=db2ec7ab-1d3a-45f4-a177-692ddf69bf09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4542400bc91449e09c44d33b478c731e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:21:50Z,use_quota=True,user_id='7c0b068a444b461cb5190024544c1291',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:50.438042 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-82e00371-97a4-4d1b-87a0-5300e79d0f16 tempest-VolumesActionsTest-9294775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (206945f0-58f1-4d72-96cd-e82e7d4c75ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:50.442831 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-82e00371-97a4-4d1b-87a0-5300e79d0f16 tempest-VolumesActionsTest-9294775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (206945f0-58f1-4d72-96cd-e82e7d4c75ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:50.449519 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-82e00371-97a4-4d1b-87a0-5300e79d0f16 tempest-VolumesActionsTest-9294775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9934b02c-cd4d-4446-8242-fae04cb5a9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:50.454252 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-82e00371-97a4-4d1b-87a0-5300e79d0f16 tempest-VolumesActionsTest-9294775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9934b02c-cd4d-4446-8242-fae04cb5a9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db2ec7ab-1d3a-45f4-a177-692ddf69bf09', 'volume_name': 'volume-db2ec7ab-1d3a-45f4-a177-692ddf69bf09', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:50.460245 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-82e00371-97a4-4d1b-87a0-5300e79d0f16 tempest-VolumesActionsTest-9294775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ecca36-7f1d-4acd-9c5b-3f9a48b9d1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:50.465386 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-82e00371-97a4-4d1b-87a0-5300e79d0f16 tempest-VolumesActionsTest-9294775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ecca36-7f1d-4acd-9c5b-3f9a48b9d1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:50.470897 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-82e00371-97a4-4d1b-87a0-5300e79d0f16 tempest-VolumesActionsTest-9294775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (950bd4e0-ae90-4bbc-9bcd-c45ab79f110d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:50.472217 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-82e00371-97a4-4d1b-87a0-5300e79d0f16 tempest-VolumesActionsTest-9294775 None] Volume db2ec7ab-1d3a-45f4-a177-692ddf69bf09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db2ec7ab-1d3a-45f4-a177-692ddf69bf09', 'volume_size': 1} Apr 09 21:21:50.472802 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-82e00371-97a4-4d1b-87a0-5300e79d0f16 tempest-VolumesActionsTest-9294775 None] creating volume 'volume-db2ec7ab-1d3a-45f4-a177-692ddf69bf09' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:21:50.473686 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-82e00371-97a4-4d1b-87a0-5300e79d0f16 tempest-VolumesActionsTest-9294775 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:21:50.613908 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-82e00371-97a4-4d1b-87a0-5300e79d0f16 tempest-VolumesActionsTest-9294775 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:21:50.614574 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-82e00371-97a4-4d1b-87a0-5300e79d0f16 tempest-VolumesActionsTest-9294775 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:21:50.618902 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-82e00371-97a4-4d1b-87a0-5300e79d0f16 tempest-VolumesActionsTest-9294775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (950bd4e0-ae90-4bbc-9bcd-c45ab79f110d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db2ec7ab-1d3a-45f4-a177-692ddf69bf09', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:50.624303 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-82e00371-97a4-4d1b-87a0-5300e79d0f16 tempest-VolumesActionsTest-9294775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66d3fd7e-13c2-47ab-8b75-a9f9d74136ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:50.647307 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-82e00371-97a4-4d1b-87a0-5300e79d0f16 tempest-VolumesActionsTest-9294775 None] Volume volume-db2ec7ab-1d3a-45f4-a177-692ddf69bf09 (db2ec7ab-1d3a-45f4-a177-692ddf69bf09): created successfully Apr 09 21:21:50.652170 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-82e00371-97a4-4d1b-87a0-5300e79d0f16 tempest-VolumesActionsTest-9294775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66d3fd7e-13c2-47ab-8b75-a9f9d74136ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:50.666587 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-82e00371-97a4-4d1b-87a0-5300e79d0f16 tempest-VolumesActionsTest-9294775 None] Flow 'volume_create_manager' (281f84f7-fa64-416f-b0f5-66d436fedb9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:21:50.680546 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-82e00371-97a4-4d1b-87a0-5300e79d0f16 tempest-VolumesActionsTest-9294775 None] Created volume successfully. Apr 09 21:21:50.740408 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-c0cdc09a-15a8-4e81-8478-4a82bb30d919 tempest-SnapshotMetadataTestJSON-1020952461 None] Lock "b'cinder-1562c0cd-5240-4461-b3d3-d9c0022bf097-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:21:50.742294 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-c0cdc09a-15a8-4e81-8478-4a82bb30d919 tempest-SnapshotMetadataTestJSON-1020952461 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:21:51.597344 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-c0cdc09a-15a8-4e81-8478-4a82bb30d919 tempest-SnapshotMetadataTestJSON-1020952461 None] Created reservations ['1476fe57-066c-4d3d-bf9e-857a5c863249', 'e18859b4-92a3-41be-a1ff-6ef6f75e99f5', '5199e2fb-57b5-4b40-8931-1d25eaf35e31', '4971f17b-c340-40c9-a32d-4a05e3f09b3e'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:21:51.639986 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-c0cdc09a-15a8-4e81-8478-4a82bb30d919 tempest-SnapshotMetadataTestJSON-1020952461 None] Delete snapshot completed successfully. Apr 09 21:21:51.651989 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-c0cdc09a-15a8-4e81-8478-4a82bb30d919 tempest-SnapshotMetadataTestJSON-1020952461 None] Lock "b'cinder-1562c0cd-5240-4461-b3d3-d9c0022bf097-delete_snapshot'" released by "delete_snapshot" :: held 0.915s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:21:51.901615 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-1bc5295d-0132-4df2-8ed0-5e18ee043799 tempest-SnapshotMetadataTestJSON-1020952461 None] Lock "b'cinder-3f59fc2d-3347-4110-b430-2bba9c51527a-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:21:51.978759 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1bc5295d-0132-4df2-8ed0-5e18ee043799 tempest-SnapshotMetadataTestJSON-1020952461 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:21:52.034948 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1bc5295d-0132-4df2-8ed0-5e18ee043799 tempest-SnapshotMetadataTestJSON-1020952461 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:21:52.035376 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1bc5295d-0132-4df2-8ed0-5e18ee043799 tempest-SnapshotMetadataTestJSON-1020952461 None] Volume volume-3f59fc2d-3347-4110-b430-2bba9c51527a is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:21:52.047679 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1bc5295d-0132-4df2-8ed0-5e18ee043799 tempest-SnapshotMetadataTestJSON-1020952461 None] deleting rbd volume volume-3f59fc2d-3347-4110-b430-2bba9c51527a {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:21:52.511202 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-1bc5295d-0132-4df2-8ed0-5e18ee043799 tempest-SnapshotMetadataTestJSON-1020952461 None] Created reservations ['053988a6-cea3-49d8-a3c3-9799f889b331', '1d470f67-4d9c-4bb7-bba2-e82f573aee3d', '96815e8b-ae5c-4207-ab6c-b04f685b18ae', 'f013e899-087c-40c3-903a-c0a03c67ee36'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:21:52.594703 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1bc5295d-0132-4df2-8ed0-5e18ee043799 tempest-SnapshotMetadataTestJSON-1020952461 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:21:52.673607 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1bc5295d-0132-4df2-8ed0-5e18ee043799 tempest-SnapshotMetadataTestJSON-1020952461 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:21:52.734813 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-1bc5295d-0132-4df2-8ed0-5e18ee043799 tempest-SnapshotMetadataTestJSON-1020952461 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:21:52.739155 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-1bc5295d-0132-4df2-8ed0-5e18ee043799 tempest-SnapshotMetadataTestJSON-1020952461 None] Deleted volume successfully. Apr 09 21:21:52.754412 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-1bc5295d-0132-4df2-8ed0-5e18ee043799 tempest-SnapshotMetadataTestJSON-1020952461 None] Lock "b'cinder-3f59fc2d-3347-4110-b430-2bba9c51527a-delete_volume'" released by "delete_volume" :: held 0.853s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:21:59.363691 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2c600f8-f51c-461d-917b-8a7d4edc7aae tempest-VolumesTransfersTest-1681990303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:21:59.415083 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2c600f8-f51c-461d-917b-8a7d4edc7aae tempest-VolumesTransfersTest-1681990303 None] Flow 'volume_create_manager' (b8a4fb5f-7f18-44d5-8b22-3676cdff03d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:21:59.425385 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2c600f8-f51c-461d-917b-8a7d4edc7aae tempest-VolumesTransfersTest-1681990303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de74d6ce-82e0-4270-947b-1c1f2cca1d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:59.507497 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2c600f8-f51c-461d-917b-8a7d4edc7aae tempest-VolumesTransfersTest-1681990303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de74d6ce-82e0-4270-947b-1c1f2cca1d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1209006312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=87847c16-ad41-4f0c-b034-cec0a94d736b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='249211709ece485daf084a48fcbf819f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:21:59Z,use_quota=True,user_id='fdbc094dc029426799bf9d0e4903c5f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:59.525916 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2c600f8-f51c-461d-917b-8a7d4edc7aae tempest-VolumesTransfersTest-1681990303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (902f6855-f6d3-47ea-9c5f-4a8a610c017a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:59.536538 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2c600f8-f51c-461d-917b-8a7d4edc7aae tempest-VolumesTransfersTest-1681990303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (902f6855-f6d3-47ea-9c5f-4a8a610c017a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:59.554859 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2c600f8-f51c-461d-917b-8a7d4edc7aae tempest-VolumesTransfersTest-1681990303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6da5a776-e8cf-4063-95c3-d49c89d3366d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:59.565646 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2c600f8-f51c-461d-917b-8a7d4edc7aae tempest-VolumesTransfersTest-1681990303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6da5a776-e8cf-4063-95c3-d49c89d3366d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87847c16-ad41-4f0c-b034-cec0a94d736b', 'volume_name': 'volume-87847c16-ad41-4f0c-b034-cec0a94d736b', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:59.579735 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2c600f8-f51c-461d-917b-8a7d4edc7aae tempest-VolumesTransfersTest-1681990303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5abddd26-23f6-439b-9171-998fcc3e56bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:59.585257 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2c600f8-f51c-461d-917b-8a7d4edc7aae tempest-VolumesTransfersTest-1681990303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5abddd26-23f6-439b-9171-998fcc3e56bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:59.590756 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2c600f8-f51c-461d-917b-8a7d4edc7aae tempest-VolumesTransfersTest-1681990303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b29fc61-d7e5-497f-ac01-b8bf9cec73f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:59.592128 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-e2c600f8-f51c-461d-917b-8a7d4edc7aae tempest-VolumesTransfersTest-1681990303 None] Volume 87847c16-ad41-4f0c-b034-cec0a94d736b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87847c16-ad41-4f0c-b034-cec0a94d736b', 'volume_size': 1} Apr 09 21:21:59.592736 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-e2c600f8-f51c-461d-917b-8a7d4edc7aae tempest-VolumesTransfersTest-1681990303 None] creating volume 'volume-87847c16-ad41-4f0c-b034-cec0a94d736b' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:21:59.593776 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-e2c600f8-f51c-461d-917b-8a7d4edc7aae tempest-VolumesTransfersTest-1681990303 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:21:59.750006 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-e2c600f8-f51c-461d-917b-8a7d4edc7aae tempest-VolumesTransfersTest-1681990303 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:21:59.750398 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-e2c600f8-f51c-461d-917b-8a7d4edc7aae tempest-VolumesTransfersTest-1681990303 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:21:59.754965 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2c600f8-f51c-461d-917b-8a7d4edc7aae tempest-VolumesTransfersTest-1681990303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b29fc61-d7e5-497f-ac01-b8bf9cec73f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87847c16-ad41-4f0c-b034-cec0a94d736b', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:59.764111 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2c600f8-f51c-461d-917b-8a7d4edc7aae tempest-VolumesTransfersTest-1681990303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99b50eba-7efb-40ea-9c81-0b9d97379e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:21:59.784394 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-e2c600f8-f51c-461d-917b-8a7d4edc7aae tempest-VolumesTransfersTest-1681990303 None] Volume volume-87847c16-ad41-4f0c-b034-cec0a94d736b (87847c16-ad41-4f0c-b034-cec0a94d736b): created successfully Apr 09 21:21:59.793704 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2c600f8-f51c-461d-917b-8a7d4edc7aae tempest-VolumesTransfersTest-1681990303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99b50eba-7efb-40ea-9c81-0b9d97379e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:21:59.811704 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-e2c600f8-f51c-461d-917b-8a7d4edc7aae tempest-VolumesTransfersTest-1681990303 None] Flow 'volume_create_manager' (b8a4fb5f-7f18-44d5-8b22-3676cdff03d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:21:59.837423 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-e2c600f8-f51c-461d-917b-8a7d4edc7aae tempest-VolumesTransfersTest-1681990303 None] Created volume successfully. Apr 09 21:22:01.327509 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-e0825976-1578-44bc-8d27-f9e1fb6e82cc tempest-VolumesTransfersTest-522181824 None] Transfer volume completed successfully. Apr 09 21:22:02.074192 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-2b650848-fd71-4c2b-a58c-8eb2704c2e60 tempest-VolumesTransfersTest-1809744573 None] Lock "b'cinder-87847c16-ad41-4f0c-b034-cec0a94d736b-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:22:02.125154 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2b650848-fd71-4c2b-a58c-8eb2704c2e60 tempest-VolumesTransfersTest-1809744573 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:22:02.230145 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2b650848-fd71-4c2b-a58c-8eb2704c2e60 tempest-VolumesTransfersTest-1809744573 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:22:02.230792 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2b650848-fd71-4c2b-a58c-8eb2704c2e60 tempest-VolumesTransfersTest-1809744573 None] Volume volume-87847c16-ad41-4f0c-b034-cec0a94d736b is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:22:02.246386 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2b650848-fd71-4c2b-a58c-8eb2704c2e60 tempest-VolumesTransfersTest-1809744573 None] deleting rbd volume volume-87847c16-ad41-4f0c-b034-cec0a94d736b {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:22:02.680171 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-2b650848-fd71-4c2b-a58c-8eb2704c2e60 tempest-VolumesTransfersTest-1809744573 None] Created reservations ['5b29144b-e483-4ed5-b2d5-1060bdd9ae0d', 'a5de385d-679b-4130-bc76-b76d42183609', 'afe9ec28-1ae5-41da-904e-293f1d5c2cee', '0a39fb4a-670f-4744-b0b5-ac297b9e2d69'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:22:02.750614 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2b650848-fd71-4c2b-a58c-8eb2704c2e60 tempest-VolumesTransfersTest-1809744573 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:22:02.788411 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2b650848-fd71-4c2b-a58c-8eb2704c2e60 tempest-VolumesTransfersTest-1809744573 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:22:02.841678 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-2b650848-fd71-4c2b-a58c-8eb2704c2e60 tempest-VolumesTransfersTest-1809744573 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:22:02.846652 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-2b650848-fd71-4c2b-a58c-8eb2704c2e60 tempest-VolumesTransfersTest-1809744573 None] Deleted volume successfully. Apr 09 21:22:02.865775 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-2b650848-fd71-4c2b-a58c-8eb2704c2e60 tempest-VolumesTransfersTest-1809744573 None] Lock "b'cinder-87847c16-ad41-4f0c-b034-cec0a94d736b-delete_volume'" released by "delete_volume" :: held 0.792s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:22:03.665361 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dd60e3d-3799-42e1-9185-bde097015b59 tempest-VolumesTransfersTest-1681990303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:22:03.692861 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1dd60e3d-3799-42e1-9185-bde097015b59 tempest-VolumesTransfersTest-1681990303 None] Flow 'volume_create_manager' (1ad463bd-a8d6-4a88-ac2e-0a6a87d195e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:22:03.701029 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1dd60e3d-3799-42e1-9185-bde097015b59 tempest-VolumesTransfersTest-1681990303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (685273a8-3314-431f-8db4-261442fb0751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:22:03.717491 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1dd60e3d-3799-42e1-9185-bde097015b59 tempest-VolumesTransfersTest-1681990303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (685273a8-3314-431f-8db4-261442fb0751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-932302394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=aed856c9-d8bf-4dfb-b379-3c3264c68230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='249211709ece485daf084a48fcbf819f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:22:04Z,use_quota=True,user_id='fdbc094dc029426799bf9d0e4903c5f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:22:03.723572 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1dd60e3d-3799-42e1-9185-bde097015b59 tempest-VolumesTransfersTest-1681990303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b55b193c-3b33-4995-9cb3-a4298c5a82cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:22:03.728222 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1dd60e3d-3799-42e1-9185-bde097015b59 tempest-VolumesTransfersTest-1681990303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b55b193c-3b33-4995-9cb3-a4298c5a82cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:22:03.733759 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1dd60e3d-3799-42e1-9185-bde097015b59 tempest-VolumesTransfersTest-1681990303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (700b2cb2-82e5-4f1e-be11-624b722f3c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:22:03.738236 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1dd60e3d-3799-42e1-9185-bde097015b59 tempest-VolumesTransfersTest-1681990303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (700b2cb2-82e5-4f1e-be11-624b722f3c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aed856c9-d8bf-4dfb-b379-3c3264c68230', 'volume_name': 'volume-aed856c9-d8bf-4dfb-b379-3c3264c68230', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:22:03.744486 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1dd60e3d-3799-42e1-9185-bde097015b59 tempest-VolumesTransfersTest-1681990303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10f48570-de39-4da0-97ae-4e7cb5b7bbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:22:03.750441 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1dd60e3d-3799-42e1-9185-bde097015b59 tempest-VolumesTransfersTest-1681990303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10f48570-de39-4da0-97ae-4e7cb5b7bbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:22:03.755592 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1dd60e3d-3799-42e1-9185-bde097015b59 tempest-VolumesTransfersTest-1681990303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81bed88-4644-4f05-b733-2d563b948bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:22:03.756931 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-1dd60e3d-3799-42e1-9185-bde097015b59 tempest-VolumesTransfersTest-1681990303 None] Volume aed856c9-d8bf-4dfb-b379-3c3264c68230: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aed856c9-d8bf-4dfb-b379-3c3264c68230', 'volume_size': 1} Apr 09 21:22:03.757551 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1dd60e3d-3799-42e1-9185-bde097015b59 tempest-VolumesTransfersTest-1681990303 None] creating volume 'volume-aed856c9-d8bf-4dfb-b379-3c3264c68230' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:22:03.758950 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1dd60e3d-3799-42e1-9185-bde097015b59 tempest-VolumesTransfersTest-1681990303 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:22:03.853213 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1dd60e3d-3799-42e1-9185-bde097015b59 tempest-VolumesTransfersTest-1681990303 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:22:03.854010 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1dd60e3d-3799-42e1-9185-bde097015b59 tempest-VolumesTransfersTest-1681990303 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:22:03.858823 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1dd60e3d-3799-42e1-9185-bde097015b59 tempest-VolumesTransfersTest-1681990303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81bed88-4644-4f05-b733-2d563b948bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aed856c9-d8bf-4dfb-b379-3c3264c68230', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:22:03.864248 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1dd60e3d-3799-42e1-9185-bde097015b59 tempest-VolumesTransfersTest-1681990303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56079a4b-3141-47e1-bae1-464e2371e63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:22:03.878185 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-1dd60e3d-3799-42e1-9185-bde097015b59 tempest-VolumesTransfersTest-1681990303 None] Volume volume-aed856c9-d8bf-4dfb-b379-3c3264c68230 (aed856c9-d8bf-4dfb-b379-3c3264c68230): created successfully Apr 09 21:22:03.886138 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1dd60e3d-3799-42e1-9185-bde097015b59 tempest-VolumesTransfersTest-1681990303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56079a4b-3141-47e1-bae1-464e2371e63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:22:03.893588 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1dd60e3d-3799-42e1-9185-bde097015b59 tempest-VolumesTransfersTest-1681990303 None] Flow 'volume_create_manager' (1ad463bd-a8d6-4a88-ac2e-0a6a87d195e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:22:03.913296 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-1dd60e3d-3799-42e1-9185-bde097015b59 tempest-VolumesTransfersTest-1681990303 None] Created volume successfully. Apr 09 21:22:05.208317 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-2b3b6918-f922-429c-aa8d-8f97dbd5d825 tempest-VolumesTransfersTest-1809744573 None] Lock "b'cinder-aed856c9-d8bf-4dfb-b379-3c3264c68230-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:22:05.270280 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2b3b6918-f922-429c-aa8d-8f97dbd5d825 tempest-VolumesTransfersTest-1809744573 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:22:05.359292 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2b3b6918-f922-429c-aa8d-8f97dbd5d825 tempest-VolumesTransfersTest-1809744573 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:22:05.359932 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2b3b6918-f922-429c-aa8d-8f97dbd5d825 tempest-VolumesTransfersTest-1809744573 None] Volume volume-aed856c9-d8bf-4dfb-b379-3c3264c68230 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:22:05.370191 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2b3b6918-f922-429c-aa8d-8f97dbd5d825 tempest-VolumesTransfersTest-1809744573 None] deleting rbd volume volume-aed856c9-d8bf-4dfb-b379-3c3264c68230 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:22:05.903690 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-2b3b6918-f922-429c-aa8d-8f97dbd5d825 tempest-VolumesTransfersTest-1809744573 None] Created reservations ['7e0a79ed-1493-4c66-9e9d-470ae6f52110', '6de0f800-4586-426f-88e8-d6456a684bbd', '4be7d770-e45a-4006-9595-29fbf01d2fee', 'dee42c32-480d-4a28-b1e7-a77ebb7286fb'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:22:06.000687 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2b3b6918-f922-429c-aa8d-8f97dbd5d825 tempest-VolumesTransfersTest-1809744573 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:22:06.069310 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2b3b6918-f922-429c-aa8d-8f97dbd5d825 tempest-VolumesTransfersTest-1809744573 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:22:06.156125 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-2b3b6918-f922-429c-aa8d-8f97dbd5d825 tempest-VolumesTransfersTest-1809744573 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:22:06.163900 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-2b3b6918-f922-429c-aa8d-8f97dbd5d825 tempest-VolumesTransfersTest-1809744573 None] Deleted volume successfully. Apr 09 21:22:06.190081 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-2b3b6918-f922-429c-aa8d-8f97dbd5d825 tempest-VolumesTransfersTest-1809744573 None] Lock "b'cinder-aed856c9-d8bf-4dfb-b379-3c3264c68230-delete_volume'" released by "delete_volume" :: held 0.975s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:22:13.699381 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-94c61658-dffe-48f2-8aa5-c0e4df865fbe tempest-VolumesActionsTest-9294775 None] Lock "b'cinder-db2ec7ab-1d3a-45f4-a177-692ddf69bf09'" acquired by "attach_volume" :: waited 0.017s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:22:13.891187 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-94c61658-dffe-48f2-8aa5-c0e4df865fbe tempest-VolumesActionsTest-9294775 None] Attaching volume db2ec7ab-1d3a-45f4-a177-692ddf69bf09 to instance a24543ae-98a2-4ec3-883a-199fa081976b at mountpoint /dev/sdb on host None. Apr 09 21:22:13.955520 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-94c61658-dffe-48f2-8aa5-c0e4df865fbe tempest-VolumesActionsTest-9294775 None] Attach volume completed successfully. Apr 09 21:22:13.960490 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-94c61658-dffe-48f2-8aa5-c0e4df865fbe tempest-VolumesActionsTest-9294775 None] Lock "b'cinder-db2ec7ab-1d3a-45f4-a177-692ddf69bf09'" released by "attach_volume" :: held 0.261s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:22:14.167216 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-a69dc602-841d-4799-ba97-57f4038b9505 tempest-VolumesActionsTest-9294775 None] Lock "b'cinder-db2ec7ab-1d3a-45f4-a177-692ddf69bf09-detach_volume'" acquired by "detach_volume" :: waited 0.031s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:22:14.167798 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-a69dc602-841d-4799-ba97-57f4038b9505 tempest-VolumesActionsTest-9294775 None] Detaching volume db2ec7ab-1d3a-45f4-a177-692ddf69bf09 from instance a24543ae-98a2-4ec3-883a-199fa081976b. Apr 09 21:22:14.241561 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-a69dc602-841d-4799-ba97-57f4038b9505 tempest-VolumesActionsTest-9294775 None] Detach volume completed successfully. Apr 09 21:22:14.249642 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-a69dc602-841d-4799-ba97-57f4038b9505 tempest-VolumesActionsTest-9294775 None] Lock "b'cinder-db2ec7ab-1d3a-45f4-a177-692ddf69bf09-detach_volume'" released by "detach_volume" :: held 0.082s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:22:14.646364 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2720fdf-995e-4027-a12f-1194fb1b46a6 tempest-VolumesBackupsV39Test-222054102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:22:14.674232 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d2720fdf-995e-4027-a12f-1194fb1b46a6 tempest-VolumesBackupsV39Test-222054102 None] Flow 'volume_create_manager' (bf1e4401-7d50-4fe2-86b7-53e8cc232a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:22:14.682317 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d2720fdf-995e-4027-a12f-1194fb1b46a6 tempest-VolumesBackupsV39Test-222054102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0118f41-dd08-4991-ab13-20f5547bb898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:22:14.699117 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d2720fdf-995e-4027-a12f-1194fb1b46a6 tempest-VolumesBackupsV39Test-222054102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0118f41-dd08-4991-ab13-20f5547bb898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Volume-1249670571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7fe19ff5-f30f-493a-bfb0-c7288094f340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3cd8a38803f4a8dbceba2c5a64f997f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:22:15Z,use_quota=True,user_id='dead4209e2844000bf7d563164daa14a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:22:14.705081 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d2720fdf-995e-4027-a12f-1194fb1b46a6 tempest-VolumesBackupsV39Test-222054102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2510454c-b528-4c29-8eba-4d3006f96df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:22:14.709749 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d2720fdf-995e-4027-a12f-1194fb1b46a6 tempest-VolumesBackupsV39Test-222054102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2510454c-b528-4c29-8eba-4d3006f96df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:22:14.715280 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d2720fdf-995e-4027-a12f-1194fb1b46a6 tempest-VolumesBackupsV39Test-222054102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d38ce25a-795c-4c4c-a634-09c06bbf8d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:22:14.720244 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d2720fdf-995e-4027-a12f-1194fb1b46a6 tempest-VolumesBackupsV39Test-222054102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d38ce25a-795c-4c4c-a634-09c06bbf8d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fe19ff5-f30f-493a-bfb0-c7288094f340', 'volume_name': 'volume-7fe19ff5-f30f-493a-bfb0-c7288094f340', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:22:14.730432 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d2720fdf-995e-4027-a12f-1194fb1b46a6 tempest-VolumesBackupsV39Test-222054102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc98f972-6c67-4e05-b8b1-0bf4d139d1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:22:14.744248 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d2720fdf-995e-4027-a12f-1194fb1b46a6 tempest-VolumesBackupsV39Test-222054102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc98f972-6c67-4e05-b8b1-0bf4d139d1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:22:14.754163 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d2720fdf-995e-4027-a12f-1194fb1b46a6 tempest-VolumesBackupsV39Test-222054102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13c846ff-7184-4810-a6fe-f797b6e292ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:22:14.755421 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-d2720fdf-995e-4027-a12f-1194fb1b46a6 tempest-VolumesBackupsV39Test-222054102 None] Volume 7fe19ff5-f30f-493a-bfb0-c7288094f340: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fe19ff5-f30f-493a-bfb0-c7288094f340', 'volume_size': 1} Apr 09 21:22:14.756355 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d2720fdf-995e-4027-a12f-1194fb1b46a6 tempest-VolumesBackupsV39Test-222054102 None] creating volume 'volume-7fe19ff5-f30f-493a-bfb0-c7288094f340' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:22:14.757432 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d2720fdf-995e-4027-a12f-1194fb1b46a6 tempest-VolumesBackupsV39Test-222054102 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:22:14.861966 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d2720fdf-995e-4027-a12f-1194fb1b46a6 tempest-VolumesBackupsV39Test-222054102 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:22:14.862672 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d2720fdf-995e-4027-a12f-1194fb1b46a6 tempest-VolumesBackupsV39Test-222054102 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:22:14.868162 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d2720fdf-995e-4027-a12f-1194fb1b46a6 tempest-VolumesBackupsV39Test-222054102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13c846ff-7184-4810-a6fe-f797b6e292ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fe19ff5-f30f-493a-bfb0-c7288094f340', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:22:14.873103 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d2720fdf-995e-4027-a12f-1194fb1b46a6 tempest-VolumesBackupsV39Test-222054102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fd79746-24fe-4aef-96a0-c953af17ec5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:22:14.896872 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-d2720fdf-995e-4027-a12f-1194fb1b46a6 tempest-VolumesBackupsV39Test-222054102 None] Volume volume-7fe19ff5-f30f-493a-bfb0-c7288094f340 (7fe19ff5-f30f-493a-bfb0-c7288094f340): created successfully Apr 09 21:22:14.902407 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d2720fdf-995e-4027-a12f-1194fb1b46a6 tempest-VolumesBackupsV39Test-222054102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fd79746-24fe-4aef-96a0-c953af17ec5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:22:14.908619 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d2720fdf-995e-4027-a12f-1194fb1b46a6 tempest-VolumesBackupsV39Test-222054102 None] Flow 'volume_create_manager' (bf1e4401-7d50-4fe2-86b7-53e8cc232a1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:22:14.920606 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-d2720fdf-995e-4027-a12f-1194fb1b46a6 tempest-VolumesBackupsV39Test-222054102 None] Created volume successfully. Apr 09 21:22:15.938481 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-31adc7ba-13b7-4c16-a1f3-45de6418986a tempest-VolumesBackupsV39Test-222054102 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-04-09T21:22:15Z,data_timestamp=2022-04-09T21:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Backup-401991413',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=857bb7fb-7e8d-4c05-ae48-7588cc36804c,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='b3cd8a38803f4a8dbceba2c5a64f997f',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='dead4209e2844000bf7d563164daa14a',volume_id=7fe19ff5-f30f-493a-bfb0-c7288094f340) Apr 09 21:22:15.939986 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.backup.rpcapi [None req-31adc7ba-13b7-4c16-a1f3-45de6418986a tempest-VolumesBackupsV39Test-222054102 None] continue_backup in rpcapi backup_id 857bb7fb-7e8d-4c05-ae48-7588cc36804c {{(pid=135002) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Apr 09 21:22:16.203776 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [None req-31adc7ba-13b7-4c16-a1f3-45de6418986a tempest-VolumesBackupsV39Test-222054102 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:22:17.061960 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [None req-31adc7ba-13b7-4c16-a1f3-45de6418986a tempest-VolumesBackupsV39Test-222054102 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.858s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:22:17.063007 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-31adc7ba-13b7-4c16-a1f3-45de6418986a tempest-VolumesBackupsV39Test-222054102 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7fe19ff5-f30f-493a-bfb0-c7288094f340', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': '7fe19ff5-f30f-493a-bfb0-c7288094f340', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:22:17.085246 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-31adc7ba-13b7-4c16-a1f3-45de6418986a tempest-VolumesBackupsV39Test-222054102 None] Initialize volume connection completed successfully. Apr 09 21:22:19.672540 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-31adc7ba-13b7-4c16-a1f3-45de6418986a tempest-VolumesBackupsV39Test-222054102 None] Terminate volume connection completed successfully. Apr 09 21:22:19.700383 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-31adc7ba-13b7-4c16-a1f3-45de6418986a tempest-VolumesBackupsV39Test-222054102 None] Remove volume export completed successfully. Apr 09 21:22:22.515292 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-125f03d7-80b7-40a4-b221-e47b08ab25fa tempest-VolumesBackupsV39Test-222054102 None] Lock "b'cinder-7fe19ff5-f30f-493a-bfb0-c7288094f340-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:22:22.566191 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-125f03d7-80b7-40a4-b221-e47b08ab25fa tempest-VolumesBackupsV39Test-222054102 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:22:23.570212 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-125f03d7-80b7-40a4-b221-e47b08ab25fa tempest-VolumesBackupsV39Test-222054102 None] Volume volume-7fe19ff5-f30f-493a-bfb0-c7288094f340 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:22:23.614883 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-125f03d7-80b7-40a4-b221-e47b08ab25fa tempest-VolumesBackupsV39Test-222054102 None] deleting rbd volume volume-7fe19ff5-f30f-493a-bfb0-c7288094f340 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:22:24.068710 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-125f03d7-80b7-40a4-b221-e47b08ab25fa tempest-VolumesBackupsV39Test-222054102 None] Created reservations ['c0b5e88f-bd0a-412e-8102-f8388003ddd3', 'b527f628-6c0c-437d-8cfb-d4d1732a0550', '1e9758e8-dc0d-43a1-909a-d49914b2fe86', '2e082466-10b9-442b-a864-1397e87501eb'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:22:24.142352 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-125f03d7-80b7-40a4-b221-e47b08ab25fa tempest-VolumesBackupsV39Test-222054102 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:22:24.172302 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-125f03d7-80b7-40a4-b221-e47b08ab25fa tempest-VolumesBackupsV39Test-222054102 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:22:24.201206 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-125f03d7-80b7-40a4-b221-e47b08ab25fa tempest-VolumesBackupsV39Test-222054102 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:22:24.205419 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-125f03d7-80b7-40a4-b221-e47b08ab25fa tempest-VolumesBackupsV39Test-222054102 None] Deleted volume successfully. Apr 09 21:22:24.220592 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-125f03d7-80b7-40a4-b221-e47b08ab25fa tempest-VolumesBackupsV39Test-222054102 None] Lock "b'cinder-7fe19ff5-f30f-493a-bfb0-c7288094f340-delete_volume'" released by "delete_volume" :: held 1.705s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:22:38.620328 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-d5076fb6-7988-4357-8467-131773632361 tempest-VolumesActionsTest-9294775 None] Lock "b'cinder-db2ec7ab-1d3a-45f4-a177-692ddf69bf09'" acquired by "attach_volume" :: waited 0.010s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:22:38.669935 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-d5076fb6-7988-4357-8467-131773632361 tempest-VolumesActionsTest-9294775 None] Attaching volume db2ec7ab-1d3a-45f4-a177-692ddf69bf09 to instance a0a8ce04-ceba-4fb0-9c00-50fcc75f6742 at mountpoint /dev/sdb on host None. Apr 09 21:22:38.707835 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-d5076fb6-7988-4357-8467-131773632361 tempest-VolumesActionsTest-9294775 None] Attach volume completed successfully. Apr 09 21:22:38.718686 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-d5076fb6-7988-4357-8467-131773632361 tempest-VolumesActionsTest-9294775 None] Lock "b'cinder-db2ec7ab-1d3a-45f4-a177-692ddf69bf09'" released by "attach_volume" :: held 0.098s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:22:38.893870 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-d580c295-6bf3-47c3-99fc-f752a229caf7 tempest-VolumesActionsTest-9294775 None] Lock "b'cinder-db2ec7ab-1d3a-45f4-a177-692ddf69bf09-detach_volume'" acquired by "detach_volume" :: waited 0.008s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:22:38.894353 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-d580c295-6bf3-47c3-99fc-f752a229caf7 tempest-VolumesActionsTest-9294775 None] Detaching volume db2ec7ab-1d3a-45f4-a177-692ddf69bf09 from instance a0a8ce04-ceba-4fb0-9c00-50fcc75f6742. Apr 09 21:22:38.934535 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-d580c295-6bf3-47c3-99fc-f752a229caf7 tempest-VolumesActionsTest-9294775 None] Detach volume completed successfully. Apr 09 21:22:38.941803 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-d580c295-6bf3-47c3-99fc-f752a229caf7 tempest-VolumesActionsTest-9294775 None] Lock "b'cinder-db2ec7ab-1d3a-45f4-a177-692ddf69bf09-detach_volume'" released by "detach_volume" :: held 0.048s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:22:44.003517 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [None req-11b6bf11-54c6-42bc-b3a2-07f082e34830 tempest-VolumesActionsTest-9294775 None] Running cmd (subprocess): rbd export --pool volumes volume-db2ec7ab-1d3a-45f4-a177-692ddf69bf09 /opt/stack/data/cinder/conversion/volume-db2ec7ab-1d3a-45f4-a177-692ddf69bf09-83144c46-9376-45ea-aed6-f741832166e1 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:22:44.629484 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [None req-11b6bf11-54c6-42bc-b3a2-07f082e34830 tempest-VolumesActionsTest-9294775 None] CMD "rbd export --pool volumes volume-db2ec7ab-1d3a-45f4-a177-692ddf69bf09 /opt/stack/data/cinder/conversion/volume-db2ec7ab-1d3a-45f4-a177-692ddf69bf09-83144c46-9376-45ea-aed6-f741832166e1 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.625s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:22:44.640780 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.image_utils [None req-11b6bf11-54c6-42bc-b3a2-07f082e34830 tempest-VolumesActionsTest-9294775 None] 83144c46-9376-45ea-aed6-f741832166e1 was raw, no need to convert to raw {{(pid=135002) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:815}} Apr 09 21:22:49.997647 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:22:50.000294 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:22:50.065361 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:22:50.100348 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:23:08.632476 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-11b6bf11-54c6-42bc-b3a2-07f082e34830 tempest-VolumesActionsTest-9294775 None] Uploaded volume to glance image-id: 83144c46-9376-45ea-aed6-f741832166e1. {{(pid=135002) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1745}} Apr 09 21:23:08.651272 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-11b6bf11-54c6-42bc-b3a2-07f082e34830 tempest-VolumesActionsTest-9294775 None] Copy volume to image completed successfully. Apr 09 21:23:09.724759 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-9afb031e-1342-4f97-b725-e46e98cf05c2 tempest-VolumesActionsTest-9294775 None] Lock "b'cinder-db2ec7ab-1d3a-45f4-a177-692ddf69bf09-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:23:09.769682 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9afb031e-1342-4f97-b725-e46e98cf05c2 tempest-VolumesActionsTest-9294775 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:23:09.810482 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9afb031e-1342-4f97-b725-e46e98cf05c2 tempest-VolumesActionsTest-9294775 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:23:09.810931 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9afb031e-1342-4f97-b725-e46e98cf05c2 tempest-VolumesActionsTest-9294775 None] Volume volume-db2ec7ab-1d3a-45f4-a177-692ddf69bf09 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:23:09.820697 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9afb031e-1342-4f97-b725-e46e98cf05c2 tempest-VolumesActionsTest-9294775 None] deleting rbd volume volume-db2ec7ab-1d3a-45f4-a177-692ddf69bf09 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:23:10.136677 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-9afb031e-1342-4f97-b725-e46e98cf05c2 tempest-VolumesActionsTest-9294775 None] Created reservations ['a9e45759-1825-4af8-a07b-fae55c441d2b', '4b0fb824-9ca4-4d66-a61a-164ddbfd1825', '2b19109d-2479-4956-8df1-a661822cea00', '359b5b4b-3209-4d47-bf9f-1595093ac5ba'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:23:10.192261 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9afb031e-1342-4f97-b725-e46e98cf05c2 tempest-VolumesActionsTest-9294775 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:23:10.223578 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9afb031e-1342-4f97-b725-e46e98cf05c2 tempest-VolumesActionsTest-9294775 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:23:10.258196 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-9afb031e-1342-4f97-b725-e46e98cf05c2 tempest-VolumesActionsTest-9294775 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:23:10.263439 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-9afb031e-1342-4f97-b725-e46e98cf05c2 tempest-VolumesActionsTest-9294775 None] Deleted volume successfully. Apr 09 21:23:10.282097 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-9afb031e-1342-4f97-b725-e46e98cf05c2 tempest-VolumesActionsTest-9294775 None] Lock "b'cinder-db2ec7ab-1d3a-45f4-a177-692ddf69bf09-delete_volume'" released by "delete_volume" :: held 0.557s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:23:18.629745 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-7239e9f4-c2dd-4c32-8d6a-9c15d0ee9294 tempest-GroupsV314Test-694496638 None] Group tempest-GroupsV314Test-Group-702979755: creating Apr 09 21:23:18.646750 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-7239e9f4-c2dd-4c32-8d6a-9c15d0ee9294 tempest-GroupsV314Test-694496638 None] Group tempest-GroupsV314Test-Group-702979755: created successfully Apr 09 21:23:18.655876 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-7239e9f4-c2dd-4c32-8d6a-9c15d0ee9294 tempest-GroupsV314Test-694496638 None] Create group completed successfully. Apr 09 21:23:20.012485 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-aadc62c0-c752-45d6-83bf-b95010331b78 tempest-GroupsV314Test-694496638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:23:20.032311 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-aadc62c0-c752-45d6-83bf-b95010331b78 tempest-GroupsV314Test-694496638 None] Flow 'volume_create_manager' (9a7d51ff-c0d8-4feb-a8a1-01cea4173901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:23:20.038899 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-aadc62c0-c752-45d6-83bf-b95010331b78 tempest-GroupsV314Test-694496638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd2a317c-add2-434f-917a-3a66c095426b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:23:20.055196 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-aadc62c0-c752-45d6-83bf-b95010331b78 tempest-GroupsV314Test-694496638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd2a317c-add2-434f-917a-3a66c095426b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsV314Test-Volume-2056707324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=138a2082-26b1-4a83-8e49-0af65452db05,host='ncdv-master-1@ceph#ceph',id=cfbaf8a1-8b48-426e-a9df-7daee1b792fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e174490470347b2876f545c2ba2f532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:23:20Z,use_quota=True,user_id='1d04f26ec3c247adb0a62145486c496b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68cfac78-b784-42ef-9eca-836d69328068),volume_type_id=68cfac78-b784-42ef-9eca-836d69328068)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:23:20.060926 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-aadc62c0-c752-45d6-83bf-b95010331b78 tempest-GroupsV314Test-694496638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abf1f5d-5ab7-4299-a63b-71447b0f2f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:23:20.065165 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-aadc62c0-c752-45d6-83bf-b95010331b78 tempest-GroupsV314Test-694496638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abf1f5d-5ab7-4299-a63b-71447b0f2f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:23:20.070280 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-aadc62c0-c752-45d6-83bf-b95010331b78 tempest-GroupsV314Test-694496638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c052123-587e-4cc2-a8c9-1b0b5970b6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:23:20.074362 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-aadc62c0-c752-45d6-83bf-b95010331b78 tempest-GroupsV314Test-694496638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c052123-587e-4cc2-a8c9-1b0b5970b6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfbaf8a1-8b48-426e-a9df-7daee1b792fd', 'volume_name': 'volume-cfbaf8a1-8b48-426e-a9df-7daee1b792fd', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:23:20.079328 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-aadc62c0-c752-45d6-83bf-b95010331b78 tempest-GroupsV314Test-694496638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3656449-debd-4bb5-8dce-feb80953951f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:23:20.083236 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-aadc62c0-c752-45d6-83bf-b95010331b78 tempest-GroupsV314Test-694496638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3656449-debd-4bb5-8dce-feb80953951f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:23:20.088001 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-aadc62c0-c752-45d6-83bf-b95010331b78 tempest-GroupsV314Test-694496638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3947b007-20a0-483d-a53f-6d0fcfd07b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:23:20.089142 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-aadc62c0-c752-45d6-83bf-b95010331b78 tempest-GroupsV314Test-694496638 None] Volume cfbaf8a1-8b48-426e-a9df-7daee1b792fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfbaf8a1-8b48-426e-a9df-7daee1b792fd', 'volume_size': 1} Apr 09 21:23:20.089515 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-aadc62c0-c752-45d6-83bf-b95010331b78 tempest-GroupsV314Test-694496638 None] creating volume 'volume-cfbaf8a1-8b48-426e-a9df-7daee1b792fd' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:23:20.090335 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-aadc62c0-c752-45d6-83bf-b95010331b78 tempest-GroupsV314Test-694496638 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:23:20.154587 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-aadc62c0-c752-45d6-83bf-b95010331b78 tempest-GroupsV314Test-694496638 None] extra_specs: {} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:23:20.154956 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-aadc62c0-c752-45d6-83bf-b95010331b78 tempest-GroupsV314Test-694496638 None] extra_specs: {} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:23:20.159165 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-aadc62c0-c752-45d6-83bf-b95010331b78 tempest-GroupsV314Test-694496638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3947b007-20a0-483d-a53f-6d0fcfd07b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfbaf8a1-8b48-426e-a9df-7daee1b792fd', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:23:20.163851 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-aadc62c0-c752-45d6-83bf-b95010331b78 tempest-GroupsV314Test-694496638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6680687-799c-4f02-9b76-a051ea4898ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:23:20.175792 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-aadc62c0-c752-45d6-83bf-b95010331b78 tempest-GroupsV314Test-694496638 None] Volume volume-cfbaf8a1-8b48-426e-a9df-7daee1b792fd (cfbaf8a1-8b48-426e-a9df-7daee1b792fd): created successfully Apr 09 21:23:20.179530 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-aadc62c0-c752-45d6-83bf-b95010331b78 tempest-GroupsV314Test-694496638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6680687-799c-4f02-9b76-a051ea4898ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:23:20.185220 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-aadc62c0-c752-45d6-83bf-b95010331b78 tempest-GroupsV314Test-694496638 None] Flow 'volume_create_manager' (9a7d51ff-c0d8-4feb-a8a1-01cea4173901) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:23:20.195403 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-aadc62c0-c752-45d6-83bf-b95010331b78 tempest-GroupsV314Test-694496638 None] Created volume successfully. Apr 09 21:23:21.582857 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-60c6594a-22e2-4f2c-a26b-d92b364cae80 tempest-GroupsV314Test-694496638 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:23:21.650103 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-60c6594a-22e2-4f2c-a26b-d92b364cae80 tempest-GroupsV314Test-694496638 None] creating snapshot='volume-03411416-dc48-41f7-a706-a16de7d28b55.clone_snap' {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Apr 09 21:23:22.567333 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-60c6594a-22e2-4f2c-a26b-d92b364cae80 tempest-GroupsV314Test-694496638 None] cloning 'volume-cfbaf8a1-8b48-426e-a9df-7daee1b792fd@volume-03411416-dc48-41f7-a706-a16de7d28b55.clone_snap' to 'volume-03411416-dc48-41f7-a706-a16de7d28b55' {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Apr 09 21:23:22.696343 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-60c6594a-22e2-4f2c-a26b-d92b364cae80 tempest-GroupsV314Test-694496638 None] Volume volume-cfbaf8a1-8b48-426e-a9df-7daee1b792fd is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:23:22.712072 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-60c6594a-22e2-4f2c-a26b-d92b364cae80 tempest-GroupsV314Test-694496638 None] extra_specs: {} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:23:22.712593 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-60c6594a-22e2-4f2c-a26b-d92b364cae80 tempest-GroupsV314Test-694496638 None] extra_specs: {} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:23:22.738298 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-60c6594a-22e2-4f2c-a26b-d92b364cae80 tempest-GroupsV314Test-694496638 None] clone created successfully {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Apr 09 21:23:22.810248 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-60c6594a-22e2-4f2c-a26b-d92b364cae80 tempest-GroupsV314Test-694496638 None] Create group from source-group-138a2082-26b1-4a83-8e49-0af65452db05 completed successfully. Apr 09 21:23:23.152368 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-30df9e61-a741-4dd8-9567-bd583fa339e5 tempest-GroupsV314Test-694496638 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:23:23.245755 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-30df9e61-a741-4dd8-9567-bd583fa339e5 tempest-GroupsV314Test-694496638 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:23:23.260412 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-30df9e61-a741-4dd8-9567-bd583fa339e5 tempest-GroupsV314Test-694496638 None] deleting rbd volume volume-03411416-dc48-41f7-a706-a16de7d28b55 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:23:23.557863 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-30df9e61-a741-4dd8-9567-bd583fa339e5 tempest-GroupsV314Test-694496638 None] volume is a clone so cleaning references {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Apr 09 21:23:23.581625 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-30df9e61-a741-4dd8-9567-bd583fa339e5 tempest-GroupsV314Test-694496638 None] Volume volume-cfbaf8a1-8b48-426e-a9df-7daee1b792fd is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:23:23.582138 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-30df9e61-a741-4dd8-9567-bd583fa339e5 tempest-GroupsV314Test-694496638 None] deleting parent snapshot volume-03411416-dc48-41f7-a706-a16de7d28b55.clone_snap {{(pid=135002) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Apr 09 21:23:24.656455 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-30df9e61-a741-4dd8-9567-bd583fa339e5 tempest-GroupsV314Test-694496638 None] Created reservations ['d48ddf92-67b8-4cae-9e9e-64d1ce565caa'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:23:24.674738 ncdv-master-1 cinder-volume[135002]: WARNING cinder.quota [None req-30df9e61-a741-4dd8-9567-bd583fa339e5 tempest-GroupsV314Test-694496638 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2024767375 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2024767375, it is now deprecated. Please use the default quota class for default quota. Apr 09 21:23:24.675440 ncdv-master-1 cinder-volume[135002]: WARNING cinder.quota [None req-30df9e61-a741-4dd8-9567-bd583fa339e5 tempest-GroupsV314Test-694496638 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2024767375 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2024767375, it is now deprecated. Please use the default quota class for default quota. Apr 09 21:23:24.693255 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-30df9e61-a741-4dd8-9567-bd583fa339e5 tempest-GroupsV314Test-694496638 None] Created reservations ['95f5c713-7d5c-46c4-8def-a158cd901b43', '1a7e9b3f-b775-49b4-9021-3500054f5d71', '72f1d09e-0a56-4e0a-816e-0efcdbef1e3e', '702c0793-505a-4dba-b6cf-880c83d3dc19'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:23:24.791454 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-30df9e61-a741-4dd8-9567-bd583fa339e5 tempest-GroupsV314Test-694496638 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:23:24.831652 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-30df9e61-a741-4dd8-9567-bd583fa339e5 tempest-GroupsV314Test-694496638 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:23:24.876041 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-30df9e61-a741-4dd8-9567-bd583fa339e5 tempest-GroupsV314Test-694496638 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:23:24.880497 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-30df9e61-a741-4dd8-9567-bd583fa339e5 tempest-GroupsV314Test-694496638 None] Delete group completed successfully. Apr 09 21:23:25.830204 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1bde19ae-dc02-426f-86b9-f7d59a206d5b tempest-GroupsV314Test-694496638 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:23:25.896842 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1bde19ae-dc02-426f-86b9-f7d59a206d5b tempest-GroupsV314Test-694496638 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:23:25.897390 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1bde19ae-dc02-426f-86b9-f7d59a206d5b tempest-GroupsV314Test-694496638 None] Volume volume-cfbaf8a1-8b48-426e-a9df-7daee1b792fd is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:23:25.905350 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1bde19ae-dc02-426f-86b9-f7d59a206d5b tempest-GroupsV314Test-694496638 None] deleting rbd volume volume-cfbaf8a1-8b48-426e-a9df-7daee1b792fd {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:23:26.228755 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-1bde19ae-dc02-426f-86b9-f7d59a206d5b tempest-GroupsV314Test-694496638 None] Created reservations ['20126159-dd8a-4ea1-893d-8240ba8db5af'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:23:26.271731 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-1bde19ae-dc02-426f-86b9-f7d59a206d5b tempest-GroupsV314Test-694496638 None] Created reservations ['d8e29b72-4941-4482-9b86-808f2e943a19', 'a3fb5f2a-bd99-439c-a0d4-22b4c7cd58b4', '3bce2d00-1de3-439e-b0f8-4b15a2e9e7c9', '611b77e8-b6df-4038-8a3f-171b033c525b'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:23:26.364635 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1bde19ae-dc02-426f-86b9-f7d59a206d5b tempest-GroupsV314Test-694496638 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:23:26.398186 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1bde19ae-dc02-426f-86b9-f7d59a206d5b tempest-GroupsV314Test-694496638 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:23:26.428966 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-1bde19ae-dc02-426f-86b9-f7d59a206d5b tempest-GroupsV314Test-694496638 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:23:26.433130 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-1bde19ae-dc02-426f-86b9-f7d59a206d5b tempest-GroupsV314Test-694496638 None] Delete group completed successfully. Apr 09 21:23:30.642067 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c1c9ac9-fcfa-44ee-a86a-045e3b5d99a3 tempest-VolumesServicesTestJSON-651752633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:23:30.661418 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5c1c9ac9-fcfa-44ee-a86a-045e3b5d99a3 tempest-VolumesServicesTestJSON-651752633 None] Flow 'volume_create_manager' (acfb4304-49d9-4aca-a48f-55eacd10db2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:23:30.668063 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5c1c9ac9-fcfa-44ee-a86a-045e3b5d99a3 tempest-VolumesServicesTestJSON-651752633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (996d2bdb-733b-4289-8158-c7a5dc78a516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:23:30.683461 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5c1c9ac9-fcfa-44ee-a86a-045e3b5d99a3 tempest-VolumesServicesTestJSON-651752633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (996d2bdb-733b-4289-8158-c7a5dc78a516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:23:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-956349669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=21fed23f-4b47-4ccf-b838-27f6d886e74b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96d107dccfe94099bf6209223bd3e4d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:23:31Z,use_quota=True,user_id='6ab957527fdc48f58b239b5755cc3084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:23:30.688896 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5c1c9ac9-fcfa-44ee-a86a-045e3b5d99a3 tempest-VolumesServicesTestJSON-651752633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603e85c7-f930-4a7a-8072-b8bbeb9651e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:23:30.693130 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5c1c9ac9-fcfa-44ee-a86a-045e3b5d99a3 tempest-VolumesServicesTestJSON-651752633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603e85c7-f930-4a7a-8072-b8bbeb9651e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:23:30.698316 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5c1c9ac9-fcfa-44ee-a86a-045e3b5d99a3 tempest-VolumesServicesTestJSON-651752633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e4841ff-1e2b-4639-8c19-d860210aa6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:23:30.702647 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5c1c9ac9-fcfa-44ee-a86a-045e3b5d99a3 tempest-VolumesServicesTestJSON-651752633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e4841ff-1e2b-4639-8c19-d860210aa6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21fed23f-4b47-4ccf-b838-27f6d886e74b', 'volume_name': 'volume-21fed23f-4b47-4ccf-b838-27f6d886e74b', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:23:30.707536 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5c1c9ac9-fcfa-44ee-a86a-045e3b5d99a3 tempest-VolumesServicesTestJSON-651752633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e655bc1-cbee-4fda-a6a0-83edafee060e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:23:30.711507 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5c1c9ac9-fcfa-44ee-a86a-045e3b5d99a3 tempest-VolumesServicesTestJSON-651752633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e655bc1-cbee-4fda-a6a0-83edafee060e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:23:30.716287 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5c1c9ac9-fcfa-44ee-a86a-045e3b5d99a3 tempest-VolumesServicesTestJSON-651752633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48d9eeb2-cb89-4693-9678-9103c34827b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:23:30.717726 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-5c1c9ac9-fcfa-44ee-a86a-045e3b5d99a3 tempest-VolumesServicesTestJSON-651752633 None] Volume 21fed23f-4b47-4ccf-b838-27f6d886e74b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21fed23f-4b47-4ccf-b838-27f6d886e74b', 'volume_size': 1} Apr 09 21:23:30.718114 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5c1c9ac9-fcfa-44ee-a86a-045e3b5d99a3 tempest-VolumesServicesTestJSON-651752633 None] creating volume 'volume-21fed23f-4b47-4ccf-b838-27f6d886e74b' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:23:30.718886 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5c1c9ac9-fcfa-44ee-a86a-045e3b5d99a3 tempest-VolumesServicesTestJSON-651752633 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:23:30.792703 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5c1c9ac9-fcfa-44ee-a86a-045e3b5d99a3 tempest-VolumesServicesTestJSON-651752633 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:23:30.793125 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5c1c9ac9-fcfa-44ee-a86a-045e3b5d99a3 tempest-VolumesServicesTestJSON-651752633 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:23:30.796970 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5c1c9ac9-fcfa-44ee-a86a-045e3b5d99a3 tempest-VolumesServicesTestJSON-651752633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48d9eeb2-cb89-4693-9678-9103c34827b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21fed23f-4b47-4ccf-b838-27f6d886e74b', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:23:30.801750 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5c1c9ac9-fcfa-44ee-a86a-045e3b5d99a3 tempest-VolumesServicesTestJSON-651752633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf4f112-f097-476e-bed8-c5c47cb731c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:23:30.812297 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-5c1c9ac9-fcfa-44ee-a86a-045e3b5d99a3 tempest-VolumesServicesTestJSON-651752633 None] Volume volume-21fed23f-4b47-4ccf-b838-27f6d886e74b (21fed23f-4b47-4ccf-b838-27f6d886e74b): created successfully Apr 09 21:23:30.816138 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5c1c9ac9-fcfa-44ee-a86a-045e3b5d99a3 tempest-VolumesServicesTestJSON-651752633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf4f112-f097-476e-bed8-c5c47cb731c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:23:30.821781 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5c1c9ac9-fcfa-44ee-a86a-045e3b5d99a3 tempest-VolumesServicesTestJSON-651752633 None] Flow 'volume_create_manager' (acfb4304-49d9-4aca-a48f-55eacd10db2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:23:30.830874 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-5c1c9ac9-fcfa-44ee-a86a-045e3b5d99a3 tempest-VolumesServicesTestJSON-651752633 None] Created volume successfully. Apr 09 21:23:31.799305 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-ee37555b-45e0-4942-a495-73d0fc0e9000 tempest-VolumesServicesTestJSON-651752633 None] Lock "b'cinder-21fed23f-4b47-4ccf-b838-27f6d886e74b-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:23:31.831222 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ee37555b-45e0-4942-a495-73d0fc0e9000 tempest-VolumesServicesTestJSON-651752633 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:23:31.872833 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ee37555b-45e0-4942-a495-73d0fc0e9000 tempest-VolumesServicesTestJSON-651752633 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:23:31.873300 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ee37555b-45e0-4942-a495-73d0fc0e9000 tempest-VolumesServicesTestJSON-651752633 None] Volume volume-21fed23f-4b47-4ccf-b838-27f6d886e74b is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:23:31.880729 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ee37555b-45e0-4942-a495-73d0fc0e9000 tempest-VolumesServicesTestJSON-651752633 None] deleting rbd volume volume-21fed23f-4b47-4ccf-b838-27f6d886e74b {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:23:32.146652 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-ee37555b-45e0-4942-a495-73d0fc0e9000 tempest-VolumesServicesTestJSON-651752633 None] Created reservations ['b4ca1a78-1322-4456-8e20-204374d054aa', '73625192-486d-4ccc-8583-8093bceafd88', 'c6905efc-65d3-49c0-82e5-2224372f2bef', '4b6e9c50-9f1b-4d3f-8737-4b6b2bc71a5f'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:23:32.190451 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ee37555b-45e0-4942-a495-73d0fc0e9000 tempest-VolumesServicesTestJSON-651752633 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:23:32.224920 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ee37555b-45e0-4942-a495-73d0fc0e9000 tempest-VolumesServicesTestJSON-651752633 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:23:32.250723 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-ee37555b-45e0-4942-a495-73d0fc0e9000 tempest-VolumesServicesTestJSON-651752633 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:23:32.255467 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-ee37555b-45e0-4942-a495-73d0fc0e9000 tempest-VolumesServicesTestJSON-651752633 None] Deleted volume successfully. Apr 09 21:23:32.271701 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-ee37555b-45e0-4942-a495-73d0fc0e9000 tempest-VolumesServicesTestJSON-651752633 None] Lock "b'cinder-21fed23f-4b47-4ccf-b838-27f6d886e74b-delete_volume'" released by "delete_volume" :: held 0.472s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:23:36.067381 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-8988c73f-0982-4b35-b2d3-cdf2cfae4cf5 tempest-VolumeTypesTest-1221711505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:23:36.086395 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8988c73f-0982-4b35-b2d3-cdf2cfae4cf5 tempest-VolumeTypesTest-1221711505 None] Flow 'volume_create_manager' (aa94ca41-4a0a-4190-9d60-9a2358a4bdbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:23:36.093354 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8988c73f-0982-4b35-b2d3-cdf2cfae4cf5 tempest-VolumeTypesTest-1221711505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10fa14e6-e93e-434d-9d69-9c55fdff3c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:23:36.108718 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8988c73f-0982-4b35-b2d3-cdf2cfae4cf5 tempest-VolumeTypesTest-1221711505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10fa14e6-e93e-434d-9d69-9c55fdff3c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-97810299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fb72669b-7694-4239-982a-63577848a9c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9651a59ae5d34821a7d10afe8a88a22d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:23:36Z,use_quota=True,user_id='218441e922cc491c9f3f0746bd50bae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47799264-66c5-46c2-a465-fb86fc47f44f),volume_type_id=47799264-66c5-46c2-a465-fb86fc47f44f)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:23:36.114315 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8988c73f-0982-4b35-b2d3-cdf2cfae4cf5 tempest-VolumeTypesTest-1221711505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b41418e7-f20c-446b-bbb6-d13842fc2980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:23:36.118525 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8988c73f-0982-4b35-b2d3-cdf2cfae4cf5 tempest-VolumeTypesTest-1221711505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b41418e7-f20c-446b-bbb6-d13842fc2980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:23:36.123746 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8988c73f-0982-4b35-b2d3-cdf2cfae4cf5 tempest-VolumeTypesTest-1221711505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (275620b9-ae3b-45b9-b7a5-d8aa8e102ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:23:36.127815 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8988c73f-0982-4b35-b2d3-cdf2cfae4cf5 tempest-VolumeTypesTest-1221711505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (275620b9-ae3b-45b9-b7a5-d8aa8e102ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb72669b-7694-4239-982a-63577848a9c6', 'volume_name': 'volume-fb72669b-7694-4239-982a-63577848a9c6', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:23:36.133020 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8988c73f-0982-4b35-b2d3-cdf2cfae4cf5 tempest-VolumeTypesTest-1221711505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3bb3717-1024-44e0-a98e-6b2d657b8372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:23:36.137572 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8988c73f-0982-4b35-b2d3-cdf2cfae4cf5 tempest-VolumeTypesTest-1221711505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3bb3717-1024-44e0-a98e-6b2d657b8372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:23:36.142311 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8988c73f-0982-4b35-b2d3-cdf2cfae4cf5 tempest-VolumeTypesTest-1221711505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2801f9f9-e294-4e3c-a083-664f22a3522f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:23:36.143367 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-8988c73f-0982-4b35-b2d3-cdf2cfae4cf5 tempest-VolumeTypesTest-1221711505 None] Volume fb72669b-7694-4239-982a-63577848a9c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb72669b-7694-4239-982a-63577848a9c6', 'volume_size': 1} Apr 09 21:23:36.143753 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-8988c73f-0982-4b35-b2d3-cdf2cfae4cf5 tempest-VolumeTypesTest-1221711505 None] creating volume 'volume-fb72669b-7694-4239-982a-63577848a9c6' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:23:36.144543 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-8988c73f-0982-4b35-b2d3-cdf2cfae4cf5 tempest-VolumeTypesTest-1221711505 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:23:36.208987 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-8988c73f-0982-4b35-b2d3-cdf2cfae4cf5 tempest-VolumeTypesTest-1221711505 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:23:36.209389 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-8988c73f-0982-4b35-b2d3-cdf2cfae4cf5 tempest-VolumeTypesTest-1221711505 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:23:36.213247 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8988c73f-0982-4b35-b2d3-cdf2cfae4cf5 tempest-VolumeTypesTest-1221711505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2801f9f9-e294-4e3c-a083-664f22a3522f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb72669b-7694-4239-982a-63577848a9c6', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:23:36.218254 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8988c73f-0982-4b35-b2d3-cdf2cfae4cf5 tempest-VolumeTypesTest-1221711505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f93cdf5-09d2-4f7e-ad8a-818ef014fedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:23:36.230576 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-8988c73f-0982-4b35-b2d3-cdf2cfae4cf5 tempest-VolumeTypesTest-1221711505 None] Volume volume-fb72669b-7694-4239-982a-63577848a9c6 (fb72669b-7694-4239-982a-63577848a9c6): created successfully Apr 09 21:23:36.234246 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8988c73f-0982-4b35-b2d3-cdf2cfae4cf5 tempest-VolumeTypesTest-1221711505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f93cdf5-09d2-4f7e-ad8a-818ef014fedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:23:36.239741 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8988c73f-0982-4b35-b2d3-cdf2cfae4cf5 tempest-VolumeTypesTest-1221711505 None] Flow 'volume_create_manager' (aa94ca41-4a0a-4190-9d60-9a2358a4bdbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:23:36.250716 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-8988c73f-0982-4b35-b2d3-cdf2cfae4cf5 tempest-VolumeTypesTest-1221711505 None] Created volume successfully. Apr 09 21:23:37.340664 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-0f491c88-085c-48ec-8ccb-03d0ceb68a0e tempest-VolumeTypesTest-1221711505 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:23:37.363046 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-0f491c88-085c-48ec-8ccb-03d0ceb68a0e tempest-VolumeTypesTest-1221711505 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:23:37.387144 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-0f491c88-085c-48ec-8ccb-03d0ceb68a0e tempest-VolumeTypesTest-1221711505 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:23:37.391357 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-0f491c88-085c-48ec-8ccb-03d0ceb68a0e tempest-VolumeTypesTest-1221711505 None] Retype volume completed successfully. Apr 09 21:23:39.239244 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-28a336c7-1e49-4929-9c63-a2a2efc789a2 tempest-VolumeTypesTest-1221711505 None] Lock "b'cinder-fb72669b-7694-4239-982a-63577848a9c6-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:23:39.269327 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-28a336c7-1e49-4929-9c63-a2a2efc789a2 tempest-VolumeTypesTest-1221711505 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:23:39.309344 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-28a336c7-1e49-4929-9c63-a2a2efc789a2 tempest-VolumeTypesTest-1221711505 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:23:39.309765 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-28a336c7-1e49-4929-9c63-a2a2efc789a2 tempest-VolumeTypesTest-1221711505 None] Volume volume-fb72669b-7694-4239-982a-63577848a9c6 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:23:39.317386 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-28a336c7-1e49-4929-9c63-a2a2efc789a2 tempest-VolumeTypesTest-1221711505 None] deleting rbd volume volume-fb72669b-7694-4239-982a-63577848a9c6 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:23:39.554958 ncdv-master-1 cinder-volume[135002]: WARNING cinder.quota [None req-28a336c7-1e49-4929-9c63-a2a2efc789a2 tempest-VolumeTypesTest-1221711505 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesTest-volume-type-193587447 is set by the default quota flag: quota_volumes_tempest-VolumeTypesTest-volume-type-193587447, it is now deprecated. Please use the default quota class for default quota. Apr 09 21:23:39.555666 ncdv-master-1 cinder-volume[135002]: WARNING cinder.quota [None req-28a336c7-1e49-4929-9c63-a2a2efc789a2 tempest-VolumeTypesTest-1221711505 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesTest-volume-type-193587447 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesTest-volume-type-193587447, it is now deprecated. Please use the default quota class for default quota. Apr 09 21:23:39.573016 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-28a336c7-1e49-4929-9c63-a2a2efc789a2 tempest-VolumeTypesTest-1221711505 None] Created reservations ['490438cd-f5b4-4a04-a35b-4dcee856f00d', '23e0a8fa-da63-451d-8f06-d497ce5f5c78', '77e99bc7-e011-488b-b914-757f8be08b6e', '118516d1-b540-4067-8856-2da11cb9cd75'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:23:39.622870 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-28a336c7-1e49-4929-9c63-a2a2efc789a2 tempest-VolumeTypesTest-1221711505 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:23:39.646953 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-28a336c7-1e49-4929-9c63-a2a2efc789a2 tempest-VolumeTypesTest-1221711505 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:23:39.669765 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-28a336c7-1e49-4929-9c63-a2a2efc789a2 tempest-VolumeTypesTest-1221711505 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:23:39.673573 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-28a336c7-1e49-4929-9c63-a2a2efc789a2 tempest-VolumeTypesTest-1221711505 None] Deleted volume successfully. Apr 09 21:23:39.686944 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-28a336c7-1e49-4929-9c63-a2a2efc789a2 tempest-VolumeTypesTest-1221711505 None] Lock "b'cinder-fb72669b-7694-4239-982a-63577848a9c6-delete_volume'" released by "delete_volume" :: held 0.448s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:23:43.418734 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4e18a2b-6f3c-43cf-bfff-6bc385df8f58 tempest-VolumesBackupsAdminTest-673043516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:23:43.437523 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a4e18a2b-6f3c-43cf-bfff-6bc385df8f58 tempest-VolumesBackupsAdminTest-673043516 None] Flow 'volume_create_manager' (baae6b88-fa84-44da-9203-b0f186412c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:23:43.444075 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a4e18a2b-6f3c-43cf-bfff-6bc385df8f58 tempest-VolumesBackupsAdminTest-673043516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (853ad160-811b-431a-a918-1761d4c09a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:23:43.460000 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a4e18a2b-6f3c-43cf-bfff-6bc385df8f58 tempest-VolumesBackupsAdminTest-673043516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (853ad160-811b-431a-a918-1761d4c09a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-809238698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ad4054d0-75a9-4219-b2d3-841907154627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7346ba2c9aef4d22ae03e0fa2bd3e7e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:23:43Z,use_quota=True,user_id='f417c3f302d54800921c418c34e3d694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:23:43.465519 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a4e18a2b-6f3c-43cf-bfff-6bc385df8f58 tempest-VolumesBackupsAdminTest-673043516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e83b15-1a80-4b83-b723-ded36a718b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:23:43.470163 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a4e18a2b-6f3c-43cf-bfff-6bc385df8f58 tempest-VolumesBackupsAdminTest-673043516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e83b15-1a80-4b83-b723-ded36a718b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:23:43.475368 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a4e18a2b-6f3c-43cf-bfff-6bc385df8f58 tempest-VolumesBackupsAdminTest-673043516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73b29807-ca5f-43d7-9a88-a6d7fa495aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:23:43.479490 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a4e18a2b-6f3c-43cf-bfff-6bc385df8f58 tempest-VolumesBackupsAdminTest-673043516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73b29807-ca5f-43d7-9a88-a6d7fa495aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad4054d0-75a9-4219-b2d3-841907154627', 'volume_name': 'volume-ad4054d0-75a9-4219-b2d3-841907154627', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:23:43.484592 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a4e18a2b-6f3c-43cf-bfff-6bc385df8f58 tempest-VolumesBackupsAdminTest-673043516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c4c948d-89a3-45a8-bd38-89ecf2b522b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:23:43.488529 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a4e18a2b-6f3c-43cf-bfff-6bc385df8f58 tempest-VolumesBackupsAdminTest-673043516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c4c948d-89a3-45a8-bd38-89ecf2b522b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:23:43.493429 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a4e18a2b-6f3c-43cf-bfff-6bc385df8f58 tempest-VolumesBackupsAdminTest-673043516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (342c3e0e-c1e4-4d86-8412-702e3beaa130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:23:43.494473 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-a4e18a2b-6f3c-43cf-bfff-6bc385df8f58 tempest-VolumesBackupsAdminTest-673043516 None] Volume ad4054d0-75a9-4219-b2d3-841907154627: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad4054d0-75a9-4219-b2d3-841907154627', 'volume_size': 1} Apr 09 21:23:43.494893 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a4e18a2b-6f3c-43cf-bfff-6bc385df8f58 tempest-VolumesBackupsAdminTest-673043516 None] creating volume 'volume-ad4054d0-75a9-4219-b2d3-841907154627' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:23:43.495683 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a4e18a2b-6f3c-43cf-bfff-6bc385df8f58 tempest-VolumesBackupsAdminTest-673043516 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:23:43.559856 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a4e18a2b-6f3c-43cf-bfff-6bc385df8f58 tempest-VolumesBackupsAdminTest-673043516 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:23:43.560226 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a4e18a2b-6f3c-43cf-bfff-6bc385df8f58 tempest-VolumesBackupsAdminTest-673043516 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:23:43.564257 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a4e18a2b-6f3c-43cf-bfff-6bc385df8f58 tempest-VolumesBackupsAdminTest-673043516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (342c3e0e-c1e4-4d86-8412-702e3beaa130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad4054d0-75a9-4219-b2d3-841907154627', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:23:43.568937 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a4e18a2b-6f3c-43cf-bfff-6bc385df8f58 tempest-VolumesBackupsAdminTest-673043516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae393a7d-2791-4898-8a67-66ee113a59f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:23:43.581182 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-a4e18a2b-6f3c-43cf-bfff-6bc385df8f58 tempest-VolumesBackupsAdminTest-673043516 None] Volume volume-ad4054d0-75a9-4219-b2d3-841907154627 (ad4054d0-75a9-4219-b2d3-841907154627): created successfully Apr 09 21:23:43.584629 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a4e18a2b-6f3c-43cf-bfff-6bc385df8f58 tempest-VolumesBackupsAdminTest-673043516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae393a7d-2791-4898-8a67-66ee113a59f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:23:43.590152 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a4e18a2b-6f3c-43cf-bfff-6bc385df8f58 tempest-VolumesBackupsAdminTest-673043516 None] Flow 'volume_create_manager' (baae6b88-fa84-44da-9203-b0f186412c69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:23:43.600806 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-a4e18a2b-6f3c-43cf-bfff-6bc385df8f58 tempest-VolumesBackupsAdminTest-673043516 None] Created volume successfully. Apr 09 21:23:44.599583 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-d88ec2f7-a473-49b4-a5ca-144f169a6e68 tempest-VolumesBackupsAdminTest-673043516 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-04-09T21:23:44Z,data_timestamp=2022-04-09T21:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-1326047191',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=ac0a6725-6e9b-4166-94fc-8c69738477b5,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='7346ba2c9aef4d22ae03e0fa2bd3e7e1',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='f417c3f302d54800921c418c34e3d694',volume_id=ad4054d0-75a9-4219-b2d3-841907154627) Apr 09 21:23:44.600284 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.backup.rpcapi [None req-d88ec2f7-a473-49b4-a5ca-144f169a6e68 tempest-VolumesBackupsAdminTest-673043516 None] continue_backup in rpcapi backup_id ac0a6725-6e9b-4166-94fc-8c69738477b5 {{(pid=135002) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Apr 09 21:23:44.724764 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [None req-d88ec2f7-a473-49b4-a5ca-144f169a6e68 tempest-VolumesBackupsAdminTest-673043516 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:23:45.409459 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [None req-d88ec2f7-a473-49b4-a5ca-144f169a6e68 tempest-VolumesBackupsAdminTest-673043516 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.684s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:23:45.410451 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d88ec2f7-a473-49b4-a5ca-144f169a6e68 tempest-VolumesBackupsAdminTest-673043516 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ad4054d0-75a9-4219-b2d3-841907154627', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': 'ad4054d0-75a9-4219-b2d3-841907154627', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:23:45.426079 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-d88ec2f7-a473-49b4-a5ca-144f169a6e68 tempest-VolumesBackupsAdminTest-673043516 None] Initialize volume connection completed successfully. Apr 09 21:23:47.029684 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-d88ec2f7-a473-49b4-a5ca-144f169a6e68 tempest-VolumesBackupsAdminTest-673043516 None] Terminate volume connection completed successfully. Apr 09 21:23:47.045360 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-d88ec2f7-a473-49b4-a5ca-144f169a6e68 tempest-VolumesBackupsAdminTest-673043516 None] Remove volume export completed successfully. Apr 09 21:23:49.461741 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8ff5f5c-59cc-4611-8109-82a24ce2dc1f tempest-VolumesBackupsAdminTest-673043516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:23:49.485273 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a8ff5f5c-59cc-4611-8109-82a24ce2dc1f tempest-VolumesBackupsAdminTest-673043516 None] Flow 'volume_create_manager' (7e9fba65-1fc3-44df-a5b5-99c940a4295d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:23:49.492233 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a8ff5f5c-59cc-4611-8109-82a24ce2dc1f tempest-VolumesBackupsAdminTest-673043516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77fcfc2a-697d-4684-83ce-bbe2fd0e1457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:23:49.510111 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a8ff5f5c-59cc-4611-8109-82a24ce2dc1f tempest-VolumesBackupsAdminTest-673043516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77fcfc2a-697d-4684-83ce-bbe2fd0e1457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:23:49Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_ac0a6725-6e9b-4166-94fc-8c69738477b5',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a6e6c23b-1f26-4f8e-8459-4296e8b8847f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7346ba2c9aef4d22ae03e0fa2bd3e7e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:23:49Z,use_quota=True,user_id='f417c3f302d54800921c418c34e3d694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:23:49.515708 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a8ff5f5c-59cc-4611-8109-82a24ce2dc1f tempest-VolumesBackupsAdminTest-673043516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ed3dc51-86ba-4985-b330-bc94ef84c926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:23:49.519909 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a8ff5f5c-59cc-4611-8109-82a24ce2dc1f tempest-VolumesBackupsAdminTest-673043516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ed3dc51-86ba-4985-b330-bc94ef84c926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:23:49.525141 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a8ff5f5c-59cc-4611-8109-82a24ce2dc1f tempest-VolumesBackupsAdminTest-673043516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26fba2b1-825f-4984-b04b-d493ef3e4b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:23:49.529205 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a8ff5f5c-59cc-4611-8109-82a24ce2dc1f tempest-VolumesBackupsAdminTest-673043516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26fba2b1-825f-4984-b04b-d493ef3e4b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6e6c23b-1f26-4f8e-8459-4296e8b8847f', 'volume_name': 'volume-a6e6c23b-1f26-4f8e-8459-4296e8b8847f', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:23:49.534203 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a8ff5f5c-59cc-4611-8109-82a24ce2dc1f tempest-VolumesBackupsAdminTest-673043516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (442b52f5-88dd-4a9c-ae86-51d5ca7ccf74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:23:49.538443 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a8ff5f5c-59cc-4611-8109-82a24ce2dc1f tempest-VolumesBackupsAdminTest-673043516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (442b52f5-88dd-4a9c-ae86-51d5ca7ccf74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:23:49.543165 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a8ff5f5c-59cc-4611-8109-82a24ce2dc1f tempest-VolumesBackupsAdminTest-673043516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a1454b9-3f95-4e81-a33a-5b9fb700102b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:23:49.544269 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-a8ff5f5c-59cc-4611-8109-82a24ce2dc1f tempest-VolumesBackupsAdminTest-673043516 None] Volume a6e6c23b-1f26-4f8e-8459-4296e8b8847f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6e6c23b-1f26-4f8e-8459-4296e8b8847f', 'volume_size': 1} Apr 09 21:23:49.544658 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a8ff5f5c-59cc-4611-8109-82a24ce2dc1f tempest-VolumesBackupsAdminTest-673043516 None] creating volume 'volume-a6e6c23b-1f26-4f8e-8459-4296e8b8847f' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:23:49.545892 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a8ff5f5c-59cc-4611-8109-82a24ce2dc1f tempest-VolumesBackupsAdminTest-673043516 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:23:49.607743 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a8ff5f5c-59cc-4611-8109-82a24ce2dc1f tempest-VolumesBackupsAdminTest-673043516 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:23:49.608154 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a8ff5f5c-59cc-4611-8109-82a24ce2dc1f tempest-VolumesBackupsAdminTest-673043516 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:23:49.612078 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a8ff5f5c-59cc-4611-8109-82a24ce2dc1f tempest-VolumesBackupsAdminTest-673043516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a1454b9-3f95-4e81-a33a-5b9fb700102b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6e6c23b-1f26-4f8e-8459-4296e8b8847f', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:23:49.616751 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a8ff5f5c-59cc-4611-8109-82a24ce2dc1f tempest-VolumesBackupsAdminTest-673043516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f75a49b-3bcb-4255-b46f-e81e7f36a295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:23:49.628409 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-a8ff5f5c-59cc-4611-8109-82a24ce2dc1f tempest-VolumesBackupsAdminTest-673043516 None] Volume volume-a6e6c23b-1f26-4f8e-8459-4296e8b8847f (a6e6c23b-1f26-4f8e-8459-4296e8b8847f): created successfully Apr 09 21:23:49.632177 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a8ff5f5c-59cc-4611-8109-82a24ce2dc1f tempest-VolumesBackupsAdminTest-673043516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f75a49b-3bcb-4255-b46f-e81e7f36a295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:23:49.637853 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a8ff5f5c-59cc-4611-8109-82a24ce2dc1f tempest-VolumesBackupsAdminTest-673043516 None] Flow 'volume_create_manager' (7e9fba65-1fc3-44df-a5b5-99c940a4295d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:23:49.649150 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-a8ff5f5c-59cc-4611-8109-82a24ce2dc1f tempest-VolumesBackupsAdminTest-673043516 None] Created volume successfully. Apr 09 21:23:49.986368 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:23:49.987135 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:23:50.016525 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:23:50.040909 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:23:50.493539 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [None req-a8ff5f5c-59cc-4611-8109-82a24ce2dc1f tempest-VolumesBackupsAdminTest-673043516 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:23:51.122304 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [None req-a8ff5f5c-59cc-4611-8109-82a24ce2dc1f tempest-VolumesBackupsAdminTest-673043516 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.628s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:23:51.123547 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a8ff5f5c-59cc-4611-8109-82a24ce2dc1f tempest-VolumesBackupsAdminTest-673043516 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a6e6c23b-1f26-4f8e-8459-4296e8b8847f', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': 'a6e6c23b-1f26-4f8e-8459-4296e8b8847f', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:23:51.140183 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-a8ff5f5c-59cc-4611-8109-82a24ce2dc1f tempest-VolumesBackupsAdminTest-673043516 None] Initialize volume connection completed successfully. Apr 09 21:23:52.122273 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-a8ff5f5c-59cc-4611-8109-82a24ce2dc1f tempest-VolumesBackupsAdminTest-673043516 None] Terminate volume connection completed successfully. Apr 09 21:23:52.139000 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-a8ff5f5c-59cc-4611-8109-82a24ce2dc1f tempest-VolumesBackupsAdminTest-673043516 None] Remove volume export completed successfully. Apr 09 21:23:52.677429 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-4f10a075-bfa0-4052-9631-4bc84c43a47e tempest-VolumesBackupsAdminTest-673043516 None] Lock "b'cinder-a6e6c23b-1f26-4f8e-8459-4296e8b8847f-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:23:52.736199 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-4f10a075-bfa0-4052-9631-4bc84c43a47e tempest-VolumesBackupsAdminTest-673043516 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:23:53.008155 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-4f10a075-bfa0-4052-9631-4bc84c43a47e tempest-VolumesBackupsAdminTest-673043516 None] Volume volume-a6e6c23b-1f26-4f8e-8459-4296e8b8847f is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:23:53.037096 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-4f10a075-bfa0-4052-9631-4bc84c43a47e tempest-VolumesBackupsAdminTest-673043516 None] deleting rbd volume volume-a6e6c23b-1f26-4f8e-8459-4296e8b8847f {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:23:53.315809 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-4f10a075-bfa0-4052-9631-4bc84c43a47e tempest-VolumesBackupsAdminTest-673043516 None] Created reservations ['f7b86fd6-b36c-4e1e-95c4-acbaa51eafb0', '1c69dc92-470b-48f4-94d4-5b8534cd1d98', '1552d149-0bec-4cf5-be70-805e22b444b3', '2f263209-97e2-45c3-aa95-026ba395992c'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:23:53.368860 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-4f10a075-bfa0-4052-9631-4bc84c43a47e tempest-VolumesBackupsAdminTest-673043516 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:23:53.390953 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-4f10a075-bfa0-4052-9631-4bc84c43a47e tempest-VolumesBackupsAdminTest-673043516 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:23:53.412998 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-4f10a075-bfa0-4052-9631-4bc84c43a47e tempest-VolumesBackupsAdminTest-673043516 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:23:53.416970 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-4f10a075-bfa0-4052-9631-4bc84c43a47e tempest-VolumesBackupsAdminTest-673043516 None] Deleted volume successfully. Apr 09 21:23:53.429756 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-4f10a075-bfa0-4052-9631-4bc84c43a47e tempest-VolumesBackupsAdminTest-673043516 None] Lock "b'cinder-a6e6c23b-1f26-4f8e-8459-4296e8b8847f-delete_volume'" released by "delete_volume" :: held 0.752s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:23:55.189714 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-74450c25-d6c2-4630-b543-3116a6b48a1b tempest-VolumesBackupsAdminTest-673043516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:23:55.212481 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-74450c25-d6c2-4630-b543-3116a6b48a1b tempest-VolumesBackupsAdminTest-673043516 None] Flow 'volume_create_manager' (36d3229b-54e0-4d3f-9086-5ae96d788af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:23:55.221716 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-74450c25-d6c2-4630-b543-3116a6b48a1b tempest-VolumesBackupsAdminTest-673043516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42ac066c-a943-4127-99b2-3e27854b7979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:23:55.243179 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-74450c25-d6c2-4630-b543-3116a6b48a1b tempest-VolumesBackupsAdminTest-673043516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42ac066c-a943-4127-99b2-3e27854b7979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-296110364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=476106a5-8968-4546-bada-3beb55b5e27a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7346ba2c9aef4d22ae03e0fa2bd3e7e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:23:55Z,use_quota=True,user_id='f417c3f302d54800921c418c34e3d694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:23:55.260619 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-74450c25-d6c2-4630-b543-3116a6b48a1b tempest-VolumesBackupsAdminTest-673043516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14241c3e-4451-40f9-b714-4c39e978e866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:23:55.265145 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-74450c25-d6c2-4630-b543-3116a6b48a1b tempest-VolumesBackupsAdminTest-673043516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14241c3e-4451-40f9-b714-4c39e978e866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:23:55.271728 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-74450c25-d6c2-4630-b543-3116a6b48a1b tempest-VolumesBackupsAdminTest-673043516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89b3fe10-57fc-4606-b946-588c1cd7ce83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:23:55.276128 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-74450c25-d6c2-4630-b543-3116a6b48a1b tempest-VolumesBackupsAdminTest-673043516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89b3fe10-57fc-4606-b946-588c1cd7ce83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '476106a5-8968-4546-bada-3beb55b5e27a', 'volume_name': 'volume-476106a5-8968-4546-bada-3beb55b5e27a', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:23:55.281702 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-74450c25-d6c2-4630-b543-3116a6b48a1b tempest-VolumesBackupsAdminTest-673043516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e63b54b1-87da-441d-8a23-28c78737f848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:23:55.285843 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-74450c25-d6c2-4630-b543-3116a6b48a1b tempest-VolumesBackupsAdminTest-673043516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e63b54b1-87da-441d-8a23-28c78737f848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:23:55.290877 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-74450c25-d6c2-4630-b543-3116a6b48a1b tempest-VolumesBackupsAdminTest-673043516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57f3f1a9-e99c-41be-bc3a-0ddec76de213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:23:55.292011 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-74450c25-d6c2-4630-b543-3116a6b48a1b tempest-VolumesBackupsAdminTest-673043516 None] Volume 476106a5-8968-4546-bada-3beb55b5e27a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-476106a5-8968-4546-bada-3beb55b5e27a', 'volume_size': 1} Apr 09 21:23:55.292412 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-74450c25-d6c2-4630-b543-3116a6b48a1b tempest-VolumesBackupsAdminTest-673043516 None] creating volume 'volume-476106a5-8968-4546-bada-3beb55b5e27a' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:23:55.293259 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-74450c25-d6c2-4630-b543-3116a6b48a1b tempest-VolumesBackupsAdminTest-673043516 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:23:55.387766 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-74450c25-d6c2-4630-b543-3116a6b48a1b tempest-VolumesBackupsAdminTest-673043516 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:23:55.391514 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-74450c25-d6c2-4630-b543-3116a6b48a1b tempest-VolumesBackupsAdminTest-673043516 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:23:55.395478 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-74450c25-d6c2-4630-b543-3116a6b48a1b tempest-VolumesBackupsAdminTest-673043516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57f3f1a9-e99c-41be-bc3a-0ddec76de213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-476106a5-8968-4546-bada-3beb55b5e27a', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:23:55.400121 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-74450c25-d6c2-4630-b543-3116a6b48a1b tempest-VolumesBackupsAdminTest-673043516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (638f64bf-cf2e-4807-9335-3590ae238727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:23:55.409705 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-74450c25-d6c2-4630-b543-3116a6b48a1b tempest-VolumesBackupsAdminTest-673043516 None] Volume volume-476106a5-8968-4546-bada-3beb55b5e27a (476106a5-8968-4546-bada-3beb55b5e27a): created successfully Apr 09 21:23:55.413354 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-74450c25-d6c2-4630-b543-3116a6b48a1b tempest-VolumesBackupsAdminTest-673043516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (638f64bf-cf2e-4807-9335-3590ae238727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:23:55.418874 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-74450c25-d6c2-4630-b543-3116a6b48a1b tempest-VolumesBackupsAdminTest-673043516 None] Flow 'volume_create_manager' (36d3229b-54e0-4d3f-9086-5ae96d788af8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:23:55.428533 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-74450c25-d6c2-4630-b543-3116a6b48a1b tempest-VolumesBackupsAdminTest-673043516 None] Created volume successfully. Apr 09 21:23:56.379025 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-105f73d4-aca4-41d5-b3d8-5c6ebacfa49e tempest-VolumesBackupsAdminTest-673043516 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-04-09T21:23:56Z,data_timestamp=2022-04-09T21:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-611943603',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=362e602c-e158-4b11-8c15-4ae47070396e,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='7346ba2c9aef4d22ae03e0fa2bd3e7e1',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='f417c3f302d54800921c418c34e3d694',volume_id=476106a5-8968-4546-bada-3beb55b5e27a) Apr 09 21:23:56.379892 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.backup.rpcapi [None req-105f73d4-aca4-41d5-b3d8-5c6ebacfa49e tempest-VolumesBackupsAdminTest-673043516 None] continue_backup in rpcapi backup_id 362e602c-e158-4b11-8c15-4ae47070396e {{(pid=135002) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Apr 09 21:23:56.510076 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [None req-105f73d4-aca4-41d5-b3d8-5c6ebacfa49e tempest-VolumesBackupsAdminTest-673043516 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:23:57.177821 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [None req-105f73d4-aca4-41d5-b3d8-5c6ebacfa49e tempest-VolumesBackupsAdminTest-673043516 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.667s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:23:57.178815 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-105f73d4-aca4-41d5-b3d8-5c6ebacfa49e tempest-VolumesBackupsAdminTest-673043516 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-476106a5-8968-4546-bada-3beb55b5e27a', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': '476106a5-8968-4546-bada-3beb55b5e27a', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:23:57.193999 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-105f73d4-aca4-41d5-b3d8-5c6ebacfa49e tempest-VolumesBackupsAdminTest-673043516 None] Initialize volume connection completed successfully. Apr 09 21:23:58.801156 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-105f73d4-aca4-41d5-b3d8-5c6ebacfa49e tempest-VolumesBackupsAdminTest-673043516 None] Terminate volume connection completed successfully. Apr 09 21:23:58.816812 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-105f73d4-aca4-41d5-b3d8-5c6ebacfa49e tempest-VolumesBackupsAdminTest-673043516 None] Remove volume export completed successfully. Apr 09 21:24:01.743182 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-9ed85195-e76e-4fb6-a844-f390f1b1dae0 tempest-VolumesBackupsAdminTest-673043516 None] Lock "b'cinder-476106a5-8968-4546-bada-3beb55b5e27a-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:24:01.782181 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9ed85195-e76e-4fb6-a844-f390f1b1dae0 tempest-VolumesBackupsAdminTest-673043516 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:24:02.663745 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9ed85195-e76e-4fb6-a844-f390f1b1dae0 tempest-VolumesBackupsAdminTest-673043516 None] Volume volume-476106a5-8968-4546-bada-3beb55b5e27a is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:24:02.680932 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9ed85195-e76e-4fb6-a844-f390f1b1dae0 tempest-VolumesBackupsAdminTest-673043516 None] deleting rbd volume volume-476106a5-8968-4546-bada-3beb55b5e27a {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:24:02.936812 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-9ed85195-e76e-4fb6-a844-f390f1b1dae0 tempest-VolumesBackupsAdminTest-673043516 None] Created reservations ['449c5a5c-a3cb-4ffa-af61-4695337c8f27', 'd1c89d21-a66f-4a56-9ef0-8f83a954a047', '9495431a-1e43-4bb8-a898-ba0e10bb0042', 'e2ce88a3-1fb6-4976-b767-3257a516d8ed'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:24:02.983434 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9ed85195-e76e-4fb6-a844-f390f1b1dae0 tempest-VolumesBackupsAdminTest-673043516 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:24:03.014911 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9ed85195-e76e-4fb6-a844-f390f1b1dae0 tempest-VolumesBackupsAdminTest-673043516 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:24:03.040159 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-9ed85195-e76e-4fb6-a844-f390f1b1dae0 tempest-VolumesBackupsAdminTest-673043516 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:24:03.044454 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-9ed85195-e76e-4fb6-a844-f390f1b1dae0 tempest-VolumesBackupsAdminTest-673043516 None] Deleted volume successfully. Apr 09 21:24:03.058146 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-9ed85195-e76e-4fb6-a844-f390f1b1dae0 tempest-VolumesBackupsAdminTest-673043516 None] Lock "b'cinder-476106a5-8968-4546-bada-3beb55b5e27a-delete_volume'" released by "delete_volume" :: held 1.315s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:24:03.940737 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-944bb302-591d-41fc-95e2-94758c820471 tempest-VolumesBackupsAdminTest-673043516 None] Lock "b'cinder-ad4054d0-75a9-4219-b2d3-841907154627-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:24:03.972415 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-944bb302-591d-41fc-95e2-94758c820471 tempest-VolumesBackupsAdminTest-673043516 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:24:04.725191 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-944bb302-591d-41fc-95e2-94758c820471 tempest-VolumesBackupsAdminTest-673043516 None] Volume volume-ad4054d0-75a9-4219-b2d3-841907154627 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:24:04.754430 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-944bb302-591d-41fc-95e2-94758c820471 tempest-VolumesBackupsAdminTest-673043516 None] deleting rbd volume volume-ad4054d0-75a9-4219-b2d3-841907154627 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:24:05.064865 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-944bb302-591d-41fc-95e2-94758c820471 tempest-VolumesBackupsAdminTest-673043516 None] Created reservations ['77ff755e-5190-4992-8373-a50d2d411569', '39e70b1b-f959-499d-b015-7c2435d5da66', 'fcec07c1-88b8-48a8-aba9-56fe12815907', '156dd34a-4a3c-4a07-bd1c-bfc8bae505b0'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:24:05.122105 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-944bb302-591d-41fc-95e2-94758c820471 tempest-VolumesBackupsAdminTest-673043516 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:24:05.176910 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-944bb302-591d-41fc-95e2-94758c820471 tempest-VolumesBackupsAdminTest-673043516 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:24:05.228543 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-944bb302-591d-41fc-95e2-94758c820471 tempest-VolumesBackupsAdminTest-673043516 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:24:05.234955 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-944bb302-591d-41fc-95e2-94758c820471 tempest-VolumesBackupsAdminTest-673043516 None] Deleted volume successfully. Apr 09 21:24:05.256843 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-944bb302-591d-41fc-95e2-94758c820471 tempest-VolumesBackupsAdminTest-673043516 None] Lock "b'cinder-ad4054d0-75a9-4219-b2d3-841907154627-delete_volume'" released by "delete_volume" :: held 1.311s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:24:09.106202 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-21464767-f1d4-423b-968f-cf1f6a2c3a37 tempest-VolumesListAdminTestJSON-568420067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:24:09.126537 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-21464767-f1d4-423b-968f-cf1f6a2c3a37 tempest-VolumesListAdminTestJSON-568420067 None] Flow 'volume_create_manager' (dce34854-969b-4955-9e0c-ace7a5a0f8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:24:09.133192 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-21464767-f1d4-423b-968f-cf1f6a2c3a37 tempest-VolumesListAdminTestJSON-568420067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12521969-93e0-4dfb-a9f9-5343c62d15e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:24:09.148766 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-21464767-f1d4-423b-968f-cf1f6a2c3a37 tempest-VolumesListAdminTestJSON-568420067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12521969-93e0-4dfb-a9f9-5343c62d15e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1168743905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a8f03391-fa2e-4d5f-8392-405c7bc9f0c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd8288163d81458486ce15654fed24e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:24:09Z,use_quota=True,user_id='e0ccd1099d6a4b148674add41fe48f28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:24:09.154572 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-21464767-f1d4-423b-968f-cf1f6a2c3a37 tempest-VolumesListAdminTestJSON-568420067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebe533ae-1f6c-4862-8a94-fe88dba6363c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:24:09.159373 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-21464767-f1d4-423b-968f-cf1f6a2c3a37 tempest-VolumesListAdminTestJSON-568420067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebe533ae-1f6c-4862-8a94-fe88dba6363c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:24:09.164914 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-21464767-f1d4-423b-968f-cf1f6a2c3a37 tempest-VolumesListAdminTestJSON-568420067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a0ed998-ca30-420f-9fdb-58da5e094169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:24:09.169014 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-21464767-f1d4-423b-968f-cf1f6a2c3a37 tempest-VolumesListAdminTestJSON-568420067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a0ed998-ca30-420f-9fdb-58da5e094169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8f03391-fa2e-4d5f-8392-405c7bc9f0c4', 'volume_name': 'volume-a8f03391-fa2e-4d5f-8392-405c7bc9f0c4', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:24:09.174001 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-21464767-f1d4-423b-968f-cf1f6a2c3a37 tempest-VolumesListAdminTestJSON-568420067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f5736c3-d70a-4807-8f3a-1c9054ef1009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:24:09.177930 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-21464767-f1d4-423b-968f-cf1f6a2c3a37 tempest-VolumesListAdminTestJSON-568420067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f5736c3-d70a-4807-8f3a-1c9054ef1009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:24:09.182845 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-21464767-f1d4-423b-968f-cf1f6a2c3a37 tempest-VolumesListAdminTestJSON-568420067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26fb467d-c9ed-4388-8274-ffd7de06af5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:24:09.184074 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-21464767-f1d4-423b-968f-cf1f6a2c3a37 tempest-VolumesListAdminTestJSON-568420067 None] Volume a8f03391-fa2e-4d5f-8392-405c7bc9f0c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8f03391-fa2e-4d5f-8392-405c7bc9f0c4', 'volume_size': 1} Apr 09 21:24:09.184646 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-21464767-f1d4-423b-968f-cf1f6a2c3a37 tempest-VolumesListAdminTestJSON-568420067 None] creating volume 'volume-a8f03391-fa2e-4d5f-8392-405c7bc9f0c4' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:24:09.185615 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-21464767-f1d4-423b-968f-cf1f6a2c3a37 tempest-VolumesListAdminTestJSON-568420067 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:24:09.264009 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-21464767-f1d4-423b-968f-cf1f6a2c3a37 tempest-VolumesListAdminTestJSON-568420067 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:24:09.264615 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-21464767-f1d4-423b-968f-cf1f6a2c3a37 tempest-VolumesListAdminTestJSON-568420067 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:24:09.268435 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-21464767-f1d4-423b-968f-cf1f6a2c3a37 tempest-VolumesListAdminTestJSON-568420067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26fb467d-c9ed-4388-8274-ffd7de06af5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8f03391-fa2e-4d5f-8392-405c7bc9f0c4', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:24:09.273455 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-21464767-f1d4-423b-968f-cf1f6a2c3a37 tempest-VolumesListAdminTestJSON-568420067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f652d437-ad74-48f1-a912-dcb2b2877afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:24:09.283416 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-21464767-f1d4-423b-968f-cf1f6a2c3a37 tempest-VolumesListAdminTestJSON-568420067 None] Volume volume-a8f03391-fa2e-4d5f-8392-405c7bc9f0c4 (a8f03391-fa2e-4d5f-8392-405c7bc9f0c4): created successfully Apr 09 21:24:09.287914 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-21464767-f1d4-423b-968f-cf1f6a2c3a37 tempest-VolumesListAdminTestJSON-568420067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f652d437-ad74-48f1-a912-dcb2b2877afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:24:09.293607 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-21464767-f1d4-423b-968f-cf1f6a2c3a37 tempest-VolumesListAdminTestJSON-568420067 None] Flow 'volume_create_manager' (dce34854-969b-4955-9e0c-ace7a5a0f8c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:24:09.303948 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-21464767-f1d4-423b-968f-cf1f6a2c3a37 tempest-VolumesListAdminTestJSON-568420067 None] Created volume successfully. Apr 09 21:24:10.511810 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c5318db-a560-4fc5-902d-8207a98b7826 tempest-VolumesListAdminTestJSON-568420067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:24:10.531708 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-4c5318db-a560-4fc5-902d-8207a98b7826 tempest-VolumesListAdminTestJSON-568420067 None] Flow 'volume_create_manager' (dfc77859-b08c-485d-9942-b6cf6b7399aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:24:10.539523 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-4c5318db-a560-4fc5-902d-8207a98b7826 tempest-VolumesListAdminTestJSON-568420067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc0f951-d7a9-4993-80d5-6a7512eaac65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:24:10.560385 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-4c5318db-a560-4fc5-902d-8207a98b7826 tempest-VolumesListAdminTestJSON-568420067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc0f951-d7a9-4993-80d5-6a7512eaac65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1037730938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=23c2890d-3dcf-4226-8806-eaadf696abe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd8288163d81458486ce15654fed24e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:24:10Z,use_quota=True,user_id='e0ccd1099d6a4b148674add41fe48f28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:24:10.566978 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-4c5318db-a560-4fc5-902d-8207a98b7826 tempest-VolumesListAdminTestJSON-568420067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94b9956b-f8e5-4e4e-9599-c90a0f90d8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:24:10.572044 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-4c5318db-a560-4fc5-902d-8207a98b7826 tempest-VolumesListAdminTestJSON-568420067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94b9956b-f8e5-4e4e-9599-c90a0f90d8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:24:10.579064 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-4c5318db-a560-4fc5-902d-8207a98b7826 tempest-VolumesListAdminTestJSON-568420067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39b497b5-16d5-4e4d-9de0-17bc172ad10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:24:10.584087 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-4c5318db-a560-4fc5-902d-8207a98b7826 tempest-VolumesListAdminTestJSON-568420067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39b497b5-16d5-4e4d-9de0-17bc172ad10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23c2890d-3dcf-4226-8806-eaadf696abe0', 'volume_name': 'volume-23c2890d-3dcf-4226-8806-eaadf696abe0', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:24:10.589763 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-4c5318db-a560-4fc5-902d-8207a98b7826 tempest-VolumesListAdminTestJSON-568420067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94d9e814-05df-4dd1-a15f-7d2f2597b8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:24:10.594147 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-4c5318db-a560-4fc5-902d-8207a98b7826 tempest-VolumesListAdminTestJSON-568420067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94d9e814-05df-4dd1-a15f-7d2f2597b8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:24:10.598982 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-4c5318db-a560-4fc5-902d-8207a98b7826 tempest-VolumesListAdminTestJSON-568420067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99886442-cf10-4bc3-84a4-ab6269b4ff3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:24:10.600117 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-4c5318db-a560-4fc5-902d-8207a98b7826 tempest-VolumesListAdminTestJSON-568420067 None] Volume 23c2890d-3dcf-4226-8806-eaadf696abe0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23c2890d-3dcf-4226-8806-eaadf696abe0', 'volume_size': 1} Apr 09 21:24:10.600455 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-4c5318db-a560-4fc5-902d-8207a98b7826 tempest-VolumesListAdminTestJSON-568420067 None] creating volume 'volume-23c2890d-3dcf-4226-8806-eaadf696abe0' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:24:10.601161 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-4c5318db-a560-4fc5-902d-8207a98b7826 tempest-VolumesListAdminTestJSON-568420067 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:24:10.663400 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-4c5318db-a560-4fc5-902d-8207a98b7826 tempest-VolumesListAdminTestJSON-568420067 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:24:10.664132 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-4c5318db-a560-4fc5-902d-8207a98b7826 tempest-VolumesListAdminTestJSON-568420067 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:24:10.668443 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-4c5318db-a560-4fc5-902d-8207a98b7826 tempest-VolumesListAdminTestJSON-568420067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99886442-cf10-4bc3-84a4-ab6269b4ff3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23c2890d-3dcf-4226-8806-eaadf696abe0', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:24:10.673998 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-4c5318db-a560-4fc5-902d-8207a98b7826 tempest-VolumesListAdminTestJSON-568420067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0971df0a-8fec-4655-bd08-5fcaf720fbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:24:10.687099 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-4c5318db-a560-4fc5-902d-8207a98b7826 tempest-VolumesListAdminTestJSON-568420067 None] Volume volume-23c2890d-3dcf-4226-8806-eaadf696abe0 (23c2890d-3dcf-4226-8806-eaadf696abe0): created successfully Apr 09 21:24:10.691728 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-4c5318db-a560-4fc5-902d-8207a98b7826 tempest-VolumesListAdminTestJSON-568420067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0971df0a-8fec-4655-bd08-5fcaf720fbc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:24:10.697451 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-4c5318db-a560-4fc5-902d-8207a98b7826 tempest-VolumesListAdminTestJSON-568420067 None] Flow 'volume_create_manager' (dfc77859-b08c-485d-9942-b6cf6b7399aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:24:10.708549 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-4c5318db-a560-4fc5-902d-8207a98b7826 tempest-VolumesListAdminTestJSON-568420067 None] Created volume successfully. Apr 09 21:24:11.839287 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-edd98d86-d1c3-44b5-97b8-df92615f7432 tempest-VolumesListAdminTestJSON-568420067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:24:11.859872 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-edd98d86-d1c3-44b5-97b8-df92615f7432 tempest-VolumesListAdminTestJSON-568420067 None] Flow 'volume_create_manager' (85788074-3433-4c23-adcc-a7f74355697f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:24:11.866962 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-edd98d86-d1c3-44b5-97b8-df92615f7432 tempest-VolumesListAdminTestJSON-568420067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (307f47b7-8bbf-401f-840d-72a36a1d7662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:24:11.881877 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-edd98d86-d1c3-44b5-97b8-df92615f7432 tempest-VolumesListAdminTestJSON-568420067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (307f47b7-8bbf-401f-840d-72a36a1d7662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1097364398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=486a19de-5744-4edf-b010-ada265b8392e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd8288163d81458486ce15654fed24e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:24:12Z,use_quota=True,user_id='e0ccd1099d6a4b148674add41fe48f28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:24:11.887350 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-edd98d86-d1c3-44b5-97b8-df92615f7432 tempest-VolumesListAdminTestJSON-568420067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ebee48e-ac73-4458-aeab-ae2b7b10aa28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:24:11.891825 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-edd98d86-d1c3-44b5-97b8-df92615f7432 tempest-VolumesListAdminTestJSON-568420067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ebee48e-ac73-4458-aeab-ae2b7b10aa28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:24:11.896943 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-edd98d86-d1c3-44b5-97b8-df92615f7432 tempest-VolumesListAdminTestJSON-568420067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4986202-bfaf-4683-91f3-12f62f5676d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:24:11.901014 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-edd98d86-d1c3-44b5-97b8-df92615f7432 tempest-VolumesListAdminTestJSON-568420067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4986202-bfaf-4683-91f3-12f62f5676d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '486a19de-5744-4edf-b010-ada265b8392e', 'volume_name': 'volume-486a19de-5744-4edf-b010-ada265b8392e', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:24:11.906057 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-edd98d86-d1c3-44b5-97b8-df92615f7432 tempest-VolumesListAdminTestJSON-568420067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f963d7a0-b340-4f40-bf7b-db59b77b3347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:24:11.909977 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-edd98d86-d1c3-44b5-97b8-df92615f7432 tempest-VolumesListAdminTestJSON-568420067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f963d7a0-b340-4f40-bf7b-db59b77b3347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:24:11.914764 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-edd98d86-d1c3-44b5-97b8-df92615f7432 tempest-VolumesListAdminTestJSON-568420067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b78523ba-63be-4997-b306-3bcb63a511bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:24:11.915830 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-edd98d86-d1c3-44b5-97b8-df92615f7432 tempest-VolumesListAdminTestJSON-568420067 None] Volume 486a19de-5744-4edf-b010-ada265b8392e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-486a19de-5744-4edf-b010-ada265b8392e', 'volume_size': 1} Apr 09 21:24:11.916215 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-edd98d86-d1c3-44b5-97b8-df92615f7432 tempest-VolumesListAdminTestJSON-568420067 None] creating volume 'volume-486a19de-5744-4edf-b010-ada265b8392e' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:24:11.916888 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-edd98d86-d1c3-44b5-97b8-df92615f7432 tempest-VolumesListAdminTestJSON-568420067 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:24:11.979427 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-edd98d86-d1c3-44b5-97b8-df92615f7432 tempest-VolumesListAdminTestJSON-568420067 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:24:11.979879 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-edd98d86-d1c3-44b5-97b8-df92615f7432 tempest-VolumesListAdminTestJSON-568420067 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:24:11.983760 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-edd98d86-d1c3-44b5-97b8-df92615f7432 tempest-VolumesListAdminTestJSON-568420067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b78523ba-63be-4997-b306-3bcb63a511bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-486a19de-5744-4edf-b010-ada265b8392e', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:24:11.988505 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-edd98d86-d1c3-44b5-97b8-df92615f7432 tempest-VolumesListAdminTestJSON-568420067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f798197-71e0-4930-91de-4b1787d502db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:24:11.999408 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-edd98d86-d1c3-44b5-97b8-df92615f7432 tempest-VolumesListAdminTestJSON-568420067 None] Volume volume-486a19de-5744-4edf-b010-ada265b8392e (486a19de-5744-4edf-b010-ada265b8392e): created successfully Apr 09 21:24:12.003412 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-edd98d86-d1c3-44b5-97b8-df92615f7432 tempest-VolumesListAdminTestJSON-568420067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f798197-71e0-4930-91de-4b1787d502db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:24:12.009119 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-edd98d86-d1c3-44b5-97b8-df92615f7432 tempest-VolumesListAdminTestJSON-568420067 None] Flow 'volume_create_manager' (85788074-3433-4c23-adcc-a7f74355697f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:24:12.018449 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-edd98d86-d1c3-44b5-97b8-df92615f7432 tempest-VolumesListAdminTestJSON-568420067 None] Created volume successfully. Apr 09 21:24:13.448699 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-67333c9e-c9f9-4254-b38b-c275072fb6f0 tempest-VolumesListAdminTestJSON-1599579950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:24:13.468806 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-67333c9e-c9f9-4254-b38b-c275072fb6f0 tempest-VolumesListAdminTestJSON-1599579950 None] Flow 'volume_create_manager' (3909bc8a-1cb5-4f58-a72b-60fc2df66551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:24:13.475616 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-67333c9e-c9f9-4254-b38b-c275072fb6f0 tempest-VolumesListAdminTestJSON-1599579950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb4b6934-9ba4-4967-ab52-48b650319884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:24:13.491412 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-67333c9e-c9f9-4254-b38b-c275072fb6f0 tempest-VolumesListAdminTestJSON-1599579950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb4b6934-9ba4-4967-ab52-48b650319884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b33f767d-43b9-4b41-b003-92c67d71efff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1f91fc1fed74a2eaa3d597b3b5645c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:24:13Z,use_quota=True,user_id='8ec34cc157714a2ba3f8f2298ca2d32c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:24:13.496901 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-67333c9e-c9f9-4254-b38b-c275072fb6f0 tempest-VolumesListAdminTestJSON-1599579950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de1eb4e-c05c-4289-8d4e-c19efc646d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:24:13.501758 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-67333c9e-c9f9-4254-b38b-c275072fb6f0 tempest-VolumesListAdminTestJSON-1599579950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de1eb4e-c05c-4289-8d4e-c19efc646d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:24:13.506998 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-67333c9e-c9f9-4254-b38b-c275072fb6f0 tempest-VolumesListAdminTestJSON-1599579950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b42b9bf7-f081-4f9f-9fd2-2cf7aea8f9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:24:13.511111 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-67333c9e-c9f9-4254-b38b-c275072fb6f0 tempest-VolumesListAdminTestJSON-1599579950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b42b9bf7-f081-4f9f-9fd2-2cf7aea8f9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b33f767d-43b9-4b41-b003-92c67d71efff', 'volume_name': 'volume-b33f767d-43b9-4b41-b003-92c67d71efff', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:24:13.516192 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-67333c9e-c9f9-4254-b38b-c275072fb6f0 tempest-VolumesListAdminTestJSON-1599579950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39834479-35cc-4af6-8686-22b641ef8e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:24:13.520157 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-67333c9e-c9f9-4254-b38b-c275072fb6f0 tempest-VolumesListAdminTestJSON-1599579950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39834479-35cc-4af6-8686-22b641ef8e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:24:13.524975 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-67333c9e-c9f9-4254-b38b-c275072fb6f0 tempest-VolumesListAdminTestJSON-1599579950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41527dcd-056a-4275-92d9-cc4d084625be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:24:13.526060 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-67333c9e-c9f9-4254-b38b-c275072fb6f0 tempest-VolumesListAdminTestJSON-1599579950 None] Volume b33f767d-43b9-4b41-b003-92c67d71efff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b33f767d-43b9-4b41-b003-92c67d71efff', 'volume_size': 1} Apr 09 21:24:13.526453 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-67333c9e-c9f9-4254-b38b-c275072fb6f0 tempest-VolumesListAdminTestJSON-1599579950 None] creating volume 'volume-b33f767d-43b9-4b41-b003-92c67d71efff' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:24:13.527124 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-67333c9e-c9f9-4254-b38b-c275072fb6f0 tempest-VolumesListAdminTestJSON-1599579950 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:24:13.589002 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-67333c9e-c9f9-4254-b38b-c275072fb6f0 tempest-VolumesListAdminTestJSON-1599579950 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:24:13.589410 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-67333c9e-c9f9-4254-b38b-c275072fb6f0 tempest-VolumesListAdminTestJSON-1599579950 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:24:13.593765 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-67333c9e-c9f9-4254-b38b-c275072fb6f0 tempest-VolumesListAdminTestJSON-1599579950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41527dcd-056a-4275-92d9-cc4d084625be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b33f767d-43b9-4b41-b003-92c67d71efff', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:24:13.598414 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-67333c9e-c9f9-4254-b38b-c275072fb6f0 tempest-VolumesListAdminTestJSON-1599579950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa5addec-aa13-4878-9094-c14fa0a5ab71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:24:13.611558 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-67333c9e-c9f9-4254-b38b-c275072fb6f0 tempest-VolumesListAdminTestJSON-1599579950 None] Volume volume-b33f767d-43b9-4b41-b003-92c67d71efff (b33f767d-43b9-4b41-b003-92c67d71efff): created successfully Apr 09 21:24:13.615316 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-67333c9e-c9f9-4254-b38b-c275072fb6f0 tempest-VolumesListAdminTestJSON-1599579950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa5addec-aa13-4878-9094-c14fa0a5ab71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:24:13.620912 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-67333c9e-c9f9-4254-b38b-c275072fb6f0 tempest-VolumesListAdminTestJSON-1599579950 None] Flow 'volume_create_manager' (3909bc8a-1cb5-4f58-a72b-60fc2df66551) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:24:13.631263 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-67333c9e-c9f9-4254-b38b-c275072fb6f0 tempest-VolumesListAdminTestJSON-1599579950 None] Created volume successfully. Apr 09 21:24:14.563379 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-76168539-1a70-41e0-b159-2a67e4ca58d9 tempest-VolumesListAdminTestJSON-1599579950 None] Lock "b'cinder-b33f767d-43b9-4b41-b003-92c67d71efff-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:24:14.595335 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-76168539-1a70-41e0-b159-2a67e4ca58d9 tempest-VolumesListAdminTestJSON-1599579950 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:24:14.658202 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-76168539-1a70-41e0-b159-2a67e4ca58d9 tempest-VolumesListAdminTestJSON-1599579950 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:24:14.660431 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-76168539-1a70-41e0-b159-2a67e4ca58d9 tempest-VolumesListAdminTestJSON-1599579950 None] Volume volume-b33f767d-43b9-4b41-b003-92c67d71efff is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:24:14.672292 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-76168539-1a70-41e0-b159-2a67e4ca58d9 tempest-VolumesListAdminTestJSON-1599579950 None] deleting rbd volume volume-b33f767d-43b9-4b41-b003-92c67d71efff {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:24:14.705669 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-0ff11360-4f28-4afe-a819-945fcc4a7280 tempest-VolumesListAdminTestJSON-568420067 None] Lock "b'cinder-486a19de-5744-4edf-b010-ada265b8392e-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:24:14.749963 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-0ff11360-4f28-4afe-a819-945fcc4a7280 tempest-VolumesListAdminTestJSON-568420067 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:24:14.821225 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-0ff11360-4f28-4afe-a819-945fcc4a7280 tempest-VolumesListAdminTestJSON-568420067 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:24:14.821757 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-0ff11360-4f28-4afe-a819-945fcc4a7280 tempest-VolumesListAdminTestJSON-568420067 None] Volume volume-486a19de-5744-4edf-b010-ada265b8392e is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:24:14.832489 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-0ff11360-4f28-4afe-a819-945fcc4a7280 tempest-VolumesListAdminTestJSON-568420067 None] deleting rbd volume volume-486a19de-5744-4edf-b010-ada265b8392e {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:24:15.032727 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-76168539-1a70-41e0-b159-2a67e4ca58d9 tempest-VolumesListAdminTestJSON-1599579950 None] Created reservations ['dac76a15-7962-4dcd-ae1d-1e138ebc7f45', '4c2c5dd0-b53a-415c-8b1f-598c1abd4d36', 'f1ed7012-2eb3-4c6a-82bc-d34ec491509a', '6d95e1da-7d49-40d1-b3c0-d3f0b67411f8'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:24:15.094542 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-76168539-1a70-41e0-b159-2a67e4ca58d9 tempest-VolumesListAdminTestJSON-1599579950 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:24:15.136829 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-76168539-1a70-41e0-b159-2a67e4ca58d9 tempest-VolumesListAdminTestJSON-1599579950 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:24:15.175568 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-76168539-1a70-41e0-b159-2a67e4ca58d9 tempest-VolumesListAdminTestJSON-1599579950 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:24:15.184940 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-76168539-1a70-41e0-b159-2a67e4ca58d9 tempest-VolumesListAdminTestJSON-1599579950 None] Deleted volume successfully. Apr 09 21:24:15.208426 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-76168539-1a70-41e0-b159-2a67e4ca58d9 tempest-VolumesListAdminTestJSON-1599579950 None] Lock "b'cinder-b33f767d-43b9-4b41-b003-92c67d71efff-delete_volume'" released by "delete_volume" :: held 0.645s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:24:15.228893 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-0ff11360-4f28-4afe-a819-945fcc4a7280 tempest-VolumesListAdminTestJSON-568420067 None] Created reservations ['f8b98f9b-da66-49ed-b558-f80651e801cb', '2d3c297f-cec1-470d-8e6d-33fdc91bb0ba', '72c5748a-3894-490a-8805-51268303d0ca', '7aae869d-3d62-48d7-a903-192111376069'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:24:15.279761 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-0ff11360-4f28-4afe-a819-945fcc4a7280 tempest-VolumesListAdminTestJSON-568420067 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:24:15.309951 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-0ff11360-4f28-4afe-a819-945fcc4a7280 tempest-VolumesListAdminTestJSON-568420067 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:24:15.349244 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-0ff11360-4f28-4afe-a819-945fcc4a7280 tempest-VolumesListAdminTestJSON-568420067 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:24:15.366532 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-0ff11360-4f28-4afe-a819-945fcc4a7280 tempest-VolumesListAdminTestJSON-568420067 None] Deleted volume successfully. Apr 09 21:24:15.382815 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-0ff11360-4f28-4afe-a819-945fcc4a7280 tempest-VolumesListAdminTestJSON-568420067 None] Lock "b'cinder-486a19de-5744-4edf-b010-ada265b8392e-delete_volume'" released by "delete_volume" :: held 0.677s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:24:15.796135 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-b9a00f3e-e09c-47ea-8d97-d8853f061905 tempest-VolumesListAdminTestJSON-568420067 None] Lock "b'cinder-23c2890d-3dcf-4226-8806-eaadf696abe0-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:24:15.842798 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b9a00f3e-e09c-47ea-8d97-d8853f061905 tempest-VolumesListAdminTestJSON-568420067 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:24:15.884857 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b9a00f3e-e09c-47ea-8d97-d8853f061905 tempest-VolumesListAdminTestJSON-568420067 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:24:15.885387 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b9a00f3e-e09c-47ea-8d97-d8853f061905 tempest-VolumesListAdminTestJSON-568420067 None] Volume volume-23c2890d-3dcf-4226-8806-eaadf696abe0 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:24:15.894489 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b9a00f3e-e09c-47ea-8d97-d8853f061905 tempest-VolumesListAdminTestJSON-568420067 None] deleting rbd volume volume-23c2890d-3dcf-4226-8806-eaadf696abe0 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:24:16.233337 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-b9a00f3e-e09c-47ea-8d97-d8853f061905 tempest-VolumesListAdminTestJSON-568420067 None] Created reservations ['94f6a82b-8107-4aa8-85c8-26be0abd3dd5', '04756e97-0d19-4d6e-97ab-02197b2ea291', 'aed5d13b-934a-4cda-b14e-1c7a28004674', 'e868936b-2118-4b56-81b3-b1abcfd8201f'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:24:16.283949 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b9a00f3e-e09c-47ea-8d97-d8853f061905 tempest-VolumesListAdminTestJSON-568420067 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:24:16.315532 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b9a00f3e-e09c-47ea-8d97-d8853f061905 tempest-VolumesListAdminTestJSON-568420067 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:24:16.344541 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-b9a00f3e-e09c-47ea-8d97-d8853f061905 tempest-VolumesListAdminTestJSON-568420067 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:24:16.355811 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-b9a00f3e-e09c-47ea-8d97-d8853f061905 tempest-VolumesListAdminTestJSON-568420067 None] Deleted volume successfully. Apr 09 21:24:16.373938 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-b9a00f3e-e09c-47ea-8d97-d8853f061905 tempest-VolumesListAdminTestJSON-568420067 None] Lock "b'cinder-23c2890d-3dcf-4226-8806-eaadf696abe0-delete_volume'" released by "delete_volume" :: held 0.578s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:24:16.927240 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-c98a42ad-ceba-46fc-85a3-002eec8b4fe7 tempest-VolumesListAdminTestJSON-568420067 None] Lock "b'cinder-a8f03391-fa2e-4d5f-8392-405c7bc9f0c4-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:24:16.965536 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-c98a42ad-ceba-46fc-85a3-002eec8b4fe7 tempest-VolumesListAdminTestJSON-568420067 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:24:17.019634 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-c98a42ad-ceba-46fc-85a3-002eec8b4fe7 tempest-VolumesListAdminTestJSON-568420067 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:24:17.020269 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-c98a42ad-ceba-46fc-85a3-002eec8b4fe7 tempest-VolumesListAdminTestJSON-568420067 None] Volume volume-a8f03391-fa2e-4d5f-8392-405c7bc9f0c4 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:24:17.042607 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-c98a42ad-ceba-46fc-85a3-002eec8b4fe7 tempest-VolumesListAdminTestJSON-568420067 None] deleting rbd volume volume-a8f03391-fa2e-4d5f-8392-405c7bc9f0c4 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:24:17.377027 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-c98a42ad-ceba-46fc-85a3-002eec8b4fe7 tempest-VolumesListAdminTestJSON-568420067 None] Created reservations ['7cdf1aed-b8c2-4cb2-b3b0-a0dec7789e79', 'cd7e6de6-cfb1-4894-8fcc-9e497ee7131d', 'f0a13dbc-8fda-4ec5-b51f-1cf2c8da2c5d', '61c81b49-222a-4e3c-a4f9-d8d6dfeae82b'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:24:17.442986 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-c98a42ad-ceba-46fc-85a3-002eec8b4fe7 tempest-VolumesListAdminTestJSON-568420067 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:24:17.493100 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-c98a42ad-ceba-46fc-85a3-002eec8b4fe7 tempest-VolumesListAdminTestJSON-568420067 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:24:17.531234 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-c98a42ad-ceba-46fc-85a3-002eec8b4fe7 tempest-VolumesListAdminTestJSON-568420067 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:24:17.535481 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-c98a42ad-ceba-46fc-85a3-002eec8b4fe7 tempest-VolumesListAdminTestJSON-568420067 None] Deleted volume successfully. Apr 09 21:24:17.550399 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-c98a42ad-ceba-46fc-85a3-002eec8b4fe7 tempest-VolumesListAdminTestJSON-568420067 None] Lock "b'cinder-a8f03391-fa2e-4d5f-8392-405c7bc9f0c4-delete_volume'" released by "delete_volume" :: held 0.624s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:24:21.110820 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1bfb0f9-89f9-42eb-8b85-93f6ca5279fa tempest-VolumesImageMetadata-479480997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:24:21.149415 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d1bfb0f9-89f9-42eb-8b85-93f6ca5279fa tempest-VolumesImageMetadata-479480997 None] Flow 'volume_create_manager' (89ee663d-8084-433d-a0b2-d2c61c309e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:24:21.160186 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d1bfb0f9-89f9-42eb-8b85-93f6ca5279fa tempest-VolumesImageMetadata-479480997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f00160b-1d1d-4886-ae0a-ea17dfc6e3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:24:21.179257 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d1bfb0f9-89f9-42eb-8b85-93f6ca5279fa tempest-VolumesImageMetadata-479480997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f00160b-1d1d-4886-ae0a-ea17dfc6e3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-860517958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=06e20c13-2140-4f03-8d2d-129658435865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e89472cd42f427093386f41e7d6d9c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:24:21Z,use_quota=True,user_id='cc4ef3bd0bd9486ebc2d7b34305e4c8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:24:21.187234 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d1bfb0f9-89f9-42eb-8b85-93f6ca5279fa tempest-VolumesImageMetadata-479480997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e99fa476-fc66-4a8d-ae37-dbdf9667081a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:24:21.192408 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d1bfb0f9-89f9-42eb-8b85-93f6ca5279fa tempest-VolumesImageMetadata-479480997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e99fa476-fc66-4a8d-ae37-dbdf9667081a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:24:21.198337 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d1bfb0f9-89f9-42eb-8b85-93f6ca5279fa tempest-VolumesImageMetadata-479480997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aa53069-9a51-4a5d-99ac-929a3e66901f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:24:21.286252 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d1bfb0f9-89f9-42eb-8b85-93f6ca5279fa tempest-VolumesImageMetadata-479480997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aa53069-9a51-4a5d-99ac-929a3e66901f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '06e20c13-2140-4f03-8d2d-129658435865', 'volume_name': 'volume-06e20c13-2140-4f03-8d2d-129658435865', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:24:21.291278 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d1bfb0f9-89f9-42eb-8b85-93f6ca5279fa tempest-VolumesImageMetadata-479480997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd53721-4028-44bf-9210-33f8bcb8c766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:24:21.295222 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d1bfb0f9-89f9-42eb-8b85-93f6ca5279fa tempest-VolumesImageMetadata-479480997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd53721-4028-44bf-9210-33f8bcb8c766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:24:21.299911 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d1bfb0f9-89f9-42eb-8b85-93f6ca5279fa tempest-VolumesImageMetadata-479480997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (238c7daf-cec6-4df5-9609-50a168a08163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:24:21.301143 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-d1bfb0f9-89f9-42eb-8b85-93f6ca5279fa tempest-VolumesImageMetadata-479480997 None] Volume 06e20c13-2140-4f03-8d2d-129658435865: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-06e20c13-2140-4f03-8d2d-129658435865', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 09 21:24:21.301713 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1bfb0f9-89f9-42eb-8b85-93f6ca5279fa tempest-VolumesImageMetadata-479480997 None] Cloning 06e20c13-2140-4f03-8d2d-129658435865 from image b539c48b-3400-4aa4-9226-8be5a3d07b36 at location (None, None). {{(pid=135002) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Apr 09 21:24:21.310105 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-d1bfb0f9-89f9-42eb-8b85-93f6ca5279fa tempest-VolumesImageMetadata-479480997 None] Lock "b'cinder-b539c48b-3400-4aa4-9226-8be5a3d07b36'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:24:21.322139 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-d1bfb0f9-89f9-42eb-8b85-93f6ca5279fa tempest-VolumesImageMetadata-479480997 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'volume_id': 'd35656e2-d293-4904-aeae-3113202bb314', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36), 'last_used': datetime.datetime(2022, 4, 9, 21, 24, 21, 314311)}. {{(pid=135002) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 09 21:24:21.322606 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-d1bfb0f9-89f9-42eb-8b85-93f6ca5279fa tempest-VolumesImageMetadata-479480997 None] Image-volume cache entry image_update_at = 2022-04-09 20:45:36+00:00, requested image updated_at = 2022-04-09 20:45:36+00:00. {{(pid=135002) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 09 21:24:21.323062 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1bfb0f9-89f9-42eb-8b85-93f6ca5279fa tempest-VolumesImageMetadata-479480997 None] Found cache entry for image = b539c48b-3400-4aa4-9226-8be5a3d07b36 on host ncdv-master-1@ceph#ceph. {{(pid=135002) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Apr 09 21:24:21.328318 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-d1bfb0f9-89f9-42eb-8b85-93f6ca5279fa tempest-VolumesImageMetadata-479480997 None] Lock "b'cinder-b539c48b-3400-4aa4-9226-8be5a3d07b36'" released by "_prepare_image_cache_entry" :: held 0.018s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:24:21.329749 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1bfb0f9-89f9-42eb-8b85-93f6ca5279fa tempest-VolumesImageMetadata-479480997 None] Attempting to retrieve cache entry for image = b539c48b-3400-4aa4-9226-8be5a3d07b36 on host ncdv-master-1@ceph#ceph. {{(pid=135002) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Apr 09 21:24:21.336434 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-d1bfb0f9-89f9-42eb-8b85-93f6ca5279fa tempest-VolumesImageMetadata-479480997 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'volume_id': 'd35656e2-d293-4904-aeae-3113202bb314', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36), 'last_used': datetime.datetime(2022, 4, 9, 21, 24, 21, 333875)}. {{(pid=135002) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 09 21:24:21.336845 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-d1bfb0f9-89f9-42eb-8b85-93f6ca5279fa tempest-VolumesImageMetadata-479480997 None] Image-volume cache entry image_update_at = 2022-04-09 20:45:36+00:00, requested image updated_at = 2022-04-09 20:45:36+00:00. {{(pid=135002) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 09 21:24:21.337264 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1bfb0f9-89f9-42eb-8b85-93f6ca5279fa tempest-VolumesImageMetadata-479480997 None] Creating from source image-volume d35656e2-d293-4904-aeae-3113202bb314 {{(pid=135002) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Apr 09 21:24:21.348937 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d1bfb0f9-89f9-42eb-8b85-93f6ca5279fa tempest-VolumesImageMetadata-479480997 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:24:21.411978 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d1bfb0f9-89f9-42eb-8b85-93f6ca5279fa tempest-VolumesImageMetadata-479480997 None] creating snapshot='volume-06e20c13-2140-4f03-8d2d-129658435865.clone_snap' {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Apr 09 21:24:21.937733 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d1bfb0f9-89f9-42eb-8b85-93f6ca5279fa tempest-VolumesImageMetadata-479480997 None] cloning 'volume-d35656e2-d293-4904-aeae-3113202bb314@volume-06e20c13-2140-4f03-8d2d-129658435865.clone_snap' to 'volume-06e20c13-2140-4f03-8d2d-129658435865' {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Apr 09 21:24:22.090716 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d1bfb0f9-89f9-42eb-8b85-93f6ca5279fa tempest-VolumesImageMetadata-479480997 None] Volume volume-6d815065-063f-4887-9bc8-5808837868ff.deleted is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:24:22.092272 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d1bfb0f9-89f9-42eb-8b85-93f6ca5279fa tempest-VolumesImageMetadata-479480997 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:24:22.092650 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d1bfb0f9-89f9-42eb-8b85-93f6ca5279fa tempest-VolumesImageMetadata-479480997 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:24:22.117079 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d1bfb0f9-89f9-42eb-8b85-93f6ca5279fa tempest-VolumesImageMetadata-479480997 None] clone created successfully {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Apr 09 21:24:22.117695 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.volume_utils [None req-d1bfb0f9-89f9-42eb-8b85-93f6ca5279fa tempest-VolumesImageMetadata-479480997 None] Marking volume 06e20c13-2140-4f03-8d2d-129658435865 as bootable. {{(pid=135002) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Apr 09 21:24:22.127631 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1bfb0f9-89f9-42eb-8b85-93f6ca5279fa tempest-VolumesImageMetadata-479480997 None] Copying metadata from image b539c48b-3400-4aa4-9226-8be5a3d07b36 to 06e20c13-2140-4f03-8d2d-129658435865. {{(pid=135002) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Apr 09 21:24:22.128115 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1bfb0f9-89f9-42eb-8b85-93f6ca5279fa tempest-VolumesImageMetadata-479480997 None] Creating volume glance metadata for volume 06e20c13-2140-4f03-8d2d-129658435865 backed by image b539c48b-3400-4aa4-9226-8be5a3d07b36 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=135002) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Apr 09 21:24:22.179042 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d1bfb0f9-89f9-42eb-8b85-93f6ca5279fa tempest-VolumesImageMetadata-479480997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (238c7daf-cec6-4df5-9609-50a168a08163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06e20c13-2140-4f03-8d2d-129658435865', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:24:22.183896 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d1bfb0f9-89f9-42eb-8b85-93f6ca5279fa tempest-VolumesImageMetadata-479480997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc00bc4f-9cc6-4984-90f2-6cdcc1649f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:24:22.194734 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-d1bfb0f9-89f9-42eb-8b85-93f6ca5279fa tempest-VolumesImageMetadata-479480997 None] Volume volume-06e20c13-2140-4f03-8d2d-129658435865 (06e20c13-2140-4f03-8d2d-129658435865): created successfully Apr 09 21:24:22.198884 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d1bfb0f9-89f9-42eb-8b85-93f6ca5279fa tempest-VolumesImageMetadata-479480997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc00bc4f-9cc6-4984-90f2-6cdcc1649f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:24:22.204850 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d1bfb0f9-89f9-42eb-8b85-93f6ca5279fa tempest-VolumesImageMetadata-479480997 None] Flow 'volume_create_manager' (89ee663d-8084-433d-a0b2-d2c61c309e68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:24:22.214542 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-d1bfb0f9-89f9-42eb-8b85-93f6ca5279fa tempest-VolumesImageMetadata-479480997 None] Created volume successfully. Apr 09 21:24:22.587241 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-b1187ef0-e6bf-4ae2-9775-ab014c5d4e27 tempest-VolumesImageMetadata-479480997 None] Lock "b'cinder-06e20c13-2140-4f03-8d2d-129658435865-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:24:22.620032 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b1187ef0-e6bf-4ae2-9775-ab014c5d4e27 tempest-VolumesImageMetadata-479480997 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:24:22.684850 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b1187ef0-e6bf-4ae2-9775-ab014c5d4e27 tempest-VolumesImageMetadata-479480997 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:24:22.693855 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b1187ef0-e6bf-4ae2-9775-ab014c5d4e27 tempest-VolumesImageMetadata-479480997 None] deleting rbd volume volume-06e20c13-2140-4f03-8d2d-129658435865 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:24:22.944936 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b1187ef0-e6bf-4ae2-9775-ab014c5d4e27 tempest-VolumesImageMetadata-479480997 None] volume is a clone so cleaning references {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Apr 09 21:24:22.979234 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b1187ef0-e6bf-4ae2-9775-ab014c5d4e27 tempest-VolumesImageMetadata-479480997 None] deleting parent snapshot volume-06e20c13-2140-4f03-8d2d-129658435865.clone_snap {{(pid=135002) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Apr 09 21:24:24.043390 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-b1187ef0-e6bf-4ae2-9775-ab014c5d4e27 tempest-VolumesImageMetadata-479480997 None] Created reservations ['c66374ca-9e33-41a9-bd03-2767d459cfd3', '220d4f72-bf42-49ae-8c6b-3398c7a51121', 'a67c7aaf-b510-4324-ae53-bc7991343a65', '6be4ea18-cd73-446e-af55-e5c05b572f90'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:24:24.093793 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b1187ef0-e6bf-4ae2-9775-ab014c5d4e27 tempest-VolumesImageMetadata-479480997 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:24:24.121837 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b1187ef0-e6bf-4ae2-9775-ab014c5d4e27 tempest-VolumesImageMetadata-479480997 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:24:24.148708 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-b1187ef0-e6bf-4ae2-9775-ab014c5d4e27 tempest-VolumesImageMetadata-479480997 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:24:24.152578 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-b1187ef0-e6bf-4ae2-9775-ab014c5d4e27 tempest-VolumesImageMetadata-479480997 None] Deleted volume successfully. Apr 09 21:24:24.168664 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-b1187ef0-e6bf-4ae2-9775-ab014c5d4e27 tempest-VolumesImageMetadata-479480997 None] Lock "b'cinder-06e20c13-2140-4f03-8d2d-129658435865-delete_volume'" released by "delete_volume" :: held 1.581s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:24:27.935392 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba0dad4a-7b78-4359-afdd-126c7872021a tempest-VolumesSnapshotListTestJSON-1573617175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:24:27.964038 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ba0dad4a-7b78-4359-afdd-126c7872021a tempest-VolumesSnapshotListTestJSON-1573617175 None] Flow 'volume_create_manager' (5f119762-442a-45c9-b3b1-36caefdcfa59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:24:27.970880 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ba0dad4a-7b78-4359-afdd-126c7872021a tempest-VolumesSnapshotListTestJSON-1573617175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37543fb0-6747-46cd-b028-6e91232a0381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:24:27.987269 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ba0dad4a-7b78-4359-afdd-126c7872021a tempest-VolumesSnapshotListTestJSON-1573617175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37543fb0-6747-46cd-b028-6e91232a0381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2111643159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9be19359-f091-4e47-a576-f88f15bce6e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78050986045342139f0f0c8d083c1bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:24:28Z,use_quota=True,user_id='9491902cf8944956bad9b60807c98b6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:24:27.992737 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ba0dad4a-7b78-4359-afdd-126c7872021a tempest-VolumesSnapshotListTestJSON-1573617175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fcd4633-d390-4290-a1b6-a01c22fc7a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:24:27.996905 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ba0dad4a-7b78-4359-afdd-126c7872021a tempest-VolumesSnapshotListTestJSON-1573617175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fcd4633-d390-4290-a1b6-a01c22fc7a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:24:28.002081 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ba0dad4a-7b78-4359-afdd-126c7872021a tempest-VolumesSnapshotListTestJSON-1573617175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f4cafb9-5578-4be8-b3aa-01dd6693f42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:24:28.006186 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ba0dad4a-7b78-4359-afdd-126c7872021a tempest-VolumesSnapshotListTestJSON-1573617175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f4cafb9-5578-4be8-b3aa-01dd6693f42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9be19359-f091-4e47-a576-f88f15bce6e4', 'volume_name': 'volume-9be19359-f091-4e47-a576-f88f15bce6e4', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:24:28.011215 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ba0dad4a-7b78-4359-afdd-126c7872021a tempest-VolumesSnapshotListTestJSON-1573617175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22ae8acd-fc91-48d2-8c76-a9ec001adf7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:24:28.015195 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ba0dad4a-7b78-4359-afdd-126c7872021a tempest-VolumesSnapshotListTestJSON-1573617175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22ae8acd-fc91-48d2-8c76-a9ec001adf7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:24:28.019924 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ba0dad4a-7b78-4359-afdd-126c7872021a tempest-VolumesSnapshotListTestJSON-1573617175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (094d8c38-2d57-4403-b0b3-2eb3d151f206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:24:28.020978 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-ba0dad4a-7b78-4359-afdd-126c7872021a tempest-VolumesSnapshotListTestJSON-1573617175 None] Volume 9be19359-f091-4e47-a576-f88f15bce6e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9be19359-f091-4e47-a576-f88f15bce6e4', 'volume_size': 1} Apr 09 21:24:28.021466 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ba0dad4a-7b78-4359-afdd-126c7872021a tempest-VolumesSnapshotListTestJSON-1573617175 None] creating volume 'volume-9be19359-f091-4e47-a576-f88f15bce6e4' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:24:28.022238 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ba0dad4a-7b78-4359-afdd-126c7872021a tempest-VolumesSnapshotListTestJSON-1573617175 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:24:28.087613 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ba0dad4a-7b78-4359-afdd-126c7872021a tempest-VolumesSnapshotListTestJSON-1573617175 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:24:28.088000 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ba0dad4a-7b78-4359-afdd-126c7872021a tempest-VolumesSnapshotListTestJSON-1573617175 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:24:28.092190 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ba0dad4a-7b78-4359-afdd-126c7872021a tempest-VolumesSnapshotListTestJSON-1573617175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (094d8c38-2d57-4403-b0b3-2eb3d151f206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9be19359-f091-4e47-a576-f88f15bce6e4', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:24:28.096870 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ba0dad4a-7b78-4359-afdd-126c7872021a tempest-VolumesSnapshotListTestJSON-1573617175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (434f27c1-4923-4249-8c69-bc4ee8b677fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:24:28.108137 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-ba0dad4a-7b78-4359-afdd-126c7872021a tempest-VolumesSnapshotListTestJSON-1573617175 None] Volume volume-9be19359-f091-4e47-a576-f88f15bce6e4 (9be19359-f091-4e47-a576-f88f15bce6e4): created successfully Apr 09 21:24:28.111876 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ba0dad4a-7b78-4359-afdd-126c7872021a tempest-VolumesSnapshotListTestJSON-1573617175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (434f27c1-4923-4249-8c69-bc4ee8b677fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:24:28.117498 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ba0dad4a-7b78-4359-afdd-126c7872021a tempest-VolumesSnapshotListTestJSON-1573617175 None] Flow 'volume_create_manager' (5f119762-442a-45c9-b3b1-36caefdcfa59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:24:28.127446 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-ba0dad4a-7b78-4359-afdd-126c7872021a tempest-VolumesSnapshotListTestJSON-1573617175 None] Created volume successfully. Apr 09 21:24:29.127196 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-c6915210-a9a7-4797-b302-e835e1b3b24a tempest-VolumesSnapshotListTestJSON-1573617175 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:24:29.888802 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-c6915210-a9a7-4797-b302-e835e1b3b24a tempest-VolumesSnapshotListTestJSON-1573617175 None] Create snapshot completed successfully Apr 09 21:24:30.325332 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-95f8d91a-416c-4baa-a962-32c73d0bac50 tempest-VolumesSnapshotListTestJSON-1573617175 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:24:30.907764 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-95f8d91a-416c-4baa-a962-32c73d0bac50 tempest-VolumesSnapshotListTestJSON-1573617175 None] Create snapshot completed successfully Apr 09 21:24:31.531947 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-e06e3855-1620-4ee6-8995-7a568a1b01cc tempest-VolumesSnapshotListTestJSON-1573617175 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:24:32.709637 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-e06e3855-1620-4ee6-8995-7a568a1b01cc tempest-VolumesSnapshotListTestJSON-1573617175 None] Create snapshot completed successfully Apr 09 21:24:34.287745 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-8640ccb6-13fb-4ccc-8d6e-26d5e8de39f8 tempest-VolumesSnapshotListTestJSON-1573617175 None] Lock "b'cinder-dc7e4102-dd2c-4571-aaf1-09b69de39a96-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:24:34.289230 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-8640ccb6-13fb-4ccc-8d6e-26d5e8de39f8 tempest-VolumesSnapshotListTestJSON-1573617175 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:24:34.733642 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-8640ccb6-13fb-4ccc-8d6e-26d5e8de39f8 tempest-VolumesSnapshotListTestJSON-1573617175 None] Created reservations ['e1aa8768-0ba0-4618-996c-f353a2fba3bf', '9ffad24b-94b9-463d-956f-0724080244f2', '484eb86c-fe47-41d3-aea4-950b0dc16ef5', '456b7785-5f6b-496e-8d49-c48f8ab9ab5c'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:24:34.767781 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-8640ccb6-13fb-4ccc-8d6e-26d5e8de39f8 tempest-VolumesSnapshotListTestJSON-1573617175 None] Delete snapshot completed successfully. Apr 09 21:24:34.772331 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-8640ccb6-13fb-4ccc-8d6e-26d5e8de39f8 tempest-VolumesSnapshotListTestJSON-1573617175 None] Lock "b'cinder-dc7e4102-dd2c-4571-aaf1-09b69de39a96-delete_snapshot'" released by "delete_snapshot" :: held 0.485s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:24:35.400276 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-821b79d4-df28-4a58-9b7a-4f025a49552e tempest-VolumesSnapshotListTestJSON-1573617175 None] Lock "b'cinder-43ff7412-cc7f-4370-a800-ca01c646f998-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:24:35.402139 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-821b79d4-df28-4a58-9b7a-4f025a49552e tempest-VolumesSnapshotListTestJSON-1573617175 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:24:35.747455 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-821b79d4-df28-4a58-9b7a-4f025a49552e tempest-VolumesSnapshotListTestJSON-1573617175 None] Created reservations ['8e2b1b48-e596-4bda-91c1-cef8ee0a752d', '2ebc16cb-f86f-4b73-9408-bd62a7c58be1', '08b033cf-3fe7-4630-ab84-d27bb8be6560', '3376a2d0-a0e8-43da-a812-6f3e22dc0120'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:24:35.784419 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-821b79d4-df28-4a58-9b7a-4f025a49552e tempest-VolumesSnapshotListTestJSON-1573617175 None] Delete snapshot completed successfully. Apr 09 21:24:35.788783 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-821b79d4-df28-4a58-9b7a-4f025a49552e tempest-VolumesSnapshotListTestJSON-1573617175 None] Lock "b'cinder-43ff7412-cc7f-4370-a800-ca01c646f998-delete_snapshot'" released by "delete_snapshot" :: held 0.389s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:24:36.510311 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-1b88e7ad-7a27-4642-a372-b5e0654cdec5 tempest-VolumesSnapshotListTestJSON-1573617175 None] Lock "b'cinder-43d0e54d-6ace-4626-991b-5e2bc17921cc-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:24:36.512272 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1b88e7ad-7a27-4642-a372-b5e0654cdec5 tempest-VolumesSnapshotListTestJSON-1573617175 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:24:37.672676 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-1b88e7ad-7a27-4642-a372-b5e0654cdec5 tempest-VolumesSnapshotListTestJSON-1573617175 None] Created reservations ['d674ad9b-6f92-4f22-9258-2570741fb5e2', 'd97c7a63-f9c5-4b93-bba5-d056ac6d36e8', '5992c088-e78b-42a5-a5c2-b6531df5d7cb', '332ff85d-a32d-4d3f-a9ce-c272ae5a258c'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:24:37.708608 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-1b88e7ad-7a27-4642-a372-b5e0654cdec5 tempest-VolumesSnapshotListTestJSON-1573617175 None] Delete snapshot completed successfully. Apr 09 21:24:37.713251 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-1b88e7ad-7a27-4642-a372-b5e0654cdec5 tempest-VolumesSnapshotListTestJSON-1573617175 None] Lock "b'cinder-43d0e54d-6ace-4626-991b-5e2bc17921cc-delete_snapshot'" released by "delete_snapshot" :: held 1.203s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:24:38.651965 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-5c8a8c3d-a75a-4374-8d9e-9464f36b91f0 tempest-VolumesSnapshotListTestJSON-1573617175 None] Lock "b'cinder-9be19359-f091-4e47-a576-f88f15bce6e4-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:24:38.685655 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5c8a8c3d-a75a-4374-8d9e-9464f36b91f0 tempest-VolumesSnapshotListTestJSON-1573617175 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:24:38.729110 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5c8a8c3d-a75a-4374-8d9e-9464f36b91f0 tempest-VolumesSnapshotListTestJSON-1573617175 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:24:38.729535 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5c8a8c3d-a75a-4374-8d9e-9464f36b91f0 tempest-VolumesSnapshotListTestJSON-1573617175 None] Volume volume-9be19359-f091-4e47-a576-f88f15bce6e4 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:24:38.737442 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5c8a8c3d-a75a-4374-8d9e-9464f36b91f0 tempest-VolumesSnapshotListTestJSON-1573617175 None] deleting rbd volume volume-9be19359-f091-4e47-a576-f88f15bce6e4 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:24:38.982751 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-5c8a8c3d-a75a-4374-8d9e-9464f36b91f0 tempest-VolumesSnapshotListTestJSON-1573617175 None] Created reservations ['1a532093-e425-4707-a377-4dbd302fdfe2', '0fcfaf48-2461-4690-8d84-6a2262178adc', '2e1e1bb7-72c7-4e00-a599-604fdc265ee6', 'c8fb37ac-84c7-4372-97c0-d6a814a41d48'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:24:39.038229 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5c8a8c3d-a75a-4374-8d9e-9464f36b91f0 tempest-VolumesSnapshotListTestJSON-1573617175 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:24:39.084834 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5c8a8c3d-a75a-4374-8d9e-9464f36b91f0 tempest-VolumesSnapshotListTestJSON-1573617175 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:24:39.134017 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-5c8a8c3d-a75a-4374-8d9e-9464f36b91f0 tempest-VolumesSnapshotListTestJSON-1573617175 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:24:39.139720 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-5c8a8c3d-a75a-4374-8d9e-9464f36b91f0 tempest-VolumesSnapshotListTestJSON-1573617175 None] Deleted volume successfully. Apr 09 21:24:39.158550 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-5c8a8c3d-a75a-4374-8d9e-9464f36b91f0 tempest-VolumesSnapshotListTestJSON-1573617175 None] Lock "b'cinder-9be19359-f091-4e47-a576-f88f15bce6e4-delete_volume'" released by "delete_volume" :: held 0.507s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:24:49.986739 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:24:49.987706 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:24:50.015360 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:24:50.037585 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:25:49.983297 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:25:49.984025 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:25:50.010784 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:25:50.035602 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:26:49.981543 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:26:49.982635 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:26:50.013348 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:26:50.044218 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:26:56.817065 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [req-86d88831-f5ad-4695-958f-80330b22fb20 req-5cd2a4f9-37de-4804-9e1d-9f27ee60809d tempest-VolumesGetTestJSON-719299906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:26:56.836157 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-86d88831-f5ad-4695-958f-80330b22fb20 req-5cd2a4f9-37de-4804-9e1d-9f27ee60809d tempest-VolumesGetTestJSON-719299906 None] Flow 'volume_create_manager' (b7f75b12-c0ef-4cf1-8a94-5d0ff3834985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:26:56.843103 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-86d88831-f5ad-4695-958f-80330b22fb20 req-5cd2a4f9-37de-4804-9e1d-9f27ee60809d tempest-VolumesGetTestJSON-719299906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91fcce3d-8b19-4b2d-a118-b1aac133a896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:26:56.859576 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-86d88831-f5ad-4695-958f-80330b22fb20 req-5cd2a4f9-37de-4804-9e1d-9f27ee60809d tempest-VolumesGetTestJSON-719299906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91fcce3d-8b19-4b2d-a118-b1aac133a896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-239623260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=647db992-b381-4014-86ac-a1395b9c2d1d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2884cbdbc9c143169084d8786530533b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:26:57Z,use_quota=True,user_id='0a1235f8c65245ed9dba39794299233c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:26:56.865063 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-86d88831-f5ad-4695-958f-80330b22fb20 req-5cd2a4f9-37de-4804-9e1d-9f27ee60809d tempest-VolumesGetTestJSON-719299906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67a61f1c-26ba-4639-98d1-6e8732e43f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:26:56.869193 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-86d88831-f5ad-4695-958f-80330b22fb20 req-5cd2a4f9-37de-4804-9e1d-9f27ee60809d tempest-VolumesGetTestJSON-719299906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67a61f1c-26ba-4639-98d1-6e8732e43f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:26:56.874359 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-86d88831-f5ad-4695-958f-80330b22fb20 req-5cd2a4f9-37de-4804-9e1d-9f27ee60809d tempest-VolumesGetTestJSON-719299906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (668eabc5-1db9-4757-9227-37c5a01affef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:26:56.878348 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-86d88831-f5ad-4695-958f-80330b22fb20 req-5cd2a4f9-37de-4804-9e1d-9f27ee60809d tempest-VolumesGetTestJSON-719299906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (668eabc5-1db9-4757-9227-37c5a01affef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '647db992-b381-4014-86ac-a1395b9c2d1d', 'volume_name': 'volume-647db992-b381-4014-86ac-a1395b9c2d1d', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:26:56.883260 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-86d88831-f5ad-4695-958f-80330b22fb20 req-5cd2a4f9-37de-4804-9e1d-9f27ee60809d tempest-VolumesGetTestJSON-719299906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27fe957b-6687-4e57-ab09-9d4289c4a346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:26:56.887234 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-86d88831-f5ad-4695-958f-80330b22fb20 req-5cd2a4f9-37de-4804-9e1d-9f27ee60809d tempest-VolumesGetTestJSON-719299906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27fe957b-6687-4e57-ab09-9d4289c4a346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:26:56.891958 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-86d88831-f5ad-4695-958f-80330b22fb20 req-5cd2a4f9-37de-4804-9e1d-9f27ee60809d tempest-VolumesGetTestJSON-719299906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (858f8563-8c1a-4922-b7ec-be1de0a96763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:26:56.893004 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [req-86d88831-f5ad-4695-958f-80330b22fb20 req-5cd2a4f9-37de-4804-9e1d-9f27ee60809d tempest-VolumesGetTestJSON-719299906 None] Volume 647db992-b381-4014-86ac-a1395b9c2d1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-647db992-b381-4014-86ac-a1395b9c2d1d', 'volume_size': 1} Apr 09 21:26:56.893434 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-86d88831-f5ad-4695-958f-80330b22fb20 req-5cd2a4f9-37de-4804-9e1d-9f27ee60809d tempest-VolumesGetTestJSON-719299906 None] creating volume 'volume-647db992-b381-4014-86ac-a1395b9c2d1d' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:26:56.894222 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-86d88831-f5ad-4695-958f-80330b22fb20 req-5cd2a4f9-37de-4804-9e1d-9f27ee60809d tempest-VolumesGetTestJSON-719299906 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:26:56.955803 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-86d88831-f5ad-4695-958f-80330b22fb20 req-5cd2a4f9-37de-4804-9e1d-9f27ee60809d tempest-VolumesGetTestJSON-719299906 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:26:56.956297 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-86d88831-f5ad-4695-958f-80330b22fb20 req-5cd2a4f9-37de-4804-9e1d-9f27ee60809d tempest-VolumesGetTestJSON-719299906 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:26:56.960104 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-86d88831-f5ad-4695-958f-80330b22fb20 req-5cd2a4f9-37de-4804-9e1d-9f27ee60809d tempest-VolumesGetTestJSON-719299906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (858f8563-8c1a-4922-b7ec-be1de0a96763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-647db992-b381-4014-86ac-a1395b9c2d1d', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:26:56.965158 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-86d88831-f5ad-4695-958f-80330b22fb20 req-5cd2a4f9-37de-4804-9e1d-9f27ee60809d tempest-VolumesGetTestJSON-719299906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d4ee3e0-1449-4223-a32d-c70efeb52e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:26:56.975862 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [req-86d88831-f5ad-4695-958f-80330b22fb20 req-5cd2a4f9-37de-4804-9e1d-9f27ee60809d tempest-VolumesGetTestJSON-719299906 None] Volume volume-647db992-b381-4014-86ac-a1395b9c2d1d (647db992-b381-4014-86ac-a1395b9c2d1d): created successfully Apr 09 21:26:56.979585 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-86d88831-f5ad-4695-958f-80330b22fb20 req-5cd2a4f9-37de-4804-9e1d-9f27ee60809d tempest-VolumesGetTestJSON-719299906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d4ee3e0-1449-4223-a32d-c70efeb52e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:26:56.985190 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-86d88831-f5ad-4695-958f-80330b22fb20 req-5cd2a4f9-37de-4804-9e1d-9f27ee60809d tempest-VolumesGetTestJSON-719299906 None] Flow 'volume_create_manager' (b7f75b12-c0ef-4cf1-8a94-5d0ff3834985) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:26:56.994146 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-86d88831-f5ad-4695-958f-80330b22fb20 req-5cd2a4f9-37de-4804-9e1d-9f27ee60809d tempest-VolumesGetTestJSON-719299906 None] Created volume successfully. Apr 09 21:26:58.023789 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [req-dacc3d05-74fe-4f25-a143-4eede20e9a55 req-e78a28ed-4f02-437a-b5e1-c91ccfcaf90c tempest-VolumesGetTestJSON-719299906 None] Lock "b'cinder-647db992-b381-4014-86ac-a1395b9c2d1d-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:26:58.055893 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-dacc3d05-74fe-4f25-a143-4eede20e9a55 req-e78a28ed-4f02-437a-b5e1-c91ccfcaf90c tempest-VolumesGetTestJSON-719299906 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:26:58.097798 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-dacc3d05-74fe-4f25-a143-4eede20e9a55 req-e78a28ed-4f02-437a-b5e1-c91ccfcaf90c tempest-VolumesGetTestJSON-719299906 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:26:58.098156 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-dacc3d05-74fe-4f25-a143-4eede20e9a55 req-e78a28ed-4f02-437a-b5e1-c91ccfcaf90c tempest-VolumesGetTestJSON-719299906 None] Volume volume-647db992-b381-4014-86ac-a1395b9c2d1d is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:26:58.105501 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-dacc3d05-74fe-4f25-a143-4eede20e9a55 req-e78a28ed-4f02-437a-b5e1-c91ccfcaf90c tempest-VolumesGetTestJSON-719299906 None] deleting rbd volume volume-647db992-b381-4014-86ac-a1395b9c2d1d {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:26:58.363030 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [req-dacc3d05-74fe-4f25-a143-4eede20e9a55 req-e78a28ed-4f02-437a-b5e1-c91ccfcaf90c tempest-VolumesGetTestJSON-719299906 None] Created reservations ['d262a40a-f2f2-4171-8762-80e4ab5406d6', '6cadfef3-7789-4ff2-baad-e4fc34a7a309', '58c68db8-bcba-4fd2-9c33-5281c3bb074c', '1cd2908b-31a5-4185-876c-90e2cc10a98f'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:26:58.412877 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-dacc3d05-74fe-4f25-a143-4eede20e9a55 req-e78a28ed-4f02-437a-b5e1-c91ccfcaf90c tempest-VolumesGetTestJSON-719299906 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:26:58.445289 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-dacc3d05-74fe-4f25-a143-4eede20e9a55 req-e78a28ed-4f02-437a-b5e1-c91ccfcaf90c tempest-VolumesGetTestJSON-719299906 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:26:58.469706 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [req-dacc3d05-74fe-4f25-a143-4eede20e9a55 req-e78a28ed-4f02-437a-b5e1-c91ccfcaf90c tempest-VolumesGetTestJSON-719299906 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:26:58.474187 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-dacc3d05-74fe-4f25-a143-4eede20e9a55 req-e78a28ed-4f02-437a-b5e1-c91ccfcaf90c tempest-VolumesGetTestJSON-719299906 None] Deleted volume successfully. Apr 09 21:26:58.488202 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [req-dacc3d05-74fe-4f25-a143-4eede20e9a55 req-e78a28ed-4f02-437a-b5e1-c91ccfcaf90c tempest-VolumesGetTestJSON-719299906 None] Lock "b'cinder-647db992-b381-4014-86ac-a1395b9c2d1d-delete_volume'" released by "delete_volume" :: held 0.464s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:27:49.979568 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:27:49.980279 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:27:50.035066 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:27:50.083844 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:28:49.985600 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:28:49.986843 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:28:50.046196 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:28:50.128871 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:28:59.041462 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c8ad575-f005-4d79-945c-c8cbc6120cd9 tempest-TestVolumeBootPattern-212634100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:28:59.075400 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-2c8ad575-f005-4d79-945c-c8cbc6120cd9 tempest-TestVolumeBootPattern-212634100 None] Flow 'volume_create_manager' (641ef8f9-f5dc-4162-863d-66cc19fbe9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:28:59.082657 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-2c8ad575-f005-4d79-945c-c8cbc6120cd9 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1131c18-b5a1-41fe-84c1-d29d2ec2ceb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:28:59.111328 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-2c8ad575-f005-4d79-945c-c8cbc6120cd9 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1131c18-b5a1-41fe-84c1-d29d2ec2ceb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1957519649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d08cae7a-bb11-48ea-ba04-20b03ccd1dd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1063334e4a426eb70eec5ed1578744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:28:59Z,use_quota=True,user_id='2e9bbd737ff54225a549f072976ef296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:28:59.116942 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-2c8ad575-f005-4d79-945c-c8cbc6120cd9 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1d0965f-d99e-4d9c-a6b4-0b515be90a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:28:59.122667 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-2c8ad575-f005-4d79-945c-c8cbc6120cd9 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1d0965f-d99e-4d9c-a6b4-0b515be90a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:28:59.130657 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-2c8ad575-f005-4d79-945c-c8cbc6120cd9 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c326cfc0-8b3a-402a-89d6-935a0b32ad28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:28:59.263486 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-2c8ad575-f005-4d79-945c-c8cbc6120cd9 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c326cfc0-8b3a-402a-89d6-935a0b32ad28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd08cae7a-bb11-48ea-ba04-20b03ccd1dd0', 'volume_name': 'volume-d08cae7a-bb11-48ea-ba04-20b03ccd1dd0', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:28:59.268719 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-2c8ad575-f005-4d79-945c-c8cbc6120cd9 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2d8aaa0-8c70-4910-ad0b-26a4e2a85ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:28:59.272918 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-2c8ad575-f005-4d79-945c-c8cbc6120cd9 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2d8aaa0-8c70-4910-ad0b-26a4e2a85ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:28:59.278465 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-2c8ad575-f005-4d79-945c-c8cbc6120cd9 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3be6f06-2d18-46f0-af54-8cef90f2aea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:28:59.279616 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-2c8ad575-f005-4d79-945c-c8cbc6120cd9 tempest-TestVolumeBootPattern-212634100 None] Volume d08cae7a-bb11-48ea-ba04-20b03ccd1dd0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d08cae7a-bb11-48ea-ba04-20b03ccd1dd0', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 09 21:28:59.280175 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c8ad575-f005-4d79-945c-c8cbc6120cd9 tempest-TestVolumeBootPattern-212634100 None] Cloning d08cae7a-bb11-48ea-ba04-20b03ccd1dd0 from image b539c48b-3400-4aa4-9226-8be5a3d07b36 at location (None, None). {{(pid=135002) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Apr 09 21:28:59.301079 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-2c8ad575-f005-4d79-945c-c8cbc6120cd9 tempest-TestVolumeBootPattern-212634100 None] Lock "b'cinder-b539c48b-3400-4aa4-9226-8be5a3d07b36'" acquired by "_prepare_image_cache_entry" :: waited 0.020s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:28:59.314131 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-2c8ad575-f005-4d79-945c-c8cbc6120cd9 tempest-TestVolumeBootPattern-212634100 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'volume_id': 'd35656e2-d293-4904-aeae-3113202bb314', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36), 'last_used': datetime.datetime(2022, 4, 9, 21, 28, 59, 306612)}. {{(pid=135002) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 09 21:28:59.314979 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-2c8ad575-f005-4d79-945c-c8cbc6120cd9 tempest-TestVolumeBootPattern-212634100 None] Image-volume cache entry image_update_at = 2022-04-09 20:45:36+00:00, requested image updated_at = 2022-04-09 20:45:36+00:00. {{(pid=135002) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 09 21:28:59.315603 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c8ad575-f005-4d79-945c-c8cbc6120cd9 tempest-TestVolumeBootPattern-212634100 None] Found cache entry for image = b539c48b-3400-4aa4-9226-8be5a3d07b36 on host ncdv-master-1@ceph#ceph. {{(pid=135002) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Apr 09 21:28:59.321393 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-2c8ad575-f005-4d79-945c-c8cbc6120cd9 tempest-TestVolumeBootPattern-212634100 None] Lock "b'cinder-b539c48b-3400-4aa4-9226-8be5a3d07b36'" released by "_prepare_image_cache_entry" :: held 0.020s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:28:59.322486 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c8ad575-f005-4d79-945c-c8cbc6120cd9 tempest-TestVolumeBootPattern-212634100 None] Attempting to retrieve cache entry for image = b539c48b-3400-4aa4-9226-8be5a3d07b36 on host ncdv-master-1@ceph#ceph. {{(pid=135002) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Apr 09 21:28:59.328611 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-2c8ad575-f005-4d79-945c-c8cbc6120cd9 tempest-TestVolumeBootPattern-212634100 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'volume_id': 'd35656e2-d293-4904-aeae-3113202bb314', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36), 'last_used': datetime.datetime(2022, 4, 9, 21, 28, 59, 326302)}. {{(pid=135002) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 09 21:28:59.329451 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-2c8ad575-f005-4d79-945c-c8cbc6120cd9 tempest-TestVolumeBootPattern-212634100 None] Image-volume cache entry image_update_at = 2022-04-09 20:45:36+00:00, requested image updated_at = 2022-04-09 20:45:36+00:00. {{(pid=135002) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 09 21:28:59.330799 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c8ad575-f005-4d79-945c-c8cbc6120cd9 tempest-TestVolumeBootPattern-212634100 None] Creating from source image-volume d35656e2-d293-4904-aeae-3113202bb314 {{(pid=135002) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Apr 09 21:28:59.363558 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2c8ad575-f005-4d79-945c-c8cbc6120cd9 tempest-TestVolumeBootPattern-212634100 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:28:59.483767 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2c8ad575-f005-4d79-945c-c8cbc6120cd9 tempest-TestVolumeBootPattern-212634100 None] creating snapshot='volume-d08cae7a-bb11-48ea-ba04-20b03ccd1dd0.clone_snap' {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Apr 09 21:29:00.168007 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2c8ad575-f005-4d79-945c-c8cbc6120cd9 tempest-TestVolumeBootPattern-212634100 None] cloning 'volume-d35656e2-d293-4904-aeae-3113202bb314@volume-d08cae7a-bb11-48ea-ba04-20b03ccd1dd0.clone_snap' to 'volume-d08cae7a-bb11-48ea-ba04-20b03ccd1dd0' {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Apr 09 21:29:00.418018 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2c8ad575-f005-4d79-945c-c8cbc6120cd9 tempest-TestVolumeBootPattern-212634100 None] Volume volume-6d815065-063f-4887-9bc8-5808837868ff.deleted is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:29:00.419224 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2c8ad575-f005-4d79-945c-c8cbc6120cd9 tempest-TestVolumeBootPattern-212634100 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:29:00.419610 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2c8ad575-f005-4d79-945c-c8cbc6120cd9 tempest-TestVolumeBootPattern-212634100 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:29:00.472856 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2c8ad575-f005-4d79-945c-c8cbc6120cd9 tempest-TestVolumeBootPattern-212634100 None] clone created successfully {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Apr 09 21:29:00.473487 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.volume_utils [None req-2c8ad575-f005-4d79-945c-c8cbc6120cd9 tempest-TestVolumeBootPattern-212634100 None] Marking volume d08cae7a-bb11-48ea-ba04-20b03ccd1dd0 as bootable. {{(pid=135002) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Apr 09 21:29:00.485688 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c8ad575-f005-4d79-945c-c8cbc6120cd9 tempest-TestVolumeBootPattern-212634100 None] Copying metadata from image b539c48b-3400-4aa4-9226-8be5a3d07b36 to d08cae7a-bb11-48ea-ba04-20b03ccd1dd0. {{(pid=135002) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Apr 09 21:29:00.486137 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c8ad575-f005-4d79-945c-c8cbc6120cd9 tempest-TestVolumeBootPattern-212634100 None] Creating volume glance metadata for volume d08cae7a-bb11-48ea-ba04-20b03ccd1dd0 backed by image b539c48b-3400-4aa4-9226-8be5a3d07b36 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=135002) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Apr 09 21:29:00.590806 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-2c8ad575-f005-4d79-945c-c8cbc6120cd9 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3be6f06-2d18-46f0-af54-8cef90f2aea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d08cae7a-bb11-48ea-ba04-20b03ccd1dd0', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:00.602945 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-2c8ad575-f005-4d79-945c-c8cbc6120cd9 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05bec31d-759e-4b54-a972-51818be9f3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:00.630783 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-2c8ad575-f005-4d79-945c-c8cbc6120cd9 tempest-TestVolumeBootPattern-212634100 None] Volume volume-d08cae7a-bb11-48ea-ba04-20b03ccd1dd0 (d08cae7a-bb11-48ea-ba04-20b03ccd1dd0): created successfully Apr 09 21:29:00.635651 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-2c8ad575-f005-4d79-945c-c8cbc6120cd9 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05bec31d-759e-4b54-a972-51818be9f3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:00.648476 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-2c8ad575-f005-4d79-945c-c8cbc6120cd9 tempest-TestVolumeBootPattern-212634100 None] Flow 'volume_create_manager' (641ef8f9-f5dc-4162-863d-66cc19fbe9b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:29:00.678725 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-2c8ad575-f005-4d79-945c-c8cbc6120cd9 tempest-TestVolumeBootPattern-212634100 None] Created volume successfully. Apr 09 21:29:01.592867 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-640ec49d-46ad-49a9-81d0-50bc82f88945 tempest-TestVolumeBootPattern-212634100 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:02.350950 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-640ec49d-46ad-49a9-81d0-50bc82f88945 tempest-TestVolumeBootPattern-212634100 None] Create snapshot completed successfully Apr 09 21:29:05.229877 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [req-d2d137c6-6525-411d-905b-70cf49382fa8 req-3de7c3e2-5064-4efb-a585-80d84aaeb9eb tempest-TestVolumeBootPattern-212634100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:29:05.260966 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-d2d137c6-6525-411d-905b-70cf49382fa8 req-3de7c3e2-5064-4efb-a585-80d84aaeb9eb tempest-TestVolumeBootPattern-212634100 None] Flow 'volume_create_manager' (843fa2b4-f406-43b7-af20-36212fa55cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:29:05.267629 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-d2d137c6-6525-411d-905b-70cf49382fa8 req-3de7c3e2-5064-4efb-a585-80d84aaeb9eb tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (681aea5c-5b3c-4498-a253-a3fff17abd5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:05.283787 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-d2d137c6-6525-411d-905b-70cf49382fa8 req-3de7c3e2-5064-4efb-a585-80d84aaeb9eb tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (681aea5c-5b3c-4498-a253-a3fff17abd5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:29:05Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=765ffaa6-06c4-4907-ba6a-5018bfcf8c1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1063334e4a426eb70eec5ed1578744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:29:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2b9fb7e5-be32-45a8-8a5b-12b2d08ee7db,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:29:05Z,use_quota=True,user_id='2e9bbd737ff54225a549f072976ef296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:05.289722 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-d2d137c6-6525-411d-905b-70cf49382fa8 req-3de7c3e2-5064-4efb-a585-80d84aaeb9eb tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0df4afb8-c656-4c65-9f1c-f3e4c0937fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:05.294712 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-d2d137c6-6525-411d-905b-70cf49382fa8 req-3de7c3e2-5064-4efb-a585-80d84aaeb9eb tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0df4afb8-c656-4c65-9f1c-f3e4c0937fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:05.302737 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-d2d137c6-6525-411d-905b-70cf49382fa8 req-3de7c3e2-5064-4efb-a585-80d84aaeb9eb tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f699b2c-1cd4-41a6-8764-1a6c09dd8c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:05.307615 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-d2d137c6-6525-411d-905b-70cf49382fa8 req-3de7c3e2-5064-4efb-a585-80d84aaeb9eb tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f699b2c-1cd4-41a6-8764-1a6c09dd8c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '765ffaa6-06c4-4907-ba6a-5018bfcf8c1e', 'volume_name': 'volume-765ffaa6-06c4-4907-ba6a-5018bfcf8c1e', 'volume_size': 1, 'snapshot_id': '2b9fb7e5-be32-45a8-8a5b-12b2d08ee7db'}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:05.312591 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-d2d137c6-6525-411d-905b-70cf49382fa8 req-3de7c3e2-5064-4efb-a585-80d84aaeb9eb tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6c1bc29-c3ab-4d7d-aa53-81465fc20f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:05.316654 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-d2d137c6-6525-411d-905b-70cf49382fa8 req-3de7c3e2-5064-4efb-a585-80d84aaeb9eb tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6c1bc29-c3ab-4d7d-aa53-81465fc20f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:05.321633 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-d2d137c6-6525-411d-905b-70cf49382fa8 req-3de7c3e2-5064-4efb-a585-80d84aaeb9eb tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbd4ffe2-c09c-4629-98f1-d50447f7e815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:05.322862 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [req-d2d137c6-6525-411d-905b-70cf49382fa8 req-3de7c3e2-5064-4efb-a585-80d84aaeb9eb tempest-TestVolumeBootPattern-212634100 None] Volume 765ffaa6-06c4-4907-ba6a-5018bfcf8c1e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-765ffaa6-06c4-4907-ba6a-5018bfcf8c1e', 'volume_size': 1, 'snapshot_id': '2b9fb7e5-be32-45a8-8a5b-12b2d08ee7db'} Apr 09 21:29:05.342673 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-d2d137c6-6525-411d-905b-70cf49382fa8 req-3de7c3e2-5064-4efb-a585-80d84aaeb9eb tempest-TestVolumeBootPattern-212634100 None] cloning volumes/volume-d08cae7a-bb11-48ea-ba04-20b03ccd1dd0@snapshot-2b9fb7e5-be32-45a8-8a5b-12b2d08ee7db to volume-765ffaa6-06c4-4907-ba6a-5018bfcf8c1e {{(pid=135002) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1090}} Apr 09 21:29:05.343361 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-d2d137c6-6525-411d-905b-70cf49382fa8 req-3de7c3e2-5064-4efb-a585-80d84aaeb9eb tempest-TestVolumeBootPattern-212634100 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:05.421983 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-d2d137c6-6525-411d-905b-70cf49382fa8 req-3de7c3e2-5064-4efb-a585-80d84aaeb9eb tempest-TestVolumeBootPattern-212634100 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:05.647123 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-d2d137c6-6525-411d-905b-70cf49382fa8 req-3de7c3e2-5064-4efb-a585-80d84aaeb9eb tempest-TestVolumeBootPattern-212634100 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:29:05.647702 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-d2d137c6-6525-411d-905b-70cf49382fa8 req-3de7c3e2-5064-4efb-a585-80d84aaeb9eb tempest-TestVolumeBootPattern-212634100 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:29:05.664624 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.volume_utils [req-d2d137c6-6525-411d-905b-70cf49382fa8 req-3de7c3e2-5064-4efb-a585-80d84aaeb9eb tempest-TestVolumeBootPattern-212634100 None] Marking volume 765ffaa6-06c4-4907-ba6a-5018bfcf8c1e as bootable. {{(pid=135002) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Apr 09 21:29:05.675563 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [req-d2d137c6-6525-411d-905b-70cf49382fa8 req-3de7c3e2-5064-4efb-a585-80d84aaeb9eb tempest-TestVolumeBootPattern-212634100 None] Copying metadata from snapshot 2b9fb7e5-be32-45a8-8a5b-12b2d08ee7db to 765ffaa6-06c4-4907-ba6a-5018bfcf8c1e. {{(pid=135002) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:427}} Apr 09 21:29:05.721141 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-d2d137c6-6525-411d-905b-70cf49382fa8 req-3de7c3e2-5064-4efb-a585-80d84aaeb9eb tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbd4ffe2-c09c-4629-98f1-d50447f7e815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-765ffaa6-06c4-4907-ba6a-5018bfcf8c1e', 'volume_size': 1, 'snapshot_id': '2b9fb7e5-be32-45a8-8a5b-12b2d08ee7db'}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:05.727338 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-d2d137c6-6525-411d-905b-70cf49382fa8 req-3de7c3e2-5064-4efb-a585-80d84aaeb9eb tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c06c87f-49b0-4440-8afe-9fb5c63e44b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:05.740339 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [req-d2d137c6-6525-411d-905b-70cf49382fa8 req-3de7c3e2-5064-4efb-a585-80d84aaeb9eb tempest-TestVolumeBootPattern-212634100 None] Volume volume-765ffaa6-06c4-4907-ba6a-5018bfcf8c1e (765ffaa6-06c4-4907-ba6a-5018bfcf8c1e): created successfully Apr 09 21:29:05.744843 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-d2d137c6-6525-411d-905b-70cf49382fa8 req-3de7c3e2-5064-4efb-a585-80d84aaeb9eb tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c06c87f-49b0-4440-8afe-9fb5c63e44b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:05.750910 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-d2d137c6-6525-411d-905b-70cf49382fa8 req-3de7c3e2-5064-4efb-a585-80d84aaeb9eb tempest-TestVolumeBootPattern-212634100 None] Flow 'volume_create_manager' (843fa2b4-f406-43b7-af20-36212fa55cd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:29:05.767922 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-d2d137c6-6525-411d-905b-70cf49382fa8 req-3de7c3e2-5064-4efb-a585-80d84aaeb9eb tempest-TestVolumeBootPattern-212634100 None] Created volume successfully. Apr 09 21:29:08.510395 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-d2d137c6-6525-411d-905b-70cf49382fa8 req-b700c128-bee3-4920-ab0b-fd9a5875ea4c tempest-TestVolumeBootPattern-212634100 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:29:09.282838 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-d2d137c6-6525-411d-905b-70cf49382fa8 req-b700c128-bee3-4920-ab0b-fd9a5875ea4c tempest-TestVolumeBootPattern-212634100 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.772s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:29:09.283792 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-d2d137c6-6525-411d-905b-70cf49382fa8 req-b700c128-bee3-4920-ab0b-fd9a5875ea4c tempest-TestVolumeBootPattern-212634100 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-765ffaa6-06c4-4907-ba6a-5018bfcf8c1e', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': '765ffaa6-06c4-4907-ba6a-5018bfcf8c1e', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:29:09.314079 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-d2d137c6-6525-411d-905b-70cf49382fa8 req-b700c128-bee3-4920-ab0b-fd9a5875ea4c tempest-TestVolumeBootPattern-212634100 None] Connection info returned from driver {'name': 'volumes/volume-765ffaa6-06c4-4907-ba6a-5018bfcf8c1e', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '765ffaa6-06c4-4907-ba6a-5018bfcf8c1e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e946002c-8725-4023-b2e0-ceb2dae6952d'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 21:29:09.368944 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-d2d137c6-6525-411d-905b-70cf49382fa8 req-b700c128-bee3-4920-ab0b-fd9a5875ea4c tempest-TestVolumeBootPattern-212634100 None] attachment_update completed successfully. Apr 09 21:29:19.088859 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-564e1291-6e27-46f0-8470-7703a92eed3a req-a4b4486b-43e9-4e46-b742-8c0dbfe625b6 tempest-TestVolumeBootPattern-212634100 None] Terminate volume connection completed successfully. Apr 09 21:29:19.089554 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-564e1291-6e27-46f0-8470-7703a92eed3a req-a4b4486b-43e9-4e46-b742-8c0dbfe625b6 tempest-TestVolumeBootPattern-212634100 None] Deleting attachment e946002c-8725-4023-b2e0-ceb2dae6952d. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 21:29:19.216377 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [req-564e1291-6e27-46f0-8470-7703a92eed3a req-b0b654a8-c1d5-4f60-a72f-1331a8fbf20f tempest-TestVolumeBootPattern-212634100 None] Lock "b'cinder-765ffaa6-06c4-4907-ba6a-5018bfcf8c1e-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:29:19.258236 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-564e1291-6e27-46f0-8470-7703a92eed3a req-b0b654a8-c1d5-4f60-a72f-1331a8fbf20f tempest-TestVolumeBootPattern-212634100 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:19.381238 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-564e1291-6e27-46f0-8470-7703a92eed3a req-b0b654a8-c1d5-4f60-a72f-1331a8fbf20f tempest-TestVolumeBootPattern-212634100 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:29:19.404934 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-564e1291-6e27-46f0-8470-7703a92eed3a req-b0b654a8-c1d5-4f60-a72f-1331a8fbf20f tempest-TestVolumeBootPattern-212634100 None] deleting rbd volume volume-765ffaa6-06c4-4907-ba6a-5018bfcf8c1e {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:29:19.672584 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [req-564e1291-6e27-46f0-8470-7703a92eed3a req-b0b654a8-c1d5-4f60-a72f-1331a8fbf20f tempest-TestVolumeBootPattern-212634100 None] Created reservations ['1d96fc9e-b9d6-430e-861f-62c303179024', '3977d9be-dcc5-4b60-a025-3735f5b14805', '66060f2c-1f50-4f9e-81a8-16ebabe4971f', 'fb3c0bf8-177c-4b1f-bba5-b7eeb43d5fff'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:29:19.726998 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-564e1291-6e27-46f0-8470-7703a92eed3a req-b0b654a8-c1d5-4f60-a72f-1331a8fbf20f tempest-TestVolumeBootPattern-212634100 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:19.756653 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-564e1291-6e27-46f0-8470-7703a92eed3a req-b0b654a8-c1d5-4f60-a72f-1331a8fbf20f tempest-TestVolumeBootPattern-212634100 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:19.785317 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [req-564e1291-6e27-46f0-8470-7703a92eed3a req-b0b654a8-c1d5-4f60-a72f-1331a8fbf20f tempest-TestVolumeBootPattern-212634100 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:29:19.789956 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-564e1291-6e27-46f0-8470-7703a92eed3a req-b0b654a8-c1d5-4f60-a72f-1331a8fbf20f tempest-TestVolumeBootPattern-212634100 None] Deleted volume successfully. Apr 09 21:29:19.805889 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [req-564e1291-6e27-46f0-8470-7703a92eed3a req-b0b654a8-c1d5-4f60-a72f-1331a8fbf20f tempest-TestVolumeBootPattern-212634100 None] Lock "b'cinder-765ffaa6-06c4-4907-ba6a-5018bfcf8c1e-delete_volume'" released by "delete_volume" :: held 0.589s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:29:20.655749 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-c93cca1a-7dd6-408b-88c1-45e044023886 tempest-TestVolumeBootPattern-212634100 None] Lock "b'cinder-2b9fb7e5-be32-45a8-8a5b-12b2d08ee7db-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:29:20.658161 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-c93cca1a-7dd6-408b-88c1-45e044023886 tempest-TestVolumeBootPattern-212634100 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:21.168718 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-c93cca1a-7dd6-408b-88c1-45e044023886 tempest-TestVolumeBootPattern-212634100 None] Created reservations ['67b617e5-e9dc-4533-849d-be9bdd3717da', 'ef74b15c-f066-465b-b236-3adb8607322f', 'a8304ac1-57f8-4a6f-99f9-6eab3e322bdd', '697511d3-40d7-4626-8193-c49ae22c3212'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:29:21.210475 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-c93cca1a-7dd6-408b-88c1-45e044023886 tempest-TestVolumeBootPattern-212634100 None] Delete snapshot completed successfully. Apr 09 21:29:21.214895 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-c93cca1a-7dd6-408b-88c1-45e044023886 tempest-TestVolumeBootPattern-212634100 None] Lock "b'cinder-2b9fb7e5-be32-45a8-8a5b-12b2d08ee7db-delete_snapshot'" released by "delete_snapshot" :: held 0.559s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:29:21.777762 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-dd342e94-fcb7-4e4b-81c3-5787f9d7dbba tempest-TestVolumeBootPattern-212634100 None] Lock "b'cinder-d08cae7a-bb11-48ea-ba04-20b03ccd1dd0-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:29:21.813294 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-dd342e94-fcb7-4e4b-81c3-5787f9d7dbba tempest-TestVolumeBootPattern-212634100 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:21.888845 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-dd342e94-fcb7-4e4b-81c3-5787f9d7dbba tempest-TestVolumeBootPattern-212634100 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:29:21.898834 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-dd342e94-fcb7-4e4b-81c3-5787f9d7dbba tempest-TestVolumeBootPattern-212634100 None] deleting rbd volume volume-d08cae7a-bb11-48ea-ba04-20b03ccd1dd0 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:29:22.126824 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-dd342e94-fcb7-4e4b-81c3-5787f9d7dbba tempest-TestVolumeBootPattern-212634100 None] volume is a clone so cleaning references {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Apr 09 21:29:22.165790 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-dd342e94-fcb7-4e4b-81c3-5787f9d7dbba tempest-TestVolumeBootPattern-212634100 None] deleting parent snapshot volume-d08cae7a-bb11-48ea-ba04-20b03ccd1dd0.clone_snap {{(pid=135002) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Apr 09 21:29:23.192187 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-dd342e94-fcb7-4e4b-81c3-5787f9d7dbba tempest-TestVolumeBootPattern-212634100 None] Created reservations ['aac2ab6e-e4e7-4fd0-abde-0048179a655d', '357396e4-b126-46df-9443-caa79e2f49ab', 'd76aedad-8c00-4fb4-bbbd-8118e545e980', '92a0b703-e418-4bd9-a77e-da4a0fba3bd2'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:29:23.237265 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-dd342e94-fcb7-4e4b-81c3-5787f9d7dbba tempest-TestVolumeBootPattern-212634100 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:23.259164 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-dd342e94-fcb7-4e4b-81c3-5787f9d7dbba tempest-TestVolumeBootPattern-212634100 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:23.281599 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-dd342e94-fcb7-4e4b-81c3-5787f9d7dbba tempest-TestVolumeBootPattern-212634100 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:29:23.285897 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-dd342e94-fcb7-4e4b-81c3-5787f9d7dbba tempest-TestVolumeBootPattern-212634100 None] Deleted volume successfully. Apr 09 21:29:23.299119 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-dd342e94-fcb7-4e4b-81c3-5787f9d7dbba tempest-TestVolumeBootPattern-212634100 None] Lock "b'cinder-d08cae7a-bb11-48ea-ba04-20b03ccd1dd0-delete_volume'" released by "delete_volume" :: held 1.522s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:29:24.369225 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5fc9373-634c-4ef0-86e3-4baff5dde377 tempest-TestVolumeBootPattern-212634100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:29:24.389228 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f5fc9373-634c-4ef0-86e3-4baff5dde377 tempest-TestVolumeBootPattern-212634100 None] Flow 'volume_create_manager' (44e5013f-bc60-4874-bcd9-fa86b9855ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:29:24.395899 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f5fc9373-634c-4ef0-86e3-4baff5dde377 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34936ee6-cd14-4589-bc5f-a8b38fcaa471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:24.411611 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f5fc9373-634c-4ef0-86e3-4baff5dde377 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34936ee6-cd14-4589-bc5f-a8b38fcaa471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-522736543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=527175d7-c75b-4775-9719-6ac41f211e5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1063334e4a426eb70eec5ed1578744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:29:24Z,use_quota=True,user_id='2e9bbd737ff54225a549f072976ef296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:24.417012 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f5fc9373-634c-4ef0-86e3-4baff5dde377 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f73bac1-cff2-4f31-abef-77c8c9259e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:24.421250 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f5fc9373-634c-4ef0-86e3-4baff5dde377 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f73bac1-cff2-4f31-abef-77c8c9259e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:24.426516 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f5fc9373-634c-4ef0-86e3-4baff5dde377 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d60c3e-2307-4472-9c6e-083403db1b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:24.507133 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f5fc9373-634c-4ef0-86e3-4baff5dde377 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d60c3e-2307-4472-9c6e-083403db1b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '527175d7-c75b-4775-9719-6ac41f211e5f', 'volume_name': 'volume-527175d7-c75b-4775-9719-6ac41f211e5f', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:24.512132 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f5fc9373-634c-4ef0-86e3-4baff5dde377 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbd520c9-48c6-476f-8992-aa9cfb6ae8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:24.516239 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f5fc9373-634c-4ef0-86e3-4baff5dde377 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbd520c9-48c6-476f-8992-aa9cfb6ae8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:24.521105 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f5fc9373-634c-4ef0-86e3-4baff5dde377 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d9d665-e636-4278-84e7-1d30ed1fa78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:24.522245 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-f5fc9373-634c-4ef0-86e3-4baff5dde377 tempest-TestVolumeBootPattern-212634100 None] Volume 527175d7-c75b-4775-9719-6ac41f211e5f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-527175d7-c75b-4775-9719-6ac41f211e5f', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 09 21:29:24.522804 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5fc9373-634c-4ef0-86e3-4baff5dde377 tempest-TestVolumeBootPattern-212634100 None] Cloning 527175d7-c75b-4775-9719-6ac41f211e5f from image b539c48b-3400-4aa4-9226-8be5a3d07b36 at location (None, None). {{(pid=135002) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Apr 09 21:29:24.531381 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-f5fc9373-634c-4ef0-86e3-4baff5dde377 tempest-TestVolumeBootPattern-212634100 None] Lock "b'cinder-b539c48b-3400-4aa4-9226-8be5a3d07b36'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:29:24.543184 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-f5fc9373-634c-4ef0-86e3-4baff5dde377 tempest-TestVolumeBootPattern-212634100 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'volume_id': 'd35656e2-d293-4904-aeae-3113202bb314', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36), 'last_used': datetime.datetime(2022, 4, 9, 21, 29, 24, 536368)}. {{(pid=135002) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 09 21:29:24.543607 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-f5fc9373-634c-4ef0-86e3-4baff5dde377 tempest-TestVolumeBootPattern-212634100 None] Image-volume cache entry image_update_at = 2022-04-09 20:45:36+00:00, requested image updated_at = 2022-04-09 20:45:36+00:00. {{(pid=135002) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 09 21:29:24.544088 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5fc9373-634c-4ef0-86e3-4baff5dde377 tempest-TestVolumeBootPattern-212634100 None] Found cache entry for image = b539c48b-3400-4aa4-9226-8be5a3d07b36 on host ncdv-master-1@ceph#ceph. {{(pid=135002) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Apr 09 21:29:24.548461 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-f5fc9373-634c-4ef0-86e3-4baff5dde377 tempest-TestVolumeBootPattern-212634100 None] Lock "b'cinder-b539c48b-3400-4aa4-9226-8be5a3d07b36'" released by "_prepare_image_cache_entry" :: held 0.017s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:29:24.549486 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5fc9373-634c-4ef0-86e3-4baff5dde377 tempest-TestVolumeBootPattern-212634100 None] Attempting to retrieve cache entry for image = b539c48b-3400-4aa4-9226-8be5a3d07b36 on host ncdv-master-1@ceph#ceph. {{(pid=135002) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Apr 09 21:29:24.554991 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-f5fc9373-634c-4ef0-86e3-4baff5dde377 tempest-TestVolumeBootPattern-212634100 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'volume_id': 'd35656e2-d293-4904-aeae-3113202bb314', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36), 'last_used': datetime.datetime(2022, 4, 9, 21, 29, 24, 552784)}. {{(pid=135002) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 09 21:29:24.555459 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-f5fc9373-634c-4ef0-86e3-4baff5dde377 tempest-TestVolumeBootPattern-212634100 None] Image-volume cache entry image_update_at = 2022-04-09 20:45:36+00:00, requested image updated_at = 2022-04-09 20:45:36+00:00. {{(pid=135002) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 09 21:29:24.555793 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5fc9373-634c-4ef0-86e3-4baff5dde377 tempest-TestVolumeBootPattern-212634100 None] Creating from source image-volume d35656e2-d293-4904-aeae-3113202bb314 {{(pid=135002) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Apr 09 21:29:24.567415 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f5fc9373-634c-4ef0-86e3-4baff5dde377 tempest-TestVolumeBootPattern-212634100 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:24.619895 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f5fc9373-634c-4ef0-86e3-4baff5dde377 tempest-TestVolumeBootPattern-212634100 None] creating snapshot='volume-527175d7-c75b-4775-9719-6ac41f211e5f.clone_snap' {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Apr 09 21:29:25.155022 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f5fc9373-634c-4ef0-86e3-4baff5dde377 tempest-TestVolumeBootPattern-212634100 None] cloning 'volume-d35656e2-d293-4904-aeae-3113202bb314@volume-527175d7-c75b-4775-9719-6ac41f211e5f.clone_snap' to 'volume-527175d7-c75b-4775-9719-6ac41f211e5f' {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Apr 09 21:29:25.320058 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f5fc9373-634c-4ef0-86e3-4baff5dde377 tempest-TestVolumeBootPattern-212634100 None] Volume volume-6d815065-063f-4887-9bc8-5808837868ff.deleted is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:29:25.321354 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f5fc9373-634c-4ef0-86e3-4baff5dde377 tempest-TestVolumeBootPattern-212634100 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:29:25.321788 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f5fc9373-634c-4ef0-86e3-4baff5dde377 tempest-TestVolumeBootPattern-212634100 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:29:25.351056 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f5fc9373-634c-4ef0-86e3-4baff5dde377 tempest-TestVolumeBootPattern-212634100 None] clone created successfully {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Apr 09 21:29:25.351798 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.volume_utils [None req-f5fc9373-634c-4ef0-86e3-4baff5dde377 tempest-TestVolumeBootPattern-212634100 None] Marking volume 527175d7-c75b-4775-9719-6ac41f211e5f as bootable. {{(pid=135002) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Apr 09 21:29:25.361727 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5fc9373-634c-4ef0-86e3-4baff5dde377 tempest-TestVolumeBootPattern-212634100 None] Copying metadata from image b539c48b-3400-4aa4-9226-8be5a3d07b36 to 527175d7-c75b-4775-9719-6ac41f211e5f. {{(pid=135002) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Apr 09 21:29:25.362309 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5fc9373-634c-4ef0-86e3-4baff5dde377 tempest-TestVolumeBootPattern-212634100 None] Creating volume glance metadata for volume 527175d7-c75b-4775-9719-6ac41f211e5f backed by image b539c48b-3400-4aa4-9226-8be5a3d07b36 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=135002) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Apr 09 21:29:25.415503 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f5fc9373-634c-4ef0-86e3-4baff5dde377 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d9d665-e636-4278-84e7-1d30ed1fa78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-527175d7-c75b-4775-9719-6ac41f211e5f', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:25.420264 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f5fc9373-634c-4ef0-86e3-4baff5dde377 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8affc992-85eb-407b-91cf-e03a4a4376a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:25.430659 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-f5fc9373-634c-4ef0-86e3-4baff5dde377 tempest-TestVolumeBootPattern-212634100 None] Volume volume-527175d7-c75b-4775-9719-6ac41f211e5f (527175d7-c75b-4775-9719-6ac41f211e5f): created successfully Apr 09 21:29:25.434367 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f5fc9373-634c-4ef0-86e3-4baff5dde377 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8affc992-85eb-407b-91cf-e03a4a4376a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:25.440154 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f5fc9373-634c-4ef0-86e3-4baff5dde377 tempest-TestVolumeBootPattern-212634100 None] Flow 'volume_create_manager' (44e5013f-bc60-4874-bcd9-fa86b9855ff8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:29:25.451900 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-f5fc9373-634c-4ef0-86e3-4baff5dde377 tempest-TestVolumeBootPattern-212634100 None] Created volume successfully. Apr 09 21:29:28.382962 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-567a6b9f-c74e-4d50-87fb-927ca7d40d21 req-58ec8eb2-73aa-4dff-a42d-0184abd3549b tempest-TestVolumeBootPattern-212634100 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:29:29.040644 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-567a6b9f-c74e-4d50-87fb-927ca7d40d21 req-58ec8eb2-73aa-4dff-a42d-0184abd3549b tempest-TestVolumeBootPattern-212634100 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.657s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:29:29.041789 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-567a6b9f-c74e-4d50-87fb-927ca7d40d21 req-58ec8eb2-73aa-4dff-a42d-0184abd3549b tempest-TestVolumeBootPattern-212634100 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-527175d7-c75b-4775-9719-6ac41f211e5f', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': '527175d7-c75b-4775-9719-6ac41f211e5f', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:29:29.066375 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-567a6b9f-c74e-4d50-87fb-927ca7d40d21 req-58ec8eb2-73aa-4dff-a42d-0184abd3549b tempest-TestVolumeBootPattern-212634100 None] Connection info returned from driver {'name': 'volumes/volume-527175d7-c75b-4775-9719-6ac41f211e5f', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '527175d7-c75b-4775-9719-6ac41f211e5f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c82e5986-2e5c-496f-80c5-1c2955661b72'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 21:29:29.122808 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-567a6b9f-c74e-4d50-87fb-927ca7d40d21 req-58ec8eb2-73aa-4dff-a42d-0184abd3549b tempest-TestVolumeBootPattern-212634100 None] attachment_update completed successfully. Apr 09 21:29:29.741703 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-02e53355-fddd-4be6-a830-65a2de0793f9 tempest-VolumesActionsTest-1368969787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:29:29.773010 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-02e53355-fddd-4be6-a830-65a2de0793f9 tempest-VolumesActionsTest-1368969787 None] Flow 'volume_create_manager' (1ac7074b-8df1-442b-ab7f-d630a66a2384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:29:29.779938 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-02e53355-fddd-4be6-a830-65a2de0793f9 tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3312a4c-986b-4af4-b2cd-576744fcd6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:29.796814 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-02e53355-fddd-4be6-a830-65a2de0793f9 tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3312a4c-986b-4af4-b2cd-576744fcd6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1613458351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=03859c10-5117-4ce7-bc0e-67c4e26a26fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f4a5d8476f48828d3bf6816ac0d864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:29:30Z,use_quota=True,user_id='a4bc643e662c4873a068f6a09663aef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:29.802383 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-02e53355-fddd-4be6-a830-65a2de0793f9 tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ce4deb-93b6-44ee-a43c-1ba3296c14ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:29.806624 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-02e53355-fddd-4be6-a830-65a2de0793f9 tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ce4deb-93b6-44ee-a43c-1ba3296c14ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:29.811912 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-02e53355-fddd-4be6-a830-65a2de0793f9 tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7688d86-9b11-41bf-812f-d62ba5b30869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:29.816070 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-02e53355-fddd-4be6-a830-65a2de0793f9 tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7688d86-9b11-41bf-812f-d62ba5b30869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03859c10-5117-4ce7-bc0e-67c4e26a26fb', 'volume_name': 'volume-03859c10-5117-4ce7-bc0e-67c4e26a26fb', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:29.821805 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-02e53355-fddd-4be6-a830-65a2de0793f9 tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd9d0005-2f19-4485-998b-f9cb56807a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:29.825863 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-02e53355-fddd-4be6-a830-65a2de0793f9 tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd9d0005-2f19-4485-998b-f9cb56807a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:29.830748 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-02e53355-fddd-4be6-a830-65a2de0793f9 tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b3c1a3-aba2-4d78-9530-d44ea250f7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:29.832243 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-02e53355-fddd-4be6-a830-65a2de0793f9 tempest-VolumesActionsTest-1368969787 None] Volume 03859c10-5117-4ce7-bc0e-67c4e26a26fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03859c10-5117-4ce7-bc0e-67c4e26a26fb', 'volume_size': 1} Apr 09 21:29:29.832873 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-02e53355-fddd-4be6-a830-65a2de0793f9 tempest-VolumesActionsTest-1368969787 None] creating volume 'volume-03859c10-5117-4ce7-bc0e-67c4e26a26fb' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:29:29.834337 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-02e53355-fddd-4be6-a830-65a2de0793f9 tempest-VolumesActionsTest-1368969787 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:29.912363 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-02e53355-fddd-4be6-a830-65a2de0793f9 tempest-VolumesActionsTest-1368969787 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:29:29.912738 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-02e53355-fddd-4be6-a830-65a2de0793f9 tempest-VolumesActionsTest-1368969787 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:29:29.916602 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-02e53355-fddd-4be6-a830-65a2de0793f9 tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b3c1a3-aba2-4d78-9530-d44ea250f7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03859c10-5117-4ce7-bc0e-67c4e26a26fb', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:29.921958 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-02e53355-fddd-4be6-a830-65a2de0793f9 tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (403cb561-c1f0-4434-87f4-427ac582f863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:29.932322 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-02e53355-fddd-4be6-a830-65a2de0793f9 tempest-VolumesActionsTest-1368969787 None] Volume volume-03859c10-5117-4ce7-bc0e-67c4e26a26fb (03859c10-5117-4ce7-bc0e-67c4e26a26fb): created successfully Apr 09 21:29:29.936105 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-02e53355-fddd-4be6-a830-65a2de0793f9 tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (403cb561-c1f0-4434-87f4-427ac582f863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:29.941787 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-02e53355-fddd-4be6-a830-65a2de0793f9 tempest-VolumesActionsTest-1368969787 None] Flow 'volume_create_manager' (1ac7074b-8df1-442b-ab7f-d630a66a2384) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:29:29.951769 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-02e53355-fddd-4be6-a830-65a2de0793f9 tempest-VolumesActionsTest-1368969787 None] Created volume successfully. Apr 09 21:29:30.783915 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-87ebfde6-6eeb-4cb8-b6a2-9cd395c824ca tempest-VolumesActionsTest-1368969787 None] Lock "b'cinder-03859c10-5117-4ce7-bc0e-67c4e26a26fb'" acquired by "attach_volume" :: waited 0.010s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:29:30.830848 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-87ebfde6-6eeb-4cb8-b6a2-9cd395c824ca tempest-VolumesActionsTest-1368969787 None] Attaching volume 03859c10-5117-4ce7-bc0e-67c4e26a26fb to instance d3a874eb-3709-4b9c-a4a9-ba3fb73d3180 at mountpoint /dev/sdb on host None. Apr 09 21:29:30.879431 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-87ebfde6-6eeb-4cb8-b6a2-9cd395c824ca tempest-VolumesActionsTest-1368969787 None] Attach volume completed successfully. Apr 09 21:29:30.884053 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-87ebfde6-6eeb-4cb8-b6a2-9cd395c824ca tempest-VolumesActionsTest-1368969787 None] Lock "b'cinder-03859c10-5117-4ce7-bc0e-67c4e26a26fb'" released by "attach_volume" :: held 0.100s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:29:31.288786 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-9fa4654c-f7a4-4685-bba6-8577a50ca396 tempest-VolumesActionsTest-1326122298 None] Terminate volume connection completed successfully. Apr 09 21:29:31.319518 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-9fa4654c-f7a4-4685-bba6-8577a50ca396 tempest-VolumesActionsTest-1326122298 None] Lock "b'cinder-03859c10-5117-4ce7-bc0e-67c4e26a26fb-detach_volume'" acquired by "detach_volume" :: waited 0.010s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:29:31.330569 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-9fa4654c-f7a4-4685-bba6-8577a50ca396 tempest-VolumesActionsTest-1326122298 None] Detaching volume 03859c10-5117-4ce7-bc0e-67c4e26a26fb from instance d3a874eb-3709-4b9c-a4a9-ba3fb73d3180. Apr 09 21:29:31.361610 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-9fa4654c-f7a4-4685-bba6-8577a50ca396 tempest-VolumesActionsTest-1326122298 None] Detach volume completed successfully. Apr 09 21:29:31.366111 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-9fa4654c-f7a4-4685-bba6-8577a50ca396 tempest-VolumesActionsTest-1326122298 None] Lock "b'cinder-03859c10-5117-4ce7-bc0e-67c4e26a26fb-detach_volume'" released by "detach_volume" :: held 0.047s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:29:31.511808 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-8b29f53a-1223-430a-8b33-405e86c1839d tempest-VolumesActionsTest-1368969787 None] Lock "b'cinder-03859c10-5117-4ce7-bc0e-67c4e26a26fb-detach_volume'" acquired by "detach_volume" :: waited 0.008s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:29:31.512216 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-8b29f53a-1223-430a-8b33-405e86c1839d tempest-VolumesActionsTest-1368969787 None] Volume detach called, but volume not attached. Apr 09 21:29:31.527415 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-8b29f53a-1223-430a-8b33-405e86c1839d tempest-VolumesActionsTest-1368969787 None] Lock "b'cinder-03859c10-5117-4ce7-bc0e-67c4e26a26fb-detach_volume'" released by "detach_volume" :: held 0.016s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:29:35.582698 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7d914e7-1afc-4032-9ee8-84c3e4783cf6 tempest-VolumesActionsTest-1368969787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:29:35.602262 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a7d914e7-1afc-4032-9ee8-84c3e4783cf6 tempest-VolumesActionsTest-1368969787 None] Flow 'volume_create_manager' (90cf8276-bf6e-425d-9732-871eeb0544bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:29:35.608943 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a7d914e7-1afc-4032-9ee8-84c3e4783cf6 tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bde306b-935f-4162-9497-ac6b82969c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:35.624272 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a7d914e7-1afc-4032-9ee8-84c3e4783cf6 tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bde306b-935f-4162-9497-ac6b82969c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-116398500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0940a6b8-569a-46a5-a217-ce1738903d1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f4a5d8476f48828d3bf6816ac0d864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:29:36Z,use_quota=True,user_id='a4bc643e662c4873a068f6a09663aef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:35.629693 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a7d914e7-1afc-4032-9ee8-84c3e4783cf6 tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3588f0a-1e81-456e-b400-970dfc98f6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:35.634072 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a7d914e7-1afc-4032-9ee8-84c3e4783cf6 tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3588f0a-1e81-456e-b400-970dfc98f6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:35.639320 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a7d914e7-1afc-4032-9ee8-84c3e4783cf6 tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1045e898-1526-48b3-9b2d-c113bf1ebe4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:35.643554 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a7d914e7-1afc-4032-9ee8-84c3e4783cf6 tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1045e898-1526-48b3-9b2d-c113bf1ebe4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0940a6b8-569a-46a5-a217-ce1738903d1c', 'volume_name': 'volume-0940a6b8-569a-46a5-a217-ce1738903d1c', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:35.648694 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a7d914e7-1afc-4032-9ee8-84c3e4783cf6 tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (925a2a05-b173-444c-bf20-b6d0c55b5720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:35.652613 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a7d914e7-1afc-4032-9ee8-84c3e4783cf6 tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (925a2a05-b173-444c-bf20-b6d0c55b5720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:35.657348 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a7d914e7-1afc-4032-9ee8-84c3e4783cf6 tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c602bcb5-fbe7-4739-8588-d64209465512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:35.658408 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-a7d914e7-1afc-4032-9ee8-84c3e4783cf6 tempest-VolumesActionsTest-1368969787 None] Volume 0940a6b8-569a-46a5-a217-ce1738903d1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0940a6b8-569a-46a5-a217-ce1738903d1c', 'volume_size': 1} Apr 09 21:29:35.658787 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a7d914e7-1afc-4032-9ee8-84c3e4783cf6 tempest-VolumesActionsTest-1368969787 None] creating volume 'volume-0940a6b8-569a-46a5-a217-ce1738903d1c' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:29:35.659449 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a7d914e7-1afc-4032-9ee8-84c3e4783cf6 tempest-VolumesActionsTest-1368969787 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:35.725754 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a7d914e7-1afc-4032-9ee8-84c3e4783cf6 tempest-VolumesActionsTest-1368969787 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:29:35.726083 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a7d914e7-1afc-4032-9ee8-84c3e4783cf6 tempest-VolumesActionsTest-1368969787 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:29:35.731325 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a7d914e7-1afc-4032-9ee8-84c3e4783cf6 tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c602bcb5-fbe7-4739-8588-d64209465512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0940a6b8-569a-46a5-a217-ce1738903d1c', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:35.739222 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a7d914e7-1afc-4032-9ee8-84c3e4783cf6 tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6064e6ce-e3da-4fdb-8820-7485670c6318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:35.754962 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-a7d914e7-1afc-4032-9ee8-84c3e4783cf6 tempest-VolumesActionsTest-1368969787 None] Volume volume-0940a6b8-569a-46a5-a217-ce1738903d1c (0940a6b8-569a-46a5-a217-ce1738903d1c): created successfully Apr 09 21:29:35.759174 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a7d914e7-1afc-4032-9ee8-84c3e4783cf6 tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6064e6ce-e3da-4fdb-8820-7485670c6318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:35.764710 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a7d914e7-1afc-4032-9ee8-84c3e4783cf6 tempest-VolumesActionsTest-1368969787 None] Flow 'volume_create_manager' (90cf8276-bf6e-425d-9732-871eeb0544bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:29:35.775149 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-a7d914e7-1afc-4032-9ee8-84c3e4783cf6 tempest-VolumesActionsTest-1368969787 None] Created volume successfully. Apr 09 21:29:36.759955 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-7b8e910c-be28-4e18-8e7d-0d2103ee1c5a tempest-VolumesActionsTest-1326122298 None] Lock "b'cinder-0940a6b8-569a-46a5-a217-ce1738903d1c-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:29:36.787407 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-7b8e910c-be28-4e18-8e7d-0d2103ee1c5a tempest-VolumesActionsTest-1326122298 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:36.834532 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-7b8e910c-be28-4e18-8e7d-0d2103ee1c5a tempest-VolumesActionsTest-1326122298 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:29:36.835156 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-7b8e910c-be28-4e18-8e7d-0d2103ee1c5a tempest-VolumesActionsTest-1326122298 None] Volume volume-0940a6b8-569a-46a5-a217-ce1738903d1c is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:29:36.846530 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-7b8e910c-be28-4e18-8e7d-0d2103ee1c5a tempest-VolumesActionsTest-1326122298 None] deleting rbd volume volume-0940a6b8-569a-46a5-a217-ce1738903d1c {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:29:37.098784 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-7b8e910c-be28-4e18-8e7d-0d2103ee1c5a tempest-VolumesActionsTest-1326122298 None] Created reservations ['161972cd-ad84-4bba-bc61-e0f125782125', 'bd8a0947-0e19-4971-b461-4874059d7f95', '483d8ae7-84b1-4dea-a386-8c6d7b29def9', 'a78de5fc-bb6e-48d6-ad20-6a3d052a6239'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:29:37.145140 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-7b8e910c-be28-4e18-8e7d-0d2103ee1c5a tempest-VolumesActionsTest-1326122298 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:37.167460 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-7b8e910c-be28-4e18-8e7d-0d2103ee1c5a tempest-VolumesActionsTest-1326122298 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:37.193472 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-7b8e910c-be28-4e18-8e7d-0d2103ee1c5a tempest-VolumesActionsTest-1326122298 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:29:37.197840 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-7b8e910c-be28-4e18-8e7d-0d2103ee1c5a tempest-VolumesActionsTest-1326122298 None] Deleted volume successfully. Apr 09 21:29:37.211422 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-7b8e910c-be28-4e18-8e7d-0d2103ee1c5a tempest-VolumesActionsTest-1326122298 None] Lock "b'cinder-0940a6b8-569a-46a5-a217-ce1738903d1c-delete_volume'" released by "delete_volume" :: held 0.452s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:29:38.137302 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-671cf679-75a3-4361-9e08-a62c6ecbf9c6 tempest-VolumesActionsTest-1368969787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:29:38.156396 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-671cf679-75a3-4361-9e08-a62c6ecbf9c6 tempest-VolumesActionsTest-1368969787 None] Flow 'volume_create_manager' (74ae4ad2-3193-4fcd-84f6-28fe32041abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:29:38.165610 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-671cf679-75a3-4361-9e08-a62c6ecbf9c6 tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83f942ad-fb2b-40dc-ad30-f6ca04a5dfce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:38.180578 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-671cf679-75a3-4361-9e08-a62c6ecbf9c6 tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83f942ad-fb2b-40dc-ad30-f6ca04a5dfce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2123460734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e910422d-e5c4-4a3d-abac-17a70afce327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f4a5d8476f48828d3bf6816ac0d864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:29:38Z,use_quota=True,user_id='a4bc643e662c4873a068f6a09663aef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:38.186099 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-671cf679-75a3-4361-9e08-a62c6ecbf9c6 tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (170b25c5-9ff6-4ad6-abb4-5cfe7ddd1455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:38.190379 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-671cf679-75a3-4361-9e08-a62c6ecbf9c6 tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (170b25c5-9ff6-4ad6-abb4-5cfe7ddd1455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:38.195599 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-671cf679-75a3-4361-9e08-a62c6ecbf9c6 tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2713da93-cfa1-4d57-aff3-53d282cc16e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:38.199920 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-671cf679-75a3-4361-9e08-a62c6ecbf9c6 tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2713da93-cfa1-4d57-aff3-53d282cc16e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e910422d-e5c4-4a3d-abac-17a70afce327', 'volume_name': 'volume-e910422d-e5c4-4a3d-abac-17a70afce327', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:38.205008 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-671cf679-75a3-4361-9e08-a62c6ecbf9c6 tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4739884-becd-4328-8c59-b695058332f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:38.209404 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-671cf679-75a3-4361-9e08-a62c6ecbf9c6 tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4739884-becd-4328-8c59-b695058332f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:38.214258 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-671cf679-75a3-4361-9e08-a62c6ecbf9c6 tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (334e991c-55c3-44cd-ad61-8075133dd712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:38.215329 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-671cf679-75a3-4361-9e08-a62c6ecbf9c6 tempest-VolumesActionsTest-1368969787 None] Volume e910422d-e5c4-4a3d-abac-17a70afce327: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e910422d-e5c4-4a3d-abac-17a70afce327', 'volume_size': 1} Apr 09 21:29:38.215731 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-671cf679-75a3-4361-9e08-a62c6ecbf9c6 tempest-VolumesActionsTest-1368969787 None] creating volume 'volume-e910422d-e5c4-4a3d-abac-17a70afce327' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:29:38.216513 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-671cf679-75a3-4361-9e08-a62c6ecbf9c6 tempest-VolumesActionsTest-1368969787 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:38.273268 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-671cf679-75a3-4361-9e08-a62c6ecbf9c6 tempest-VolumesActionsTest-1368969787 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:29:38.273647 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-671cf679-75a3-4361-9e08-a62c6ecbf9c6 tempest-VolumesActionsTest-1368969787 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:29:38.277539 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-671cf679-75a3-4361-9e08-a62c6ecbf9c6 tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (334e991c-55c3-44cd-ad61-8075133dd712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e910422d-e5c4-4a3d-abac-17a70afce327', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:38.282246 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-671cf679-75a3-4361-9e08-a62c6ecbf9c6 tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde1d1a5-4515-4474-bca6-0140aeb180d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:38.292771 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-671cf679-75a3-4361-9e08-a62c6ecbf9c6 tempest-VolumesActionsTest-1368969787 None] Volume volume-e910422d-e5c4-4a3d-abac-17a70afce327 (e910422d-e5c4-4a3d-abac-17a70afce327): created successfully Apr 09 21:29:38.296481 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-671cf679-75a3-4361-9e08-a62c6ecbf9c6 tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde1d1a5-4515-4474-bca6-0140aeb180d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:38.302084 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-671cf679-75a3-4361-9e08-a62c6ecbf9c6 tempest-VolumesActionsTest-1368969787 None] Flow 'volume_create_manager' (74ae4ad2-3193-4fcd-84f6-28fe32041abf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:29:38.310801 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-671cf679-75a3-4361-9e08-a62c6ecbf9c6 tempest-VolumesActionsTest-1368969787 None] Created volume successfully. Apr 09 21:29:38.664172 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-1ace0f58-4049-4701-9b8c-a41563e29c9d req-3487d929-3ff6-4677-a3a8-580cd1484169 tempest-TestVolumeBootPattern-212634100 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:39.196555 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-1ace0f58-4049-4701-9b8c-a41563e29c9d req-3487d929-3ff6-4677-a3a8-580cd1484169 tempest-TestVolumeBootPattern-212634100 None] Create snapshot completed successfully Apr 09 21:29:39.328905 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-d2f0870a-6b7a-40bf-9098-cf232155a5be tempest-VolumesActionsTest-1326122298 None] Lock "b'cinder-e910422d-e5c4-4a3d-abac-17a70afce327-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:29:39.362179 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d2f0870a-6b7a-40bf-9098-cf232155a5be tempest-VolumesActionsTest-1326122298 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:39.408701 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d2f0870a-6b7a-40bf-9098-cf232155a5be tempest-VolumesActionsTest-1326122298 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:29:39.409119 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d2f0870a-6b7a-40bf-9098-cf232155a5be tempest-VolumesActionsTest-1326122298 None] Volume volume-e910422d-e5c4-4a3d-abac-17a70afce327 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:29:39.415966 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d2f0870a-6b7a-40bf-9098-cf232155a5be tempest-VolumesActionsTest-1326122298 None] deleting rbd volume volume-e910422d-e5c4-4a3d-abac-17a70afce327 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:29:39.667758 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-d2f0870a-6b7a-40bf-9098-cf232155a5be tempest-VolumesActionsTest-1326122298 None] Created reservations ['52cb3ea7-3545-401e-9339-d239c84a0e47', 'd0966384-31b1-4b43-8505-e300b0a2e17f', '94592306-7184-4ff3-b670-482a43f0ea4f', 'dda75641-0b22-478c-834d-93ed51899bcc'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:29:39.713689 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d2f0870a-6b7a-40bf-9098-cf232155a5be tempest-VolumesActionsTest-1326122298 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:39.747662 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d2f0870a-6b7a-40bf-9098-cf232155a5be tempest-VolumesActionsTest-1326122298 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:39.776651 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-d2f0870a-6b7a-40bf-9098-cf232155a5be tempest-VolumesActionsTest-1326122298 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:29:39.780716 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-d2f0870a-6b7a-40bf-9098-cf232155a5be tempest-VolumesActionsTest-1326122298 None] Deleted volume successfully. Apr 09 21:29:39.793730 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-d2f0870a-6b7a-40bf-9098-cf232155a5be tempest-VolumesActionsTest-1326122298 None] Lock "b'cinder-e910422d-e5c4-4a3d-abac-17a70afce327-delete_volume'" released by "delete_volume" :: held 0.465s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:29:40.718415 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-f92ea55f-1ea6-4d3a-8f64-a81385f8831c tempest-VolumesActionsTest-1368969787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:29:40.737073 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f92ea55f-1ea6-4d3a-8f64-a81385f8831c tempest-VolumesActionsTest-1368969787 None] Flow 'volume_create_manager' (fd8d82dc-f7da-4bf3-92e4-09d0b645f44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:29:40.743633 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f92ea55f-1ea6-4d3a-8f64-a81385f8831c tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa8b629a-73d4-40e7-976c-320214a09631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:40.759071 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f92ea55f-1ea6-4d3a-8f64-a81385f8831c tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa8b629a-73d4-40e7-976c-320214a09631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-309485221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=07b95d59-3970-450f-8733-f7fd158b2323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f4a5d8476f48828d3bf6816ac0d864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:29:41Z,use_quota=True,user_id='a4bc643e662c4873a068f6a09663aef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:40.764591 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f92ea55f-1ea6-4d3a-8f64-a81385f8831c tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a4e27f9-d1bd-4e86-af0c-2bd786c72bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:40.768798 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f92ea55f-1ea6-4d3a-8f64-a81385f8831c tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a4e27f9-d1bd-4e86-af0c-2bd786c72bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:40.774065 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f92ea55f-1ea6-4d3a-8f64-a81385f8831c tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a0c951-9567-4ac4-bf96-16a80ef31ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:40.778194 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f92ea55f-1ea6-4d3a-8f64-a81385f8831c tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a0c951-9567-4ac4-bf96-16a80ef31ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07b95d59-3970-450f-8733-f7fd158b2323', 'volume_name': 'volume-07b95d59-3970-450f-8733-f7fd158b2323', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:40.783212 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f92ea55f-1ea6-4d3a-8f64-a81385f8831c tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46057758-be51-4ec3-9028-94b0f393916c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:40.787184 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f92ea55f-1ea6-4d3a-8f64-a81385f8831c tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46057758-be51-4ec3-9028-94b0f393916c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:40.792018 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f92ea55f-1ea6-4d3a-8f64-a81385f8831c tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b3dfdfa-c380-4ce6-9ddb-68856731a415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:40.793090 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-f92ea55f-1ea6-4d3a-8f64-a81385f8831c tempest-VolumesActionsTest-1368969787 None] Volume 07b95d59-3970-450f-8733-f7fd158b2323: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07b95d59-3970-450f-8733-f7fd158b2323', 'volume_size': 1} Apr 09 21:29:40.793499 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f92ea55f-1ea6-4d3a-8f64-a81385f8831c tempest-VolumesActionsTest-1368969787 None] creating volume 'volume-07b95d59-3970-450f-8733-f7fd158b2323' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:29:40.794281 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f92ea55f-1ea6-4d3a-8f64-a81385f8831c tempest-VolumesActionsTest-1368969787 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:40.858877 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f92ea55f-1ea6-4d3a-8f64-a81385f8831c tempest-VolumesActionsTest-1368969787 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:29:40.859247 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f92ea55f-1ea6-4d3a-8f64-a81385f8831c tempest-VolumesActionsTest-1368969787 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:29:40.863026 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f92ea55f-1ea6-4d3a-8f64-a81385f8831c tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b3dfdfa-c380-4ce6-9ddb-68856731a415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07b95d59-3970-450f-8733-f7fd158b2323', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:40.867729 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f92ea55f-1ea6-4d3a-8f64-a81385f8831c tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (414dbaa8-c26c-488b-8b08-17809c3de15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:40.879638 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-f92ea55f-1ea6-4d3a-8f64-a81385f8831c tempest-VolumesActionsTest-1368969787 None] Volume volume-07b95d59-3970-450f-8733-f7fd158b2323 (07b95d59-3970-450f-8733-f7fd158b2323): created successfully Apr 09 21:29:40.883372 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f92ea55f-1ea6-4d3a-8f64-a81385f8831c tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (414dbaa8-c26c-488b-8b08-17809c3de15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:40.888943 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f92ea55f-1ea6-4d3a-8f64-a81385f8831c tempest-VolumesActionsTest-1368969787 None] Flow 'volume_create_manager' (fd8d82dc-f7da-4bf3-92e4-09d0b645f44c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:29:40.897897 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-f92ea55f-1ea6-4d3a-8f64-a81385f8831c tempest-VolumesActionsTest-1368969787 None] Created volume successfully. Apr 09 21:29:41.515386 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 req-96410f13-5f94-45cc-ac98-633411391b31 tempest-TestVolumeBootPattern-212634100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:29:41.544285 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 req-96410f13-5f94-45cc-ac98-633411391b31 tempest-TestVolumeBootPattern-212634100 None] Flow 'volume_create_manager' (ffd8b075-770f-482a-9b3d-a260969bf3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:29:41.553319 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 req-96410f13-5f94-45cc-ac98-633411391b31 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcdfc415-aaf5-4d4e-a00d-d100d79a4202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:41.569437 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 req-96410f13-5f94-45cc-ac98-633411391b31 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcdfc415-aaf5-4d4e-a00d-d100d79a4202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:29:41Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=300de092-989d-4496-bcbd-a7f297a9c7f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1063334e4a426eb70eec5ed1578744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c3acf4f7-f0e5-4ae7-a626-c36dbdcfb52a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:29:41Z,use_quota=True,user_id='2e9bbd737ff54225a549f072976ef296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:41.575763 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 req-96410f13-5f94-45cc-ac98-633411391b31 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (863e1340-ea09-417f-be73-d95c78f33e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:41.581549 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 req-96410f13-5f94-45cc-ac98-633411391b31 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (863e1340-ea09-417f-be73-d95c78f33e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:41.588268 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 req-96410f13-5f94-45cc-ac98-633411391b31 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88453680-7139-4d1a-9833-7eeb81ff5fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:41.592136 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 req-96410f13-5f94-45cc-ac98-633411391b31 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88453680-7139-4d1a-9833-7eeb81ff5fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '300de092-989d-4496-bcbd-a7f297a9c7f0', 'volume_name': 'volume-300de092-989d-4496-bcbd-a7f297a9c7f0', 'volume_size': 1, 'snapshot_id': 'c3acf4f7-f0e5-4ae7-a626-c36dbdcfb52a'}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:41.597198 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 req-96410f13-5f94-45cc-ac98-633411391b31 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2677cbd2-ae8e-4a71-a9ea-7b7fa1e1da12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:41.601171 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 req-96410f13-5f94-45cc-ac98-633411391b31 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2677cbd2-ae8e-4a71-a9ea-7b7fa1e1da12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:41.606033 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 req-96410f13-5f94-45cc-ac98-633411391b31 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20cddf70-4973-46a9-ada5-46721a2d3c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:41.607110 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 req-96410f13-5f94-45cc-ac98-633411391b31 tempest-TestVolumeBootPattern-212634100 None] Volume 300de092-989d-4496-bcbd-a7f297a9c7f0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-300de092-989d-4496-bcbd-a7f297a9c7f0', 'volume_size': 1, 'snapshot_id': 'c3acf4f7-f0e5-4ae7-a626-c36dbdcfb52a'} Apr 09 21:29:41.631961 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 req-96410f13-5f94-45cc-ac98-633411391b31 tempest-TestVolumeBootPattern-212634100 None] cloning volumes/volume-527175d7-c75b-4775-9719-6ac41f211e5f@snapshot-c3acf4f7-f0e5-4ae7-a626-c36dbdcfb52a to volume-300de092-989d-4496-bcbd-a7f297a9c7f0 {{(pid=135002) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1090}} Apr 09 21:29:41.632324 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 req-96410f13-5f94-45cc-ac98-633411391b31 tempest-TestVolumeBootPattern-212634100 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:41.763699 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 req-96410f13-5f94-45cc-ac98-633411391b31 tempest-TestVolumeBootPattern-212634100 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:41.944188 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-fc09791d-617c-4f30-a0b4-ef65fb76f0c0 tempest-VolumesActionsTest-1326122298 None] Lock "b'cinder-07b95d59-3970-450f-8733-f7fd158b2323-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:29:41.968438 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 req-96410f13-5f94-45cc-ac98-633411391b31 tempest-TestVolumeBootPattern-212634100 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:29:41.969054 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 req-96410f13-5f94-45cc-ac98-633411391b31 tempest-TestVolumeBootPattern-212634100 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:29:41.998134 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.volume_utils [req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 req-96410f13-5f94-45cc-ac98-633411391b31 tempest-TestVolumeBootPattern-212634100 None] Marking volume 300de092-989d-4496-bcbd-a7f297a9c7f0 as bootable. {{(pid=135002) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Apr 09 21:29:42.008057 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-fc09791d-617c-4f30-a0b4-ef65fb76f0c0 tempest-VolumesActionsTest-1326122298 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:42.052180 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-fc09791d-617c-4f30-a0b4-ef65fb76f0c0 tempest-VolumesActionsTest-1326122298 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:29:42.052610 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-fc09791d-617c-4f30-a0b4-ef65fb76f0c0 tempest-VolumesActionsTest-1326122298 None] Volume volume-07b95d59-3970-450f-8733-f7fd158b2323 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:29:42.058561 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-fc09791d-617c-4f30-a0b4-ef65fb76f0c0 tempest-VolumesActionsTest-1326122298 None] deleting rbd volume volume-07b95d59-3970-450f-8733-f7fd158b2323 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:29:42.066425 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 req-96410f13-5f94-45cc-ac98-633411391b31 tempest-TestVolumeBootPattern-212634100 None] Copying metadata from snapshot c3acf4f7-f0e5-4ae7-a626-c36dbdcfb52a to 300de092-989d-4496-bcbd-a7f297a9c7f0. {{(pid=135002) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:427}} Apr 09 21:29:42.099201 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 req-96410f13-5f94-45cc-ac98-633411391b31 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20cddf70-4973-46a9-ada5-46721a2d3c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-300de092-989d-4496-bcbd-a7f297a9c7f0', 'volume_size': 1, 'snapshot_id': 'c3acf4f7-f0e5-4ae7-a626-c36dbdcfb52a'}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:42.103903 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 req-96410f13-5f94-45cc-ac98-633411391b31 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fbcabcd-2f48-4fef-aa29-bc63a3b78a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:42.115252 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 req-96410f13-5f94-45cc-ac98-633411391b31 tempest-TestVolumeBootPattern-212634100 None] Volume volume-300de092-989d-4496-bcbd-a7f297a9c7f0 (300de092-989d-4496-bcbd-a7f297a9c7f0): created successfully Apr 09 21:29:42.119120 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 req-96410f13-5f94-45cc-ac98-633411391b31 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fbcabcd-2f48-4fef-aa29-bc63a3b78a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:42.124753 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 req-96410f13-5f94-45cc-ac98-633411391b31 tempest-TestVolumeBootPattern-212634100 None] Flow 'volume_create_manager' (ffd8b075-770f-482a-9b3d-a260969bf3a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:29:42.140870 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 req-96410f13-5f94-45cc-ac98-633411391b31 tempest-TestVolumeBootPattern-212634100 None] Created volume successfully. Apr 09 21:29:42.350084 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-fc09791d-617c-4f30-a0b4-ef65fb76f0c0 tempest-VolumesActionsTest-1326122298 None] Created reservations ['e9745f6f-4cb8-45cc-a271-a02d4c7bc301', 'dd8d27d6-379a-4da8-ad46-61fb8f4bb8c9', '450df722-7b30-4643-bdbd-06601bd14bb0', '96607598-e14b-411c-8065-2eb389b919de'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:29:42.412949 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-fc09791d-617c-4f30-a0b4-ef65fb76f0c0 tempest-VolumesActionsTest-1326122298 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:42.475482 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-fc09791d-617c-4f30-a0b4-ef65fb76f0c0 tempest-VolumesActionsTest-1326122298 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:42.523247 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-fc09791d-617c-4f30-a0b4-ef65fb76f0c0 tempest-VolumesActionsTest-1326122298 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:29:42.546815 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-fc09791d-617c-4f30-a0b4-ef65fb76f0c0 tempest-VolumesActionsTest-1326122298 None] Deleted volume successfully. Apr 09 21:29:42.567403 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-fc09791d-617c-4f30-a0b4-ef65fb76f0c0 tempest-VolumesActionsTest-1326122298 None] Lock "b'cinder-07b95d59-3970-450f-8733-f7fd158b2323-delete_volume'" released by "delete_volume" :: held 0.623s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:29:43.347504 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-8154fdd7-49e9-4eea-bd9f-ebf581465f4d tempest-VolumesActionsTest-1368969787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:29:43.367500 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8154fdd7-49e9-4eea-bd9f-ebf581465f4d tempest-VolumesActionsTest-1368969787 None] Flow 'volume_create_manager' (65df6060-b88b-4114-835d-daceef085241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:29:43.374535 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8154fdd7-49e9-4eea-bd9f-ebf581465f4d tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (871c9471-641e-4a14-a7cf-aca35b95d6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:43.389596 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8154fdd7-49e9-4eea-bd9f-ebf581465f4d tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (871c9471-641e-4a14-a7cf-aca35b95d6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1198254323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=61edad4d-ad8e-4dd4-a002-24591311155c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f4a5d8476f48828d3bf6816ac0d864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:29:43Z,use_quota=True,user_id='a4bc643e662c4873a068f6a09663aef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:43.395139 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8154fdd7-49e9-4eea-bd9f-ebf581465f4d tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7976e47-8be4-4b9c-a3cc-88921d1d9578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:43.399302 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8154fdd7-49e9-4eea-bd9f-ebf581465f4d tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7976e47-8be4-4b9c-a3cc-88921d1d9578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:43.404486 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8154fdd7-49e9-4eea-bd9f-ebf581465f4d tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaccc85b-7af0-42c3-86fa-9429fcc68994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:43.408588 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8154fdd7-49e9-4eea-bd9f-ebf581465f4d tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaccc85b-7af0-42c3-86fa-9429fcc68994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61edad4d-ad8e-4dd4-a002-24591311155c', 'volume_name': 'volume-61edad4d-ad8e-4dd4-a002-24591311155c', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:43.413779 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8154fdd7-49e9-4eea-bd9f-ebf581465f4d tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83656a9a-696c-4fe0-b23e-189e3e88fa49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:43.417921 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8154fdd7-49e9-4eea-bd9f-ebf581465f4d tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83656a9a-696c-4fe0-b23e-189e3e88fa49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:43.422769 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8154fdd7-49e9-4eea-bd9f-ebf581465f4d tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a31ff6d-4511-40be-b2dd-cc669183f003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:43.423839 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-8154fdd7-49e9-4eea-bd9f-ebf581465f4d tempest-VolumesActionsTest-1368969787 None] Volume 61edad4d-ad8e-4dd4-a002-24591311155c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61edad4d-ad8e-4dd4-a002-24591311155c', 'volume_size': 1} Apr 09 21:29:43.424225 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-8154fdd7-49e9-4eea-bd9f-ebf581465f4d tempest-VolumesActionsTest-1368969787 None] creating volume 'volume-61edad4d-ad8e-4dd4-a002-24591311155c' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:29:43.425018 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-8154fdd7-49e9-4eea-bd9f-ebf581465f4d tempest-VolumesActionsTest-1368969787 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:43.494888 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-8154fdd7-49e9-4eea-bd9f-ebf581465f4d tempest-VolumesActionsTest-1368969787 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:29:43.495335 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-8154fdd7-49e9-4eea-bd9f-ebf581465f4d tempest-VolumesActionsTest-1368969787 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:29:43.499241 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8154fdd7-49e9-4eea-bd9f-ebf581465f4d tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a31ff6d-4511-40be-b2dd-cc669183f003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61edad4d-ad8e-4dd4-a002-24591311155c', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:43.504504 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8154fdd7-49e9-4eea-bd9f-ebf581465f4d tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b53ccf-3c4f-47d0-a284-37f52353f6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:43.514420 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-8154fdd7-49e9-4eea-bd9f-ebf581465f4d tempest-VolumesActionsTest-1368969787 None] Volume volume-61edad4d-ad8e-4dd4-a002-24591311155c (61edad4d-ad8e-4dd4-a002-24591311155c): created successfully Apr 09 21:29:43.518417 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8154fdd7-49e9-4eea-bd9f-ebf581465f4d tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b53ccf-3c4f-47d0-a284-37f52353f6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:43.524109 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-8154fdd7-49e9-4eea-bd9f-ebf581465f4d tempest-VolumesActionsTest-1368969787 None] Flow 'volume_create_manager' (65df6060-b88b-4114-835d-daceef085241) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:29:43.533218 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-8154fdd7-49e9-4eea-bd9f-ebf581465f4d tempest-VolumesActionsTest-1368969787 None] Created volume successfully. Apr 09 21:29:44.527752 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-75b51054-43f0-4eb6-8337-0ab29f716113 tempest-VolumesActionsTest-1326122298 None] Lock "b'cinder-61edad4d-ad8e-4dd4-a002-24591311155c-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:29:44.556142 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-75b51054-43f0-4eb6-8337-0ab29f716113 tempest-VolumesActionsTest-1326122298 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:44.613816 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-75b51054-43f0-4eb6-8337-0ab29f716113 tempest-VolumesActionsTest-1326122298 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:29:44.614277 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-75b51054-43f0-4eb6-8337-0ab29f716113 tempest-VolumesActionsTest-1326122298 None] Volume volume-61edad4d-ad8e-4dd4-a002-24591311155c is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:29:44.626135 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-75b51054-43f0-4eb6-8337-0ab29f716113 tempest-VolumesActionsTest-1326122298 None] deleting rbd volume volume-61edad4d-ad8e-4dd4-a002-24591311155c {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:29:44.795555 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 req-3a1464e5-6ca6-4efc-a530-6f755e5c0ec8 tempest-TestVolumeBootPattern-212634100 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:29:44.899132 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-75b51054-43f0-4eb6-8337-0ab29f716113 tempest-VolumesActionsTest-1326122298 None] Created reservations ['4e81ff14-f3c9-4adb-a01f-2b2fd40c2a82', '0e22b72c-973f-4004-9335-1b55bbd3373c', '9740abde-f9fc-43fb-a05e-a01c881c3089', 'df505a4d-f299-45c7-97e0-9b8b0111cac2'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:29:44.947896 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-75b51054-43f0-4eb6-8337-0ab29f716113 tempest-VolumesActionsTest-1326122298 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:44.972331 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-75b51054-43f0-4eb6-8337-0ab29f716113 tempest-VolumesActionsTest-1326122298 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:44.996998 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-75b51054-43f0-4eb6-8337-0ab29f716113 tempest-VolumesActionsTest-1326122298 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:29:45.001522 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-75b51054-43f0-4eb6-8337-0ab29f716113 tempest-VolumesActionsTest-1326122298 None] Deleted volume successfully. Apr 09 21:29:45.017927 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-75b51054-43f0-4eb6-8337-0ab29f716113 tempest-VolumesActionsTest-1326122298 None] Lock "b'cinder-61edad4d-ad8e-4dd4-a002-24591311155c-delete_volume'" released by "delete_volume" :: held 0.490s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:29:45.423663 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 req-3a1464e5-6ca6-4efc-a530-6f755e5c0ec8 tempest-TestVolumeBootPattern-212634100 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.628s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:29:45.424306 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 req-3a1464e5-6ca6-4efc-a530-6f755e5c0ec8 tempest-TestVolumeBootPattern-212634100 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-300de092-989d-4496-bcbd-a7f297a9c7f0', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': '300de092-989d-4496-bcbd-a7f297a9c7f0', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:29:45.447519 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 req-3a1464e5-6ca6-4efc-a530-6f755e5c0ec8 tempest-TestVolumeBootPattern-212634100 None] Connection info returned from driver {'name': 'volumes/volume-300de092-989d-4496-bcbd-a7f297a9c7f0', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '300de092-989d-4496-bcbd-a7f297a9c7f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0723b793-3cb2-4429-b150-1683acc2aa32'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 21:29:45.493422 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-74a3d30d-c990-41e6-92e2-293a61c4d2b4 req-3a1464e5-6ca6-4efc-a530-6f755e5c0ec8 tempest-TestVolumeBootPattern-212634100 None] attachment_update completed successfully. Apr 09 21:29:45.897545 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a80e83c-c54a-42b5-b363-530c12fb0ebf tempest-VolumesActionsTest-1368969787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:29:45.917097 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-0a80e83c-c54a-42b5-b363-530c12fb0ebf tempest-VolumesActionsTest-1368969787 None] Flow 'volume_create_manager' (72fcb336-1d66-4edd-bd45-63ce85e5e6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:29:45.923679 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-0a80e83c-c54a-42b5-b363-530c12fb0ebf tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94402a36-d9e9-4d93-b200-18f40a7b4bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:45.939619 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-0a80e83c-c54a-42b5-b363-530c12fb0ebf tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94402a36-d9e9-4d93-b200-18f40a7b4bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1683216053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9a4f86d4-0d25-4e59-8dcf-82c9effa55bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f4a5d8476f48828d3bf6816ac0d864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:29:46Z,use_quota=True,user_id='a4bc643e662c4873a068f6a09663aef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:45.944813 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-0a80e83c-c54a-42b5-b363-530c12fb0ebf tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de0a8e71-f5a6-45b5-8765-922465016d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:45.949168 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-0a80e83c-c54a-42b5-b363-530c12fb0ebf tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de0a8e71-f5a6-45b5-8765-922465016d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:45.954335 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-0a80e83c-c54a-42b5-b363-530c12fb0ebf tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea00292-0c90-41ec-8223-ced6d2351e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:45.958917 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-0a80e83c-c54a-42b5-b363-530c12fb0ebf tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea00292-0c90-41ec-8223-ced6d2351e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a4f86d4-0d25-4e59-8dcf-82c9effa55bd', 'volume_name': 'volume-9a4f86d4-0d25-4e59-8dcf-82c9effa55bd', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:45.964407 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-0a80e83c-c54a-42b5-b363-530c12fb0ebf tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35efca8a-3916-4a84-9c7d-7b16b15702db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:45.968368 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-0a80e83c-c54a-42b5-b363-530c12fb0ebf tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35efca8a-3916-4a84-9c7d-7b16b15702db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:45.973191 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-0a80e83c-c54a-42b5-b363-530c12fb0ebf tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfb3e01f-4dff-43fa-8b1d-eac3416061d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:45.974266 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-0a80e83c-c54a-42b5-b363-530c12fb0ebf tempest-VolumesActionsTest-1368969787 None] Volume 9a4f86d4-0d25-4e59-8dcf-82c9effa55bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a4f86d4-0d25-4e59-8dcf-82c9effa55bd', 'volume_size': 1} Apr 09 21:29:45.974659 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-0a80e83c-c54a-42b5-b363-530c12fb0ebf tempest-VolumesActionsTest-1368969787 None] creating volume 'volume-9a4f86d4-0d25-4e59-8dcf-82c9effa55bd' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:29:45.975457 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-0a80e83c-c54a-42b5-b363-530c12fb0ebf tempest-VolumesActionsTest-1368969787 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:46.037935 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-0a80e83c-c54a-42b5-b363-530c12fb0ebf tempest-VolumesActionsTest-1368969787 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:29:46.038314 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-0a80e83c-c54a-42b5-b363-530c12fb0ebf tempest-VolumesActionsTest-1368969787 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:29:46.042147 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-0a80e83c-c54a-42b5-b363-530c12fb0ebf tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfb3e01f-4dff-43fa-8b1d-eac3416061d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a4f86d4-0d25-4e59-8dcf-82c9effa55bd', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:46.046837 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-0a80e83c-c54a-42b5-b363-530c12fb0ebf tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (092778f2-2f67-42d8-aa6a-316bee9a886d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:46.056980 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-0a80e83c-c54a-42b5-b363-530c12fb0ebf tempest-VolumesActionsTest-1368969787 None] Volume volume-9a4f86d4-0d25-4e59-8dcf-82c9effa55bd (9a4f86d4-0d25-4e59-8dcf-82c9effa55bd): created successfully Apr 09 21:29:46.060693 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-0a80e83c-c54a-42b5-b363-530c12fb0ebf tempest-VolumesActionsTest-1368969787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (092778f2-2f67-42d8-aa6a-316bee9a886d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:46.066470 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-0a80e83c-c54a-42b5-b363-530c12fb0ebf tempest-VolumesActionsTest-1368969787 None] Flow 'volume_create_manager' (72fcb336-1d66-4edd-bd45-63ce85e5e6d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:29:46.074963 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-0a80e83c-c54a-42b5-b363-530c12fb0ebf tempest-VolumesActionsTest-1368969787 None] Created volume successfully. Apr 09 21:29:47.434487 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-94f0177c-3d05-4e75-b811-bc94c89da370 tempest-VolumesActionsTest-1368969787 None] Lock "b'cinder-9a4f86d4-0d25-4e59-8dcf-82c9effa55bd-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:29:47.477307 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-94f0177c-3d05-4e75-b811-bc94c89da370 tempest-VolumesActionsTest-1368969787 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:47.512830 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-94f0177c-3d05-4e75-b811-bc94c89da370 tempest-VolumesActionsTest-1368969787 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:29:47.513312 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-94f0177c-3d05-4e75-b811-bc94c89da370 tempest-VolumesActionsTest-1368969787 None] Volume volume-9a4f86d4-0d25-4e59-8dcf-82c9effa55bd is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:29:47.520302 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-94f0177c-3d05-4e75-b811-bc94c89da370 tempest-VolumesActionsTest-1368969787 None] deleting rbd volume volume-9a4f86d4-0d25-4e59-8dcf-82c9effa55bd {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:29:47.779237 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-94f0177c-3d05-4e75-b811-bc94c89da370 tempest-VolumesActionsTest-1368969787 None] Created reservations ['c53e119b-5746-4f1d-8016-63a2d2b500d9', '1451927f-0338-40e8-9f13-c4113d3d1c3d', 'c91e42a7-916d-4e2a-80ea-2c07f4af32eb', '2e119d06-00fb-4367-aa41-6b68dc9a36af'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:29:47.828511 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-94f0177c-3d05-4e75-b811-bc94c89da370 tempest-VolumesActionsTest-1368969787 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:47.852127 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-94f0177c-3d05-4e75-b811-bc94c89da370 tempest-VolumesActionsTest-1368969787 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:47.875115 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-94f0177c-3d05-4e75-b811-bc94c89da370 tempest-VolumesActionsTest-1368969787 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:29:47.881664 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-94f0177c-3d05-4e75-b811-bc94c89da370 tempest-VolumesActionsTest-1368969787 None] Deleted volume successfully. Apr 09 21:29:47.894875 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-94f0177c-3d05-4e75-b811-bc94c89da370 tempest-VolumesActionsTest-1368969787 None] Lock "b'cinder-9a4f86d4-0d25-4e59-8dcf-82c9effa55bd-delete_volume'" released by "delete_volume" :: held 0.460s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:29:48.654928 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-d2ce24c5-132a-4e73-a613-13cbcf825233 tempest-VolumesActionsTest-1368969787 None] Lock "b'cinder-03859c10-5117-4ce7-bc0e-67c4e26a26fb-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:29:48.686673 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d2ce24c5-132a-4e73-a613-13cbcf825233 tempest-VolumesActionsTest-1368969787 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:48.772923 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d2ce24c5-132a-4e73-a613-13cbcf825233 tempest-VolumesActionsTest-1368969787 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:29:48.773411 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d2ce24c5-132a-4e73-a613-13cbcf825233 tempest-VolumesActionsTest-1368969787 None] Volume volume-03859c10-5117-4ce7-bc0e-67c4e26a26fb is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:29:48.782054 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d2ce24c5-132a-4e73-a613-13cbcf825233 tempest-VolumesActionsTest-1368969787 None] deleting rbd volume volume-03859c10-5117-4ce7-bc0e-67c4e26a26fb {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:29:49.029518 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-d2ce24c5-132a-4e73-a613-13cbcf825233 tempest-VolumesActionsTest-1368969787 None] Created reservations ['4e6ff71a-75d4-4670-ada0-a041d1e125e8', '82dea8fa-71fb-4f4b-b375-3b042133e022', '62e91a6c-ca0b-4a94-83c6-9c21c8b3cfa4', 'a602c839-7086-4351-8e12-2b5f0313c76e'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:29:49.073792 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d2ce24c5-132a-4e73-a613-13cbcf825233 tempest-VolumesActionsTest-1368969787 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:49.097158 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d2ce24c5-132a-4e73-a613-13cbcf825233 tempest-VolumesActionsTest-1368969787 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:49.119805 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-d2ce24c5-132a-4e73-a613-13cbcf825233 tempest-VolumesActionsTest-1368969787 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:29:49.123750 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-d2ce24c5-132a-4e73-a613-13cbcf825233 tempest-VolumesActionsTest-1368969787 None] Deleted volume successfully. Apr 09 21:29:49.136754 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-d2ce24c5-132a-4e73-a613-13cbcf825233 tempest-VolumesActionsTest-1368969787 None] Lock "b'cinder-03859c10-5117-4ce7-bc0e-67c4e26a26fb-delete_volume'" released by "delete_volume" :: held 0.482s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:29:49.985668 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:29:49.986470 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:50.016221 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:50.041312 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:29:53.502342 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-decc1aaf-2ca1-4921-9ddd-231312b3e0be tempest-AbsoluteLimitsTests-2028798940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:29:53.522235 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-decc1aaf-2ca1-4921-9ddd-231312b3e0be tempest-AbsoluteLimitsTests-2028798940 None] Flow 'volume_create_manager' (f4b0b035-4fe4-425d-ae3c-2825727fee70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:29:53.528795 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-decc1aaf-2ca1-4921-9ddd-231312b3e0be tempest-AbsoluteLimitsTests-2028798940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fc6b79f-a386-4272-9ed4-c7e07d9179b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:53.543719 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-decc1aaf-2ca1-4921-9ddd-231312b3e0be tempest-AbsoluteLimitsTests-2028798940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fc6b79f-a386-4272-9ed4-c7e07d9179b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1382901390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2abc2415-a9f4-4608-9fbe-f6fdb3cb26bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f49c048d7943447da35f5e12790dcd1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:29:53Z,use_quota=True,user_id='f2f03c792aaa4d3380ddfe073fef7904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:53.549772 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-decc1aaf-2ca1-4921-9ddd-231312b3e0be tempest-AbsoluteLimitsTests-2028798940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (375ba7d1-701a-4709-a714-021c1734f7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:53.554162 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-decc1aaf-2ca1-4921-9ddd-231312b3e0be tempest-AbsoluteLimitsTests-2028798940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (375ba7d1-701a-4709-a714-021c1734f7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:53.559441 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-decc1aaf-2ca1-4921-9ddd-231312b3e0be tempest-AbsoluteLimitsTests-2028798940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (040e0605-f9f8-41eb-83b1-c2095773fed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:53.563553 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-decc1aaf-2ca1-4921-9ddd-231312b3e0be tempest-AbsoluteLimitsTests-2028798940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (040e0605-f9f8-41eb-83b1-c2095773fed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2abc2415-a9f4-4608-9fbe-f6fdb3cb26bf', 'volume_name': 'volume-2abc2415-a9f4-4608-9fbe-f6fdb3cb26bf', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:53.568539 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-decc1aaf-2ca1-4921-9ddd-231312b3e0be tempest-AbsoluteLimitsTests-2028798940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee971a14-992b-4c72-9722-3da9fcdb39be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:53.572511 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-decc1aaf-2ca1-4921-9ddd-231312b3e0be tempest-AbsoluteLimitsTests-2028798940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee971a14-992b-4c72-9722-3da9fcdb39be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:53.577375 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-decc1aaf-2ca1-4921-9ddd-231312b3e0be tempest-AbsoluteLimitsTests-2028798940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d37f9e5-3424-4740-a374-dc701380b859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:53.578569 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-decc1aaf-2ca1-4921-9ddd-231312b3e0be tempest-AbsoluteLimitsTests-2028798940 None] Volume 2abc2415-a9f4-4608-9fbe-f6fdb3cb26bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2abc2415-a9f4-4608-9fbe-f6fdb3cb26bf', 'volume_size': 1} Apr 09 21:29:53.578930 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-decc1aaf-2ca1-4921-9ddd-231312b3e0be tempest-AbsoluteLimitsTests-2028798940 None] creating volume 'volume-2abc2415-a9f4-4608-9fbe-f6fdb3cb26bf' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:29:53.579730 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-decc1aaf-2ca1-4921-9ddd-231312b3e0be tempest-AbsoluteLimitsTests-2028798940 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:53.645528 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-decc1aaf-2ca1-4921-9ddd-231312b3e0be tempest-AbsoluteLimitsTests-2028798940 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:29:53.645933 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-decc1aaf-2ca1-4921-9ddd-231312b3e0be tempest-AbsoluteLimitsTests-2028798940 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:29:53.649820 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-decc1aaf-2ca1-4921-9ddd-231312b3e0be tempest-AbsoluteLimitsTests-2028798940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d37f9e5-3424-4740-a374-dc701380b859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2abc2415-a9f4-4608-9fbe-f6fdb3cb26bf', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:53.654719 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-decc1aaf-2ca1-4921-9ddd-231312b3e0be tempest-AbsoluteLimitsTests-2028798940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa943d90-04f5-4860-997c-8b442fd018e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:53.666189 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-decc1aaf-2ca1-4921-9ddd-231312b3e0be tempest-AbsoluteLimitsTests-2028798940 None] Volume volume-2abc2415-a9f4-4608-9fbe-f6fdb3cb26bf (2abc2415-a9f4-4608-9fbe-f6fdb3cb26bf): created successfully Apr 09 21:29:53.670217 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-decc1aaf-2ca1-4921-9ddd-231312b3e0be tempest-AbsoluteLimitsTests-2028798940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa943d90-04f5-4860-997c-8b442fd018e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:53.675733 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-decc1aaf-2ca1-4921-9ddd-231312b3e0be tempest-AbsoluteLimitsTests-2028798940 None] Flow 'volume_create_manager' (f4b0b035-4fe4-425d-ae3c-2825727fee70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:29:53.686740 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-decc1aaf-2ca1-4921-9ddd-231312b3e0be tempest-AbsoluteLimitsTests-2028798940 None] Created volume successfully. Apr 09 21:29:54.627849 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-55b70460-d3c1-4449-8664-97981f2d353d tempest-AbsoluteLimitsTests-2028798940 None] Lock "b'cinder-2abc2415-a9f4-4608-9fbe-f6fdb3cb26bf-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:29:54.661680 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-55b70460-d3c1-4449-8664-97981f2d353d tempest-AbsoluteLimitsTests-2028798940 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:54.701404 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-55b70460-d3c1-4449-8664-97981f2d353d tempest-AbsoluteLimitsTests-2028798940 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:29:54.701907 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-55b70460-d3c1-4449-8664-97981f2d353d tempest-AbsoluteLimitsTests-2028798940 None] Volume volume-2abc2415-a9f4-4608-9fbe-f6fdb3cb26bf is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:29:54.710155 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-55b70460-d3c1-4449-8664-97981f2d353d tempest-AbsoluteLimitsTests-2028798940 None] deleting rbd volume volume-2abc2415-a9f4-4608-9fbe-f6fdb3cb26bf {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:29:54.958033 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-55b70460-d3c1-4449-8664-97981f2d353d tempest-AbsoluteLimitsTests-2028798940 None] Created reservations ['111405f5-5afc-41ee-89d2-dc347c516cc6', 'f82cec15-a4c3-44e1-b5b5-a8a858d04bd3', 'f0940138-c6ff-4af7-8b1f-7e20a6c07788', 'd9f89661-0a97-4c53-ad26-7192c92d5733'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:29:55.007862 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-55b70460-d3c1-4449-8664-97981f2d353d tempest-AbsoluteLimitsTests-2028798940 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:55.033103 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-55b70460-d3c1-4449-8664-97981f2d353d tempest-AbsoluteLimitsTests-2028798940 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:55.056438 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-55b70460-d3c1-4449-8664-97981f2d353d tempest-AbsoluteLimitsTests-2028798940 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:29:55.060866 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-55b70460-d3c1-4449-8664-97981f2d353d tempest-AbsoluteLimitsTests-2028798940 None] Deleted volume successfully. Apr 09 21:29:55.075660 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-55b70460-d3c1-4449-8664-97981f2d353d tempest-AbsoluteLimitsTests-2028798940 None] Lock "b'cinder-2abc2415-a9f4-4608-9fbe-f6fdb3cb26bf-delete_volume'" released by "delete_volume" :: held 0.448s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:29:58.014150 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-a0348c5d-f3d2-4164-b7cc-cbfca6176fd3 req-1da8dd64-5e4b-4da8-9cf0-97a4da5fac88 tempest-TestVolumeBootPattern-212634100 None] Terminate volume connection completed successfully. Apr 09 21:29:58.016077 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-a0348c5d-f3d2-4164-b7cc-cbfca6176fd3 req-1da8dd64-5e4b-4da8-9cf0-97a4da5fac88 tempest-TestVolumeBootPattern-212634100 None] Deleting attachment 0723b793-3cb2-4429-b150-1683acc2aa32. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 21:29:58.149360 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [req-a0348c5d-f3d2-4164-b7cc-cbfca6176fd3 req-5d67522e-2322-4bf9-b077-b76a07429ee0 tempest-TestVolumeBootPattern-212634100 None] Lock "b'cinder-300de092-989d-4496-bcbd-a7f297a9c7f0-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:29:58.183515 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-a0348c5d-f3d2-4164-b7cc-cbfca6176fd3 req-5d67522e-2322-4bf9-b077-b76a07429ee0 tempest-TestVolumeBootPattern-212634100 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:58.273269 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-a0348c5d-f3d2-4164-b7cc-cbfca6176fd3 req-5d67522e-2322-4bf9-b077-b76a07429ee0 tempest-TestVolumeBootPattern-212634100 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:29:58.283921 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-a0348c5d-f3d2-4164-b7cc-cbfca6176fd3 req-5d67522e-2322-4bf9-b077-b76a07429ee0 tempest-TestVolumeBootPattern-212634100 None] deleting rbd volume volume-300de092-989d-4496-bcbd-a7f297a9c7f0 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:29:58.436594 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d72a9ab-c002-4af3-936f-71db445b0e13 tempest-VolumesDeleteCascade-1622728886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:29:58.456353 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1d72a9ab-c002-4af3-936f-71db445b0e13 tempest-VolumesDeleteCascade-1622728886 None] Flow 'volume_create_manager' (cdcadca3-d0a2-4097-8f92-49bb84d65c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:29:58.463737 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1d72a9ab-c002-4af3-936f-71db445b0e13 tempest-VolumesDeleteCascade-1622728886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ce905dc-61b2-4979-85d2-97e877140f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:58.479355 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1d72a9ab-c002-4af3-936f-71db445b0e13 tempest-VolumesDeleteCascade-1622728886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ce905dc-61b2-4979-85d2-97e877140f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-649123262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=827f3f57-b5bb-4dda-ac23-e177ad0cb4ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a1e134964d24ff89caaf84a52590601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:29:58Z,use_quota=True,user_id='cbd52b74730348139214b0c383944286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:58.486771 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1d72a9ab-c002-4af3-936f-71db445b0e13 tempest-VolumesDeleteCascade-1622728886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e4855b6-948a-4ab0-9ae1-9ea541a85ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:58.493409 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1d72a9ab-c002-4af3-936f-71db445b0e13 tempest-VolumesDeleteCascade-1622728886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e4855b6-948a-4ab0-9ae1-9ea541a85ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:58.499919 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1d72a9ab-c002-4af3-936f-71db445b0e13 tempest-VolumesDeleteCascade-1622728886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9484a906-3b8f-46df-8fd2-8c07496dece9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:58.510585 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1d72a9ab-c002-4af3-936f-71db445b0e13 tempest-VolumesDeleteCascade-1622728886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9484a906-3b8f-46df-8fd2-8c07496dece9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '827f3f57-b5bb-4dda-ac23-e177ad0cb4ea', 'volume_name': 'volume-827f3f57-b5bb-4dda-ac23-e177ad0cb4ea', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:58.526929 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1d72a9ab-c002-4af3-936f-71db445b0e13 tempest-VolumesDeleteCascade-1622728886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb718e0f-ca07-43e0-b6df-c382dd165df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:58.531492 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1d72a9ab-c002-4af3-936f-71db445b0e13 tempest-VolumesDeleteCascade-1622728886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb718e0f-ca07-43e0-b6df-c382dd165df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:58.537070 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1d72a9ab-c002-4af3-936f-71db445b0e13 tempest-VolumesDeleteCascade-1622728886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8618d85d-cd58-4a4f-bf28-31a25c4730cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:58.538203 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-1d72a9ab-c002-4af3-936f-71db445b0e13 tempest-VolumesDeleteCascade-1622728886 None] Volume 827f3f57-b5bb-4dda-ac23-e177ad0cb4ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-827f3f57-b5bb-4dda-ac23-e177ad0cb4ea', 'volume_size': 1} Apr 09 21:29:58.538611 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1d72a9ab-c002-4af3-936f-71db445b0e13 tempest-VolumesDeleteCascade-1622728886 None] creating volume 'volume-827f3f57-b5bb-4dda-ac23-e177ad0cb4ea' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:29:58.539426 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1d72a9ab-c002-4af3-936f-71db445b0e13 tempest-VolumesDeleteCascade-1622728886 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:58.676057 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1d72a9ab-c002-4af3-936f-71db445b0e13 tempest-VolumesDeleteCascade-1622728886 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:29:58.676441 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-1d72a9ab-c002-4af3-936f-71db445b0e13 tempest-VolumesDeleteCascade-1622728886 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:29:58.680944 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1d72a9ab-c002-4af3-936f-71db445b0e13 tempest-VolumesDeleteCascade-1622728886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8618d85d-cd58-4a4f-bf28-31a25c4730cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-827f3f57-b5bb-4dda-ac23-e177ad0cb4ea', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:58.686336 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1d72a9ab-c002-4af3-936f-71db445b0e13 tempest-VolumesDeleteCascade-1622728886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d52b771-2957-4abb-9f08-11a474f95195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:29:58.696882 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-1d72a9ab-c002-4af3-936f-71db445b0e13 tempest-VolumesDeleteCascade-1622728886 None] Volume volume-827f3f57-b5bb-4dda-ac23-e177ad0cb4ea (827f3f57-b5bb-4dda-ac23-e177ad0cb4ea): created successfully Apr 09 21:29:58.701254 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1d72a9ab-c002-4af3-936f-71db445b0e13 tempest-VolumesDeleteCascade-1622728886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d52b771-2957-4abb-9f08-11a474f95195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:29:58.707525 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-1d72a9ab-c002-4af3-936f-71db445b0e13 tempest-VolumesDeleteCascade-1622728886 None] Flow 'volume_create_manager' (cdcadca3-d0a2-4097-8f92-49bb84d65c57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:29:58.716900 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-1d72a9ab-c002-4af3-936f-71db445b0e13 tempest-VolumesDeleteCascade-1622728886 None] Created volume successfully. Apr 09 21:29:58.829295 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [req-a0348c5d-f3d2-4164-b7cc-cbfca6176fd3 req-5d67522e-2322-4bf9-b077-b76a07429ee0 tempest-TestVolumeBootPattern-212634100 None] Created reservations ['6891e4e5-8e90-4d05-965c-63d251571b15', 'c30f7965-448a-4934-94f7-7177804c6548', 'f8d7e055-e002-41d0-8732-353d02697ed8', '79753814-38fe-4ba3-bb00-4ba6b9454243'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:29:58.880478 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-a0348c5d-f3d2-4164-b7cc-cbfca6176fd3 req-5d67522e-2322-4bf9-b077-b76a07429ee0 tempest-TestVolumeBootPattern-212634100 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:58.904879 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-a0348c5d-f3d2-4164-b7cc-cbfca6176fd3 req-5d67522e-2322-4bf9-b077-b76a07429ee0 tempest-TestVolumeBootPattern-212634100 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:58.928715 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [req-a0348c5d-f3d2-4164-b7cc-cbfca6176fd3 req-5d67522e-2322-4bf9-b077-b76a07429ee0 tempest-TestVolumeBootPattern-212634100 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:29:58.932961 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-a0348c5d-f3d2-4164-b7cc-cbfca6176fd3 req-5d67522e-2322-4bf9-b077-b76a07429ee0 tempest-TestVolumeBootPattern-212634100 None] Deleted volume successfully. Apr 09 21:29:58.947016 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [req-a0348c5d-f3d2-4164-b7cc-cbfca6176fd3 req-5d67522e-2322-4bf9-b077-b76a07429ee0 tempest-TestVolumeBootPattern-212634100 None] Lock "b'cinder-300de092-989d-4496-bcbd-a7f297a9c7f0-delete_volume'" released by "delete_volume" :: held 0.798s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:29:59.485437 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-749cccac-b6fd-4ad3-bda2-d71db3d19f96 tempest-TestVolumeBootPattern-212634100 None] Lock "b'cinder-c3acf4f7-f0e5-4ae7-a626-c36dbdcfb52a-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:29:59.487129 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-749cccac-b6fd-4ad3-bda2-d71db3d19f96 tempest-TestVolumeBootPattern-212634100 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:29:59.679432 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-91171f8c-fff7-42e4-a3be-9d38f51a870f tempest-VolumesDeleteCascade-1622728886 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:00.207469 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-91171f8c-fff7-42e4-a3be-9d38f51a870f tempest-VolumesDeleteCascade-1622728886 None] Create snapshot completed successfully Apr 09 21:30:00.876087 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-e4449d6b-1c91-4b83-96db-b5e45354c171 tempest-VolumesDeleteCascade-1622728886 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:01.196999 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-e4449d6b-1c91-4b83-96db-b5e45354c171 tempest-VolumesDeleteCascade-1622728886 None] Create snapshot completed successfully Apr 09 21:30:01.977704 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-eb71b13c-90e1-4295-937e-f9c37abe3c76 tempest-VolumesDeleteCascade-1622728886 None] Lock "b'cinder-827f3f57-b5bb-4dda-ac23-e177ad0cb4ea-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:30:02.010454 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eb71b13c-90e1-4295-937e-f9c37abe3c76 tempest-VolumesDeleteCascade-1622728886 None] Performing cascade delete. {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/manager.py:963}} Apr 09 21:30:02.031753 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-eb71b13c-90e1-4295-937e-f9c37abe3c76 tempest-VolumesDeleteCascade-1622728886 None] Lock "b'cinder-a2719a42-a510-4e11-bb98-eb156ebccfcd-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:30:02.046497 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-eb71b13c-90e1-4295-937e-f9c37abe3c76 tempest-VolumesDeleteCascade-1622728886 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:03.236718 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-eb71b13c-90e1-4295-937e-f9c37abe3c76 tempest-VolumesDeleteCascade-1622728886 None] Created reservations ['31cc28f2-68c9-48af-9055-957fc0dc18c4', 'ea575bb7-7284-4c30-ab98-054bbf88a8db', '6d934e84-c8e1-49ce-931c-95ef6c3dd66b', 'bdc3daba-d9d0-4dcd-9581-66983dc809bd'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:30:03.273661 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-eb71b13c-90e1-4295-937e-f9c37abe3c76 tempest-VolumesDeleteCascade-1622728886 None] Delete snapshot completed successfully. Apr 09 21:30:03.278201 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-eb71b13c-90e1-4295-937e-f9c37abe3c76 tempest-VolumesDeleteCascade-1622728886 None] Lock "b'cinder-a2719a42-a510-4e11-bb98-eb156ebccfcd-delete_snapshot'" released by "delete_snapshot" :: held 1.247s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:30:03.286106 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-eb71b13c-90e1-4295-937e-f9c37abe3c76 tempest-VolumesDeleteCascade-1622728886 None] Lock "b'cinder-fcd8f00b-95b2-473d-a6bc-20e7a1cfbd92-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.007s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:30:03.299752 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-eb71b13c-90e1-4295-937e-f9c37abe3c76 tempest-VolumesDeleteCascade-1622728886 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:04.256021 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-eb71b13c-90e1-4295-937e-f9c37abe3c76 tempest-VolumesDeleteCascade-1622728886 None] Created reservations ['28b2d78e-e989-45b1-be31-34bfa34f4041', '042609b1-851c-4578-aec5-eefbf2eb8b3b', 'f4ccf7d5-8d6d-461c-96f3-8737bd3aefa8', '7df8a6be-42be-4d54-b0e6-10f91bd6dcd3'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:30:04.298832 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-eb71b13c-90e1-4295-937e-f9c37abe3c76 tempest-VolumesDeleteCascade-1622728886 None] Delete snapshot completed successfully. Apr 09 21:30:04.303622 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-eb71b13c-90e1-4295-937e-f9c37abe3c76 tempest-VolumesDeleteCascade-1622728886 None] Lock "b'cinder-fcd8f00b-95b2-473d-a6bc-20e7a1cfbd92-delete_snapshot'" released by "delete_snapshot" :: held 1.018s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:30:04.304310 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-eb71b13c-90e1-4295-937e-f9c37abe3c76 tempest-VolumesDeleteCascade-1622728886 None] Snapshots deleted, issuing volume delete {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/manager.py:978}} Apr 09 21:30:04.305332 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-eb71b13c-90e1-4295-937e-f9c37abe3c76 tempest-VolumesDeleteCascade-1622728886 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:04.355941 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-eb71b13c-90e1-4295-937e-f9c37abe3c76 tempest-VolumesDeleteCascade-1622728886 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:30:04.356512 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-eb71b13c-90e1-4295-937e-f9c37abe3c76 tempest-VolumesDeleteCascade-1622728886 None] Volume volume-827f3f57-b5bb-4dda-ac23-e177ad0cb4ea is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:30:04.365974 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-eb71b13c-90e1-4295-937e-f9c37abe3c76 tempest-VolumesDeleteCascade-1622728886 None] deleting rbd volume volume-827f3f57-b5bb-4dda-ac23-e177ad0cb4ea {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:30:04.737534 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-eb71b13c-90e1-4295-937e-f9c37abe3c76 tempest-VolumesDeleteCascade-1622728886 None] Created reservations ['675fd13a-92f1-4718-b4a2-55677a6e32f9', '685d019f-c271-4d66-8667-ec7c2255315f', 'd3577e3c-67d9-42af-9245-da696b31eee5', '07be248b-64ae-4114-97f8-a6b5408d1099'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:30:04.786646 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-eb71b13c-90e1-4295-937e-f9c37abe3c76 tempest-VolumesDeleteCascade-1622728886 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:04.811205 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-eb71b13c-90e1-4295-937e-f9c37abe3c76 tempest-VolumesDeleteCascade-1622728886 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:04.835638 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-eb71b13c-90e1-4295-937e-f9c37abe3c76 tempest-VolumesDeleteCascade-1622728886 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:30:04.841910 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-eb71b13c-90e1-4295-937e-f9c37abe3c76 tempest-VolumesDeleteCascade-1622728886 None] Deleted volume successfully. Apr 09 21:30:04.856372 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-eb71b13c-90e1-4295-937e-f9c37abe3c76 tempest-VolumesDeleteCascade-1622728886 None] Lock "b'cinder-827f3f57-b5bb-4dda-ac23-e177ad0cb4ea-delete_volume'" released by "delete_volume" :: held 2.879s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:30:07.211194 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-51fd0c4d-887a-473a-87e4-e7370ce13e74 tempest-VolumesGetTest-2123264463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:30:07.230210 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-51fd0c4d-887a-473a-87e4-e7370ce13e74 tempest-VolumesGetTest-2123264463 None] Flow 'volume_create_manager' (a954d23b-facb-4f8e-9334-0923dfbdfc9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:30:07.237695 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-51fd0c4d-887a-473a-87e4-e7370ce13e74 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e50d9ed-961e-44cf-936b-d018652c789b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:07.254227 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-51fd0c4d-887a-473a-87e4-e7370ce13e74 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e50d9ed-961e-44cf-936b-d018652c789b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-847155864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=32197c28-5b4d-42aa-b7c2-89ea75a8b2bf,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='12c2722cae9e4b4a979b5a23ffd211f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:30:07Z,use_quota=True,user_id='95eba67fe59f4248a99483f457a083ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:07.259753 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-51fd0c4d-887a-473a-87e4-e7370ce13e74 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6447f27d-179f-49a6-a149-e79e6eb82003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:07.263982 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-51fd0c4d-887a-473a-87e4-e7370ce13e74 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6447f27d-179f-49a6-a149-e79e6eb82003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:07.269279 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-51fd0c4d-887a-473a-87e4-e7370ce13e74 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (465af45b-c8dc-47ca-be10-a82f18cf2247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:07.273422 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-51fd0c4d-887a-473a-87e4-e7370ce13e74 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (465af45b-c8dc-47ca-be10-a82f18cf2247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32197c28-5b4d-42aa-b7c2-89ea75a8b2bf', 'volume_name': 'volume-32197c28-5b4d-42aa-b7c2-89ea75a8b2bf', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:07.278415 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-51fd0c4d-887a-473a-87e4-e7370ce13e74 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3941dcf-55c1-4ee9-b789-606ce541d41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:07.282433 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-51fd0c4d-887a-473a-87e4-e7370ce13e74 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3941dcf-55c1-4ee9-b789-606ce541d41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:07.287350 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-51fd0c4d-887a-473a-87e4-e7370ce13e74 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f57d0dd-6abb-44ed-a367-6f40d2cba759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:07.288522 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-51fd0c4d-887a-473a-87e4-e7370ce13e74 tempest-VolumesGetTest-2123264463 None] Volume 32197c28-5b4d-42aa-b7c2-89ea75a8b2bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32197c28-5b4d-42aa-b7c2-89ea75a8b2bf', 'volume_size': 1} Apr 09 21:30:07.288914 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-51fd0c4d-887a-473a-87e4-e7370ce13e74 tempest-VolumesGetTest-2123264463 None] creating volume 'volume-32197c28-5b4d-42aa-b7c2-89ea75a8b2bf' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:30:07.289737 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-51fd0c4d-887a-473a-87e4-e7370ce13e74 tempest-VolumesGetTest-2123264463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:07.350967 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-51fd0c4d-887a-473a-87e4-e7370ce13e74 tempest-VolumesGetTest-2123264463 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:30:07.351372 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-51fd0c4d-887a-473a-87e4-e7370ce13e74 tempest-VolumesGetTest-2123264463 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:30:07.355227 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-51fd0c4d-887a-473a-87e4-e7370ce13e74 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f57d0dd-6abb-44ed-a367-6f40d2cba759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32197c28-5b4d-42aa-b7c2-89ea75a8b2bf', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:07.359895 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-51fd0c4d-887a-473a-87e4-e7370ce13e74 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7a3781c-60be-46f0-b568-4ba7babc48dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:07.371765 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-51fd0c4d-887a-473a-87e4-e7370ce13e74 tempest-VolumesGetTest-2123264463 None] Volume volume-32197c28-5b4d-42aa-b7c2-89ea75a8b2bf (32197c28-5b4d-42aa-b7c2-89ea75a8b2bf): created successfully Apr 09 21:30:07.375314 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-51fd0c4d-887a-473a-87e4-e7370ce13e74 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7a3781c-60be-46f0-b568-4ba7babc48dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:07.380784 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-51fd0c4d-887a-473a-87e4-e7370ce13e74 tempest-VolumesGetTest-2123264463 None] Flow 'volume_create_manager' (a954d23b-facb-4f8e-9334-0923dfbdfc9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:30:07.390312 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-51fd0c4d-887a-473a-87e4-e7370ce13e74 tempest-VolumesGetTest-2123264463 None] Created volume successfully. Apr 09 21:30:08.732128 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a537d77-a116-442c-9db4-b955f95d359f tempest-VolumesGetTest-2123264463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:30:08.753248 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9a537d77-a116-442c-9db4-b955f95d359f tempest-VolumesGetTest-2123264463 None] Flow 'volume_create_manager' (2a6078f6-fee9-4d11-bd21-93be4d60bdbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:30:08.759763 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9a537d77-a116-442c-9db4-b955f95d359f tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be5b17d-9b8d-4a09-a6a6-c0edd88ab54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:08.775196 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9a537d77-a116-442c-9db4-b955f95d359f tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be5b17d-9b8d-4a09-a6a6-c0edd88ab54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:30:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-256681433',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d28c5118-a27f-4c7a-89f2-072630d10b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12c2722cae9e4b4a979b5a23ffd211f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:30:09Z,use_quota=True,user_id='95eba67fe59f4248a99483f457a083ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:08.780669 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9a537d77-a116-442c-9db4-b955f95d359f tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d84ca3-8a23-4d33-9e3c-50e9d012daff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:08.785115 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9a537d77-a116-442c-9db4-b955f95d359f tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d84ca3-8a23-4d33-9e3c-50e9d012daff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:08.790917 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9a537d77-a116-442c-9db4-b955f95d359f tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e55ece-340f-4e17-881c-e108bf43d617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:08.795363 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9a537d77-a116-442c-9db4-b955f95d359f tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e55ece-340f-4e17-881c-e108bf43d617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd28c5118-a27f-4c7a-89f2-072630d10b96', 'volume_name': 'volume-d28c5118-a27f-4c7a-89f2-072630d10b96', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:08.800423 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9a537d77-a116-442c-9db4-b955f95d359f tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25b1c1cb-4707-4e6f-8f2b-2fcb09358bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:08.804404 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9a537d77-a116-442c-9db4-b955f95d359f tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25b1c1cb-4707-4e6f-8f2b-2fcb09358bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:08.809289 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9a537d77-a116-442c-9db4-b955f95d359f tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (142da235-908e-42b0-a115-e61acaab2a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:08.810367 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-9a537d77-a116-442c-9db4-b955f95d359f tempest-VolumesGetTest-2123264463 None] Volume d28c5118-a27f-4c7a-89f2-072630d10b96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d28c5118-a27f-4c7a-89f2-072630d10b96', 'volume_size': 1} Apr 09 21:30:08.810755 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9a537d77-a116-442c-9db4-b955f95d359f tempest-VolumesGetTest-2123264463 None] creating volume 'volume-d28c5118-a27f-4c7a-89f2-072630d10b96' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:30:08.811426 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9a537d77-a116-442c-9db4-b955f95d359f tempest-VolumesGetTest-2123264463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:08.872223 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9a537d77-a116-442c-9db4-b955f95d359f tempest-VolumesGetTest-2123264463 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:30:08.872638 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9a537d77-a116-442c-9db4-b955f95d359f tempest-VolumesGetTest-2123264463 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:30:08.876434 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9a537d77-a116-442c-9db4-b955f95d359f tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (142da235-908e-42b0-a115-e61acaab2a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d28c5118-a27f-4c7a-89f2-072630d10b96', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:08.881163 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9a537d77-a116-442c-9db4-b955f95d359f tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b9f8b29-c44b-4f91-8374-04112894bc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:08.892755 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-9a537d77-a116-442c-9db4-b955f95d359f tempest-VolumesGetTest-2123264463 None] Volume volume-d28c5118-a27f-4c7a-89f2-072630d10b96 (d28c5118-a27f-4c7a-89f2-072630d10b96): created successfully Apr 09 21:30:08.896287 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9a537d77-a116-442c-9db4-b955f95d359f tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b9f8b29-c44b-4f91-8374-04112894bc2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:08.901832 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9a537d77-a116-442c-9db4-b955f95d359f tempest-VolumesGetTest-2123264463 None] Flow 'volume_create_manager' (2a6078f6-fee9-4d11-bd21-93be4d60bdbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:30:08.911654 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-9a537d77-a116-442c-9db4-b955f95d359f tempest-VolumesGetTest-2123264463 None] Created volume successfully. Apr 09 21:30:09.875472 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-0de663e1-49d4-4eef-acb9-f0fefc8a58ed tempest-VolumesGetTest-2123264463 None] Lock "b'cinder-d28c5118-a27f-4c7a-89f2-072630d10b96-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:30:09.914391 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-0de663e1-49d4-4eef-acb9-f0fefc8a58ed tempest-VolumesGetTest-2123264463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:09.957611 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-0de663e1-49d4-4eef-acb9-f0fefc8a58ed tempest-VolumesGetTest-2123264463 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:30:09.958502 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-0de663e1-49d4-4eef-acb9-f0fefc8a58ed tempest-VolumesGetTest-2123264463 None] Volume volume-d28c5118-a27f-4c7a-89f2-072630d10b96 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:30:09.967751 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-0de663e1-49d4-4eef-acb9-f0fefc8a58ed tempest-VolumesGetTest-2123264463 None] deleting rbd volume volume-d28c5118-a27f-4c7a-89f2-072630d10b96 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:30:10.319048 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-0de663e1-49d4-4eef-acb9-f0fefc8a58ed tempest-VolumesGetTest-2123264463 None] Created reservations ['ce591cd0-45df-404b-97de-a8b2768902d8', '42426ab3-55f5-423a-ae61-a82bc1883b50', '6348b8df-c52e-4284-b2b8-63bb0db4ae5c', '4cb324f3-3219-4335-9592-f2e8924d4bd5'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:30:10.365252 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-0de663e1-49d4-4eef-acb9-f0fefc8a58ed tempest-VolumesGetTest-2123264463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:10.389265 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-0de663e1-49d4-4eef-acb9-f0fefc8a58ed tempest-VolumesGetTest-2123264463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:10.414259 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-0de663e1-49d4-4eef-acb9-f0fefc8a58ed tempest-VolumesGetTest-2123264463 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:30:10.418783 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-0de663e1-49d4-4eef-acb9-f0fefc8a58ed tempest-VolumesGetTest-2123264463 None] Deleted volume successfully. Apr 09 21:30:10.433500 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-0de663e1-49d4-4eef-acb9-f0fefc8a58ed tempest-VolumesGetTest-2123264463 None] Lock "b'cinder-d28c5118-a27f-4c7a-89f2-072630d10b96-delete_volume'" released by "delete_volume" :: held 0.558s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:30:11.012562 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-7fa9add4-9dd7-4120-a7fb-0c1d038ec8c6 tempest-VolumesGetTest-2123264463 None] Lock "b'cinder-32197c28-5b4d-42aa-b7c2-89ea75a8b2bf-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:30:11.058719 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-7fa9add4-9dd7-4120-a7fb-0c1d038ec8c6 tempest-VolumesGetTest-2123264463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:11.108643 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-7fa9add4-9dd7-4120-a7fb-0c1d038ec8c6 tempest-VolumesGetTest-2123264463 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:30:11.109135 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-7fa9add4-9dd7-4120-a7fb-0c1d038ec8c6 tempest-VolumesGetTest-2123264463 None] Volume volume-32197c28-5b4d-42aa-b7c2-89ea75a8b2bf is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:30:11.118520 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-7fa9add4-9dd7-4120-a7fb-0c1d038ec8c6 tempest-VolumesGetTest-2123264463 None] deleting rbd volume volume-32197c28-5b4d-42aa-b7c2-89ea75a8b2bf {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:30:11.491680 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-7fa9add4-9dd7-4120-a7fb-0c1d038ec8c6 tempest-VolumesGetTest-2123264463 None] Created reservations ['15cabfcf-6b9d-4d03-a2be-46493dc8b547', 'e810a94c-0250-404e-b009-acfaafbe4638', '0cb36fd7-5f68-422b-aa9a-0549ae83c5db', 'd9552a9a-4b75-4d1f-8618-22903a7a6de5'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:30:11.539699 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-7fa9add4-9dd7-4120-a7fb-0c1d038ec8c6 tempest-VolumesGetTest-2123264463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:11.563506 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-7fa9add4-9dd7-4120-a7fb-0c1d038ec8c6 tempest-VolumesGetTest-2123264463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:11.587282 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-7fa9add4-9dd7-4120-a7fb-0c1d038ec8c6 tempest-VolumesGetTest-2123264463 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:30:11.592149 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-7fa9add4-9dd7-4120-a7fb-0c1d038ec8c6 tempest-VolumesGetTest-2123264463 None] Deleted volume successfully. Apr 09 21:30:11.606257 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-7fa9add4-9dd7-4120-a7fb-0c1d038ec8c6 tempest-VolumesGetTest-2123264463 None] Lock "b'cinder-32197c28-5b4d-42aa-b7c2-89ea75a8b2bf-delete_volume'" released by "delete_volume" :: held 0.594s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:30:12.411937 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca7ab9b4-21a5-4099-a898-03ff1b521013 tempest-VolumesGetTest-2123264463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:30:12.430709 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ca7ab9b4-21a5-4099-a898-03ff1b521013 tempest-VolumesGetTest-2123264463 None] Flow 'volume_create_manager' (fb54831d-9b8a-4908-ba42-526121de055b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:30:12.437668 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ca7ab9b4-21a5-4099-a898-03ff1b521013 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73d6a46f-2021-4551-b043-b90e3f94c939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:12.453745 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ca7ab9b4-21a5-4099-a898-03ff1b521013 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73d6a46f-2021-4551-b043-b90e3f94c939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-477971683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7cf2ef4c-9d49-4fcc-8263-da280e6b1b81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12c2722cae9e4b4a979b5a23ffd211f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:30:12Z,use_quota=True,user_id='95eba67fe59f4248a99483f457a083ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:12.459659 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ca7ab9b4-21a5-4099-a898-03ff1b521013 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6d4f73-6fd2-40ef-ae44-9e1a50270883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:12.463960 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ca7ab9b4-21a5-4099-a898-03ff1b521013 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6d4f73-6fd2-40ef-ae44-9e1a50270883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:12.469274 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ca7ab9b4-21a5-4099-a898-03ff1b521013 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55a7c83-98b1-4078-b2f8-f9eeeefb7c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:12.473358 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ca7ab9b4-21a5-4099-a898-03ff1b521013 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55a7c83-98b1-4078-b2f8-f9eeeefb7c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cf2ef4c-9d49-4fcc-8263-da280e6b1b81', 'volume_name': 'volume-7cf2ef4c-9d49-4fcc-8263-da280e6b1b81', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:12.478328 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ca7ab9b4-21a5-4099-a898-03ff1b521013 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (142570f0-67c3-48ff-8768-8d660a04a4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:12.482304 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ca7ab9b4-21a5-4099-a898-03ff1b521013 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (142570f0-67c3-48ff-8768-8d660a04a4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:12.487168 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ca7ab9b4-21a5-4099-a898-03ff1b521013 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f83242-4abe-409f-b3cc-3d1af39d68b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:12.488290 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-ca7ab9b4-21a5-4099-a898-03ff1b521013 tempest-VolumesGetTest-2123264463 None] Volume 7cf2ef4c-9d49-4fcc-8263-da280e6b1b81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cf2ef4c-9d49-4fcc-8263-da280e6b1b81', 'volume_size': 1} Apr 09 21:30:12.488693 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ca7ab9b4-21a5-4099-a898-03ff1b521013 tempest-VolumesGetTest-2123264463 None] creating volume 'volume-7cf2ef4c-9d49-4fcc-8263-da280e6b1b81' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:30:12.489521 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ca7ab9b4-21a5-4099-a898-03ff1b521013 tempest-VolumesGetTest-2123264463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:12.619246 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ca7ab9b4-21a5-4099-a898-03ff1b521013 tempest-VolumesGetTest-2123264463 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:30:12.619564 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-ca7ab9b4-21a5-4099-a898-03ff1b521013 tempest-VolumesGetTest-2123264463 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:30:12.623407 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ca7ab9b4-21a5-4099-a898-03ff1b521013 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f83242-4abe-409f-b3cc-3d1af39d68b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cf2ef4c-9d49-4fcc-8263-da280e6b1b81', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:12.628086 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ca7ab9b4-21a5-4099-a898-03ff1b521013 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64c04bbf-6968-42b8-a296-b580bae21d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:12.639739 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-ca7ab9b4-21a5-4099-a898-03ff1b521013 tempest-VolumesGetTest-2123264463 None] Volume volume-7cf2ef4c-9d49-4fcc-8263-da280e6b1b81 (7cf2ef4c-9d49-4fcc-8263-da280e6b1b81): created successfully Apr 09 21:30:12.643514 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ca7ab9b4-21a5-4099-a898-03ff1b521013 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64c04bbf-6968-42b8-a296-b580bae21d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:12.649531 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-ca7ab9b4-21a5-4099-a898-03ff1b521013 tempest-VolumesGetTest-2123264463 None] Flow 'volume_create_manager' (fb54831d-9b8a-4908-ba42-526121de055b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:30:12.660659 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-ca7ab9b4-21a5-4099-a898-03ff1b521013 tempest-VolumesGetTest-2123264463 None] Created volume successfully. Apr 09 21:30:13.764402 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-989f6b1b-a209-4136-8e3c-52d5c3dc32bd tempest-VolumesGetTest-2123264463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:30:13.793285 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-989f6b1b-a209-4136-8e3c-52d5c3dc32bd tempest-VolumesGetTest-2123264463 None] Flow 'volume_create_manager' (52008cba-d2fa-41f5-9154-daed6cec2f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:30:13.800540 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-989f6b1b-a209-4136-8e3c-52d5c3dc32bd tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34851d0d-b3ab-4529-b317-bc76f2a27904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:13.819129 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-989f6b1b-a209-4136-8e3c-52d5c3dc32bd tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34851d0d-b3ab-4529-b317-bc76f2a27904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:30:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2093766770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=744613e6-6842-4f6c-a6fd-8c91e31533c0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='12c2722cae9e4b4a979b5a23ffd211f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=7cf2ef4c-9d49-4fcc-8263-da280e6b1b81,status='creating',terminated_at=None,updated_at=2022-04-09T21:30:14Z,use_quota=True,user_id='95eba67fe59f4248a99483f457a083ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:13.824696 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-989f6b1b-a209-4136-8e3c-52d5c3dc32bd tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f6478a0-4d30-4872-8d21-c9624350b6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:13.829098 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-989f6b1b-a209-4136-8e3c-52d5c3dc32bd tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f6478a0-4d30-4872-8d21-c9624350b6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:13.834825 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-989f6b1b-a209-4136-8e3c-52d5c3dc32bd tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de422d30-4014-4ca3-8a8d-9958ce694d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:13.850539 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-989f6b1b-a209-4136-8e3c-52d5c3dc32bd tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de422d30-4014-4ca3-8a8d-9958ce694d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '744613e6-6842-4f6c-a6fd-8c91e31533c0', 'volume_name': 'volume-744613e6-6842-4f6c-a6fd-8c91e31533c0', 'volume_size': 1, 'source_volid': '7cf2ef4c-9d49-4fcc-8263-da280e6b1b81', 'source_volstatus': 'available'}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:13.855905 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-989f6b1b-a209-4136-8e3c-52d5c3dc32bd tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cd2624a-2aa4-433c-9a99-3a40e9cdc701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:13.860146 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-989f6b1b-a209-4136-8e3c-52d5c3dc32bd tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cd2624a-2aa4-433c-9a99-3a40e9cdc701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:13.865187 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-989f6b1b-a209-4136-8e3c-52d5c3dc32bd tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5c5af3b-2115-416c-90bc-30cf673436e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:13.866310 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-989f6b1b-a209-4136-8e3c-52d5c3dc32bd tempest-VolumesGetTest-2123264463 None] Volume 744613e6-6842-4f6c-a6fd-8c91e31533c0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-744613e6-6842-4f6c-a6fd-8c91e31533c0', 'volume_size': 1, 'source_volid': '7cf2ef4c-9d49-4fcc-8263-da280e6b1b81', 'source_volstatus': 'available'} Apr 09 21:30:13.878486 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-989f6b1b-a209-4136-8e3c-52d5c3dc32bd tempest-VolumesGetTest-2123264463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:13.924627 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-989f6b1b-a209-4136-8e3c-52d5c3dc32bd tempest-VolumesGetTest-2123264463 None] creating snapshot='volume-744613e6-6842-4f6c-a6fd-8c91e31533c0.clone_snap' {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Apr 09 21:30:14.297220 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-989f6b1b-a209-4136-8e3c-52d5c3dc32bd tempest-VolumesGetTest-2123264463 None] cloning 'volume-7cf2ef4c-9d49-4fcc-8263-da280e6b1b81@volume-744613e6-6842-4f6c-a6fd-8c91e31533c0.clone_snap' to 'volume-744613e6-6842-4f6c-a6fd-8c91e31533c0' {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Apr 09 21:30:14.428922 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-989f6b1b-a209-4136-8e3c-52d5c3dc32bd tempest-VolumesGetTest-2123264463 None] Volume volume-7cf2ef4c-9d49-4fcc-8263-da280e6b1b81 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:30:14.430190 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-989f6b1b-a209-4136-8e3c-52d5c3dc32bd tempest-VolumesGetTest-2123264463 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:30:14.430619 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-989f6b1b-a209-4136-8e3c-52d5c3dc32bd tempest-VolumesGetTest-2123264463 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:30:14.465169 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-989f6b1b-a209-4136-8e3c-52d5c3dc32bd tempest-VolumesGetTest-2123264463 None] clone created successfully {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Apr 09 21:30:14.469344 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-989f6b1b-a209-4136-8e3c-52d5c3dc32bd tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5c5af3b-2115-416c-90bc-30cf673436e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-744613e6-6842-4f6c-a6fd-8c91e31533c0', 'volume_size': 1, 'source_volid': '7cf2ef4c-9d49-4fcc-8263-da280e6b1b81', 'source_volstatus': 'available'}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:14.474446 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-989f6b1b-a209-4136-8e3c-52d5c3dc32bd tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ddd8691-937e-45fa-89ff-28abb97e854e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:14.484246 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-989f6b1b-a209-4136-8e3c-52d5c3dc32bd tempest-VolumesGetTest-2123264463 None] Volume volume-744613e6-6842-4f6c-a6fd-8c91e31533c0 (744613e6-6842-4f6c-a6fd-8c91e31533c0): created successfully Apr 09 21:30:14.488275 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-989f6b1b-a209-4136-8e3c-52d5c3dc32bd tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ddd8691-937e-45fa-89ff-28abb97e854e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:14.494392 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-989f6b1b-a209-4136-8e3c-52d5c3dc32bd tempest-VolumesGetTest-2123264463 None] Flow 'volume_create_manager' (52008cba-d2fa-41f5-9154-daed6cec2f12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:30:14.508228 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-989f6b1b-a209-4136-8e3c-52d5c3dc32bd tempest-VolumesGetTest-2123264463 None] Created volume successfully. Apr 09 21:30:15.280568 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-28572828-1b79-499f-8bd8-01a80019ffd4 tempest-VolumesGetTest-2123264463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:30:15.300817 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-28572828-1b79-499f-8bd8-01a80019ffd4 tempest-VolumesGetTest-2123264463 None] Flow 'volume_create_manager' (36636cba-91a4-4e47-a553-275e58275235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:30:15.307289 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-28572828-1b79-499f-8bd8-01a80019ffd4 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de9bf0d9-9218-4ccb-abe3-3a5dfebed4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:15.323523 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-28572828-1b79-499f-8bd8-01a80019ffd4 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de9bf0d9-9218-4ccb-abe3-3a5dfebed4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:30:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1031298254',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b6c10f8a-1623-4c05-84bc-ee5a7d95d984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12c2722cae9e4b4a979b5a23ffd211f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:30:15Z,use_quota=True,user_id='95eba67fe59f4248a99483f457a083ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:15.329632 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-28572828-1b79-499f-8bd8-01a80019ffd4 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (842385d9-8acd-4d6b-b512-7c75b7f04b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:15.334369 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-28572828-1b79-499f-8bd8-01a80019ffd4 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (842385d9-8acd-4d6b-b512-7c75b7f04b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:15.339790 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-28572828-1b79-499f-8bd8-01a80019ffd4 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (015318af-e143-4457-a59a-a5c83ef7329e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:15.344334 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-28572828-1b79-499f-8bd8-01a80019ffd4 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (015318af-e143-4457-a59a-a5c83ef7329e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6c10f8a-1623-4c05-84bc-ee5a7d95d984', 'volume_name': 'volume-b6c10f8a-1623-4c05-84bc-ee5a7d95d984', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:15.350038 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-28572828-1b79-499f-8bd8-01a80019ffd4 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fee2c04b-53c0-4d0a-ae36-4c4573b43df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:15.354287 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-28572828-1b79-499f-8bd8-01a80019ffd4 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fee2c04b-53c0-4d0a-ae36-4c4573b43df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:15.359274 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-28572828-1b79-499f-8bd8-01a80019ffd4 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (666b43af-63bf-4976-9aaf-38d47d597d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:15.360355 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-28572828-1b79-499f-8bd8-01a80019ffd4 tempest-VolumesGetTest-2123264463 None] Volume b6c10f8a-1623-4c05-84bc-ee5a7d95d984: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6c10f8a-1623-4c05-84bc-ee5a7d95d984', 'volume_size': 1} Apr 09 21:30:15.360747 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-28572828-1b79-499f-8bd8-01a80019ffd4 tempest-VolumesGetTest-2123264463 None] creating volume 'volume-b6c10f8a-1623-4c05-84bc-ee5a7d95d984' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:30:15.361447 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-28572828-1b79-499f-8bd8-01a80019ffd4 tempest-VolumesGetTest-2123264463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:15.431439 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-28572828-1b79-499f-8bd8-01a80019ffd4 tempest-VolumesGetTest-2123264463 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:30:15.431817 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-28572828-1b79-499f-8bd8-01a80019ffd4 tempest-VolumesGetTest-2123264463 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:30:15.436172 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-28572828-1b79-499f-8bd8-01a80019ffd4 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (666b43af-63bf-4976-9aaf-38d47d597d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6c10f8a-1623-4c05-84bc-ee5a7d95d984', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:15.441561 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-28572828-1b79-499f-8bd8-01a80019ffd4 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70d877e7-add2-4df1-9318-aa20985d129f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:15.456831 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-28572828-1b79-499f-8bd8-01a80019ffd4 tempest-VolumesGetTest-2123264463 None] Volume volume-b6c10f8a-1623-4c05-84bc-ee5a7d95d984 (b6c10f8a-1623-4c05-84bc-ee5a7d95d984): created successfully Apr 09 21:30:15.461376 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-28572828-1b79-499f-8bd8-01a80019ffd4 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70d877e7-add2-4df1-9318-aa20985d129f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:15.467725 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-28572828-1b79-499f-8bd8-01a80019ffd4 tempest-VolumesGetTest-2123264463 None] Flow 'volume_create_manager' (36636cba-91a4-4e47-a553-275e58275235) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:30:15.477977 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-28572828-1b79-499f-8bd8-01a80019ffd4 tempest-VolumesGetTest-2123264463 None] Created volume successfully. Apr 09 21:30:16.405254 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-6aeecb01-c2df-40be-83f1-285f8998fbed tempest-VolumesGetTest-2123264463 None] Lock "b'cinder-b6c10f8a-1623-4c05-84bc-ee5a7d95d984-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:30:16.437999 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-6aeecb01-c2df-40be-83f1-285f8998fbed tempest-VolumesGetTest-2123264463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:16.479671 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-6aeecb01-c2df-40be-83f1-285f8998fbed tempest-VolumesGetTest-2123264463 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:30:16.480101 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-6aeecb01-c2df-40be-83f1-285f8998fbed tempest-VolumesGetTest-2123264463 None] Volume volume-b6c10f8a-1623-4c05-84bc-ee5a7d95d984 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:30:16.490894 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-6aeecb01-c2df-40be-83f1-285f8998fbed tempest-VolumesGetTest-2123264463 None] deleting rbd volume volume-b6c10f8a-1623-4c05-84bc-ee5a7d95d984 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:30:16.859719 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-6aeecb01-c2df-40be-83f1-285f8998fbed tempest-VolumesGetTest-2123264463 None] Created reservations ['71cf1ad4-40e2-4f64-a5eb-696d6e80ad98', 'b3ca9685-8fdc-48ae-a15a-70e320f59cda', '43b347f0-a34f-4c88-85ea-e68c0c3ba4a3', 'f6888b7c-1835-4817-b502-77d477f63ebc'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:30:16.903689 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-6aeecb01-c2df-40be-83f1-285f8998fbed tempest-VolumesGetTest-2123264463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:16.926991 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-6aeecb01-c2df-40be-83f1-285f8998fbed tempest-VolumesGetTest-2123264463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:16.951887 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-6aeecb01-c2df-40be-83f1-285f8998fbed tempest-VolumesGetTest-2123264463 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:30:16.956298 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-6aeecb01-c2df-40be-83f1-285f8998fbed tempest-VolumesGetTest-2123264463 None] Deleted volume successfully. Apr 09 21:30:16.970284 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-6aeecb01-c2df-40be-83f1-285f8998fbed tempest-VolumesGetTest-2123264463 None] Lock "b'cinder-b6c10f8a-1623-4c05-84bc-ee5a7d95d984-delete_volume'" released by "delete_volume" :: held 0.565s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:30:17.538323 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-70f954f4-0bc5-4b0f-a0fe-1f64ffe617d2 tempest-VolumesGetTest-2123264463 None] Lock "b'cinder-744613e6-6842-4f6c-a6fd-8c91e31533c0-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:30:17.571560 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-70f954f4-0bc5-4b0f-a0fe-1f64ffe617d2 tempest-VolumesGetTest-2123264463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:17.624994 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-70f954f4-0bc5-4b0f-a0fe-1f64ffe617d2 tempest-VolumesGetTest-2123264463 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:30:17.632533 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-70f954f4-0bc5-4b0f-a0fe-1f64ffe617d2 tempest-VolumesGetTest-2123264463 None] deleting rbd volume volume-744613e6-6842-4f6c-a6fd-8c91e31533c0 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:30:18.023579 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-70f954f4-0bc5-4b0f-a0fe-1f64ffe617d2 tempest-VolumesGetTest-2123264463 None] volume is a clone so cleaning references {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Apr 09 21:30:18.049049 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-70f954f4-0bc5-4b0f-a0fe-1f64ffe617d2 tempest-VolumesGetTest-2123264463 None] Volume volume-7cf2ef4c-9d49-4fcc-8263-da280e6b1b81 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:30:18.049711 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-70f954f4-0bc5-4b0f-a0fe-1f64ffe617d2 tempest-VolumesGetTest-2123264463 None] deleting parent snapshot volume-744613e6-6842-4f6c-a6fd-8c91e31533c0.clone_snap {{(pid=135002) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Apr 09 21:30:18.975307 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-70f954f4-0bc5-4b0f-a0fe-1f64ffe617d2 tempest-VolumesGetTest-2123264463 None] Created reservations ['446bbac0-8784-424d-a3b8-fc53daec288b', 'f91ee21f-e7d9-4e30-a147-0f4dc2ee30cc', '03e8f774-4519-4c97-8700-87defde5a5b6', 'cb0cd34d-c694-4f1f-b253-3121444165af'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:30:19.025379 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-70f954f4-0bc5-4b0f-a0fe-1f64ffe617d2 tempest-VolumesGetTest-2123264463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:19.052120 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-70f954f4-0bc5-4b0f-a0fe-1f64ffe617d2 tempest-VolumesGetTest-2123264463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:19.078946 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-70f954f4-0bc5-4b0f-a0fe-1f64ffe617d2 tempest-VolumesGetTest-2123264463 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:30:19.084679 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-70f954f4-0bc5-4b0f-a0fe-1f64ffe617d2 tempest-VolumesGetTest-2123264463 None] Deleted volume successfully. Apr 09 21:30:19.098428 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-70f954f4-0bc5-4b0f-a0fe-1f64ffe617d2 tempest-VolumesGetTest-2123264463 None] Lock "b'cinder-744613e6-6842-4f6c-a6fd-8c91e31533c0-delete_volume'" released by "delete_volume" :: held 1.560s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:30:20.148919 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-336506b8-e121-4aa6-954f-d4b800578e18 tempest-VolumesGetTest-2123264463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:30:20.170689 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-336506b8-e121-4aa6-954f-d4b800578e18 tempest-VolumesGetTest-2123264463 None] Flow 'volume_create_manager' (756a9695-5ca0-479e-a96b-46d1c917fb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:30:20.177264 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-336506b8-e121-4aa6-954f-d4b800578e18 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dd762c1-d272-44c2-bc46-f13ec2c198d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:20.192554 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-336506b8-e121-4aa6-954f-d4b800578e18 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dd762c1-d272-44c2-bc46-f13ec2c198d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-117353347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=963ec8da-6076-44b0-80be-eb95d04dc2a1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='12c2722cae9e4b4a979b5a23ffd211f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:30:20Z,use_quota=True,user_id='95eba67fe59f4248a99483f457a083ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:20.198016 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-336506b8-e121-4aa6-954f-d4b800578e18 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0751da1-0a4d-4e7a-a3de-d0ed6409f902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:20.202223 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-336506b8-e121-4aa6-954f-d4b800578e18 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0751da1-0a4d-4e7a-a3de-d0ed6409f902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:20.207413 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-336506b8-e121-4aa6-954f-d4b800578e18 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db39fd50-6c43-43b7-affe-0b3f19863f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:20.294172 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-336506b8-e121-4aa6-954f-d4b800578e18 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db39fd50-6c43-43b7-affe-0b3f19863f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '963ec8da-6076-44b0-80be-eb95d04dc2a1', 'volume_name': 'volume-963ec8da-6076-44b0-80be-eb95d04dc2a1', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:20.299264 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-336506b8-e121-4aa6-954f-d4b800578e18 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f42cd3f-3dac-4dce-b49d-ac55fd579aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:20.303222 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-336506b8-e121-4aa6-954f-d4b800578e18 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f42cd3f-3dac-4dce-b49d-ac55fd579aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:20.307996 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-336506b8-e121-4aa6-954f-d4b800578e18 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0270e22e-99b9-4faa-ba42-03e966535a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:20.309162 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-336506b8-e121-4aa6-954f-d4b800578e18 tempest-VolumesGetTest-2123264463 None] Volume 963ec8da-6076-44b0-80be-eb95d04dc2a1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-963ec8da-6076-44b0-80be-eb95d04dc2a1', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 09 21:30:20.309743 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-336506b8-e121-4aa6-954f-d4b800578e18 tempest-VolumesGetTest-2123264463 None] Cloning 963ec8da-6076-44b0-80be-eb95d04dc2a1 from image b539c48b-3400-4aa4-9226-8be5a3d07b36 at location (None, None). {{(pid=135002) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Apr 09 21:30:20.318402 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-336506b8-e121-4aa6-954f-d4b800578e18 tempest-VolumesGetTest-2123264463 None] Lock "b'cinder-b539c48b-3400-4aa4-9226-8be5a3d07b36'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:30:20.331206 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-336506b8-e121-4aa6-954f-d4b800578e18 tempest-VolumesGetTest-2123264463 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'volume_id': 'd35656e2-d293-4904-aeae-3113202bb314', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36), 'last_used': datetime.datetime(2022, 4, 9, 21, 30, 20, 323010)}. {{(pid=135002) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 09 21:30:20.331732 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-336506b8-e121-4aa6-954f-d4b800578e18 tempest-VolumesGetTest-2123264463 None] Image-volume cache entry image_update_at = 2022-04-09 20:45:36+00:00, requested image updated_at = 2022-04-09 20:45:36+00:00. {{(pid=135002) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 09 21:30:20.332181 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-336506b8-e121-4aa6-954f-d4b800578e18 tempest-VolumesGetTest-2123264463 None] Found cache entry for image = b539c48b-3400-4aa4-9226-8be5a3d07b36 on host ncdv-master-1@ceph#ceph. {{(pid=135002) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Apr 09 21:30:20.336400 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-336506b8-e121-4aa6-954f-d4b800578e18 tempest-VolumesGetTest-2123264463 None] Lock "b'cinder-b539c48b-3400-4aa4-9226-8be5a3d07b36'" released by "_prepare_image_cache_entry" :: held 0.018s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:30:20.337330 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-336506b8-e121-4aa6-954f-d4b800578e18 tempest-VolumesGetTest-2123264463 None] Attempting to retrieve cache entry for image = b539c48b-3400-4aa4-9226-8be5a3d07b36 on host ncdv-master-1@ceph#ceph. {{(pid=135002) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Apr 09 21:30:20.342625 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-336506b8-e121-4aa6-954f-d4b800578e18 tempest-VolumesGetTest-2123264463 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'volume_id': 'd35656e2-d293-4904-aeae-3113202bb314', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36), 'last_used': datetime.datetime(2022, 4, 9, 21, 30, 20, 340369)}. {{(pid=135002) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 09 21:30:20.343052 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-336506b8-e121-4aa6-954f-d4b800578e18 tempest-VolumesGetTest-2123264463 None] Image-volume cache entry image_update_at = 2022-04-09 20:45:36+00:00, requested image updated_at = 2022-04-09 20:45:36+00:00. {{(pid=135002) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 09 21:30:20.343700 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-336506b8-e121-4aa6-954f-d4b800578e18 tempest-VolumesGetTest-2123264463 None] Creating from source image-volume d35656e2-d293-4904-aeae-3113202bb314 {{(pid=135002) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Apr 09 21:30:20.355183 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-336506b8-e121-4aa6-954f-d4b800578e18 tempest-VolumesGetTest-2123264463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:20.414418 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-336506b8-e121-4aa6-954f-d4b800578e18 tempest-VolumesGetTest-2123264463 None] creating snapshot='volume-963ec8da-6076-44b0-80be-eb95d04dc2a1.clone_snap' {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Apr 09 21:30:20.958991 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-336506b8-e121-4aa6-954f-d4b800578e18 tempest-VolumesGetTest-2123264463 None] cloning 'volume-d35656e2-d293-4904-aeae-3113202bb314@volume-963ec8da-6076-44b0-80be-eb95d04dc2a1.clone_snap' to 'volume-963ec8da-6076-44b0-80be-eb95d04dc2a1' {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Apr 09 21:30:21.158600 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-336506b8-e121-4aa6-954f-d4b800578e18 tempest-VolumesGetTest-2123264463 None] Volume volume-6d815065-063f-4887-9bc8-5808837868ff.deleted is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:30:21.159969 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-336506b8-e121-4aa6-954f-d4b800578e18 tempest-VolumesGetTest-2123264463 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:30:21.160520 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-336506b8-e121-4aa6-954f-d4b800578e18 tempest-VolumesGetTest-2123264463 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:30:21.190502 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-336506b8-e121-4aa6-954f-d4b800578e18 tempest-VolumesGetTest-2123264463 None] clone created successfully {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Apr 09 21:30:21.191256 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.volume_utils [None req-336506b8-e121-4aa6-954f-d4b800578e18 tempest-VolumesGetTest-2123264463 None] Marking volume 963ec8da-6076-44b0-80be-eb95d04dc2a1 as bootable. {{(pid=135002) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Apr 09 21:30:21.200858 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-336506b8-e121-4aa6-954f-d4b800578e18 tempest-VolumesGetTest-2123264463 None] Copying metadata from image b539c48b-3400-4aa4-9226-8be5a3d07b36 to 963ec8da-6076-44b0-80be-eb95d04dc2a1. {{(pid=135002) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Apr 09 21:30:21.201401 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-336506b8-e121-4aa6-954f-d4b800578e18 tempest-VolumesGetTest-2123264463 None] Creating volume glance metadata for volume 963ec8da-6076-44b0-80be-eb95d04dc2a1 backed by image b539c48b-3400-4aa4-9226-8be5a3d07b36 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=135002) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Apr 09 21:30:21.252976 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-336506b8-e121-4aa6-954f-d4b800578e18 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0270e22e-99b9-4faa-ba42-03e966535a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-963ec8da-6076-44b0-80be-eb95d04dc2a1', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:21.257703 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-336506b8-e121-4aa6-954f-d4b800578e18 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b953ab-3ec7-4bbe-bce2-3a0e632e323c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:21.266876 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-336506b8-e121-4aa6-954f-d4b800578e18 tempest-VolumesGetTest-2123264463 None] Volume volume-963ec8da-6076-44b0-80be-eb95d04dc2a1 (963ec8da-6076-44b0-80be-eb95d04dc2a1): created successfully Apr 09 21:30:21.270522 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-336506b8-e121-4aa6-954f-d4b800578e18 tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b953ab-3ec7-4bbe-bce2-3a0e632e323c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:21.276020 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-336506b8-e121-4aa6-954f-d4b800578e18 tempest-VolumesGetTest-2123264463 None] Flow 'volume_create_manager' (756a9695-5ca0-479e-a96b-46d1c917fb70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:30:21.284618 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-336506b8-e121-4aa6-954f-d4b800578e18 tempest-VolumesGetTest-2123264463 None] Created volume successfully. Apr 09 21:30:22.736454 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f584fe9-607b-47cd-bf8d-0e5de340d8dd tempest-VolumesGetTest-2123264463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:30:22.755090 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5f584fe9-607b-47cd-bf8d-0e5de340d8dd tempest-VolumesGetTest-2123264463 None] Flow 'volume_create_manager' (79ebf9a5-dca2-4eac-8703-1ac424ab8d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:30:22.761589 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5f584fe9-607b-47cd-bf8d-0e5de340d8dd tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbe0df3d-e130-44c8-b2ef-023a9d5bb558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:22.776734 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5f584fe9-607b-47cd-bf8d-0e5de340d8dd tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbe0df3d-e130-44c8-b2ef-023a9d5bb558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:30:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1134940123',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1af99910-7445-4843-ab82-e63f5bb2d571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12c2722cae9e4b4a979b5a23ffd211f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:30:23Z,use_quota=True,user_id='95eba67fe59f4248a99483f457a083ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:22.782226 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5f584fe9-607b-47cd-bf8d-0e5de340d8dd tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a916322e-5249-4177-b9c7-ad83c1de36df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:22.786348 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5f584fe9-607b-47cd-bf8d-0e5de340d8dd tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a916322e-5249-4177-b9c7-ad83c1de36df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:22.791459 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5f584fe9-607b-47cd-bf8d-0e5de340d8dd tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c447619f-61fd-4dc4-9c94-e98d4607d39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:22.795545 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5f584fe9-607b-47cd-bf8d-0e5de340d8dd tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c447619f-61fd-4dc4-9c94-e98d4607d39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1af99910-7445-4843-ab82-e63f5bb2d571', 'volume_name': 'volume-1af99910-7445-4843-ab82-e63f5bb2d571', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:22.800427 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5f584fe9-607b-47cd-bf8d-0e5de340d8dd tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e3f74e-4070-47f8-98d6-3aa16920ae7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:22.804324 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5f584fe9-607b-47cd-bf8d-0e5de340d8dd tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e3f74e-4070-47f8-98d6-3aa16920ae7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:22.809010 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5f584fe9-607b-47cd-bf8d-0e5de340d8dd tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f58f9a1-7112-46f9-a12f-8c97a2f1fa63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:22.810095 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-5f584fe9-607b-47cd-bf8d-0e5de340d8dd tempest-VolumesGetTest-2123264463 None] Volume 1af99910-7445-4843-ab82-e63f5bb2d571: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1af99910-7445-4843-ab82-e63f5bb2d571', 'volume_size': 1} Apr 09 21:30:22.810474 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5f584fe9-607b-47cd-bf8d-0e5de340d8dd tempest-VolumesGetTest-2123264463 None] creating volume 'volume-1af99910-7445-4843-ab82-e63f5bb2d571' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:30:22.811318 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5f584fe9-607b-47cd-bf8d-0e5de340d8dd tempest-VolumesGetTest-2123264463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:22.875082 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5f584fe9-607b-47cd-bf8d-0e5de340d8dd tempest-VolumesGetTest-2123264463 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:30:22.875453 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5f584fe9-607b-47cd-bf8d-0e5de340d8dd tempest-VolumesGetTest-2123264463 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:30:22.879267 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5f584fe9-607b-47cd-bf8d-0e5de340d8dd tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f58f9a1-7112-46f9-a12f-8c97a2f1fa63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1af99910-7445-4843-ab82-e63f5bb2d571', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:22.883937 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5f584fe9-607b-47cd-bf8d-0e5de340d8dd tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae3c9413-1325-4453-84c2-d37ee00402ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:22.894956 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-5f584fe9-607b-47cd-bf8d-0e5de340d8dd tempest-VolumesGetTest-2123264463 None] Volume volume-1af99910-7445-4843-ab82-e63f5bb2d571 (1af99910-7445-4843-ab82-e63f5bb2d571): created successfully Apr 09 21:30:22.898422 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5f584fe9-607b-47cd-bf8d-0e5de340d8dd tempest-VolumesGetTest-2123264463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae3c9413-1325-4453-84c2-d37ee00402ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:22.903984 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5f584fe9-607b-47cd-bf8d-0e5de340d8dd tempest-VolumesGetTest-2123264463 None] Flow 'volume_create_manager' (79ebf9a5-dca2-4eac-8703-1ac424ab8d2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:30:22.913053 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-5f584fe9-607b-47cd-bf8d-0e5de340d8dd tempest-VolumesGetTest-2123264463 None] Created volume successfully. Apr 09 21:30:23.866581 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-96add067-943b-47a4-955a-95b3d4a395e0 tempest-VolumesGetTest-2123264463 None] Lock "b'cinder-1af99910-7445-4843-ab82-e63f5bb2d571-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:30:23.897397 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-96add067-943b-47a4-955a-95b3d4a395e0 tempest-VolumesGetTest-2123264463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:23.936917 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-96add067-943b-47a4-955a-95b3d4a395e0 tempest-VolumesGetTest-2123264463 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:30:23.937415 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-96add067-943b-47a4-955a-95b3d4a395e0 tempest-VolumesGetTest-2123264463 None] Volume volume-1af99910-7445-4843-ab82-e63f5bb2d571 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:30:23.944972 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-96add067-943b-47a4-955a-95b3d4a395e0 tempest-VolumesGetTest-2123264463 None] deleting rbd volume volume-1af99910-7445-4843-ab82-e63f5bb2d571 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:30:24.203355 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-96add067-943b-47a4-955a-95b3d4a395e0 tempest-VolumesGetTest-2123264463 None] Created reservations ['9b8092e5-8ac5-4742-b9fb-746d55e362af', '4824a355-cd0e-4151-809d-94bf50997362', '91db7fb9-a328-4ac9-9eab-6dfa72b296d1', '2adf4dbf-5d65-46ec-b447-45853f820359'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:30:24.253959 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-96add067-943b-47a4-955a-95b3d4a395e0 tempest-VolumesGetTest-2123264463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:24.277984 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-96add067-943b-47a4-955a-95b3d4a395e0 tempest-VolumesGetTest-2123264463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:24.299935 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-96add067-943b-47a4-955a-95b3d4a395e0 tempest-VolumesGetTest-2123264463 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:30:24.303979 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-96add067-943b-47a4-955a-95b3d4a395e0 tempest-VolumesGetTest-2123264463 None] Deleted volume successfully. Apr 09 21:30:24.317257 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-96add067-943b-47a4-955a-95b3d4a395e0 tempest-VolumesGetTest-2123264463 None] Lock "b'cinder-1af99910-7445-4843-ab82-e63f5bb2d571-delete_volume'" released by "delete_volume" :: held 0.451s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:30:25.003769 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-42b061ca-2aaf-4f65-a2e1-6e5989251847 tempest-VolumesGetTest-2123264463 None] Lock "b'cinder-963ec8da-6076-44b0-80be-eb95d04dc2a1-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:30:25.042318 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-42b061ca-2aaf-4f65-a2e1-6e5989251847 tempest-VolumesGetTest-2123264463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:25.108708 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-42b061ca-2aaf-4f65-a2e1-6e5989251847 tempest-VolumesGetTest-2123264463 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:30:25.118310 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-42b061ca-2aaf-4f65-a2e1-6e5989251847 tempest-VolumesGetTest-2123264463 None] deleting rbd volume volume-963ec8da-6076-44b0-80be-eb95d04dc2a1 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:30:25.345680 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-42b061ca-2aaf-4f65-a2e1-6e5989251847 tempest-VolumesGetTest-2123264463 None] volume is a clone so cleaning references {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Apr 09 21:30:25.382786 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-42b061ca-2aaf-4f65-a2e1-6e5989251847 tempest-VolumesGetTest-2123264463 None] deleting parent snapshot volume-963ec8da-6076-44b0-80be-eb95d04dc2a1.clone_snap {{(pid=135002) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Apr 09 21:30:26.177319 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-42b061ca-2aaf-4f65-a2e1-6e5989251847 tempest-VolumesGetTest-2123264463 None] Created reservations ['5f4f7af6-51c8-4cfc-a951-a1c8eed84b8f', '6c8a841d-1ffc-4309-99cb-c1d0251c5c4e', '96138e59-686c-4bcb-bdf6-f70d08a89118', '50bdba9d-18ea-40e1-8883-803e28043fca'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:30:26.223572 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-42b061ca-2aaf-4f65-a2e1-6e5989251847 tempest-VolumesGetTest-2123264463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:26.244967 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-42b061ca-2aaf-4f65-a2e1-6e5989251847 tempest-VolumesGetTest-2123264463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:26.289634 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-42b061ca-2aaf-4f65-a2e1-6e5989251847 tempest-VolumesGetTest-2123264463 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:30:26.295329 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-42b061ca-2aaf-4f65-a2e1-6e5989251847 tempest-VolumesGetTest-2123264463 None] Deleted volume successfully. Apr 09 21:30:26.312500 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-42b061ca-2aaf-4f65-a2e1-6e5989251847 tempest-VolumesGetTest-2123264463 None] Lock "b'cinder-963ec8da-6076-44b0-80be-eb95d04dc2a1-delete_volume'" released by "delete_volume" :: held 1.309s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:30:27.217069 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-a0e12472-7a15-4a7f-a0a8-b4eebe39e25f tempest-VolumesGetTest-2123264463 None] Lock "b'cinder-7cf2ef4c-9d49-4fcc-8263-da280e6b1b81-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:30:27.257800 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a0e12472-7a15-4a7f-a0a8-b4eebe39e25f tempest-VolumesGetTest-2123264463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:27.303750 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a0e12472-7a15-4a7f-a0a8-b4eebe39e25f tempest-VolumesGetTest-2123264463 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:30:27.304177 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a0e12472-7a15-4a7f-a0a8-b4eebe39e25f tempest-VolumesGetTest-2123264463 None] Volume volume-7cf2ef4c-9d49-4fcc-8263-da280e6b1b81 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:30:27.311738 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a0e12472-7a15-4a7f-a0a8-b4eebe39e25f tempest-VolumesGetTest-2123264463 None] deleting rbd volume volume-7cf2ef4c-9d49-4fcc-8263-da280e6b1b81 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:30:27.638890 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-a0e12472-7a15-4a7f-a0a8-b4eebe39e25f tempest-VolumesGetTest-2123264463 None] Created reservations ['f2d077e0-3986-497f-8ffb-e57738c8f666', '76c87c87-257d-4530-aaf4-e84f31202b30', '1b79b050-d7a7-4cf2-909e-80a6688208b6', '1c02d975-6dbb-4db4-92e1-45707c74a415'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:30:27.688028 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a0e12472-7a15-4a7f-a0a8-b4eebe39e25f tempest-VolumesGetTest-2123264463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:27.713294 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a0e12472-7a15-4a7f-a0a8-b4eebe39e25f tempest-VolumesGetTest-2123264463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:27.737404 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-a0e12472-7a15-4a7f-a0a8-b4eebe39e25f tempest-VolumesGetTest-2123264463 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:30:27.741336 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-a0e12472-7a15-4a7f-a0a8-b4eebe39e25f tempest-VolumesGetTest-2123264463 None] Deleted volume successfully. Apr 09 21:30:27.754607 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-a0e12472-7a15-4a7f-a0a8-b4eebe39e25f tempest-VolumesGetTest-2123264463 None] Lock "b'cinder-7cf2ef4c-9d49-4fcc-8263-da280e6b1b81-delete_volume'" released by "delete_volume" :: held 0.538s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:30:29.702928 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-749cccac-b6fd-4ad3-bda2-d71db3d19f96 tempest-TestVolumeBootPattern-212634100 None] Created reservations ['d133c2c8-161f-42fa-a253-c9fa4307c035', '6cccdd2d-c0ee-4212-b80f-21f3bef19f65', '899d896b-5e56-4057-8178-444cbc8e5615', 'bfe05ef2-a8b9-49d5-a5ff-77c616f62ca3'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:30:29.748277 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-749cccac-b6fd-4ad3-bda2-d71db3d19f96 tempest-TestVolumeBootPattern-212634100 None] Delete snapshot completed successfully. Apr 09 21:30:29.753722 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-749cccac-b6fd-4ad3-bda2-d71db3d19f96 tempest-TestVolumeBootPattern-212634100 None] Lock "b'cinder-c3acf4f7-f0e5-4ae7-a626-c36dbdcfb52a-delete_snapshot'" released by "delete_snapshot" :: held 30.268s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:30:31.033462 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4f1ba1f-5e95-4dfd-ac8a-5f04e641ca2d tempest-VolumesSnapshotTestJSON-286608301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:30:31.053367 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d4f1ba1f-5e95-4dfd-ac8a-5f04e641ca2d tempest-VolumesSnapshotTestJSON-286608301 None] Flow 'volume_create_manager' (f4837cb1-0f66-4aaf-b96c-4c1ada52ac18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:30:31.059938 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d4f1ba1f-5e95-4dfd-ac8a-5f04e641ca2d tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4505ba7d-fd67-4499-a2df-999f4c3dcdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:31.076464 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d4f1ba1f-5e95-4dfd-ac8a-5f04e641ca2d tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4505ba7d-fd67-4499-a2df-999f4c3dcdb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1687760687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fbfeac4b-61b9-4faf-a5c0-5f9332a0b38b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e1e5cc7222142ab82cd6a857f7be3de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:30:31Z,use_quota=True,user_id='f858bd78e1794185a908d3372a7359dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:31.082096 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d4f1ba1f-5e95-4dfd-ac8a-5f04e641ca2d tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac7d351b-26b2-4850-9d08-11e4c8c70b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:31.086850 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d4f1ba1f-5e95-4dfd-ac8a-5f04e641ca2d tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac7d351b-26b2-4850-9d08-11e4c8c70b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:31.092136 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d4f1ba1f-5e95-4dfd-ac8a-5f04e641ca2d tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02ed030b-4f6b-4e4a-9d52-752c6ef7272a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:31.096447 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d4f1ba1f-5e95-4dfd-ac8a-5f04e641ca2d tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02ed030b-4f6b-4e4a-9d52-752c6ef7272a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbfeac4b-61b9-4faf-a5c0-5f9332a0b38b', 'volume_name': 'volume-fbfeac4b-61b9-4faf-a5c0-5f9332a0b38b', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:31.101593 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d4f1ba1f-5e95-4dfd-ac8a-5f04e641ca2d tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc44c96-3fc1-4586-9bfe-9dde343953da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:31.105578 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d4f1ba1f-5e95-4dfd-ac8a-5f04e641ca2d tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc44c96-3fc1-4586-9bfe-9dde343953da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:31.110401 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d4f1ba1f-5e95-4dfd-ac8a-5f04e641ca2d tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce410512-abeb-4836-a7d1-b1a06f8f8808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:31.111488 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-d4f1ba1f-5e95-4dfd-ac8a-5f04e641ca2d tempest-VolumesSnapshotTestJSON-286608301 None] Volume fbfeac4b-61b9-4faf-a5c0-5f9332a0b38b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbfeac4b-61b9-4faf-a5c0-5f9332a0b38b', 'volume_size': 1} Apr 09 21:30:31.111876 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d4f1ba1f-5e95-4dfd-ac8a-5f04e641ca2d tempest-VolumesSnapshotTestJSON-286608301 None] creating volume 'volume-fbfeac4b-61b9-4faf-a5c0-5f9332a0b38b' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:30:31.113630 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d4f1ba1f-5e95-4dfd-ac8a-5f04e641ca2d tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:31.187696 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d4f1ba1f-5e95-4dfd-ac8a-5f04e641ca2d tempest-VolumesSnapshotTestJSON-286608301 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:30:31.187998 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d4f1ba1f-5e95-4dfd-ac8a-5f04e641ca2d tempest-VolumesSnapshotTestJSON-286608301 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:30:31.192251 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d4f1ba1f-5e95-4dfd-ac8a-5f04e641ca2d tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce410512-abeb-4836-a7d1-b1a06f8f8808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbfeac4b-61b9-4faf-a5c0-5f9332a0b38b', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:31.197156 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d4f1ba1f-5e95-4dfd-ac8a-5f04e641ca2d tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c4da3f5-2d96-482c-b4c4-6cd821eb93cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:31.207901 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-d4f1ba1f-5e95-4dfd-ac8a-5f04e641ca2d tempest-VolumesSnapshotTestJSON-286608301 None] Volume volume-fbfeac4b-61b9-4faf-a5c0-5f9332a0b38b (fbfeac4b-61b9-4faf-a5c0-5f9332a0b38b): created successfully Apr 09 21:30:31.214274 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d4f1ba1f-5e95-4dfd-ac8a-5f04e641ca2d tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c4da3f5-2d96-482c-b4c4-6cd821eb93cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:31.220469 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-d4f1ba1f-5e95-4dfd-ac8a-5f04e641ca2d tempest-VolumesSnapshotTestJSON-286608301 None] Flow 'volume_create_manager' (f4837cb1-0f66-4aaf-b96c-4c1ada52ac18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:30:31.229915 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-d4f1ba1f-5e95-4dfd-ac8a-5f04e641ca2d tempest-VolumesSnapshotTestJSON-286608301 None] Created volume successfully. Apr 09 21:30:32.230728 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-6f81ac6d-2666-4a13-9975-21748d0067ba tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:32.731665 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-c61ecc7a-17f8-4950-8f2b-af37ee8d743c req-eec1a9eb-6687-4965-aae9-aa18098e5e9e tempest-TestVolumeBootPattern-212634100 None] Terminate volume connection completed successfully. Apr 09 21:30:32.732069 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-c61ecc7a-17f8-4950-8f2b-af37ee8d743c req-eec1a9eb-6687-4965-aae9-aa18098e5e9e tempest-TestVolumeBootPattern-212634100 None] Deleting attachment c82e5986-2e5c-496f-80c5-1c2955661b72. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 21:30:32.856329 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [req-c61ecc7a-17f8-4950-8f2b-af37ee8d743c req-5e55e7b3-f504-411c-a6e0-8b94b54dd02e tempest-TestVolumeBootPattern-212634100 None] Lock "b'cinder-527175d7-c75b-4775-9719-6ac41f211e5f-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:30:32.889971 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-c61ecc7a-17f8-4950-8f2b-af37ee8d743c req-5e55e7b3-f504-411c-a6e0-8b94b54dd02e tempest-TestVolumeBootPattern-212634100 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:32.964990 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-c61ecc7a-17f8-4950-8f2b-af37ee8d743c req-5e55e7b3-f504-411c-a6e0-8b94b54dd02e tempest-TestVolumeBootPattern-212634100 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:30:32.974962 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-c61ecc7a-17f8-4950-8f2b-af37ee8d743c req-5e55e7b3-f504-411c-a6e0-8b94b54dd02e tempest-TestVolumeBootPattern-212634100 None] deleting rbd volume volume-527175d7-c75b-4775-9719-6ac41f211e5f {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:30:33.306751 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-c61ecc7a-17f8-4950-8f2b-af37ee8d743c req-5e55e7b3-f504-411c-a6e0-8b94b54dd02e tempest-TestVolumeBootPattern-212634100 None] volume is a clone so cleaning references {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Apr 09 21:30:33.345845 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-c61ecc7a-17f8-4950-8f2b-af37ee8d743c req-5e55e7b3-f504-411c-a6e0-8b94b54dd02e tempest-TestVolumeBootPattern-212634100 None] deleting parent snapshot volume-527175d7-c75b-4775-9719-6ac41f211e5f.clone_snap {{(pid=135002) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Apr 09 21:30:34.295954 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-6f81ac6d-2666-4a13-9975-21748d0067ba tempest-VolumesSnapshotTestJSON-286608301 None] Create snapshot completed successfully Apr 09 21:30:34.318817 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [req-c61ecc7a-17f8-4950-8f2b-af37ee8d743c req-5e55e7b3-f504-411c-a6e0-8b94b54dd02e tempest-TestVolumeBootPattern-212634100 None] Created reservations ['88f18b2e-c287-4258-9721-00a85f38194c', '6660c0ce-c731-4101-8812-1a546afbb4d1', '75e437f1-e05f-4e63-a097-e550aef8f289', '08746c8c-29df-4bb8-a966-a140b5f971dc'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:30:34.365051 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-c61ecc7a-17f8-4950-8f2b-af37ee8d743c req-5e55e7b3-f504-411c-a6e0-8b94b54dd02e tempest-TestVolumeBootPattern-212634100 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:34.390436 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-c61ecc7a-17f8-4950-8f2b-af37ee8d743c req-5e55e7b3-f504-411c-a6e0-8b94b54dd02e tempest-TestVolumeBootPattern-212634100 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:34.416158 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [req-c61ecc7a-17f8-4950-8f2b-af37ee8d743c req-5e55e7b3-f504-411c-a6e0-8b94b54dd02e tempest-TestVolumeBootPattern-212634100 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:30:34.420272 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-c61ecc7a-17f8-4950-8f2b-af37ee8d743c req-5e55e7b3-f504-411c-a6e0-8b94b54dd02e tempest-TestVolumeBootPattern-212634100 None] Deleted volume successfully. Apr 09 21:30:34.436153 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [req-c61ecc7a-17f8-4950-8f2b-af37ee8d743c req-5e55e7b3-f504-411c-a6e0-8b94b54dd02e tempest-TestVolumeBootPattern-212634100 None] Lock "b'cinder-527175d7-c75b-4775-9719-6ac41f211e5f-delete_volume'" released by "delete_volume" :: held 1.580s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:30:35.535535 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.driver [None req-77bd54df-6b92-4765-add7-8ebbfccafd14 tempest-VolumesSnapshotTestJSON-286608301 None] Creating a new backup for volume volume-fbfeac4b-61b9-4faf-a5c0-5f9332a0b38b. {{(pid=135002) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1212}} Apr 09 21:30:35.568871 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-77bd54df-6b92-4765-add7-8ebbfccafd14 tempest-VolumesSnapshotTestJSON-286608301 None] cloning volumes/volume-fbfeac4b-61b9-4faf-a5c0-5f9332a0b38b@snapshot-9cdf63cf-ccc4-49b8-a938-a3945341defb to volume-a5c65ac7-7c90-409b-a38a-0d7304ee17bf {{(pid=135002) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1090}} Apr 09 21:30:35.569595 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-77bd54df-6b92-4765-add7-8ebbfccafd14 tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:35.612981 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-77bd54df-6b92-4765-add7-8ebbfccafd14 tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:35.736380 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-77bd54df-6b92-4765-add7-8ebbfccafd14 tempest-VolumesSnapshotTestJSON-286608301 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:30:35.736765 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-77bd54df-6b92-4765-add7-8ebbfccafd14 tempest-VolumesSnapshotTestJSON-286608301 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:30:35.758276 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-77bd54df-6b92-4765-add7-8ebbfccafd14 tempest-VolumesSnapshotTestJSON-286608301 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-04-09T21:30:35Z,data_timestamp=2022-04-09T21:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Backup-1277760299',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=f41cb63e-911f-4569-881d-c775f1c4df59,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='3e1e5cc7222142ab82cd6a857f7be3de',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id='9cdf63cf-ccc4-49b8-a938-a3945341defb',status='creating',temp_snapshot_id=None,temp_volume_id='a5c65ac7-7c90-409b-a38a-0d7304ee17bf',updated_at=None,user_id='f858bd78e1794185a908d3372a7359dd',volume_id=fbfeac4b-61b9-4faf-a5c0-5f9332a0b38b) Apr 09 21:30:35.759022 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.backup.rpcapi [None req-77bd54df-6b92-4765-add7-8ebbfccafd14 tempest-VolumesSnapshotTestJSON-286608301 None] continue_backup in rpcapi backup_id f41cb63e-911f-4569-881d-c775f1c4df59 {{(pid=135002) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Apr 09 21:30:35.882888 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [None req-77bd54df-6b92-4765-add7-8ebbfccafd14 tempest-VolumesSnapshotTestJSON-286608301 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:30:36.537262 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [None req-77bd54df-6b92-4765-add7-8ebbfccafd14 tempest-VolumesSnapshotTestJSON-286608301 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.654s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:30:36.538220 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-77bd54df-6b92-4765-add7-8ebbfccafd14 tempest-VolumesSnapshotTestJSON-286608301 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a5c65ac7-7c90-409b-a38a-0d7304ee17bf', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': 'a5c65ac7-7c90-409b-a38a-0d7304ee17bf', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:30:36.551612 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-77bd54df-6b92-4765-add7-8ebbfccafd14 tempest-VolumesSnapshotTestJSON-286608301 None] Initialize volume connection completed successfully. Apr 09 21:30:36.728707 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0d5a07b-3e03-4675-800a-7dc6377f067e tempest-TestVolumeBootPattern-212634100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:30:36.750206 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f0d5a07b-3e03-4675-800a-7dc6377f067e tempest-TestVolumeBootPattern-212634100 None] Flow 'volume_create_manager' (40d85011-ac61-4e4a-bbd1-503ecd70b7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:30:36.757501 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f0d5a07b-3e03-4675-800a-7dc6377f067e tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c61eba-ec07-4f71-a5f1-2fafefb4c816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:36.775830 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f0d5a07b-3e03-4675-800a-7dc6377f067e tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c61eba-ec07-4f71-a5f1-2fafefb4c816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1773557822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ac526ef0-508b-4640-8ed5-a8a5a3135756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1063334e4a426eb70eec5ed1578744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:30:37Z,use_quota=True,user_id='2e9bbd737ff54225a549f072976ef296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:36.781849 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f0d5a07b-3e03-4675-800a-7dc6377f067e tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56c46a91-7424-4dd6-b219-cef1b6e10512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:36.786142 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f0d5a07b-3e03-4675-800a-7dc6377f067e tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56c46a91-7424-4dd6-b219-cef1b6e10512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:36.791934 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f0d5a07b-3e03-4675-800a-7dc6377f067e tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d1f241-a890-4cba-bd70-b1ff17830742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:36.880982 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f0d5a07b-3e03-4675-800a-7dc6377f067e tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d1f241-a890-4cba-bd70-b1ff17830742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ac526ef0-508b-4640-8ed5-a8a5a3135756', 'volume_name': 'volume-ac526ef0-508b-4640-8ed5-a8a5a3135756', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:36.886324 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f0d5a07b-3e03-4675-800a-7dc6377f067e tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a794ff08-2f37-4165-b7fa-c85501d62a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:36.890708 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f0d5a07b-3e03-4675-800a-7dc6377f067e tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a794ff08-2f37-4165-b7fa-c85501d62a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:36.895663 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f0d5a07b-3e03-4675-800a-7dc6377f067e tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35ef2dcd-0e57-478d-814f-cee0ce9b5c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:36.897522 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-f0d5a07b-3e03-4675-800a-7dc6377f067e tempest-TestVolumeBootPattern-212634100 None] Volume ac526ef0-508b-4640-8ed5-a8a5a3135756: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ac526ef0-508b-4640-8ed5-a8a5a3135756', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 09 21:30:36.898167 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0d5a07b-3e03-4675-800a-7dc6377f067e tempest-TestVolumeBootPattern-212634100 None] Cloning ac526ef0-508b-4640-8ed5-a8a5a3135756 from image b539c48b-3400-4aa4-9226-8be5a3d07b36 at location (None, None). {{(pid=135002) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Apr 09 21:30:36.907309 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-f0d5a07b-3e03-4675-800a-7dc6377f067e tempest-TestVolumeBootPattern-212634100 None] Lock "b'cinder-b539c48b-3400-4aa4-9226-8be5a3d07b36'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:30:36.919745 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-f0d5a07b-3e03-4675-800a-7dc6377f067e tempest-TestVolumeBootPattern-212634100 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'volume_id': 'd35656e2-d293-4904-aeae-3113202bb314', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36), 'last_used': datetime.datetime(2022, 4, 9, 21, 30, 36, 912096)}. {{(pid=135002) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 09 21:30:36.920212 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-f0d5a07b-3e03-4675-800a-7dc6377f067e tempest-TestVolumeBootPattern-212634100 None] Image-volume cache entry image_update_at = 2022-04-09 20:45:36+00:00, requested image updated_at = 2022-04-09 20:45:36+00:00. {{(pid=135002) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 09 21:30:36.920665 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0d5a07b-3e03-4675-800a-7dc6377f067e tempest-TestVolumeBootPattern-212634100 None] Found cache entry for image = b539c48b-3400-4aa4-9226-8be5a3d07b36 on host ncdv-master-1@ceph#ceph. {{(pid=135002) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Apr 09 21:30:36.925308 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-f0d5a07b-3e03-4675-800a-7dc6377f067e tempest-TestVolumeBootPattern-212634100 None] Lock "b'cinder-b539c48b-3400-4aa4-9226-8be5a3d07b36'" released by "_prepare_image_cache_entry" :: held 0.018s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:30:36.926237 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0d5a07b-3e03-4675-800a-7dc6377f067e tempest-TestVolumeBootPattern-212634100 None] Attempting to retrieve cache entry for image = b539c48b-3400-4aa4-9226-8be5a3d07b36 on host ncdv-master-1@ceph#ceph. {{(pid=135002) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Apr 09 21:30:36.932596 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-f0d5a07b-3e03-4675-800a-7dc6377f067e tempest-TestVolumeBootPattern-212634100 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'volume_id': 'd35656e2-d293-4904-aeae-3113202bb314', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36), 'last_used': datetime.datetime(2022, 4, 9, 21, 30, 36, 930062)}. {{(pid=135002) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 09 21:30:36.933417 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-f0d5a07b-3e03-4675-800a-7dc6377f067e tempest-TestVolumeBootPattern-212634100 None] Image-volume cache entry image_update_at = 2022-04-09 20:45:36+00:00, requested image updated_at = 2022-04-09 20:45:36+00:00. {{(pid=135002) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 09 21:30:36.933854 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0d5a07b-3e03-4675-800a-7dc6377f067e tempest-TestVolumeBootPattern-212634100 None] Creating from source image-volume d35656e2-d293-4904-aeae-3113202bb314 {{(pid=135002) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Apr 09 21:30:36.946264 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f0d5a07b-3e03-4675-800a-7dc6377f067e tempest-TestVolumeBootPattern-212634100 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:37.001843 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f0d5a07b-3e03-4675-800a-7dc6377f067e tempest-TestVolumeBootPattern-212634100 None] creating snapshot='volume-ac526ef0-508b-4640-8ed5-a8a5a3135756.clone_snap' {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Apr 09 21:30:37.229488 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f0d5a07b-3e03-4675-800a-7dc6377f067e tempest-TestVolumeBootPattern-212634100 None] cloning 'volume-d35656e2-d293-4904-aeae-3113202bb314@volume-ac526ef0-508b-4640-8ed5-a8a5a3135756.clone_snap' to 'volume-ac526ef0-508b-4640-8ed5-a8a5a3135756' {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Apr 09 21:30:37.698885 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f0d5a07b-3e03-4675-800a-7dc6377f067e tempest-TestVolumeBootPattern-212634100 None] Volume volume-6d815065-063f-4887-9bc8-5808837868ff.deleted is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:30:37.700114 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f0d5a07b-3e03-4675-800a-7dc6377f067e tempest-TestVolumeBootPattern-212634100 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:30:37.700593 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f0d5a07b-3e03-4675-800a-7dc6377f067e tempest-TestVolumeBootPattern-212634100 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:30:37.774351 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-f0d5a07b-3e03-4675-800a-7dc6377f067e tempest-TestVolumeBootPattern-212634100 None] clone created successfully {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Apr 09 21:30:37.775009 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.volume_utils [None req-f0d5a07b-3e03-4675-800a-7dc6377f067e tempest-TestVolumeBootPattern-212634100 None] Marking volume ac526ef0-508b-4640-8ed5-a8a5a3135756 as bootable. {{(pid=135002) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Apr 09 21:30:37.788614 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0d5a07b-3e03-4675-800a-7dc6377f067e tempest-TestVolumeBootPattern-212634100 None] Copying metadata from image b539c48b-3400-4aa4-9226-8be5a3d07b36 to ac526ef0-508b-4640-8ed5-a8a5a3135756. {{(pid=135002) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Apr 09 21:30:37.789092 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0d5a07b-3e03-4675-800a-7dc6377f067e tempest-TestVolumeBootPattern-212634100 None] Creating volume glance metadata for volume ac526ef0-508b-4640-8ed5-a8a5a3135756 backed by image b539c48b-3400-4aa4-9226-8be5a3d07b36 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=135002) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Apr 09 21:30:37.852952 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f0d5a07b-3e03-4675-800a-7dc6377f067e tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35ef2dcd-0e57-478d-814f-cee0ce9b5c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac526ef0-508b-4640-8ed5-a8a5a3135756', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:37.858358 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f0d5a07b-3e03-4675-800a-7dc6377f067e tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (624d3c73-2357-46f2-9259-59ec9d211abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:37.872117 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-f0d5a07b-3e03-4675-800a-7dc6377f067e tempest-TestVolumeBootPattern-212634100 None] Volume volume-ac526ef0-508b-4640-8ed5-a8a5a3135756 (ac526ef0-508b-4640-8ed5-a8a5a3135756): created successfully Apr 09 21:30:37.873891 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f0d5a07b-3e03-4675-800a-7dc6377f067e tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (624d3c73-2357-46f2-9259-59ec9d211abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:37.880046 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-f0d5a07b-3e03-4675-800a-7dc6377f067e tempest-TestVolumeBootPattern-212634100 None] Flow 'volume_create_manager' (40d85011-ac61-4e4a-bbd1-503ecd70b7c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:30:37.890832 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-f0d5a07b-3e03-4675-800a-7dc6377f067e tempest-TestVolumeBootPattern-212634100 None] Created volume successfully. Apr 09 21:30:41.045709 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-517d57ce-5e89-4597-b3b6-585ce31dc885 req-fb38f2f2-738a-43a4-a47f-7d04bd573df1 tempest-TestVolumeBootPattern-212634100 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:30:41.774948 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-517d57ce-5e89-4597-b3b6-585ce31dc885 req-fb38f2f2-738a-43a4-a47f-7d04bd573df1 tempest-TestVolumeBootPattern-212634100 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.729s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:30:41.775924 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-517d57ce-5e89-4597-b3b6-585ce31dc885 req-fb38f2f2-738a-43a4-a47f-7d04bd573df1 tempest-TestVolumeBootPattern-212634100 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ac526ef0-508b-4640-8ed5-a8a5a3135756', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': 'ac526ef0-508b-4640-8ed5-a8a5a3135756', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:30:41.837200 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-517d57ce-5e89-4597-b3b6-585ce31dc885 req-fb38f2f2-738a-43a4-a47f-7d04bd573df1 tempest-TestVolumeBootPattern-212634100 None] Connection info returned from driver {'name': 'volumes/volume-ac526ef0-508b-4640-8ed5-a8a5a3135756', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ac526ef0-508b-4640-8ed5-a8a5a3135756', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b5f1ca2d-d045-4a76-bf25-ba4c9aec8d81'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 21:30:41.955705 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-517d57ce-5e89-4597-b3b6-585ce31dc885 req-fb38f2f2-738a-43a4-a47f-7d04bd573df1 tempest-TestVolumeBootPattern-212634100 None] attachment_update completed successfully. Apr 09 21:30:46.318877 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-77bd54df-6b92-4765-add7-8ebbfccafd14 tempest-VolumesSnapshotTestJSON-286608301 None] Terminate volume connection completed successfully. Apr 09 21:30:46.334021 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-77bd54df-6b92-4765-add7-8ebbfccafd14 tempest-VolumesSnapshotTestJSON-286608301 None] Remove volume export completed successfully. Apr 09 21:30:46.368553 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-77bd54df-6b92-4765-add7-8ebbfccafd14 tempest-VolumesSnapshotTestJSON-286608301 None] Lock "b'cinder-a5c65ac7-7c90-409b-a38a-0d7304ee17bf-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:30:46.381190 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-77bd54df-6b92-4765-add7-8ebbfccafd14 tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:46.433778 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-77bd54df-6b92-4765-add7-8ebbfccafd14 tempest-VolumesSnapshotTestJSON-286608301 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:30:46.442218 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-77bd54df-6b92-4765-add7-8ebbfccafd14 tempest-VolumesSnapshotTestJSON-286608301 None] deleting rbd volume volume-a5c65ac7-7c90-409b-a38a-0d7304ee17bf {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:30:46.671839 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-77bd54df-6b92-4765-add7-8ebbfccafd14 tempest-VolumesSnapshotTestJSON-286608301 None] Deleted volume successfully. Apr 09 21:30:46.677277 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-77bd54df-6b92-4765-add7-8ebbfccafd14 tempest-VolumesSnapshotTestJSON-286608301 None] Lock "b'cinder-a5c65ac7-7c90-409b-a38a-0d7304ee17bf-delete_volume'" released by "delete_volume" :: held 0.309s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:30:49.987132 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:30:49.988042 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:50.014768 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:50.040043 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:30:58.669702 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b39c916-5963-4f27-a21c-c3b07f81f9c9 tempest-VolumesSnapshotTestJSON-286608301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:30:58.689111 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b39c916-5963-4f27-a21c-c3b07f81f9c9 tempest-VolumesSnapshotTestJSON-286608301 None] Flow 'volume_create_manager' (8bd6485a-acb1-40bb-b043-ec41b6836a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:30:58.695541 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b39c916-5963-4f27-a21c-c3b07f81f9c9 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56d0c20a-7cae-45ad-a12b-0947e6241509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:58.712244 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b39c916-5963-4f27-a21c-c3b07f81f9c9 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56d0c20a-7cae-45ad-a12b-0947e6241509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-281978578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=390d885e-abbc-40c6-a67c-adccc1e809d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e1e5cc7222142ab82cd6a857f7be3de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:30:59Z,use_quota=True,user_id='f858bd78e1794185a908d3372a7359dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:58.717531 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b39c916-5963-4f27-a21c-c3b07f81f9c9 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb357987-99c4-4ce8-9f52-eab1cbd7287d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:58.721616 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b39c916-5963-4f27-a21c-c3b07f81f9c9 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb357987-99c4-4ce8-9f52-eab1cbd7287d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:58.726754 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b39c916-5963-4f27-a21c-c3b07f81f9c9 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65a60f08-70d7-48fb-9dd9-289a8924eb66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:58.816715 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b39c916-5963-4f27-a21c-c3b07f81f9c9 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65a60f08-70d7-48fb-9dd9-289a8924eb66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '390d885e-abbc-40c6-a67c-adccc1e809d8', 'volume_name': 'volume-390d885e-abbc-40c6-a67c-adccc1e809d8', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:58.821938 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b39c916-5963-4f27-a21c-c3b07f81f9c9 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6bfbf72-5ce2-42b8-a94e-8836ee59d43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:58.826015 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b39c916-5963-4f27-a21c-c3b07f81f9c9 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6bfbf72-5ce2-42b8-a94e-8836ee59d43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:58.830798 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b39c916-5963-4f27-a21c-c3b07f81f9c9 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14d31f06-d8af-4e04-b638-523d4f59d74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:58.832264 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-5b39c916-5963-4f27-a21c-c3b07f81f9c9 tempest-VolumesSnapshotTestJSON-286608301 None] Volume 390d885e-abbc-40c6-a67c-adccc1e809d8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-390d885e-abbc-40c6-a67c-adccc1e809d8', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 09 21:30:58.832834 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b39c916-5963-4f27-a21c-c3b07f81f9c9 tempest-VolumesSnapshotTestJSON-286608301 None] Cloning 390d885e-abbc-40c6-a67c-adccc1e809d8 from image b539c48b-3400-4aa4-9226-8be5a3d07b36 at location (None, None). {{(pid=135002) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Apr 09 21:30:58.843462 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-5b39c916-5963-4f27-a21c-c3b07f81f9c9 tempest-VolumesSnapshotTestJSON-286608301 None] Lock "b'cinder-b539c48b-3400-4aa4-9226-8be5a3d07b36'" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:30:58.854184 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-5b39c916-5963-4f27-a21c-c3b07f81f9c9 tempest-VolumesSnapshotTestJSON-286608301 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'volume_id': 'd35656e2-d293-4904-aeae-3113202bb314', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36), 'last_used': datetime.datetime(2022, 4, 9, 21, 30, 58, 847406)}. {{(pid=135002) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 09 21:30:58.854626 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-5b39c916-5963-4f27-a21c-c3b07f81f9c9 tempest-VolumesSnapshotTestJSON-286608301 None] Image-volume cache entry image_update_at = 2022-04-09 20:45:36+00:00, requested image updated_at = 2022-04-09 20:45:36+00:00. {{(pid=135002) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 09 21:30:58.855001 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b39c916-5963-4f27-a21c-c3b07f81f9c9 tempest-VolumesSnapshotTestJSON-286608301 None] Found cache entry for image = b539c48b-3400-4aa4-9226-8be5a3d07b36 on host ncdv-master-1@ceph#ceph. {{(pid=135002) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Apr 09 21:30:58.859382 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-5b39c916-5963-4f27-a21c-c3b07f81f9c9 tempest-VolumesSnapshotTestJSON-286608301 None] Lock "b'cinder-b539c48b-3400-4aa4-9226-8be5a3d07b36'" released by "_prepare_image_cache_entry" :: held 0.016s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:30:58.860128 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b39c916-5963-4f27-a21c-c3b07f81f9c9 tempest-VolumesSnapshotTestJSON-286608301 None] Attempting to retrieve cache entry for image = b539c48b-3400-4aa4-9226-8be5a3d07b36 on host ncdv-master-1@ceph#ceph. {{(pid=135002) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Apr 09 21:30:58.865413 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-5b39c916-5963-4f27-a21c-c3b07f81f9c9 tempest-VolumesSnapshotTestJSON-286608301 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'volume_id': 'd35656e2-d293-4904-aeae-3113202bb314', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36), 'last_used': datetime.datetime(2022, 4, 9, 21, 30, 58, 863222)}. {{(pid=135002) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 09 21:30:58.865820 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-5b39c916-5963-4f27-a21c-c3b07f81f9c9 tempest-VolumesSnapshotTestJSON-286608301 None] Image-volume cache entry image_update_at = 2022-04-09 20:45:36+00:00, requested image updated_at = 2022-04-09 20:45:36+00:00. {{(pid=135002) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 09 21:30:58.866219 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b39c916-5963-4f27-a21c-c3b07f81f9c9 tempest-VolumesSnapshotTestJSON-286608301 None] Creating from source image-volume d35656e2-d293-4904-aeae-3113202bb314 {{(pid=135002) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Apr 09 21:30:58.878654 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5b39c916-5963-4f27-a21c-c3b07f81f9c9 tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:30:58.932224 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5b39c916-5963-4f27-a21c-c3b07f81f9c9 tempest-VolumesSnapshotTestJSON-286608301 None] creating snapshot='volume-390d885e-abbc-40c6-a67c-adccc1e809d8.clone_snap' {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Apr 09 21:30:59.220589 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5b39c916-5963-4f27-a21c-c3b07f81f9c9 tempest-VolumesSnapshotTestJSON-286608301 None] cloning 'volume-d35656e2-d293-4904-aeae-3113202bb314@volume-390d885e-abbc-40c6-a67c-adccc1e809d8.clone_snap' to 'volume-390d885e-abbc-40c6-a67c-adccc1e809d8' {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Apr 09 21:30:59.382408 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5b39c916-5963-4f27-a21c-c3b07f81f9c9 tempest-VolumesSnapshotTestJSON-286608301 None] Volume volume-6d815065-063f-4887-9bc8-5808837868ff.deleted is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:30:59.383591 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5b39c916-5963-4f27-a21c-c3b07f81f9c9 tempest-VolumesSnapshotTestJSON-286608301 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:30:59.383953 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5b39c916-5963-4f27-a21c-c3b07f81f9c9 tempest-VolumesSnapshotTestJSON-286608301 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:30:59.408167 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5b39c916-5963-4f27-a21c-c3b07f81f9c9 tempest-VolumesSnapshotTestJSON-286608301 None] clone created successfully {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Apr 09 21:30:59.408857 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.volume_utils [None req-5b39c916-5963-4f27-a21c-c3b07f81f9c9 tempest-VolumesSnapshotTestJSON-286608301 None] Marking volume 390d885e-abbc-40c6-a67c-adccc1e809d8 as bootable. {{(pid=135002) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Apr 09 21:30:59.418754 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b39c916-5963-4f27-a21c-c3b07f81f9c9 tempest-VolumesSnapshotTestJSON-286608301 None] Copying metadata from image b539c48b-3400-4aa4-9226-8be5a3d07b36 to 390d885e-abbc-40c6-a67c-adccc1e809d8. {{(pid=135002) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Apr 09 21:30:59.419181 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b39c916-5963-4f27-a21c-c3b07f81f9c9 tempest-VolumesSnapshotTestJSON-286608301 None] Creating volume glance metadata for volume 390d885e-abbc-40c6-a67c-adccc1e809d8 backed by image b539c48b-3400-4aa4-9226-8be5a3d07b36 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=135002) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Apr 09 21:30:59.472242 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b39c916-5963-4f27-a21c-c3b07f81f9c9 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14d31f06-d8af-4e04-b638-523d4f59d74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-390d885e-abbc-40c6-a67c-adccc1e809d8', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:59.476891 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b39c916-5963-4f27-a21c-c3b07f81f9c9 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (963a733c-1696-496a-93ea-842e14d4d438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:30:59.487432 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-5b39c916-5963-4f27-a21c-c3b07f81f9c9 tempest-VolumesSnapshotTestJSON-286608301 None] Volume volume-390d885e-abbc-40c6-a67c-adccc1e809d8 (390d885e-abbc-40c6-a67c-adccc1e809d8): created successfully Apr 09 21:30:59.490990 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b39c916-5963-4f27-a21c-c3b07f81f9c9 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (963a733c-1696-496a-93ea-842e14d4d438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:30:59.496551 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5b39c916-5963-4f27-a21c-c3b07f81f9c9 tempest-VolumesSnapshotTestJSON-286608301 None] Flow 'volume_create_manager' (8bd6485a-acb1-40bb-b043-ec41b6836a8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:30:59.506206 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-5b39c916-5963-4f27-a21c-c3b07f81f9c9 tempest-VolumesSnapshotTestJSON-286608301 None] Created volume successfully. Apr 09 21:31:00.096310 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-36409d80-425a-4aa4-a57e-7b6e4bbdfc9f req-28175660-4530-4593-a951-0d714e97fb1b tempest-VolumesSnapshotTestJSON-286608301 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:31:00.754680 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-36409d80-425a-4aa4-a57e-7b6e4bbdfc9f req-28175660-4530-4593-a951-0d714e97fb1b tempest-VolumesSnapshotTestJSON-286608301 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.658s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:31:00.755524 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-36409d80-425a-4aa4-a57e-7b6e4bbdfc9f req-28175660-4530-4593-a951-0d714e97fb1b tempest-VolumesSnapshotTestJSON-286608301 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-390d885e-abbc-40c6-a67c-adccc1e809d8', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': '390d885e-abbc-40c6-a67c-adccc1e809d8', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:31:00.781226 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-36409d80-425a-4aa4-a57e-7b6e4bbdfc9f req-28175660-4530-4593-a951-0d714e97fb1b tempest-VolumesSnapshotTestJSON-286608301 None] Connection info returned from driver {'name': 'volumes/volume-390d885e-abbc-40c6-a67c-adccc1e809d8', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '390d885e-abbc-40c6-a67c-adccc1e809d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f387b44d-fca0-4541-be07-8853e115de42'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 21:31:00.827110 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-36409d80-425a-4aa4-a57e-7b6e4bbdfc9f req-28175660-4530-4593-a951-0d714e97fb1b tempest-VolumesSnapshotTestJSON-286608301 None] attachment_update completed successfully. Apr 09 21:31:03.412578 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-e3dee44f-b7bf-427b-b59d-7108f2787524 tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:31:04.333620 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-e3dee44f-b7bf-427b-b59d-7108f2787524 tempest-VolumesSnapshotTestJSON-286608301 None] Create snapshot completed successfully Apr 09 21:31:04.628519 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-6efaba0d-49d4-4258-8095-2dc572e80e5d tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:31:05.362740 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-6efaba0d-49d4-4258-8095-2dc572e80e5d tempest-VolumesSnapshotTestJSON-286608301 None] Create snapshot completed successfully Apr 09 21:31:05.827859 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-2e5bf7ba-5f9e-4958-9ba8-40be892aa859 tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:31:06.380154 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-2e5bf7ba-5f9e-4958-9ba8-40be892aa859 tempest-VolumesSnapshotTestJSON-286608301 None] Create snapshot completed successfully Apr 09 21:31:06.896770 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-435129f5-2a86-430d-a14d-c9785134b3d6 tempest-VolumesSnapshotTestJSON-286608301 None] Lock "b'cinder-5426bcee-b0a1-4835-b631-ceb2905a8eae-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.008s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:31:06.898318 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-435129f5-2a86-430d-a14d-c9785134b3d6 tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:31:37.084398 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-435129f5-2a86-430d-a14d-c9785134b3d6 tempest-VolumesSnapshotTestJSON-286608301 None] Created reservations ['ca8737c2-32e7-433f-be90-f043d244cf45', '93d92e7a-7d62-4d4d-b38e-abb0587ac9fa', '029bfc06-d97f-40d4-8dbc-24beddd81256', '5aa8b414-e743-4ab9-a458-d351c85ab23f'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:31:37.126621 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-435129f5-2a86-430d-a14d-c9785134b3d6 tempest-VolumesSnapshotTestJSON-286608301 None] Delete snapshot completed successfully. Apr 09 21:31:37.131266 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-435129f5-2a86-430d-a14d-c9785134b3d6 tempest-VolumesSnapshotTestJSON-286608301 None] Lock "b'cinder-5426bcee-b0a1-4835-b631-ceb2905a8eae-delete_snapshot'" released by "delete_snapshot" :: held 30.235s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:31:37.896856 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-c9c67ab9-cd2f-4f9b-8d1c-df842d3b0864 tempest-VolumesSnapshotTestJSON-286608301 None] Lock "b'cinder-c65c036e-4bfe-43a1-a7a6-1a5a9a22be5c-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:31:37.898784 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-c9c67ab9-cd2f-4f9b-8d1c-df842d3b0864 tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:31:49.986712 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:31:49.988065 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:31:50.023636 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:31:50.046025 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:32:08.093549 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-c9c67ab9-cd2f-4f9b-8d1c-df842d3b0864 tempest-VolumesSnapshotTestJSON-286608301 None] Created reservations ['3f87c269-1a90-485d-ba1f-87f7f74a8e87', 'cd25131d-c066-445c-8a3f-975e17ce8780', 'f4c0df0d-992c-4dc6-a431-2c6fbaf1feac', 'cbd717d5-c182-4ddd-9b0e-48ad947825a8'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:32:08.136511 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-c9c67ab9-cd2f-4f9b-8d1c-df842d3b0864 tempest-VolumesSnapshotTestJSON-286608301 None] Delete snapshot completed successfully. Apr 09 21:32:08.141173 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-c9c67ab9-cd2f-4f9b-8d1c-df842d3b0864 tempest-VolumesSnapshotTestJSON-286608301 None] Lock "b'cinder-c65c036e-4bfe-43a1-a7a6-1a5a9a22be5c-delete_snapshot'" released by "delete_snapshot" :: held 30.244s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:32:08.951975 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-64cafd1d-0561-4d7b-8ba7-68f1aff53b5c tempest-VolumesSnapshotTestJSON-286608301 None] Lock "b'cinder-cd2325f7-184f-4cb6-9339-8de8d588c0f5-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:32:08.953883 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-64cafd1d-0561-4d7b-8ba7-68f1aff53b5c tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:32:39.147178 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-64cafd1d-0561-4d7b-8ba7-68f1aff53b5c tempest-VolumesSnapshotTestJSON-286608301 None] Created reservations ['a3e4019e-4c91-42fa-aa76-dbbd9f3a6ff0', '901ea77e-21f0-4801-bddb-9cd7f2b0006c', '013f7a30-9ec1-4fb9-ba25-68e9ce518e5c', '8643b2d7-4bfa-4cd9-9600-fc5d69b6eea7'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:32:39.190641 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-64cafd1d-0561-4d7b-8ba7-68f1aff53b5c tempest-VolumesSnapshotTestJSON-286608301 None] Delete snapshot completed successfully. Apr 09 21:32:39.195191 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-64cafd1d-0561-4d7b-8ba7-68f1aff53b5c tempest-VolumesSnapshotTestJSON-286608301 None] Lock "b'cinder-cd2325f7-184f-4cb6-9339-8de8d588c0f5-delete_snapshot'" released by "delete_snapshot" :: held 30.243s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:32:40.796338 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-c4f2dcd2-db2b-4077-835f-e26f5cbc77ff req-191e3b4c-37ae-4d88-bed5-a4dd01da8ad0 tempest-VolumesSnapshotTestJSON-286608301 None] Terminate volume connection completed successfully. Apr 09 21:32:40.797092 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-c4f2dcd2-db2b-4077-835f-e26f5cbc77ff req-191e3b4c-37ae-4d88-bed5-a4dd01da8ad0 tempest-VolumesSnapshotTestJSON-286608301 None] Deleting attachment f387b44d-fca0-4541-be07-8853e115de42. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 21:32:45.129106 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-09c81a58-be54-432e-b928-7a285261c488 tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:32:46.034334 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-09c81a58-be54-432e-b928-7a285261c488 tempest-VolumesSnapshotTestJSON-286608301 None] Create snapshot completed successfully Apr 09 21:32:46.324627 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-b0e66aed-499d-421b-9922-174f01b528e9 tempest-VolumesSnapshotTestJSON-286608301 None] Lock "b'cinder-cb92aff0-b3ae-4db4-af56-f76aafdcea3f-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:32:46.326137 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b0e66aed-499d-421b-9922-174f01b528e9 tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:32:47.045368 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-b0e66aed-499d-421b-9922-174f01b528e9 tempest-VolumesSnapshotTestJSON-286608301 None] Created reservations ['9c6df85d-a5e4-4ce9-a52f-bc34d799755c', '325c0cae-60e4-41d6-a819-bfaa8a96084d', 'b61a1cb1-84c1-4d1d-9246-80a50b4cc3ad', '5b39b880-186b-460b-9aae-cbb32218d669'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:32:47.084057 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-b0e66aed-499d-421b-9922-174f01b528e9 tempest-VolumesSnapshotTestJSON-286608301 None] Delete snapshot completed successfully. Apr 09 21:32:47.088610 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-b0e66aed-499d-421b-9922-174f01b528e9 tempest-VolumesSnapshotTestJSON-286608301 None] Lock "b'cinder-cb92aff0-b3ae-4db4-af56-f76aafdcea3f-delete_snapshot'" released by "delete_snapshot" :: held 0.764s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:32:47.567917 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-8cc2bafe-d64a-462e-9e1b-6df873c6b505 tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:32:48.357895 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-8cc2bafe-d64a-462e-9e1b-6df873c6b505 tempest-VolumesSnapshotTestJSON-286608301 None] Create snapshot completed successfully Apr 09 21:32:49.991428 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:32:49.992243 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:32:50.014180 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:32:50.037420 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:32:59.124271 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-abe34623-a965-4a71-9173-57d20dd8b694 req-1acf9d71-7df4-4a66-a0b9-dbddf2bb7f16 tempest-VolumesSnapshotTestJSON-286608301 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:32:59.761795 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-abe34623-a965-4a71-9173-57d20dd8b694 req-1acf9d71-7df4-4a66-a0b9-dbddf2bb7f16 tempest-VolumesSnapshotTestJSON-286608301 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.636s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:32:59.762845 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-abe34623-a965-4a71-9173-57d20dd8b694 req-1acf9d71-7df4-4a66-a0b9-dbddf2bb7f16 tempest-VolumesSnapshotTestJSON-286608301 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-fbfeac4b-61b9-4faf-a5c0-5f9332a0b38b', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': 'fbfeac4b-61b9-4faf-a5c0-5f9332a0b38b', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:32:59.792646 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-abe34623-a965-4a71-9173-57d20dd8b694 req-1acf9d71-7df4-4a66-a0b9-dbddf2bb7f16 tempest-VolumesSnapshotTestJSON-286608301 None] Connection info returned from driver {'name': 'volumes/volume-fbfeac4b-61b9-4faf-a5c0-5f9332a0b38b', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'fbfeac4b-61b9-4faf-a5c0-5f9332a0b38b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5a792539-9987-4749-883c-3c2dfa1c2c4f'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 21:32:59.841356 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-abe34623-a965-4a71-9173-57d20dd8b694 req-1acf9d71-7df4-4a66-a0b9-dbddf2bb7f16 tempest-VolumesSnapshotTestJSON-286608301 None] attachment_update completed successfully. Apr 09 21:33:01.316637 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-af8fb9c5-9567-45e6-9b0e-4108a308d806 tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:33:02.077973 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-af8fb9c5-9567-45e6-9b0e-4108a308d806 tempest-VolumesSnapshotTestJSON-286608301 None] Create snapshot completed successfully Apr 09 21:33:02.509982 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9fee4971-48c6-4f11-b499-94fb3956ea9e tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:33:03.384256 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-9fee4971-48c6-4f11-b499-94fb3956ea9e tempest-VolumesSnapshotTestJSON-286608301 None] Create snapshot completed successfully Apr 09 21:33:03.585470 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-82c7fe44-743e-4d4f-962e-b8fb5d6d007a tempest-VolumesSnapshotTestJSON-286608301 None] Lock "b'cinder-60492689-6bc1-4c12-b984-2278696aaf3f-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.021s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:33:03.587948 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-82c7fe44-743e-4d4f-962e-b8fb5d6d007a tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:33:03.961144 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-ed777a9d-4c69-45c8-a2ee-5232d8d52f92 req-f10ea198-ee28-4380-b982-c409fec80b0e tempest-TestVolumeBootPattern-212634100 None] Terminate volume connection completed successfully. Apr 09 21:33:03.961559 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-ed777a9d-4c69-45c8-a2ee-5232d8d52f92 req-f10ea198-ee28-4380-b982-c409fec80b0e tempest-TestVolumeBootPattern-212634100 None] Deleting attachment b5f1ca2d-d045-4a76-bf25-ba4c9aec8d81. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 21:33:07.397010 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-289f84f4-1f5a-462d-9607-50f7bb52edb7 req-ab0c5256-4618-4e62-b89e-28d6d81be8d9 tempest-TestVolumeBootPattern-212634100 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:33:08.028941 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-289f84f4-1f5a-462d-9607-50f7bb52edb7 req-ab0c5256-4618-4e62-b89e-28d6d81be8d9 tempest-TestVolumeBootPattern-212634100 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.632s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:33:08.029767 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-289f84f4-1f5a-462d-9607-50f7bb52edb7 req-ab0c5256-4618-4e62-b89e-28d6d81be8d9 tempest-TestVolumeBootPattern-212634100 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ac526ef0-508b-4640-8ed5-a8a5a3135756', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': 'ac526ef0-508b-4640-8ed5-a8a5a3135756', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:33:08.056657 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-289f84f4-1f5a-462d-9607-50f7bb52edb7 req-ab0c5256-4618-4e62-b89e-28d6d81be8d9 tempest-TestVolumeBootPattern-212634100 None] Connection info returned from driver {'name': 'volumes/volume-ac526ef0-508b-4640-8ed5-a8a5a3135756', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ac526ef0-508b-4640-8ed5-a8a5a3135756', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0d3a89cf-1862-4586-a41e-1b9210ed4169'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 21:33:08.111497 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-289f84f4-1f5a-462d-9607-50f7bb52edb7 req-ab0c5256-4618-4e62-b89e-28d6d81be8d9 tempest-TestVolumeBootPattern-212634100 None] attachment_update completed successfully. Apr 09 21:33:33.770535 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-82c7fe44-743e-4d4f-962e-b8fb5d6d007a tempest-VolumesSnapshotTestJSON-286608301 None] Created reservations ['4db17bd4-8b9c-4bf0-8d24-ca560f300b14', '5e364af8-7fd5-47c6-91fa-bca933b1937d', 'c2cd42d8-714b-4120-90e1-5fa228bbcff2', 'bae47eec-d126-4935-90be-adda89c365ba'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:33:33.810264 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-82c7fe44-743e-4d4f-962e-b8fb5d6d007a tempest-VolumesSnapshotTestJSON-286608301 None] Delete snapshot completed successfully. Apr 09 21:33:33.815189 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-82c7fe44-743e-4d4f-962e-b8fb5d6d007a tempest-VolumesSnapshotTestJSON-286608301 None] Lock "b'cinder-60492689-6bc1-4c12-b984-2278696aaf3f-delete_snapshot'" released by "delete_snapshot" :: held 30.230s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:33:34.597630 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-b6d2d584-27e9-4609-ac36-30da1c2d6046 tempest-VolumesSnapshotTestJSON-286608301 None] Lock "b'cinder-5ddc55a0-2e73-4c83-bef1-e33fd0296f94-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:33:34.599746 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b6d2d584-27e9-4609-ac36-30da1c2d6046 tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:33:49.992916 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:33:49.993780 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:33:50.018229 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:33:50.046238 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:34:04.760330 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-b6d2d584-27e9-4609-ac36-30da1c2d6046 tempest-VolumesSnapshotTestJSON-286608301 None] Created reservations ['62ace103-459b-4395-88ce-5ffc744a3130', '1b25fc88-cf23-4bca-8cd0-4953e5080340', '5556e723-58ff-4b3a-82c8-d22ea92c22ff', 'ca4f658a-d914-4b35-8295-27e3a5745be4'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:34:04.797538 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-b6d2d584-27e9-4609-ac36-30da1c2d6046 tempest-VolumesSnapshotTestJSON-286608301 None] Delete snapshot completed successfully. Apr 09 21:34:04.802171 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-b6d2d584-27e9-4609-ac36-30da1c2d6046 tempest-VolumesSnapshotTestJSON-286608301 None] Lock "b'cinder-5ddc55a0-2e73-4c83-bef1-e33fd0296f94-delete_snapshot'" released by "delete_snapshot" :: held 30.205s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:34:05.582014 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-c35e5c7e-3b1a-412e-949b-ce58f253afc0 tempest-VolumesSnapshotTestJSON-286608301 None] Lock "b'cinder-cc5b31df-bc79-4711-9b55-80c4f4dc175e-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:34:05.583997 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-c35e5c7e-3b1a-412e-949b-ce58f253afc0 tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:34:35.729718 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-c35e5c7e-3b1a-412e-949b-ce58f253afc0 tempest-VolumesSnapshotTestJSON-286608301 None] Created reservations ['4900c6bf-5a36-4bb2-8439-23e79ad2d288', 'c2dc0aea-9d9c-4b00-8e45-b5fabd1d3919', '4ed2177f-84e9-446c-aa98-38cbd92f9cb3', 'e2f5ed1a-58c8-4e09-a0b5-772bd306a0b4'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:34:35.764303 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-c35e5c7e-3b1a-412e-949b-ce58f253afc0 tempest-VolumesSnapshotTestJSON-286608301 None] Delete snapshot completed successfully. Apr 09 21:34:35.770025 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-c35e5c7e-3b1a-412e-949b-ce58f253afc0 tempest-VolumesSnapshotTestJSON-286608301 None] Lock "b'cinder-cc5b31df-bc79-4711-9b55-80c4f4dc175e-delete_snapshot'" released by "delete_snapshot" :: held 30.188s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:34:37.348467 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-e0dfbea1-1087-46de-93e5-4a1dfc753e96 req-7b652df6-05de-4d11-8f52-d8a81b974b38 tempest-VolumesSnapshotTestJSON-286608301 None] Terminate volume connection completed successfully. Apr 09 21:34:37.349326 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-e0dfbea1-1087-46de-93e5-4a1dfc753e96 req-7b652df6-05de-4d11-8f52-d8a81b974b38 tempest-VolumesSnapshotTestJSON-286608301 None] Deleting attachment 5a792539-9987-4749-883c-3c2dfa1c2c4f. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 21:34:41.802939 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-253365c7-cae2-4361-baac-703635861678 tempest-VolumesSnapshotTestJSON-286608301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:34:41.822461 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-253365c7-cae2-4361-baac-703635861678 tempest-VolumesSnapshotTestJSON-286608301 None] Flow 'volume_create_manager' (68e438b9-c62f-4c2c-aadb-9eac840d34b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:34:41.829791 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-253365c7-cae2-4361-baac-703635861678 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5da9a9f-5ad8-47f2-808f-b6dcd7c3a460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:34:41.844925 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-253365c7-cae2-4361-baac-703635861678 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5da9a9f-5ad8-47f2-808f-b6dcd7c3a460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:34:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1382569219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3ccd531e-c5bf-4240-8c95-af163036d59f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e1e5cc7222142ab82cd6a857f7be3de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:34:42Z,use_quota=True,user_id='f858bd78e1794185a908d3372a7359dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:34:41.850544 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-253365c7-cae2-4361-baac-703635861678 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2e90e9-82dc-4a36-ad6c-1783285bf4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:34:41.855346 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-253365c7-cae2-4361-baac-703635861678 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2e90e9-82dc-4a36-ad6c-1783285bf4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:34:41.860791 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-253365c7-cae2-4361-baac-703635861678 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f496e71-8cdc-4938-95db-ea9a67f2e369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:34:41.865194 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-253365c7-cae2-4361-baac-703635861678 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f496e71-8cdc-4938-95db-ea9a67f2e369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ccd531e-c5bf-4240-8c95-af163036d59f', 'volume_name': 'volume-3ccd531e-c5bf-4240-8c95-af163036d59f', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:34:41.870224 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-253365c7-cae2-4361-baac-703635861678 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e347f66-d6d3-4ad3-b4a2-7ebd90aa895a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:34:41.874171 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-253365c7-cae2-4361-baac-703635861678 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e347f66-d6d3-4ad3-b4a2-7ebd90aa895a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:34:41.879050 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-253365c7-cae2-4361-baac-703635861678 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (172b8ddd-972c-46e7-af0b-dfa31f19e820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:34:41.880123 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-253365c7-cae2-4361-baac-703635861678 tempest-VolumesSnapshotTestJSON-286608301 None] Volume 3ccd531e-c5bf-4240-8c95-af163036d59f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ccd531e-c5bf-4240-8c95-af163036d59f', 'volume_size': 1} Apr 09 21:34:41.880518 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-253365c7-cae2-4361-baac-703635861678 tempest-VolumesSnapshotTestJSON-286608301 None] creating volume 'volume-3ccd531e-c5bf-4240-8c95-af163036d59f' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:34:41.881604 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-253365c7-cae2-4361-baac-703635861678 tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:34:41.942275 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-253365c7-cae2-4361-baac-703635861678 tempest-VolumesSnapshotTestJSON-286608301 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:34:41.942571 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-253365c7-cae2-4361-baac-703635861678 tempest-VolumesSnapshotTestJSON-286608301 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:34:41.946360 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-253365c7-cae2-4361-baac-703635861678 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (172b8ddd-972c-46e7-af0b-dfa31f19e820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ccd531e-c5bf-4240-8c95-af163036d59f', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:34:41.951415 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-253365c7-cae2-4361-baac-703635861678 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b12db4-56fe-4701-84ff-5b48ef0af5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:34:41.962564 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-253365c7-cae2-4361-baac-703635861678 tempest-VolumesSnapshotTestJSON-286608301 None] Volume volume-3ccd531e-c5bf-4240-8c95-af163036d59f (3ccd531e-c5bf-4240-8c95-af163036d59f): created successfully Apr 09 21:34:41.966460 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-253365c7-cae2-4361-baac-703635861678 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b12db4-56fe-4701-84ff-5b48ef0af5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:34:41.972070 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-253365c7-cae2-4361-baac-703635861678 tempest-VolumesSnapshotTestJSON-286608301 None] Flow 'volume_create_manager' (68e438b9-c62f-4c2c-aadb-9eac840d34b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:34:41.982563 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-253365c7-cae2-4361-baac-703635861678 tempest-VolumesSnapshotTestJSON-286608301 None] Created volume successfully. Apr 09 21:34:42.989751 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-8b4279ce-8588-4ab3-a472-8f475d6e9ffa tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:34:43.534287 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-8b4279ce-8588-4ab3-a472-8f475d6e9ffa tempest-VolumesSnapshotTestJSON-286608301 None] Create snapshot completed successfully Apr 09 21:34:44.372068 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-12fbfb1e-8aff-4c25-a561-3f9e1a5484e6 tempest-VolumesSnapshotTestJSON-286608301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:34:44.403707 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-12fbfb1e-8aff-4c25-a561-3f9e1a5484e6 tempest-VolumesSnapshotTestJSON-286608301 None] Flow 'volume_create_manager' (9a782683-aacd-441c-be61-ff9babe95b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:34:44.410498 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-12fbfb1e-8aff-4c25-a561-3f9e1a5484e6 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (204b2a12-af53-474b-989f-2104a578c5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:34:44.426123 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-12fbfb1e-8aff-4c25-a561-3f9e1a5484e6 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (204b2a12-af53-474b-989f-2104a578c5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2030786944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=689d80c6-cb4c-479a-9bd6-63387ea5754e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e1e5cc7222142ab82cd6a857f7be3de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:34:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=bca4f42b-9647-4c29-9244-7d4ae66a1920,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:34:44Z,use_quota=True,user_id='f858bd78e1794185a908d3372a7359dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:34:44.431778 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-12fbfb1e-8aff-4c25-a561-3f9e1a5484e6 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9484b19-e0a2-4d00-a9d3-35c1d1739f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:34:44.436161 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-12fbfb1e-8aff-4c25-a561-3f9e1a5484e6 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9484b19-e0a2-4d00-a9d3-35c1d1739f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:34:44.441804 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-12fbfb1e-8aff-4c25-a561-3f9e1a5484e6 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3d1cd0c-5718-4b22-a4d4-1645026215b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:34:44.445912 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-12fbfb1e-8aff-4c25-a561-3f9e1a5484e6 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3d1cd0c-5718-4b22-a4d4-1645026215b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '689d80c6-cb4c-479a-9bd6-63387ea5754e', 'volume_name': 'volume-689d80c6-cb4c-479a-9bd6-63387ea5754e', 'volume_size': 2, 'snapshot_id': 'bca4f42b-9647-4c29-9244-7d4ae66a1920'}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:34:44.451218 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-12fbfb1e-8aff-4c25-a561-3f9e1a5484e6 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e33656b-3842-461b-85b4-f2084528e628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:34:44.455158 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-12fbfb1e-8aff-4c25-a561-3f9e1a5484e6 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e33656b-3842-461b-85b4-f2084528e628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:34:44.460031 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-12fbfb1e-8aff-4c25-a561-3f9e1a5484e6 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (674cb5b6-17d9-43dd-9fd1-0b6d987863b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:34:44.461128 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-12fbfb1e-8aff-4c25-a561-3f9e1a5484e6 tempest-VolumesSnapshotTestJSON-286608301 None] Volume 689d80c6-cb4c-479a-9bd6-63387ea5754e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-689d80c6-cb4c-479a-9bd6-63387ea5754e', 'volume_size': 2, 'snapshot_id': 'bca4f42b-9647-4c29-9244-7d4ae66a1920'} Apr 09 21:34:44.486726 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-12fbfb1e-8aff-4c25-a561-3f9e1a5484e6 tempest-VolumesSnapshotTestJSON-286608301 None] cloning volumes/volume-3ccd531e-c5bf-4240-8c95-af163036d59f@snapshot-bca4f42b-9647-4c29-9244-7d4ae66a1920 to volume-689d80c6-cb4c-479a-9bd6-63387ea5754e {{(pid=135002) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1090}} Apr 09 21:34:44.487659 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-12fbfb1e-8aff-4c25-a561-3f9e1a5484e6 tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:34:44.524991 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-12fbfb1e-8aff-4c25-a561-3f9e1a5484e6 tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:34:44.645086 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-12fbfb1e-8aff-4c25-a561-3f9e1a5484e6 tempest-VolumesSnapshotTestJSON-286608301 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:34:44.645386 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-12fbfb1e-8aff-4c25-a561-3f9e1a5484e6 tempest-VolumesSnapshotTestJSON-286608301 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:34:44.649260 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-12fbfb1e-8aff-4c25-a561-3f9e1a5484e6 tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:34:44.804473 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-12fbfb1e-8aff-4c25-a561-3f9e1a5484e6 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (674cb5b6-17d9-43dd-9fd1-0b6d987863b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-689d80c6-cb4c-479a-9bd6-63387ea5754e', 'volume_size': 2, 'snapshot_id': 'bca4f42b-9647-4c29-9244-7d4ae66a1920'}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:34:44.811061 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-12fbfb1e-8aff-4c25-a561-3f9e1a5484e6 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4687ab1d-8485-44fb-a97d-c5bbd8e5ae6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:34:44.824485 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-12fbfb1e-8aff-4c25-a561-3f9e1a5484e6 tempest-VolumesSnapshotTestJSON-286608301 None] Volume volume-689d80c6-cb4c-479a-9bd6-63387ea5754e (689d80c6-cb4c-479a-9bd6-63387ea5754e): created successfully Apr 09 21:34:44.828498 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-12fbfb1e-8aff-4c25-a561-3f9e1a5484e6 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4687ab1d-8485-44fb-a97d-c5bbd8e5ae6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:34:44.834017 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-12fbfb1e-8aff-4c25-a561-3f9e1a5484e6 tempest-VolumesSnapshotTestJSON-286608301 None] Flow 'volume_create_manager' (9a782683-aacd-441c-be61-ff9babe95b8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:34:44.850292 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-12fbfb1e-8aff-4c25-a561-3f9e1a5484e6 tempest-VolumesSnapshotTestJSON-286608301 None] Created volume successfully. Apr 09 21:34:45.497527 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-5056717e-e6d3-4246-a91f-f90d253a76f9 tempest-VolumesSnapshotTestJSON-286608301 None] Lock "b'cinder-689d80c6-cb4c-479a-9bd6-63387ea5754e-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:34:45.530849 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5056717e-e6d3-4246-a91f-f90d253a76f9 tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:34:45.582456 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5056717e-e6d3-4246-a91f-f90d253a76f9 tempest-VolumesSnapshotTestJSON-286608301 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:34:45.591005 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5056717e-e6d3-4246-a91f-f90d253a76f9 tempest-VolumesSnapshotTestJSON-286608301 None] deleting rbd volume volume-689d80c6-cb4c-479a-9bd6-63387ea5754e {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:34:45.859162 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-5056717e-e6d3-4246-a91f-f90d253a76f9 tempest-VolumesSnapshotTestJSON-286608301 None] Created reservations ['1aa6d0b7-643b-4f0f-bf7f-7c21d6d04e15', 'a6d3cbf2-e9e9-47b0-8d15-eb2956b01db5', 'd3268196-1ab2-4ca1-81ee-1f60c9152898', '0aece102-edc4-41e6-b797-a17587ede564'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:34:45.904686 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5056717e-e6d3-4246-a91f-f90d253a76f9 tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:34:45.927945 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5056717e-e6d3-4246-a91f-f90d253a76f9 tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:34:45.950181 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-5056717e-e6d3-4246-a91f-f90d253a76f9 tempest-VolumesSnapshotTestJSON-286608301 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:34:45.955009 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-5056717e-e6d3-4246-a91f-f90d253a76f9 tempest-VolumesSnapshotTestJSON-286608301 None] Deleted volume successfully. Apr 09 21:34:45.969024 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-5056717e-e6d3-4246-a91f-f90d253a76f9 tempest-VolumesSnapshotTestJSON-286608301 None] Lock "b'cinder-689d80c6-cb4c-479a-9bd6-63387ea5754e-delete_volume'" released by "delete_volume" :: held 0.472s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:34:46.870988 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cf2587d-616a-4b95-a2e2-01fa521144e5 tempest-VolumesSnapshotTestJSON-286608301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:34:46.889492 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5cf2587d-616a-4b95-a2e2-01fa521144e5 tempest-VolumesSnapshotTestJSON-286608301 None] Flow 'volume_create_manager' (85bff3fa-b1d8-4791-bd02-ea52baac5e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:34:46.896407 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5cf2587d-616a-4b95-a2e2-01fa521144e5 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0027a663-a74f-4bf1-8933-eff2c2a67560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:34:46.911782 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5cf2587d-616a-4b95-a2e2-01fa521144e5 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0027a663-a74f-4bf1-8933-eff2c2a67560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-475133990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=03105fb2-e0a4-4f3a-b902-2cb3925122fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e1e5cc7222142ab82cd6a857f7be3de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:34:47Z,use_quota=True,user_id='f858bd78e1794185a908d3372a7359dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:34:46.917300 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5cf2587d-616a-4b95-a2e2-01fa521144e5 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4524ae1c-6c25-4f05-8a9a-333522b04100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:34:46.921482 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5cf2587d-616a-4b95-a2e2-01fa521144e5 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4524ae1c-6c25-4f05-8a9a-333522b04100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:34:46.926695 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5cf2587d-616a-4b95-a2e2-01fa521144e5 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (027d5282-d04e-4929-bf0b-c0a217d79daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:34:46.930840 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5cf2587d-616a-4b95-a2e2-01fa521144e5 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (027d5282-d04e-4929-bf0b-c0a217d79daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03105fb2-e0a4-4f3a-b902-2cb3925122fd', 'volume_name': 'volume-03105fb2-e0a4-4f3a-b902-2cb3925122fd', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:34:46.935803 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5cf2587d-616a-4b95-a2e2-01fa521144e5 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e13ba9d-feee-41c2-adf3-8dce5e93f615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:34:46.939802 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5cf2587d-616a-4b95-a2e2-01fa521144e5 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e13ba9d-feee-41c2-adf3-8dce5e93f615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:34:46.944567 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5cf2587d-616a-4b95-a2e2-01fa521144e5 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (780ae25b-f8e6-43e9-b35e-4eb44450e889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:34:46.945673 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-5cf2587d-616a-4b95-a2e2-01fa521144e5 tempest-VolumesSnapshotTestJSON-286608301 None] Volume 03105fb2-e0a4-4f3a-b902-2cb3925122fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03105fb2-e0a4-4f3a-b902-2cb3925122fd', 'volume_size': 1} Apr 09 21:34:46.946061 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5cf2587d-616a-4b95-a2e2-01fa521144e5 tempest-VolumesSnapshotTestJSON-286608301 None] creating volume 'volume-03105fb2-e0a4-4f3a-b902-2cb3925122fd' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:34:46.946845 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5cf2587d-616a-4b95-a2e2-01fa521144e5 tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:34:47.007902 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5cf2587d-616a-4b95-a2e2-01fa521144e5 tempest-VolumesSnapshotTestJSON-286608301 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:34:47.008215 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-5cf2587d-616a-4b95-a2e2-01fa521144e5 tempest-VolumesSnapshotTestJSON-286608301 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:34:47.011957 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5cf2587d-616a-4b95-a2e2-01fa521144e5 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (780ae25b-f8e6-43e9-b35e-4eb44450e889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03105fb2-e0a4-4f3a-b902-2cb3925122fd', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:34:47.016577 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5cf2587d-616a-4b95-a2e2-01fa521144e5 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50e18849-5a86-4da5-8f6e-e15085d64abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:34:47.029198 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-5cf2587d-616a-4b95-a2e2-01fa521144e5 tempest-VolumesSnapshotTestJSON-286608301 None] Volume volume-03105fb2-e0a4-4f3a-b902-2cb3925122fd (03105fb2-e0a4-4f3a-b902-2cb3925122fd): created successfully Apr 09 21:34:47.032676 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5cf2587d-616a-4b95-a2e2-01fa521144e5 tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50e18849-5a86-4da5-8f6e-e15085d64abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:34:47.038184 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-5cf2587d-616a-4b95-a2e2-01fa521144e5 tempest-VolumesSnapshotTestJSON-286608301 None] Flow 'volume_create_manager' (85bff3fa-b1d8-4791-bd02-ea52baac5e7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:34:47.047911 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-5cf2587d-616a-4b95-a2e2-01fa521144e5 tempest-VolumesSnapshotTestJSON-286608301 None] Created volume successfully. Apr 09 21:34:48.043454 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-fca65e97-057c-41f5-a7c6-03ead8f7df97 tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:34:48.596111 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-fca65e97-057c-41f5-a7c6-03ead8f7df97 tempest-VolumesSnapshotTestJSON-286608301 None] Create snapshot completed successfully Apr 09 21:34:49.428092 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-a77ab833-5070-449b-b414-f1861c60169b tempest-VolumesSnapshotTestJSON-286608301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:34:49.455985 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a77ab833-5070-449b-b414-f1861c60169b tempest-VolumesSnapshotTestJSON-286608301 None] Flow 'volume_create_manager' (f0fb62c3-e4bc-4821-a30a-733167cf2285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:34:49.462849 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a77ab833-5070-449b-b414-f1861c60169b tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1011ab3-5813-48b1-9fb9-1cb902e5a73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:34:49.478795 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a77ab833-5070-449b-b414-f1861c60169b tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1011ab3-5813-48b1-9fb9-1cb902e5a73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2081143661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=06d0f22b-3020-46e3-9e42-1bc40293a7a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e1e5cc7222142ab82cd6a857f7be3de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b3598b81-5d83-40e6-845e-c350e4aca14a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:34:49Z,use_quota=True,user_id='f858bd78e1794185a908d3372a7359dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:34:49.484576 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a77ab833-5070-449b-b414-f1861c60169b tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f078cbfa-4f90-4768-8e59-270dc66411db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:34:49.488979 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a77ab833-5070-449b-b414-f1861c60169b tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f078cbfa-4f90-4768-8e59-270dc66411db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:34:49.494323 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a77ab833-5070-449b-b414-f1861c60169b tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (404ea75b-905a-4b6f-acb9-81d8947ee5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:34:49.498480 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a77ab833-5070-449b-b414-f1861c60169b tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (404ea75b-905a-4b6f-acb9-81d8947ee5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '06d0f22b-3020-46e3-9e42-1bc40293a7a7', 'volume_name': 'volume-06d0f22b-3020-46e3-9e42-1bc40293a7a7', 'volume_size': 1, 'snapshot_id': 'b3598b81-5d83-40e6-845e-c350e4aca14a'}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:34:49.503529 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a77ab833-5070-449b-b414-f1861c60169b tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f824283-14e8-4233-a92d-d8ef518d496b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:34:49.507972 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a77ab833-5070-449b-b414-f1861c60169b tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f824283-14e8-4233-a92d-d8ef518d496b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:34:49.513250 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a77ab833-5070-449b-b414-f1861c60169b tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcdf6175-1a59-47a3-9f8f-7adcebb38efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:34:49.514330 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-a77ab833-5070-449b-b414-f1861c60169b tempest-VolumesSnapshotTestJSON-286608301 None] Volume 06d0f22b-3020-46e3-9e42-1bc40293a7a7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-06d0f22b-3020-46e3-9e42-1bc40293a7a7', 'volume_size': 1, 'snapshot_id': 'b3598b81-5d83-40e6-845e-c350e4aca14a'} Apr 09 21:34:49.532811 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a77ab833-5070-449b-b414-f1861c60169b tempest-VolumesSnapshotTestJSON-286608301 None] cloning volumes/volume-03105fb2-e0a4-4f3a-b902-2cb3925122fd@snapshot-b3598b81-5d83-40e6-845e-c350e4aca14a to volume-06d0f22b-3020-46e3-9e42-1bc40293a7a7 {{(pid=135002) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1090}} Apr 09 21:34:49.533426 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a77ab833-5070-449b-b414-f1861c60169b tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:34:49.567629 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a77ab833-5070-449b-b414-f1861c60169b tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:34:49.688306 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a77ab833-5070-449b-b414-f1861c60169b tempest-VolumesSnapshotTestJSON-286608301 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:34:49.688564 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a77ab833-5070-449b-b414-f1861c60169b tempest-VolumesSnapshotTestJSON-286608301 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:34:49.709003 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a77ab833-5070-449b-b414-f1861c60169b tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcdf6175-1a59-47a3-9f8f-7adcebb38efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06d0f22b-3020-46e3-9e42-1bc40293a7a7', 'volume_size': 1, 'snapshot_id': 'b3598b81-5d83-40e6-845e-c350e4aca14a'}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:34:49.713700 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a77ab833-5070-449b-b414-f1861c60169b tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddc50602-d9b5-4eb6-a650-dae25ae66dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:34:49.724296 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-a77ab833-5070-449b-b414-f1861c60169b tempest-VolumesSnapshotTestJSON-286608301 None] Volume volume-06d0f22b-3020-46e3-9e42-1bc40293a7a7 (06d0f22b-3020-46e3-9e42-1bc40293a7a7): created successfully Apr 09 21:34:49.727768 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a77ab833-5070-449b-b414-f1861c60169b tempest-VolumesSnapshotTestJSON-286608301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddc50602-d9b5-4eb6-a650-dae25ae66dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:34:49.733230 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a77ab833-5070-449b-b414-f1861c60169b tempest-VolumesSnapshotTestJSON-286608301 None] Flow 'volume_create_manager' (f0fb62c3-e4bc-4821-a30a-733167cf2285) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:34:49.746893 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-a77ab833-5070-449b-b414-f1861c60169b tempest-VolumesSnapshotTestJSON-286608301 None] Created volume successfully. Apr 09 21:34:50.547484 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-889da110-e3b5-451e-964e-e9420f1d1821 tempest-VolumesSnapshotTestJSON-286608301 None] Lock "b'cinder-06d0f22b-3020-46e3-9e42-1bc40293a7a7-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:34:50.580007 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-889da110-e3b5-451e-964e-e9420f1d1821 tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:34:50.633259 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-889da110-e3b5-451e-964e-e9420f1d1821 tempest-VolumesSnapshotTestJSON-286608301 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:34:50.644291 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-889da110-e3b5-451e-964e-e9420f1d1821 tempest-VolumesSnapshotTestJSON-286608301 None] deleting rbd volume volume-06d0f22b-3020-46e3-9e42-1bc40293a7a7 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:34:50.895537 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-889da110-e3b5-451e-964e-e9420f1d1821 tempest-VolumesSnapshotTestJSON-286608301 None] Created reservations ['a179df4f-8761-41af-a9d5-97567e6fcd60', '46a2e3cd-a564-4afb-8d31-befbace549b6', 'b4d322a7-34c4-4ec2-ade5-8c9b04a80856', '78ab30f0-5c80-4f93-9922-54fd06b9089d'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:34:50.940346 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-889da110-e3b5-451e-964e-e9420f1d1821 tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:34:50.966592 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-889da110-e3b5-451e-964e-e9420f1d1821 tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:34:50.991281 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-889da110-e3b5-451e-964e-e9420f1d1821 tempest-VolumesSnapshotTestJSON-286608301 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:34:50.995497 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-889da110-e3b5-451e-964e-e9420f1d1821 tempest-VolumesSnapshotTestJSON-286608301 None] Deleted volume successfully. Apr 09 21:34:51.009243 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-889da110-e3b5-451e-964e-e9420f1d1821 tempest-VolumesSnapshotTestJSON-286608301 None] Lock "b'cinder-06d0f22b-3020-46e3-9e42-1bc40293a7a7-delete_volume'" released by "delete_volume" :: held 0.462s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:34:51.706707 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-15abaac5-d181-4f5e-983f-d5f291f21643 tempest-VolumesSnapshotTestJSON-286608301 None] Lock "b'cinder-b3598b81-5d83-40e6-845e-c350e4aca14a-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:34:51.708214 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-15abaac5-d181-4f5e-983f-d5f291f21643 tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:34:52.080132 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-15abaac5-d181-4f5e-983f-d5f291f21643 tempest-VolumesSnapshotTestJSON-286608301 None] Created reservations ['3bfb1106-4ca8-49d7-91e9-ae8bea501204', 'f5361c91-8d24-4d99-87a3-70c2e6892f37', 'f10be1f5-30e9-4b07-a56d-d38a345b7132', '775c3017-8cdc-4f70-8e94-00180e5f474d'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:34:52.119641 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-15abaac5-d181-4f5e-983f-d5f291f21643 tempest-VolumesSnapshotTestJSON-286608301 None] Delete snapshot completed successfully. Apr 09 21:34:52.124056 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-15abaac5-d181-4f5e-983f-d5f291f21643 tempest-VolumesSnapshotTestJSON-286608301 None] Lock "b'cinder-b3598b81-5d83-40e6-845e-c350e4aca14a-delete_snapshot'" released by "delete_snapshot" :: held 0.417s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:34:52.818506 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-c8dad2b1-c097-467a-8880-04f319f7b152 tempest-VolumesSnapshotTestJSON-286608301 None] Lock "b'cinder-03105fb2-e0a4-4f3a-b902-2cb3925122fd-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:34:52.851932 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-c8dad2b1-c097-467a-8880-04f319f7b152 tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:34:52.893773 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-c8dad2b1-c097-467a-8880-04f319f7b152 tempest-VolumesSnapshotTestJSON-286608301 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:34:52.894182 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-c8dad2b1-c097-467a-8880-04f319f7b152 tempest-VolumesSnapshotTestJSON-286608301 None] Volume volume-03105fb2-e0a4-4f3a-b902-2cb3925122fd is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:34:52.901299 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-c8dad2b1-c097-467a-8880-04f319f7b152 tempest-VolumesSnapshotTestJSON-286608301 None] deleting rbd volume volume-03105fb2-e0a4-4f3a-b902-2cb3925122fd {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:34:53.158416 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-c8dad2b1-c097-467a-8880-04f319f7b152 tempest-VolumesSnapshotTestJSON-286608301 None] Created reservations ['6143c8cb-13da-4ea8-a395-d65398c99c17', 'c6a82fc2-d995-47a4-a4aa-2f377c30592c', '5fcb15e5-88c8-4378-ae2f-7d182e34be19', '364c7179-34a9-44c7-af30-e3d257b5429b'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:34:53.208082 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-c8dad2b1-c097-467a-8880-04f319f7b152 tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:34:53.233968 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-c8dad2b1-c097-467a-8880-04f319f7b152 tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:34:53.260744 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-c8dad2b1-c097-467a-8880-04f319f7b152 tempest-VolumesSnapshotTestJSON-286608301 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:34:53.265147 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-c8dad2b1-c097-467a-8880-04f319f7b152 tempest-VolumesSnapshotTestJSON-286608301 None] Deleted volume successfully. Apr 09 21:34:53.279937 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-c8dad2b1-c097-467a-8880-04f319f7b152 tempest-VolumesSnapshotTestJSON-286608301 None] Lock "b'cinder-03105fb2-e0a4-4f3a-b902-2cb3925122fd-delete_volume'" released by "delete_volume" :: held 0.461s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:34:53.961591 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-45d1508e-78bc-495f-b205-d3315082df17 tempest-VolumesSnapshotTestJSON-286608301 None] Lock "b'cinder-bca4f42b-9647-4c29-9244-7d4ae66a1920-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:34:53.963599 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-45d1508e-78bc-495f-b205-d3315082df17 tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:34:55.100357 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-45d1508e-78bc-495f-b205-d3315082df17 tempest-VolumesSnapshotTestJSON-286608301 None] Created reservations ['ab4ce015-e4a3-4c4f-b437-fbefed5f38ea', '1c960bbe-09b8-4472-9a91-f392d8e28590', 'fbb95c04-717f-4484-9f51-d111e94ebde7', '06ced0a6-8828-497d-b2e3-21d96768a1f3'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:34:55.134300 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-45d1508e-78bc-495f-b205-d3315082df17 tempest-VolumesSnapshotTestJSON-286608301 None] Delete snapshot completed successfully. Apr 09 21:34:55.140081 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-45d1508e-78bc-495f-b205-d3315082df17 tempest-VolumesSnapshotTestJSON-286608301 None] Lock "b'cinder-bca4f42b-9647-4c29-9244-7d4ae66a1920-delete_snapshot'" released by "delete_snapshot" :: held 1.178s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:34:56.101630 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-faa01abc-43e4-42c2-8eec-19cfbd6df926 tempest-VolumesSnapshotTestJSON-286608301 None] Lock "b'cinder-3ccd531e-c5bf-4240-8c95-af163036d59f-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:34:56.134763 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-faa01abc-43e4-42c2-8eec-19cfbd6df926 tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:34:56.176766 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-faa01abc-43e4-42c2-8eec-19cfbd6df926 tempest-VolumesSnapshotTestJSON-286608301 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:34:56.177239 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-faa01abc-43e4-42c2-8eec-19cfbd6df926 tempest-VolumesSnapshotTestJSON-286608301 None] Volume volume-3ccd531e-c5bf-4240-8c95-af163036d59f is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:34:56.184181 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-faa01abc-43e4-42c2-8eec-19cfbd6df926 tempest-VolumesSnapshotTestJSON-286608301 None] deleting rbd volume volume-3ccd531e-c5bf-4240-8c95-af163036d59f {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:34:56.438089 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-faa01abc-43e4-42c2-8eec-19cfbd6df926 tempest-VolumesSnapshotTestJSON-286608301 None] Created reservations ['97b7cfc9-2cd1-4611-bd44-aabd30948004', '2b5ee4b7-c80f-4052-9325-411d246a684b', '2d9de653-2ceb-47d6-83d2-02d31d161ae0', '3868ae1a-f3f2-4c4b-b67a-edd779d1eac1'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:34:56.481752 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-faa01abc-43e4-42c2-8eec-19cfbd6df926 tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:34:56.503479 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-faa01abc-43e4-42c2-8eec-19cfbd6df926 tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:34:56.527664 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-faa01abc-43e4-42c2-8eec-19cfbd6df926 tempest-VolumesSnapshotTestJSON-286608301 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:34:56.532665 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-faa01abc-43e4-42c2-8eec-19cfbd6df926 tempest-VolumesSnapshotTestJSON-286608301 None] Deleted volume successfully. Apr 09 21:34:56.548451 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-faa01abc-43e4-42c2-8eec-19cfbd6df926 tempest-VolumesSnapshotTestJSON-286608301 None] Lock "b'cinder-3ccd531e-c5bf-4240-8c95-af163036d59f-delete_volume'" released by "delete_volume" :: held 0.447s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:34:57.360235 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-b745c714-c553-42d4-8060-8ffbafeaa637 tempest-VolumesSnapshotTestJSON-286608301 None] Lock "b'cinder-390d885e-abbc-40c6-a67c-adccc1e809d8-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:34:57.400303 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b745c714-c553-42d4-8060-8ffbafeaa637 tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:34:57.464338 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b745c714-c553-42d4-8060-8ffbafeaa637 tempest-VolumesSnapshotTestJSON-286608301 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:34:57.473625 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b745c714-c553-42d4-8060-8ffbafeaa637 tempest-VolumesSnapshotTestJSON-286608301 None] deleting rbd volume volume-390d885e-abbc-40c6-a67c-adccc1e809d8 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:34:57.688442 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b745c714-c553-42d4-8060-8ffbafeaa637 tempest-VolumesSnapshotTestJSON-286608301 None] volume is a clone so cleaning references {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Apr 09 21:34:57.722850 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b745c714-c553-42d4-8060-8ffbafeaa637 tempest-VolumesSnapshotTestJSON-286608301 None] deleting parent snapshot volume-390d885e-abbc-40c6-a67c-adccc1e809d8.clone_snap {{(pid=135002) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Apr 09 21:34:58.545357 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-b745c714-c553-42d4-8060-8ffbafeaa637 tempest-VolumesSnapshotTestJSON-286608301 None] Created reservations ['a57c2b9f-1274-4758-87ee-d7c995413409', 'ff1d7c03-3ce2-4466-b3d5-bec274e3ec67', 'a87cc128-3efa-4012-9ffd-5590fbed3a3a', '62e740a4-c17a-43f1-92ed-658d5934783d'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:34:58.591635 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b745c714-c553-42d4-8060-8ffbafeaa637 tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:34:58.616763 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-b745c714-c553-42d4-8060-8ffbafeaa637 tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:34:58.644661 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-b745c714-c553-42d4-8060-8ffbafeaa637 tempest-VolumesSnapshotTestJSON-286608301 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:34:58.648631 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-b745c714-c553-42d4-8060-8ffbafeaa637 tempest-VolumesSnapshotTestJSON-286608301 None] Deleted volume successfully. Apr 09 21:34:58.661969 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-b745c714-c553-42d4-8060-8ffbafeaa637 tempest-VolumesSnapshotTestJSON-286608301 None] Lock "b'cinder-390d885e-abbc-40c6-a67c-adccc1e809d8-delete_volume'" released by "delete_volume" :: held 1.302s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:34:59.550699 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-8783c1fa-d9a1-4cea-bebc-1bfc3bd9b2fd tempest-VolumesSnapshotTestJSON-286608301 None] Lock "b'cinder-9cdf63cf-ccc4-49b8-a938-a3945341defb-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.008s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:34:59.552242 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-8783c1fa-d9a1-4cea-bebc-1bfc3bd9b2fd tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:35:00.579196 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-8783c1fa-d9a1-4cea-bebc-1bfc3bd9b2fd tempest-VolumesSnapshotTestJSON-286608301 None] Created reservations ['7b5bf118-05b5-47c4-9dc6-681700340006', '0d6b5442-956a-4d3b-972f-60e301dc80bd', '6a0c8ba0-c1ba-4bdd-83bb-9e331a2bf351', '2157205a-6657-420a-8a43-93d9bd38387a'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:35:00.616187 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-8783c1fa-d9a1-4cea-bebc-1bfc3bd9b2fd tempest-VolumesSnapshotTestJSON-286608301 None] Delete snapshot completed successfully. Apr 09 21:35:00.620632 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-8783c1fa-d9a1-4cea-bebc-1bfc3bd9b2fd tempest-VolumesSnapshotTestJSON-286608301 None] Lock "b'cinder-9cdf63cf-ccc4-49b8-a938-a3945341defb-delete_snapshot'" released by "delete_snapshot" :: held 1.070s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:35:01.696150 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-234d6f3f-548a-462b-9edc-027441c3d06f tempest-VolumesSnapshotTestJSON-286608301 None] Lock "b'cinder-fbfeac4b-61b9-4faf-a5c0-5f9332a0b38b-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:35:01.733825 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-234d6f3f-548a-462b-9edc-027441c3d06f tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:35:01.773414 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-234d6f3f-548a-462b-9edc-027441c3d06f tempest-VolumesSnapshotTestJSON-286608301 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:35:01.773885 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-234d6f3f-548a-462b-9edc-027441c3d06f tempest-VolumesSnapshotTestJSON-286608301 None] Volume volume-fbfeac4b-61b9-4faf-a5c0-5f9332a0b38b is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:35:01.781938 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-234d6f3f-548a-462b-9edc-027441c3d06f tempest-VolumesSnapshotTestJSON-286608301 None] deleting rbd volume volume-fbfeac4b-61b9-4faf-a5c0-5f9332a0b38b {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:35:02.011133 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-234d6f3f-548a-462b-9edc-027441c3d06f tempest-VolumesSnapshotTestJSON-286608301 None] Created reservations ['39b9bfb9-c762-4696-a646-0f03372af753', '360753b9-7f8d-42d8-9a73-39b294dcce98', '6063d8da-0ddb-4a0e-9908-9deca817c9b9', '89cf604d-ef65-4080-9b2c-c0136fa408da'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:35:02.055723 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-234d6f3f-548a-462b-9edc-027441c3d06f tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:35:02.080335 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-234d6f3f-548a-462b-9edc-027441c3d06f tempest-VolumesSnapshotTestJSON-286608301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:35:02.107182 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-234d6f3f-548a-462b-9edc-027441c3d06f tempest-VolumesSnapshotTestJSON-286608301 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:35:02.111076 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-234d6f3f-548a-462b-9edc-027441c3d06f tempest-VolumesSnapshotTestJSON-286608301 None] Deleted volume successfully. Apr 09 21:35:02.124629 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-234d6f3f-548a-462b-9edc-027441c3d06f tempest-VolumesSnapshotTestJSON-286608301 None] Lock "b'cinder-fbfeac4b-61b9-4faf-a5c0-5f9332a0b38b-delete_volume'" released by "delete_volume" :: held 0.429s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:35:13.436397 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-35e98945-10a5-458c-8a05-2861b056b4fe tempest-TestVolumeBootPattern-212634100 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:35:14.622217 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-35e98945-10a5-458c-8a05-2861b056b4fe tempest-TestVolumeBootPattern-212634100 None] Create snapshot completed successfully Apr 09 21:35:15.901059 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-297963c1-9692-4f03-a6c8-61c0cae886f5 tempest-TestVolumeBootPattern-212634100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:35:15.928677 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-297963c1-9692-4f03-a6c8-61c0cae886f5 tempest-TestVolumeBootPattern-212634100 None] Flow 'volume_create_manager' (a77550d3-dc6c-4de6-820c-c62cc199c5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:35:15.935657 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-297963c1-9692-4f03-a6c8-61c0cae886f5 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd93c03-2e8b-4cd0-85ef-23076580a20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:35:15.951522 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-297963c1-9692-4f03-a6c8-61c0cae886f5 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd93c03-2e8b-4cd0-85ef-23076580a20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-239459695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c19b2253-ae96-41f0-89c0-10ccf95949e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1063334e4a426eb70eec5ed1578744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:35:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=43b0970e-dbe9-428c-841b-acc723a8573a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:35:16Z,use_quota=True,user_id='2e9bbd737ff54225a549f072976ef296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:35:15.957045 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-297963c1-9692-4f03-a6c8-61c0cae886f5 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (373ddac3-60fc-4a42-9f00-dc4f35964f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:35:15.961309 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-297963c1-9692-4f03-a6c8-61c0cae886f5 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (373ddac3-60fc-4a42-9f00-dc4f35964f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:35:15.966497 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-297963c1-9692-4f03-a6c8-61c0cae886f5 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95e25e4b-3e54-4b93-8ea4-9ac69dae7339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:35:15.970867 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-297963c1-9692-4f03-a6c8-61c0cae886f5 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95e25e4b-3e54-4b93-8ea4-9ac69dae7339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c19b2253-ae96-41f0-89c0-10ccf95949e0', 'volume_name': 'volume-c19b2253-ae96-41f0-89c0-10ccf95949e0', 'volume_size': 1, 'snapshot_id': '43b0970e-dbe9-428c-841b-acc723a8573a'}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:35:15.975863 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-297963c1-9692-4f03-a6c8-61c0cae886f5 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbb7fbd1-99f0-45bb-ab94-bc867eb5e36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:35:15.979849 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-297963c1-9692-4f03-a6c8-61c0cae886f5 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbb7fbd1-99f0-45bb-ab94-bc867eb5e36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:35:15.984620 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-297963c1-9692-4f03-a6c8-61c0cae886f5 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (561ed0af-a78b-4db0-983f-ef8ef8d6d04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:35:15.985775 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-297963c1-9692-4f03-a6c8-61c0cae886f5 tempest-TestVolumeBootPattern-212634100 None] Volume c19b2253-ae96-41f0-89c0-10ccf95949e0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c19b2253-ae96-41f0-89c0-10ccf95949e0', 'volume_size': 1, 'snapshot_id': '43b0970e-dbe9-428c-841b-acc723a8573a'} Apr 09 21:35:16.008348 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-297963c1-9692-4f03-a6c8-61c0cae886f5 tempest-TestVolumeBootPattern-212634100 None] cloning volumes/volume-ac526ef0-508b-4640-8ed5-a8a5a3135756@snapshot-43b0970e-dbe9-428c-841b-acc723a8573a to volume-c19b2253-ae96-41f0-89c0-10ccf95949e0 {{(pid=135002) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1090}} Apr 09 21:35:16.009060 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-297963c1-9692-4f03-a6c8-61c0cae886f5 tempest-TestVolumeBootPattern-212634100 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:35:16.077024 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-297963c1-9692-4f03-a6c8-61c0cae886f5 tempest-TestVolumeBootPattern-212634100 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:35:16.230144 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-297963c1-9692-4f03-a6c8-61c0cae886f5 tempest-TestVolumeBootPattern-212634100 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:35:16.230516 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-297963c1-9692-4f03-a6c8-61c0cae886f5 tempest-TestVolumeBootPattern-212634100 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:35:16.249412 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.volume_utils [None req-297963c1-9692-4f03-a6c8-61c0cae886f5 tempest-TestVolumeBootPattern-212634100 None] Marking volume c19b2253-ae96-41f0-89c0-10ccf95949e0 as bootable. {{(pid=135002) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Apr 09 21:35:16.254396 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-297963c1-9692-4f03-a6c8-61c0cae886f5 tempest-TestVolumeBootPattern-212634100 None] Copying metadata from snapshot 43b0970e-dbe9-428c-841b-acc723a8573a to c19b2253-ae96-41f0-89c0-10ccf95949e0. {{(pid=135002) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:427}} Apr 09 21:35:16.291235 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-297963c1-9692-4f03-a6c8-61c0cae886f5 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (561ed0af-a78b-4db0-983f-ef8ef8d6d04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c19b2253-ae96-41f0-89c0-10ccf95949e0', 'volume_size': 1, 'snapshot_id': '43b0970e-dbe9-428c-841b-acc723a8573a'}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:35:16.296041 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-297963c1-9692-4f03-a6c8-61c0cae886f5 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75796e7a-a991-46cb-9abc-32b829f77ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:35:16.306095 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-297963c1-9692-4f03-a6c8-61c0cae886f5 tempest-TestVolumeBootPattern-212634100 None] Volume volume-c19b2253-ae96-41f0-89c0-10ccf95949e0 (c19b2253-ae96-41f0-89c0-10ccf95949e0): created successfully Apr 09 21:35:16.310348 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-297963c1-9692-4f03-a6c8-61c0cae886f5 tempest-TestVolumeBootPattern-212634100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75796e7a-a991-46cb-9abc-32b829f77ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:35:16.315970 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-297963c1-9692-4f03-a6c8-61c0cae886f5 tempest-TestVolumeBootPattern-212634100 None] Flow 'volume_create_manager' (a77550d3-dc6c-4de6-820c-c62cc199c5f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:35:16.330251 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-297963c1-9692-4f03-a6c8-61c0cae886f5 tempest-TestVolumeBootPattern-212634100 None] Created volume successfully. Apr 09 21:35:18.909600 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-1a538172-0a58-49b1-a002-1eeb5b863e72 req-e26ab9e7-ade2-4e86-b59f-9e093ca13a32 tempest-TestVolumeBootPattern-212634100 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:35:19.597685 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-1a538172-0a58-49b1-a002-1eeb5b863e72 req-e26ab9e7-ade2-4e86-b59f-9e093ca13a32 tempest-TestVolumeBootPattern-212634100 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.688s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:35:19.598838 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-1a538172-0a58-49b1-a002-1eeb5b863e72 req-e26ab9e7-ade2-4e86-b59f-9e093ca13a32 tempest-TestVolumeBootPattern-212634100 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c19b2253-ae96-41f0-89c0-10ccf95949e0', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': 'c19b2253-ae96-41f0-89c0-10ccf95949e0', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:35:19.627757 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-1a538172-0a58-49b1-a002-1eeb5b863e72 req-e26ab9e7-ade2-4e86-b59f-9e093ca13a32 tempest-TestVolumeBootPattern-212634100 None] Connection info returned from driver {'name': 'volumes/volume-c19b2253-ae96-41f0-89c0-10ccf95949e0', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c19b2253-ae96-41f0-89c0-10ccf95949e0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '1cd32bb1-f98a-4b45-936f-3e6bef3b3eef'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 21:35:19.678870 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-1a538172-0a58-49b1-a002-1eeb5b863e72 req-e26ab9e7-ade2-4e86-b59f-9e093ca13a32 tempest-TestVolumeBootPattern-212634100 None] attachment_update completed successfully. Apr 09 21:35:49.993502 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:35:49.995053 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:35:50.025984 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:35:50.048823 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:36:49.994580 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:36:49.995365 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:36:50.019889 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:36:50.048869 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:37:23.891331 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-5bcb6621-d9e1-407b-8862-6b45f0b8e7d7 req-633818e7-865b-4520-8b93-a3bdebf07c60 tempest-TestVolumeBootPattern-212634100 None] Terminate volume connection completed successfully. Apr 09 21:37:23.892069 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-5bcb6621-d9e1-407b-8862-6b45f0b8e7d7 req-633818e7-865b-4520-8b93-a3bdebf07c60 tempest-TestVolumeBootPattern-212634100 None] Deleting attachment 1cd32bb1-f98a-4b45-936f-3e6bef3b3eef. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 21:37:25.432682 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-46db4a6a-9fa3-48f3-8800-b07de0888cde tempest-TestVolumeBootPattern-212634100 None] Lock "b'cinder-c19b2253-ae96-41f0-89c0-10ccf95949e0-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:37:25.473736 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-46db4a6a-9fa3-48f3-8800-b07de0888cde tempest-TestVolumeBootPattern-212634100 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:37:25.566329 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-46db4a6a-9fa3-48f3-8800-b07de0888cde tempest-TestVolumeBootPattern-212634100 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:37:25.575013 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-46db4a6a-9fa3-48f3-8800-b07de0888cde tempest-TestVolumeBootPattern-212634100 None] deleting rbd volume volume-c19b2253-ae96-41f0-89c0-10ccf95949e0 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:37:25.878894 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-46db4a6a-9fa3-48f3-8800-b07de0888cde tempest-TestVolumeBootPattern-212634100 None] Created reservations ['78bceb2d-6862-4258-94e2-a5e70731ac62', 'faacc6a3-1f1d-4829-8772-8ceeedd23285', 'd1990281-54e8-47b5-9a80-608694eb7189', 'f293f849-bfeb-4374-b364-0a57d0f9ff46'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:37:25.927713 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-46db4a6a-9fa3-48f3-8800-b07de0888cde tempest-TestVolumeBootPattern-212634100 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:37:25.957883 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-46db4a6a-9fa3-48f3-8800-b07de0888cde tempest-TestVolumeBootPattern-212634100 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:37:25.981601 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-46db4a6a-9fa3-48f3-8800-b07de0888cde tempest-TestVolumeBootPattern-212634100 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:37:25.986822 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-46db4a6a-9fa3-48f3-8800-b07de0888cde tempest-TestVolumeBootPattern-212634100 None] Deleted volume successfully. Apr 09 21:37:25.999051 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-46db4a6a-9fa3-48f3-8800-b07de0888cde tempest-TestVolumeBootPattern-212634100 None] Lock "b'cinder-c19b2253-ae96-41f0-89c0-10ccf95949e0-delete_volume'" released by "delete_volume" :: held 0.566s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:37:26.565058 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-d65e0998-df9a-435c-8185-ec7aa91c9802 tempest-TestVolumeBootPattern-212634100 None] Lock "b'cinder-43b0970e-dbe9-428c-841b-acc723a8573a-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.008s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:37:26.566882 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-d65e0998-df9a-435c-8185-ec7aa91c9802 tempest-TestVolumeBootPattern-212634100 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:37:49.994675 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:37:49.995482 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:37:50.018593 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:37:50.040111 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:37:56.738310 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-d65e0998-df9a-435c-8185-ec7aa91c9802 tempest-TestVolumeBootPattern-212634100 None] Created reservations ['26b05f5a-9825-47bb-9da7-e3b451d5563d', '26c5a352-458e-4f2d-a981-0b48917c5b86', 'd4ad4b7c-dfa3-40f9-b8e8-bf793e2b7c4d', 'b1b0276d-efcc-438c-b57b-bc8596899823'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:37:56.779340 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-d65e0998-df9a-435c-8185-ec7aa91c9802 tempest-TestVolumeBootPattern-212634100 None] Delete snapshot completed successfully. Apr 09 21:37:56.784306 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-d65e0998-df9a-435c-8185-ec7aa91c9802 tempest-TestVolumeBootPattern-212634100 None] Lock "b'cinder-43b0970e-dbe9-428c-841b-acc723a8573a-delete_snapshot'" released by "delete_snapshot" :: held 30.219s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:38:01.208772 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-4811d1a4-3a71-4f92-81cd-73076c7b6f81 req-f31a944c-1a18-4043-8840-d466d611c95d tempest-TestVolumeBootPattern-212634100 None] Terminate volume connection completed successfully. Apr 09 21:38:01.209540 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-4811d1a4-3a71-4f92-81cd-73076c7b6f81 req-f31a944c-1a18-4043-8840-d466d611c95d tempest-TestVolumeBootPattern-212634100 None] Deleting attachment 0d3a89cf-1862-4586-a41e-1b9210ed4169. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 21:38:03.326958 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-c26de518-8217-41c8-8de0-4b31c33d4574 tempest-TestVolumeBootPattern-212634100 None] Lock "b'cinder-ac526ef0-508b-4640-8ed5-a8a5a3135756-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:38:03.357050 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-c26de518-8217-41c8-8de0-4b31c33d4574 tempest-TestVolumeBootPattern-212634100 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:38:03.420241 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-c26de518-8217-41c8-8de0-4b31c33d4574 tempest-TestVolumeBootPattern-212634100 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:38:03.428925 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-c26de518-8217-41c8-8de0-4b31c33d4574 tempest-TestVolumeBootPattern-212634100 None] deleting rbd volume volume-ac526ef0-508b-4640-8ed5-a8a5a3135756 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:38:03.726465 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-c26de518-8217-41c8-8de0-4b31c33d4574 tempest-TestVolumeBootPattern-212634100 None] volume is a clone so cleaning references {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Apr 09 21:38:03.762930 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-c26de518-8217-41c8-8de0-4b31c33d4574 tempest-TestVolumeBootPattern-212634100 None] deleting parent snapshot volume-ac526ef0-508b-4640-8ed5-a8a5a3135756.clone_snap {{(pid=135002) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Apr 09 21:38:04.814936 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-c26de518-8217-41c8-8de0-4b31c33d4574 tempest-TestVolumeBootPattern-212634100 None] Created reservations ['0b8e0db5-2647-41cc-9e73-642f9b5bd0a3', '7d6b76c2-dbef-44db-a594-369e2cf29f8a', '162b26d3-4160-4146-ac36-94482aa51c4f', '38f6c783-95cc-459d-8aeb-6c4296eb1887'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:38:04.861064 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-c26de518-8217-41c8-8de0-4b31c33d4574 tempest-TestVolumeBootPattern-212634100 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:38:04.887761 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-c26de518-8217-41c8-8de0-4b31c33d4574 tempest-TestVolumeBootPattern-212634100 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:38:04.922389 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-c26de518-8217-41c8-8de0-4b31c33d4574 tempest-TestVolumeBootPattern-212634100 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:38:04.926643 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-c26de518-8217-41c8-8de0-4b31c33d4574 tempest-TestVolumeBootPattern-212634100 None] Deleted volume successfully. Apr 09 21:38:04.940429 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-c26de518-8217-41c8-8de0-4b31c33d4574 tempest-TestVolumeBootPattern-212634100 None] Lock "b'cinder-ac526ef0-508b-4640-8ed5-a8a5a3135756-delete_volume'" released by "delete_volume" :: held 1.613s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:38:49.995303 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:38:49.996016 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:38:50.026021 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:38:50.067728 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:39:49.999832 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:39:50.000931 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:39:50.023856 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:39:50.046076 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:40:50.001727 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:40:50.002398 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:40:50.032627 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:40:50.063127 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:41:49.998357 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:41:49.999060 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:41:50.020653 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:41:50.047974 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:42:50.003579 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:42:50.004620 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:42:50.032429 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:42:50.059345 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:43:50.005647 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:43:50.006753 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:43:50.033946 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:43:50.058588 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:44:28.106697 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a4b9237-4c7a-45b3-bd22-5c3ae1cf41d9 tempest-ServerActionsTestJSON-1381280569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:44:28.127434 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9a4b9237-4c7a-45b3-bd22-5c3ae1cf41d9 tempest-ServerActionsTestJSON-1381280569 None] Flow 'volume_create_manager' (bc7852b9-efd4-4fea-8692-00e5bea0dd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:44:28.134025 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9a4b9237-4c7a-45b3-bd22-5c3ae1cf41d9 tempest-ServerActionsTestJSON-1381280569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20465433-34fd-4543-b58f-af0845eefef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:44:28.149661 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9a4b9237-4c7a-45b3-bd22-5c3ae1cf41d9 tempest-ServerActionsTestJSON-1381280569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20465433-34fd-4543-b58f-af0845eefef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-765245240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1ab8d030-830e-4da1-8980-0f5616179eb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67f62a23dbf04cfca2a3403c6a2186b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:44:28Z,use_quota=True,user_id='bc98c87ca47647008da1ddc42a738b29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:44:28.155349 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9a4b9237-4c7a-45b3-bd22-5c3ae1cf41d9 tempest-ServerActionsTestJSON-1381280569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b12c420c-4b93-4134-86ad-c57cc180b667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:44:28.159579 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9a4b9237-4c7a-45b3-bd22-5c3ae1cf41d9 tempest-ServerActionsTestJSON-1381280569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b12c420c-4b93-4134-86ad-c57cc180b667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:44:28.164861 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9a4b9237-4c7a-45b3-bd22-5c3ae1cf41d9 tempest-ServerActionsTestJSON-1381280569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cfc4ae7-ab2e-472e-933b-beadcdfdb371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:44:28.168996 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9a4b9237-4c7a-45b3-bd22-5c3ae1cf41d9 tempest-ServerActionsTestJSON-1381280569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cfc4ae7-ab2e-472e-933b-beadcdfdb371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ab8d030-830e-4da1-8980-0f5616179eb1', 'volume_name': 'volume-1ab8d030-830e-4da1-8980-0f5616179eb1', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:44:28.174168 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9a4b9237-4c7a-45b3-bd22-5c3ae1cf41d9 tempest-ServerActionsTestJSON-1381280569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a24783d4-be49-4bb4-9d94-7b22cf7da70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:44:28.178261 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9a4b9237-4c7a-45b3-bd22-5c3ae1cf41d9 tempest-ServerActionsTestJSON-1381280569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a24783d4-be49-4bb4-9d94-7b22cf7da70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:44:28.183061 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9a4b9237-4c7a-45b3-bd22-5c3ae1cf41d9 tempest-ServerActionsTestJSON-1381280569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5dc27fc-0f27-42f2-89c9-bf795740c28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:44:28.184298 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-9a4b9237-4c7a-45b3-bd22-5c3ae1cf41d9 tempest-ServerActionsTestJSON-1381280569 None] Volume 1ab8d030-830e-4da1-8980-0f5616179eb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ab8d030-830e-4da1-8980-0f5616179eb1', 'volume_size': 1} Apr 09 21:44:28.184771 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9a4b9237-4c7a-45b3-bd22-5c3ae1cf41d9 tempest-ServerActionsTestJSON-1381280569 None] creating volume 'volume-1ab8d030-830e-4da1-8980-0f5616179eb1' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:44:28.185730 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9a4b9237-4c7a-45b3-bd22-5c3ae1cf41d9 tempest-ServerActionsTestJSON-1381280569 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:44:28.251288 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9a4b9237-4c7a-45b3-bd22-5c3ae1cf41d9 tempest-ServerActionsTestJSON-1381280569 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:44:28.251773 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9a4b9237-4c7a-45b3-bd22-5c3ae1cf41d9 tempest-ServerActionsTestJSON-1381280569 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:44:28.255722 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9a4b9237-4c7a-45b3-bd22-5c3ae1cf41d9 tempest-ServerActionsTestJSON-1381280569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5dc27fc-0f27-42f2-89c9-bf795740c28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ab8d030-830e-4da1-8980-0f5616179eb1', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:44:28.260588 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9a4b9237-4c7a-45b3-bd22-5c3ae1cf41d9 tempest-ServerActionsTestJSON-1381280569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a27fc311-ac82-4de0-8232-ca424761fc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:44:28.272993 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-9a4b9237-4c7a-45b3-bd22-5c3ae1cf41d9 tempest-ServerActionsTestJSON-1381280569 None] Volume volume-1ab8d030-830e-4da1-8980-0f5616179eb1 (1ab8d030-830e-4da1-8980-0f5616179eb1): created successfully Apr 09 21:44:28.277139 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9a4b9237-4c7a-45b3-bd22-5c3ae1cf41d9 tempest-ServerActionsTestJSON-1381280569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a27fc311-ac82-4de0-8232-ca424761fc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:44:28.282857 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9a4b9237-4c7a-45b3-bd22-5c3ae1cf41d9 tempest-ServerActionsTestJSON-1381280569 None] Flow 'volume_create_manager' (bc7852b9-efd4-4fea-8692-00e5bea0dd75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:44:28.292861 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-9a4b9237-4c7a-45b3-bd22-5c3ae1cf41d9 tempest-ServerActionsTestJSON-1381280569 None] Created volume successfully. Apr 09 21:44:29.705472 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-474dd5ee-0548-4cd6-85c1-a3578344de91 req-aa5c2c98-fb88-4103-b839-d1eafc2f757d tempest-ServerActionsTestJSON-1381280569 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:44:30.350128 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-474dd5ee-0548-4cd6-85c1-a3578344de91 req-aa5c2c98-fb88-4103-b839-d1eafc2f757d tempest-ServerActionsTestJSON-1381280569 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.644s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:44:30.350991 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-474dd5ee-0548-4cd6-85c1-a3578344de91 req-aa5c2c98-fb88-4103-b839-d1eafc2f757d tempest-ServerActionsTestJSON-1381280569 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1ab8d030-830e-4da1-8980-0f5616179eb1', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': '1ab8d030-830e-4da1-8980-0f5616179eb1', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:44:30.378795 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-474dd5ee-0548-4cd6-85c1-a3578344de91 req-aa5c2c98-fb88-4103-b839-d1eafc2f757d tempest-ServerActionsTestJSON-1381280569 None] Connection info returned from driver {'name': 'volumes/volume-1ab8d030-830e-4da1-8980-0f5616179eb1', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1ab8d030-830e-4da1-8980-0f5616179eb1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '33f4163f-ae26-489c-b135-a3e1ed7c1835'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 21:44:30.435250 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-474dd5ee-0548-4cd6-85c1-a3578344de91 req-aa5c2c98-fb88-4103-b839-d1eafc2f757d tempest-ServerActionsTestJSON-1381280569 None] attachment_update completed successfully. Apr 09 21:44:50.004981 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:44:50.006459 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:44:50.044451 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:44:50.066802 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:44:51.108641 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-7449752a-96a4-4ca4-82cb-005b695e3d43 req-3c12dfe3-927e-4be6-8232-b7d99e7413b9 tempest-ServerActionsTestJSON-1381280569 None] Terminate volume connection completed successfully. Apr 09 21:44:51.109317 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-7449752a-96a4-4ca4-82cb-005b695e3d43 req-3c12dfe3-927e-4be6-8232-b7d99e7413b9 tempest-ServerActionsTestJSON-1381280569 None] Deleting attachment 33f4163f-ae26-489c-b135-a3e1ed7c1835. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 21:44:53.247923 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-7449752a-96a4-4ca4-82cb-005b695e3d43 req-0d658e42-734a-4de4-bb2f-740c4f6d054b tempest-ServerActionsTestJSON-1381280569 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:44:53.874102 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-7449752a-96a4-4ca4-82cb-005b695e3d43 req-0d658e42-734a-4de4-bb2f-740c4f6d054b tempest-ServerActionsTestJSON-1381280569 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.626s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:44:53.874961 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-7449752a-96a4-4ca4-82cb-005b695e3d43 req-0d658e42-734a-4de4-bb2f-740c4f6d054b tempest-ServerActionsTestJSON-1381280569 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1ab8d030-830e-4da1-8980-0f5616179eb1', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': '1ab8d030-830e-4da1-8980-0f5616179eb1', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:44:53.901358 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-7449752a-96a4-4ca4-82cb-005b695e3d43 req-0d658e42-734a-4de4-bb2f-740c4f6d054b tempest-ServerActionsTestJSON-1381280569 None] Connection info returned from driver {'name': 'volumes/volume-1ab8d030-830e-4da1-8980-0f5616179eb1', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1ab8d030-830e-4da1-8980-0f5616179eb1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '6f6a22f3-b98a-4a48-b0a0-a0555e96d775'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 21:44:53.957313 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-7449752a-96a4-4ca4-82cb-005b695e3d43 req-0d658e42-734a-4de4-bb2f-740c4f6d054b tempest-ServerActionsTestJSON-1381280569 None] attachment_update completed successfully. Apr 09 21:45:01.917582 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-8f9d52bf-f238-49d0-b5a4-324c0a6dfd72 req-e07fdd8a-6b52-4026-bd34-b81d601ae099 tempest-ServerActionsTestJSON-1381280569 None] Terminate volume connection completed successfully. Apr 09 21:45:01.918155 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-8f9d52bf-f238-49d0-b5a4-324c0a6dfd72 req-e07fdd8a-6b52-4026-bd34-b81d601ae099 tempest-ServerActionsTestJSON-1381280569 None] Deleting attachment 6f6a22f3-b98a-4a48-b0a0-a0555e96d775. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 21:45:04.121160 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-8f9d52bf-f238-49d0-b5a4-324c0a6dfd72 req-5d900cce-875b-4fb2-8678-eddae54815a6 tempest-ServerActionsTestJSON-1381280569 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:45:04.765570 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-8f9d52bf-f238-49d0-b5a4-324c0a6dfd72 req-5d900cce-875b-4fb2-8678-eddae54815a6 tempest-ServerActionsTestJSON-1381280569 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.644s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:45:04.766391 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-8f9d52bf-f238-49d0-b5a4-324c0a6dfd72 req-5d900cce-875b-4fb2-8678-eddae54815a6 tempest-ServerActionsTestJSON-1381280569 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1ab8d030-830e-4da1-8980-0f5616179eb1', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': '1ab8d030-830e-4da1-8980-0f5616179eb1', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:45:04.793071 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-8f9d52bf-f238-49d0-b5a4-324c0a6dfd72 req-5d900cce-875b-4fb2-8678-eddae54815a6 tempest-ServerActionsTestJSON-1381280569 None] Connection info returned from driver {'name': 'volumes/volume-1ab8d030-830e-4da1-8980-0f5616179eb1', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1ab8d030-830e-4da1-8980-0f5616179eb1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '63b857be-1177-442a-8659-ffcc90691e79'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 21:45:04.842254 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-8f9d52bf-f238-49d0-b5a4-324c0a6dfd72 req-5d900cce-875b-4fb2-8678-eddae54815a6 tempest-ServerActionsTestJSON-1381280569 None] attachment_update completed successfully. Apr 09 21:45:11.173426 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-4ed50e9b-e331-4abb-b6c2-f8a89fad2d91 req-b6c34c50-2a89-4c31-abf2-3a47d7365283 tempest-ServerActionsTestJSON-1381280569 None] Terminate volume connection completed successfully. Apr 09 21:45:11.174047 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-4ed50e9b-e331-4abb-b6c2-f8a89fad2d91 req-b6c34c50-2a89-4c31-abf2-3a47d7365283 tempest-ServerActionsTestJSON-1381280569 None] Deleting attachment 63b857be-1177-442a-8659-ffcc90691e79. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 21:45:12.232685 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-66f76e62-de32-4601-961e-fca3f409db89 tempest-ServerActionsTestJSON-1381280569 None] Lock "b'cinder-1ab8d030-830e-4da1-8980-0f5616179eb1-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:45:12.265297 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-66f76e62-de32-4601-961e-fca3f409db89 tempest-ServerActionsTestJSON-1381280569 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:45:12.305362 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-66f76e62-de32-4601-961e-fca3f409db89 tempest-ServerActionsTestJSON-1381280569 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:45:12.305814 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-66f76e62-de32-4601-961e-fca3f409db89 tempest-ServerActionsTestJSON-1381280569 None] Volume volume-1ab8d030-830e-4da1-8980-0f5616179eb1 is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:45:12.313651 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-66f76e62-de32-4601-961e-fca3f409db89 tempest-ServerActionsTestJSON-1381280569 None] deleting rbd volume volume-1ab8d030-830e-4da1-8980-0f5616179eb1 {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:45:12.571314 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-66f76e62-de32-4601-961e-fca3f409db89 tempest-ServerActionsTestJSON-1381280569 None] Created reservations ['f33ba560-f3db-4168-8d7f-9cdf2f7733a5', 'cdeaea10-100c-4977-93b4-c59c07454f8e', '6b7bcd31-eb51-4c8e-aa6d-6a023c7b612d', 'a14b4011-f38e-42f1-bd22-6fa6464c5cc5'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:45:12.617178 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-66f76e62-de32-4601-961e-fca3f409db89 tempest-ServerActionsTestJSON-1381280569 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:45:12.639396 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-66f76e62-de32-4601-961e-fca3f409db89 tempest-ServerActionsTestJSON-1381280569 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:45:12.662803 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-66f76e62-de32-4601-961e-fca3f409db89 tempest-ServerActionsTestJSON-1381280569 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:45:12.667244 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-66f76e62-de32-4601-961e-fca3f409db89 tempest-ServerActionsTestJSON-1381280569 None] Deleted volume successfully. Apr 09 21:45:12.681137 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-66f76e62-de32-4601-961e-fca3f409db89 tempest-ServerActionsTestJSON-1381280569 None] Lock "b'cinder-1ab8d030-830e-4da1-8980-0f5616179eb1-delete_volume'" released by "delete_volume" :: held 0.448s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:45:50.001923 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:45:50.002652 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:45:50.024839 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:45:50.053880 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:46:44.108853 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c0b0d36-9e67-4c02-a4f8-2f6d39563afa tempest-TestMinimumBasicScenario-1285877756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 21:46:44.131126 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9c0b0d36-9e67-4c02-a4f8-2f6d39563afa tempest-TestMinimumBasicScenario-1285877756 None] Flow 'volume_create_manager' (93a83762-4236-47ab-bcbe-50975f81b112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:46:44.137853 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9c0b0d36-9e67-4c02-a4f8-2f6d39563afa tempest-TestMinimumBasicScenario-1285877756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8436005d-06d3-4ff3-8b84-0d010ab844b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:46:44.157430 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9c0b0d36-9e67-4c02-a4f8-2f6d39563afa tempest-TestMinimumBasicScenario-1285877756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8436005d-06d3-4ff3-8b84-0d010ab844b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T21:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-418913869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6cd5af3d-2661-42d8-95fb-819d1da6c9bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4071a76a44224683a79239cce8574953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T21:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T21:46:44Z,use_quota=True,user_id='93a7d4f90ba64dcfaf84d65638e1a652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:46:44.165180 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9c0b0d36-9e67-4c02-a4f8-2f6d39563afa tempest-TestMinimumBasicScenario-1285877756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7911f9d8-5f61-4e51-b680-6d66c2bd1ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:46:44.171845 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9c0b0d36-9e67-4c02-a4f8-2f6d39563afa tempest-TestMinimumBasicScenario-1285877756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7911f9d8-5f61-4e51-b680-6d66c2bd1ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:46:44.178991 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9c0b0d36-9e67-4c02-a4f8-2f6d39563afa tempest-TestMinimumBasicScenario-1285877756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdb098dc-274e-4a48-856f-8ec5389f8c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:46:44.183162 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9c0b0d36-9e67-4c02-a4f8-2f6d39563afa tempest-TestMinimumBasicScenario-1285877756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdb098dc-274e-4a48-856f-8ec5389f8c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cd5af3d-2661-42d8-95fb-819d1da6c9bc', 'volume_name': 'volume-6cd5af3d-2661-42d8-95fb-819d1da6c9bc', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:46:44.188193 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9c0b0d36-9e67-4c02-a4f8-2f6d39563afa tempest-TestMinimumBasicScenario-1285877756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f0c2cbe-b7e4-4f54-a89b-efe3c732b23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:46:44.192212 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9c0b0d36-9e67-4c02-a4f8-2f6d39563afa tempest-TestMinimumBasicScenario-1285877756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f0c2cbe-b7e4-4f54-a89b-efe3c732b23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:46:44.196960 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9c0b0d36-9e67-4c02-a4f8-2f6d39563afa tempest-TestMinimumBasicScenario-1285877756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (841bc0ea-03f1-405e-a9b4-11372883564a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:46:44.198069 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-9c0b0d36-9e67-4c02-a4f8-2f6d39563afa tempest-TestMinimumBasicScenario-1285877756 None] Volume 6cd5af3d-2661-42d8-95fb-819d1da6c9bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cd5af3d-2661-42d8-95fb-819d1da6c9bc', 'volume_size': 1} Apr 09 21:46:44.198468 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9c0b0d36-9e67-4c02-a4f8-2f6d39563afa tempest-TestMinimumBasicScenario-1285877756 None] creating volume 'volume-6cd5af3d-2661-42d8-95fb-819d1da6c9bc' {{(pid=135002) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Apr 09 21:46:44.199300 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9c0b0d36-9e67-4c02-a4f8-2f6d39563afa tempest-TestMinimumBasicScenario-1285877756 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:46:44.368829 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9c0b0d36-9e67-4c02-a4f8-2f6d39563afa tempest-TestMinimumBasicScenario-1285877756 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 21:46:44.369154 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-9c0b0d36-9e67-4c02-a4f8-2f6d39563afa tempest-TestMinimumBasicScenario-1285877756 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 21:46:44.372889 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9c0b0d36-9e67-4c02-a4f8-2f6d39563afa tempest-TestMinimumBasicScenario-1285877756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (841bc0ea-03f1-405e-a9b4-11372883564a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cd5af3d-2661-42d8-95fb-819d1da6c9bc', 'volume_size': 1}' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:46:44.377601 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9c0b0d36-9e67-4c02-a4f8-2f6d39563afa tempest-TestMinimumBasicScenario-1285877756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54e078a7-7fd7-4ed7-99e8-417465ea3890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 21:46:44.389691 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-9c0b0d36-9e67-4c02-a4f8-2f6d39563afa tempest-TestMinimumBasicScenario-1285877756 None] Volume volume-6cd5af3d-2661-42d8-95fb-819d1da6c9bc (6cd5af3d-2661-42d8-95fb-819d1da6c9bc): created successfully Apr 09 21:46:44.393292 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9c0b0d36-9e67-4c02-a4f8-2f6d39563afa tempest-TestMinimumBasicScenario-1285877756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54e078a7-7fd7-4ed7-99e8-417465ea3890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 21:46:44.398812 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-9c0b0d36-9e67-4c02-a4f8-2f6d39563afa tempest-TestMinimumBasicScenario-1285877756 None] Flow 'volume_create_manager' (93a83762-4236-47ab-bcbe-50975f81b112) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 21:46:44.408360 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-9c0b0d36-9e67-4c02-a4f8-2f6d39563afa tempest-TestMinimumBasicScenario-1285877756 None] Created volume successfully. Apr 09 21:46:45.748114 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-84096929-15c5-4883-8748-4ce17a4cedeb req-536c8cee-c8c1-41a8-a09e-8518088b1435 tempest-TestMinimumBasicScenario-1285877756 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 21:46:47.098694 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-84096929-15c5-4883-8748-4ce17a4cedeb req-536c8cee-c8c1-41a8-a09e-8518088b1435 tempest-TestMinimumBasicScenario-1285877756 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.350s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 21:46:47.099481 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-84096929-15c5-4883-8748-4ce17a4cedeb req-536c8cee-c8c1-41a8-a09e-8518088b1435 tempest-TestMinimumBasicScenario-1285877756 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6cd5af3d-2661-42d8-95fb-819d1da6c9bc', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': '6cd5af3d-2661-42d8-95fb-819d1da6c9bc', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 21:46:47.123515 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-84096929-15c5-4883-8748-4ce17a4cedeb req-536c8cee-c8c1-41a8-a09e-8518088b1435 tempest-TestMinimumBasicScenario-1285877756 None] Connection info returned from driver {'name': 'volumes/volume-6cd5af3d-2661-42d8-95fb-819d1da6c9bc', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '6cd5af3d-2661-42d8-95fb-819d1da6c9bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '2bdd5119-f318-4fb7-894a-57acf9ab9adf'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 21:46:47.169985 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-84096929-15c5-4883-8748-4ce17a4cedeb req-536c8cee-c8c1-41a8-a09e-8518088b1435 tempest-TestMinimumBasicScenario-1285877756 None] attachment_update completed successfully. Apr 09 21:46:49.999662 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:46:50.000744 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:46:50.027299 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:46:50.052228 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:47:49.998412 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:47:49.999522 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:47:50.030857 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:47:50.054467 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:48:10.398965 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-e3a8775d-08aa-403c-b5ae-57d7c991b38f req-4599a947-8a27-4646-9b96-45cbf8b5486f tempest-TestMinimumBasicScenario-1285877756 None] Terminate volume connection completed successfully. Apr 09 21:48:10.399681 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-e3a8775d-08aa-403c-b5ae-57d7c991b38f req-4599a947-8a27-4646-9b96-45cbf8b5486f tempest-TestMinimumBasicScenario-1285877756 None] Deleting attachment 2bdd5119-f318-4fb7-894a-57acf9ab9adf. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 21:48:11.043190 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-6e66b329-4838-40c4-800f-8b488dd77add tempest-TestMinimumBasicScenario-1285877756 None] Lock "b'cinder-6cd5af3d-2661-42d8-95fb-819d1da6c9bc-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 21:48:11.076325 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-6e66b329-4838-40c4-800f-8b488dd77add tempest-TestMinimumBasicScenario-1285877756 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:48:11.117015 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-6e66b329-4838-40c4-800f-8b488dd77add tempest-TestMinimumBasicScenario-1285877756 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 21:48:11.117505 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-6e66b329-4838-40c4-800f-8b488dd77add tempest-TestMinimumBasicScenario-1285877756 None] Volume volume-6cd5af3d-2661-42d8-95fb-819d1da6c9bc is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 21:48:11.125605 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-6e66b329-4838-40c4-800f-8b488dd77add tempest-TestMinimumBasicScenario-1285877756 None] deleting rbd volume volume-6cd5af3d-2661-42d8-95fb-819d1da6c9bc {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 21:48:11.373659 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [None req-6e66b329-4838-40c4-800f-8b488dd77add tempest-TestMinimumBasicScenario-1285877756 None] Created reservations ['40b19a40-7ea5-42b8-a229-eb5c08b73b4d', '97fac1c6-b86e-48b2-a8c6-2b15e22f9b58', 'd9244fb7-830e-4cd6-bb8f-f0c6372d0832', '2bd66337-8115-48cf-81e1-0df2c915e0f4'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 21:48:11.424333 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-6e66b329-4838-40c4-800f-8b488dd77add tempest-TestMinimumBasicScenario-1285877756 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:48:11.451241 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-6e66b329-4838-40c4-800f-8b488dd77add tempest-TestMinimumBasicScenario-1285877756 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:48:11.475382 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-6e66b329-4838-40c4-800f-8b488dd77add tempest-TestMinimumBasicScenario-1285877756 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:48:11.479875 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-6e66b329-4838-40c4-800f-8b488dd77add tempest-TestMinimumBasicScenario-1285877756 None] Deleted volume successfully. Apr 09 21:48:11.493198 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-6e66b329-4838-40c4-800f-8b488dd77add tempest-TestMinimumBasicScenario-1285877756 None] Lock "b'cinder-6cd5af3d-2661-42d8-95fb-819d1da6c9bc-delete_volume'" released by "delete_volume" :: held 0.450s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 21:48:50.000156 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:48:50.002202 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:48:50.027577 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:48:50.050240 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:49:50.005920 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:49:50.007060 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:49:50.032789 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:49:50.055042 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:50:50.010697 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:50:50.011459 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:50:50.046475 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:50:50.076275 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:51:50.011554 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:51:50.012282 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:51:50.042538 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:51:50.066796 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:52:50.013701 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:52:50.014821 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:52:50.042664 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:52:50.065330 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:53:50.011070 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:53:50.012227 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:53:50.037804 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:53:50.060055 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:54:50.015891 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:54:50.017148 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:54:50.044864 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:54:50.069287 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:55:50.015147 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:55:50.016301 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:55:50.044671 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:55:50.067004 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:56:50.013022 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:56:50.013641 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:56:50.048878 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:56:50.081405 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:57:50.017820 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:57:50.018470 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:57:50.047046 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:57:50.073162 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:58:50.019131 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:58:50.020492 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:58:50.045964 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:58:50.069274 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 21:59:50.024548 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 21:59:50.025770 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:59:50.062251 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 21:59:50.084171 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 22:00:50.030239 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 22:00:50.031401 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:00:50.064692 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:00:50.087275 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 22:01:50.033540 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 22:01:50.034783 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:01:50.064390 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:01:50.087172 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 22:02:46.572462 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5367e94-d6d0-42ab-ac0f-59ee57ff5ef8 tempest-TestShelveInstance-1992476203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135002) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Apr 09 22:02:46.591567 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a5367e94-d6d0-42ab-ac0f-59ee57ff5ef8 tempest-TestShelveInstance-1992476203 None] Flow 'volume_create_manager' (0e63f582-3fa7-4c50-a2b2-2ea48d548e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 22:02:46.598560 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a5367e94-d6d0-42ab-ac0f-59ee57ff5ef8 tempest-TestShelveInstance-1992476203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bce25a16-72ed-4187-b0ab-b1c9307282b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 22:02:46.614079 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a5367e94-d6d0-42ab-ac0f-59ee57ff5ef8 tempest-TestShelveInstance-1992476203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bce25a16-72ed-4187-b0ab-b1c9307282b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-04-09T22:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-217441894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=eec72ecd-21f3-4e41-9d0f-7686e6238eeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5b6456b64b3420cb9fd86fb1cb15247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-09T22:02:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-09T22:02:47Z,use_quota=True,user_id='9c33fcbaf68845b686f70eb205fa1e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bed363b-b37b-4bdd-bf92-3fc06f4db0b8),volume_type_id=7bed363b-b37b-4bdd-bf92-3fc06f4db0b8)' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 22:02:46.619539 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a5367e94-d6d0-42ab-ac0f-59ee57ff5ef8 tempest-TestShelveInstance-1992476203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c4ac33-90ad-4912-9fb0-5164f7605f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 22:02:46.623684 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a5367e94-d6d0-42ab-ac0f-59ee57ff5ef8 tempest-TestShelveInstance-1992476203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c4ac33-90ad-4912-9fb0-5164f7605f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 22:02:46.628913 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a5367e94-d6d0-42ab-ac0f-59ee57ff5ef8 tempest-TestShelveInstance-1992476203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed454798-1635-4653-9a51-00a05c725043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 22:02:46.713809 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a5367e94-d6d0-42ab-ac0f-59ee57ff5ef8 tempest-TestShelveInstance-1992476203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed454798-1635-4653-9a51-00a05c725043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'eec72ecd-21f3-4e41-9d0f-7686e6238eeb', 'volume_name': 'volume-eec72ecd-21f3-4e41-9d0f-7686e6238eeb', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 22:02:46.718914 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a5367e94-d6d0-42ab-ac0f-59ee57ff5ef8 tempest-TestShelveInstance-1992476203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77bef61b-8f07-41d0-9c1d-2afc79b49d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 22:02:46.722945 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a5367e94-d6d0-42ab-ac0f-59ee57ff5ef8 tempest-TestShelveInstance-1992476203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77bef61b-8f07-41d0-9c1d-2afc79b49d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 22:02:46.728050 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a5367e94-d6d0-42ab-ac0f-59ee57ff5ef8 tempest-TestShelveInstance-1992476203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (398150e0-c643-4d6f-aa7a-b5a76a6f2640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 22:02:46.729188 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-a5367e94-d6d0-42ab-ac0f-59ee57ff5ef8 tempest-TestShelveInstance-1992476203 None] Volume eec72ecd-21f3-4e41-9d0f-7686e6238eeb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-eec72ecd-21f3-4e41-9d0f-7686e6238eeb', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 09 22:02:46.729755 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5367e94-d6d0-42ab-ac0f-59ee57ff5ef8 tempest-TestShelveInstance-1992476203 None] Cloning eec72ecd-21f3-4e41-9d0f-7686e6238eeb from image b539c48b-3400-4aa4-9226-8be5a3d07b36 at location (None, None). {{(pid=135002) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Apr 09 22:02:46.738888 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-a5367e94-d6d0-42ab-ac0f-59ee57ff5ef8 tempest-TestShelveInstance-1992476203 None] Lock "b'cinder-b539c48b-3400-4aa4-9226-8be5a3d07b36'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 22:02:46.750909 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-a5367e94-d6d0-42ab-ac0f-59ee57ff5ef8 tempest-TestShelveInstance-1992476203 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'volume_id': 'd35656e2-d293-4904-aeae-3113202bb314', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36), 'last_used': datetime.datetime(2022, 4, 9, 22, 2, 46, 742918)}. {{(pid=135002) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 09 22:02:46.751373 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-a5367e94-d6d0-42ab-ac0f-59ee57ff5ef8 tempest-TestShelveInstance-1992476203 None] Image-volume cache entry image_update_at = 2022-04-09 20:45:36+00:00, requested image updated_at = 2022-04-09 20:45:36+00:00. {{(pid=135002) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 09 22:02:46.751803 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5367e94-d6d0-42ab-ac0f-59ee57ff5ef8 tempest-TestShelveInstance-1992476203 None] Found cache entry for image = b539c48b-3400-4aa4-9226-8be5a3d07b36 on host ncdv-master-1@ceph#ceph. {{(pid=135002) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Apr 09 22:02:46.755828 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [None req-a5367e94-d6d0-42ab-ac0f-59ee57ff5ef8 tempest-TestShelveInstance-1992476203 None] Lock "b'cinder-b539c48b-3400-4aa4-9226-8be5a3d07b36'" released by "_prepare_image_cache_entry" :: held 0.017s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 22:02:46.756750 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5367e94-d6d0-42ab-ac0f-59ee57ff5ef8 tempest-TestShelveInstance-1992476203 None] Attempting to retrieve cache entry for image = b539c48b-3400-4aa4-9226-8be5a3d07b36 on host ncdv-master-1@ceph#ceph. {{(pid=135002) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Apr 09 22:02:46.761899 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-a5367e94-d6d0-42ab-ac0f-59ee57ff5ef8 tempest-TestShelveInstance-1992476203 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'volume_id': 'd35656e2-d293-4904-aeae-3113202bb314', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36), 'last_used': datetime.datetime(2022, 4, 9, 22, 2, 46, 759794)}. {{(pid=135002) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 09 22:02:46.762302 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.image.cache [None req-a5367e94-d6d0-42ab-ac0f-59ee57ff5ef8 tempest-TestShelveInstance-1992476203 None] Image-volume cache entry image_update_at = 2022-04-09 20:45:36+00:00, requested image updated_at = 2022-04-09 20:45:36+00:00. {{(pid=135002) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 09 22:02:46.762685 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5367e94-d6d0-42ab-ac0f-59ee57ff5ef8 tempest-TestShelveInstance-1992476203 None] Creating from source image-volume d35656e2-d293-4904-aeae-3113202bb314 {{(pid=135002) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Apr 09 22:02:46.773524 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a5367e94-d6d0-42ab-ac0f-59ee57ff5ef8 tempest-TestShelveInstance-1992476203 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:02:46.828397 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a5367e94-d6d0-42ab-ac0f-59ee57ff5ef8 tempest-TestShelveInstance-1992476203 None] creating snapshot='volume-eec72ecd-21f3-4e41-9d0f-7686e6238eeb.clone_snap' {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Apr 09 22:02:47.119341 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a5367e94-d6d0-42ab-ac0f-59ee57ff5ef8 tempest-TestShelveInstance-1992476203 None] cloning 'volume-d35656e2-d293-4904-aeae-3113202bb314@volume-eec72ecd-21f3-4e41-9d0f-7686e6238eeb.clone_snap' to 'volume-eec72ecd-21f3-4e41-9d0f-7686e6238eeb' {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Apr 09 22:02:47.280973 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a5367e94-d6d0-42ab-ac0f-59ee57ff5ef8 tempest-TestShelveInstance-1992476203 None] Volume volume-6d815065-063f-4887-9bc8-5808837868ff.deleted is not a clone. {{(pid=135002) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Apr 09 22:02:47.282190 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a5367e94-d6d0-42ab-ac0f-59ee57ff5ef8 tempest-TestShelveInstance-1992476203 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Apr 09 22:02:47.282562 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a5367e94-d6d0-42ab-ac0f-59ee57ff5ef8 tempest-TestShelveInstance-1992476203 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135002) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Apr 09 22:02:47.305826 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-a5367e94-d6d0-42ab-ac0f-59ee57ff5ef8 tempest-TestShelveInstance-1992476203 None] clone created successfully {{(pid=135002) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Apr 09 22:02:47.306441 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.volume_utils [None req-a5367e94-d6d0-42ab-ac0f-59ee57ff5ef8 tempest-TestShelveInstance-1992476203 None] Marking volume eec72ecd-21f3-4e41-9d0f-7686e6238eeb as bootable. {{(pid=135002) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Apr 09 22:02:47.315737 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5367e94-d6d0-42ab-ac0f-59ee57ff5ef8 tempest-TestShelveInstance-1992476203 None] Copying metadata from image b539c48b-3400-4aa4-9226-8be5a3d07b36 to eec72ecd-21f3-4e41-9d0f-7686e6238eeb. {{(pid=135002) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Apr 09 22:02:47.316173 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5367e94-d6d0-42ab-ac0f-59ee57ff5ef8 tempest-TestShelveInstance-1992476203 None] Creating volume glance metadata for volume eec72ecd-21f3-4e41-9d0f-7686e6238eeb backed by image b539c48b-3400-4aa4-9226-8be5a3d07b36 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=135002) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Apr 09 22:02:47.367927 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a5367e94-d6d0-42ab-ac0f-59ee57ff5ef8 tempest-TestShelveInstance-1992476203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (398150e0-c643-4d6f-aa7a-b5a76a6f2640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eec72ecd-21f3-4e41-9d0f-7686e6238eeb', 'volume_size': 1, 'image_id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac45ac4c5799419597fa1b4dd7090c85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b539c48b-3400-4aa4-9226-8be5a3d07b36', 'created_at': datetime.datetime(2022, 4, 9, 20, 45, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 9, 20, 45, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b539c48b-3400-4aa4-9226-8be5a3d07b36/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 22:02:47.375724 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a5367e94-d6d0-42ab-ac0f-59ee57ff5ef8 tempest-TestShelveInstance-1992476203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0d060b0-b6a2-4497-aff5-39dbfdc7bff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Apr 09 22:02:47.386427 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.flows.manager.create_volume [None req-a5367e94-d6d0-42ab-ac0f-59ee57ff5ef8 tempest-TestShelveInstance-1992476203 None] Volume volume-eec72ecd-21f3-4e41-9d0f-7686e6238eeb (eec72ecd-21f3-4e41-9d0f-7686e6238eeb): created successfully Apr 09 22:02:47.390006 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a5367e94-d6d0-42ab-ac0f-59ee57ff5ef8 tempest-TestShelveInstance-1992476203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0d060b0-b6a2-4497-aff5-39dbfdc7bff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135002) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Apr 09 22:02:47.395524 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [None req-a5367e94-d6d0-42ab-ac0f-59ee57ff5ef8 tempest-TestShelveInstance-1992476203 None] Flow 'volume_create_manager' (0e63f582-3fa7-4c50-a2b2-2ea48d548e5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135002) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Apr 09 22:02:47.404881 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [None req-a5367e94-d6d0-42ab-ac0f-59ee57ff5ef8 tempest-TestShelveInstance-1992476203 None] Created volume successfully. Apr 09 22:02:50.033120 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 22:02:50.033901 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:02:50.058099 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:02:50.080413 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 22:02:53.924856 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-42edaf25-3d69-4a72-b48c-8422e2700478 req-bf869e57-8bb6-47ec-8f4c-3977c7a95ba4 tempest-TestShelveInstance-1992476203 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 22:02:54.613395 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-42edaf25-3d69-4a72-b48c-8422e2700478 req-bf869e57-8bb6-47ec-8f4c-3977c7a95ba4 tempest-TestShelveInstance-1992476203 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.688s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 22:02:54.614262 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-42edaf25-3d69-4a72-b48c-8422e2700478 req-bf869e57-8bb6-47ec-8f4c-3977c7a95ba4 tempest-TestShelveInstance-1992476203 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-eec72ecd-21f3-4e41-9d0f-7686e6238eeb', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': 'eec72ecd-21f3-4e41-9d0f-7686e6238eeb', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 22:02:54.638934 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-42edaf25-3d69-4a72-b48c-8422e2700478 req-bf869e57-8bb6-47ec-8f4c-3977c7a95ba4 tempest-TestShelveInstance-1992476203 None] Connection info returned from driver {'name': 'volumes/volume-eec72ecd-21f3-4e41-9d0f-7686e6238eeb', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'eec72ecd-21f3-4e41-9d0f-7686e6238eeb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '76a68f44-a68f-4208-a555-1a0cbce2b453'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 22:02:54.692677 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-42edaf25-3d69-4a72-b48c-8422e2700478 req-bf869e57-8bb6-47ec-8f4c-3977c7a95ba4 tempest-TestShelveInstance-1992476203 None] attachment_update completed successfully. Apr 09 22:03:50.035869 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 22:03:50.036854 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:03:50.060078 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:03:50.082546 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 22:04:50.038225 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 22:04:50.039131 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:04:50.070661 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:04:50.099195 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 22:05:31.819749 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-3115e668-0412-4308-a425-366a01a2c80a req-6fe7540c-bad8-4487-903b-3adf956ca6a8 tempest-TestShelveInstance-1992476203 None] Terminate volume connection completed successfully. Apr 09 22:05:31.820449 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-3115e668-0412-4308-a425-366a01a2c80a req-6fe7540c-bad8-4487-903b-3adf956ca6a8 tempest-TestShelveInstance-1992476203 None] Deleting attachment 76a68f44-a68f-4208-a555-1a0cbce2b453. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 22:05:33.586568 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-0b7d2414-d7ff-4484-9aa2-871bf2c4d128 req-f52a038d-ac47-4ba3-ab10-0c77577348b8 tempest-TestShelveInstance-1992476203 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 09 22:05:34.216149 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_concurrency.processutils [req-0b7d2414-d7ff-4484-9aa2-871bf2c4d128 req-f52a038d-ac47-4ba3-ab10-0c77577348b8 tempest-TestShelveInstance-1992476203 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.629s {{(pid=135002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 09 22:05:34.216984 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-0b7d2414-d7ff-4484-9aa2-871bf2c4d128 req-f52a038d-ac47-4ba3-ab10-0c77577348b8 tempest-TestShelveInstance-1992476203 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-eec72ecd-21f3-4e41-9d0f-7686e6238eeb', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '85b3303f-9894-4409-bb45-d72c5aa3a4f1', 'volume_id': 'eec72ecd-21f3-4e41-9d0f-7686e6238eeb', 'discard': True}} {{(pid=135002) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Apr 09 22:05:34.240720 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-0b7d2414-d7ff-4484-9aa2-871bf2c4d128 req-f52a038d-ac47-4ba3-ab10-0c77577348b8 tempest-TestShelveInstance-1992476203 None] Connection info returned from driver {'name': 'volumes/volume-eec72ecd-21f3-4e41-9d0f-7686e6238eeb', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'eec72ecd-21f3-4e41-9d0f-7686e6238eeb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ef1b04f1-2326-4c5f-a1b6-f4a12f24eb97'} {{(pid=135002) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Apr 09 22:05:34.287807 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-0b7d2414-d7ff-4484-9aa2-871bf2c4d128 req-f52a038d-ac47-4ba3-ab10-0c77577348b8 tempest-TestShelveInstance-1992476203 None] attachment_update completed successfully. Apr 09 22:05:50.034404 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 22:05:50.036748 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:05:50.067434 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:05:50.090137 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 22:06:50.035902 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 22:06:50.036758 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:06:50.061218 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:06:50.083521 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 22:07:13.922015 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-bf07ba63-012a-44f5-aebe-6ab27d61ff8b req-ffeac907-a165-4a82-ad0f-f65e79b12118 tempest-TestShelveInstance-1992476203 None] Terminate volume connection completed successfully. Apr 09 22:07:13.922610 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.manager [req-bf07ba63-012a-44f5-aebe-6ab27d61ff8b req-ffeac907-a165-4a82-ad0f-f65e79b12118 tempest-TestShelveInstance-1992476203 None] Deleting attachment ef1b04f1-2326-4c5f-a1b6-f4a12f24eb97. {{(pid=135002) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Apr 09 22:07:14.050645 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [req-bf07ba63-012a-44f5-aebe-6ab27d61ff8b req-61759bb9-eaf5-4dbe-9c85-240077819e69 tempest-TestShelveInstance-1992476203 None] Lock "b'cinder-eec72ecd-21f3-4e41-9d0f-7686e6238eeb-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Apr 09 22:07:14.083765 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-bf07ba63-012a-44f5-aebe-6ab27d61ff8b req-61759bb9-eaf5-4dbe-9c85-240077819e69 tempest-TestShelveInstance-1992476203 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:07:14.164932 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-bf07ba63-012a-44f5-aebe-6ab27d61ff8b req-61759bb9-eaf5-4dbe-9c85-240077819e69 tempest-TestShelveInstance-1992476203 None] volume has no backup snaps {{(pid=135002) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Apr 09 22:07:14.174098 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-bf07ba63-012a-44f5-aebe-6ab27d61ff8b req-61759bb9-eaf5-4dbe-9c85-240077819e69 tempest-TestShelveInstance-1992476203 None] deleting rbd volume volume-eec72ecd-21f3-4e41-9d0f-7686e6238eeb {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Apr 09 22:07:14.443670 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-bf07ba63-012a-44f5-aebe-6ab27d61ff8b req-61759bb9-eaf5-4dbe-9c85-240077819e69 tempest-TestShelveInstance-1992476203 None] volume is a clone so cleaning references {{(pid=135002) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Apr 09 22:07:14.477524 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-bf07ba63-012a-44f5-aebe-6ab27d61ff8b req-61759bb9-eaf5-4dbe-9c85-240077819e69 tempest-TestShelveInstance-1992476203 None] deleting parent snapshot volume-eec72ecd-21f3-4e41-9d0f-7686e6238eeb.clone_snap {{(pid=135002) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Apr 09 22:07:14.741998 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.quota [req-bf07ba63-012a-44f5-aebe-6ab27d61ff8b req-61759bb9-eaf5-4dbe-9c85-240077819e69 tempest-TestShelveInstance-1992476203 None] Created reservations ['3c679e9b-3007-484f-b4b3-4fb67fb30f21', 'bf23a2dc-b130-4c08-863c-20dfb580dcbf', 'd1a22429-1bfd-4107-baa6-390d9807ca51', 'b43fdb2b-2deb-4387-9e96-cec351df9e27'] {{(pid=135002) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 09 22:07:14.790138 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-bf07ba63-012a-44f5-aebe-6ab27d61ff8b req-61759bb9-eaf5-4dbe-9c85-240077819e69 tempest-TestShelveInstance-1992476203 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:07:14.814422 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [req-bf07ba63-012a-44f5-aebe-6ab27d61ff8b req-61759bb9-eaf5-4dbe-9c85-240077819e69 tempest-TestShelveInstance-1992476203 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:07:14.842248 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [req-bf07ba63-012a-44f5-aebe-6ab27d61ff8b req-61759bb9-eaf5-4dbe-9c85-240077819e69 tempest-TestShelveInstance-1992476203 None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 22:07:14.847437 ncdv-master-1 cinder-volume[135002]: INFO cinder.volume.manager [req-bf07ba63-012a-44f5-aebe-6ab27d61ff8b req-61759bb9-eaf5-4dbe-9c85-240077819e69 tempest-TestShelveInstance-1992476203 None] Deleted volume successfully. Apr 09 22:07:14.860674 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.coordination [req-bf07ba63-012a-44f5-aebe-6ab27d61ff8b req-61759bb9-eaf5-4dbe-9c85-240077819e69 tempest-TestShelveInstance-1992476203 None] Lock "b'cinder-eec72ecd-21f3-4e41-9d0f-7686e6238eeb-delete_volume'" released by "delete_volume" :: held 0.810s {{(pid=135002) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Apr 09 22:07:50.040457 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 22:07:50.041584 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:07:50.071154 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:07:50.093648 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 22:08:50.039802 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 22:08:50.040952 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:08:50.069614 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:08:50.092579 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 22:09:50.038542 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 22:09:50.039614 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:09:50.069496 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:09:50.091635 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 22:10:50.037672 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 22:10:50.038539 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:10:50.065073 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:10:50.104409 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 22:11:50.039617 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 22:11:50.040720 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:11:50.071465 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:11:50.094089 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 22:12:50.039727 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 22:12:50.040577 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:12:50.071003 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:12:50.094869 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 22:13:50.040728 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 22:13:50.041507 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:13:50.071065 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:13:50.094590 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 22:14:50.039951 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 22:14:50.041144 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:14:50.075746 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:14:50.098209 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 22:15:50.043906 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 22:15:50.044987 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:15:50.075880 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:15:50.099208 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 22:16:50.046014 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 22:16:50.047095 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:16:50.077772 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:16:50.100120 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 22:17:50.045944 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 22:17:50.047033 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:17:50.076298 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:17:50.099730 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 22:18:50.045199 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 22:18:50.046355 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:18:50.074900 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:18:50.097977 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 22:19:50.043687 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 22:19:50.044386 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:19:50.070234 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:19:50.092519 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 22:20:50.048309 ncdv-master-1 cinder-volume[135002]: DEBUG oslo_service.periodic_task [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135002) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Apr 09 22:20:50.049425 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:20:50.080900 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.volume.drivers.rbd [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135002) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Apr 09 22:20:50.104670 ncdv-master-1 cinder-volume[135002]: DEBUG cinder.manager [None req-cb8e09bd-2c77-4c5c-8802-c4a805c86a4d None None] Notifying Schedulers of capabilities ... {{(pid=135002) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}